2024-02-19T06:29:33.724 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T06:29:33.724 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566145 --owner scheduled_vshankar@teuthology --name vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} -- /home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566145/orig.config.yaml 2024-02-19T06:29:33.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:29:33.852 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566145 branch: wip-vshankar-testing-20240216.060239 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7566145' kernel: flavor: default kdb: true sha1: 8d59ab0bd93c806231018a6729893bf309624262 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240216.060239 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240216.060239 sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 owner: scheduled_vshankar@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8780 sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 sleep_before_teardown: 0 subset: 669/1024 suite: fs suite_branch: wip-vshankar-testing-20240216.060239 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_25296a8f176256aea5ed8b5850b25167dce0ae33/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCRwEqQUB0oGPS+8VezED5jT+Def1467E1i1lJkuWvaJ3Sabp3+5KeluxXag7qGvwpMzSW2LbO2ky51pIqLp9ko= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOu7dUQvGBMCo6lD45JCEYWKDYPKDCnUGkeliFEJ+PhMRVo9YmePA3uDYWpOhAUQF9/NmDIyeniAeolTA2gxiFk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-19_06:18:55 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-19T06:29:33.854 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_25296a8f176256aea5ed8b5850b25167dce0ae33/qa; will attempt to use it 2024-02-19T06:29:33.855 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_25296a8f176256aea5ed8b5850b25167dce0ae33/qa/tasks 2024-02-19T06:29:33.855 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-19T06:29:33.857 INFO:teuthology.task.internal:Checking packages... 2024-02-19T06:29:33.890 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '25296a8f176256aea5ed8b5850b25167dce0ae33' 2024-02-19T06:29:33.890 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-19T06:29:33.890 INFO:teuthology.packaging:ref: None 2024-02-19T06:29:33.890 INFO:teuthology.packaging:tag: None 2024-02-19T06:29:33.890 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240216.060239 2024-02-19T06:29:33.891 INFO:teuthology.packaging:sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-19T06:29:33.891 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240216.060239 2024-02-19T06:29:34.258 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1514.g25296a8f 2024-02-19T06:29:34.260 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-19T06:29:34.267 INFO:teuthology.task.internal:no buildpackages task found 2024-02-19T06:29:34.267 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-19T06:29:34.287 INFO:teuthology.task.internal:Saving configuration 2024-02-19T06:29:34.303 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-19T06:29:34.309 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-19T06:29:34.336 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566145', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 06:20:41.052521', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCRwEqQUB0oGPS+8VezED5jT+Def1467E1i1lJkuWvaJ3Sabp3+5KeluxXag7qGvwpMzSW2LbO2ky51pIqLp9ko='} 2024-02-19T06:29:34.356 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566145', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 06:20:41.050829', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOu7dUQvGBMCo6lD45JCEYWKDYPKDCnUGkeliFEJ+PhMRVo9YmePA3uDYWpOhAUQF9/NmDIyeniAeolTA2gxiFk='} 2024-02-19T06:29:34.356 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-19T06:29:34.362 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-02-19T06:29:34.362 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-02-19T06:29:34.362 INFO:teuthology.run_tasks:Running task console_log... 2024-02-19T06:29:34.435 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff60c005160>, signals=[15]) 2024-02-19T06:29:34.435 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-19T06:29:34.441 INFO:teuthology.task.internal:Opening connections... 2024-02-19T06:29:34.441 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T06:29:34.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:29:34.549 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T06:29:34.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:29:34.637 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-19T06:29:34.643 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-02-19T06:29:34.660 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-02-19T06:29:34.660 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-02-19T06:29:34.720 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-02-19T06:29:34.720 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-02-19T06:29:34.720 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-02-19T06:29:34.720 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-02-19T06:29:34.720 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-02-19T06:29:34.720 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-02-19T06:29:34.720 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T06:29:34.720 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-02-19T06:29:34.720 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-02-19T06:29:34.720 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T06:29:34.720 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-02-19T06:29:34.721 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T06:29:34.721 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T06:29:34.721 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T06:29:34.721 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-02-19T06:29:34.740 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-02-19T06:29:34.757 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-02-19T06:29:34.757 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-02-19T06:29:34.815 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-02-19T06:29:34.815 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-02-19T06:29:34.815 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-02-19T06:29:34.815 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-02-19T06:29:34.816 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-02-19T06:29:34.816 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-02-19T06:29:34.816 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T06:29:34.816 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-02-19T06:29:34.816 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-02-19T06:29:34.816 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T06:29:34.816 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-02-19T06:29:34.816 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T06:29:34.816 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T06:29:34.816 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T06:29:34.816 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-02-19T06:29:34.832 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-19T06:29:34.842 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-19T06:29:34.848 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-19T06:29:34.848 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-02-19T06:29:34.850 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-02-19T06:29:34.871 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-19T06:29:34.877 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-19T06:29:34.877 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-02-19T06:29:34.910 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-02-19T06:29:34.934 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-19T06:29:34.984 INFO:teuthology.run_tasks:Running task kernel... 2024-02-19T06:29:34.999 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '8d59ab0bd93c806231018a6729893bf309624262'} 2024-02-19T06:29:34.999 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '8d59ab0bd93c806231018a6729893bf309624262'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '8d59ab0bd93c806231018a6729893bf309624262'}}, timeout 300 2024-02-19T06:29:35.000 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-19T06:29:35.000 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-19T06:29:35.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T06:29:35.016 DEBUG:teuthology.task.kernel:sha1 for mon.a is 8d59ab0bd93c806231018a6729893bf309624262 2024-02-19T06:29:35.016 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "8d59ab0bd93c806231018a6729893bf309624262"... 2024-02-19T06:29:35.016 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-02-19T06:29:35.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T06:29:35.017 DEBUG:teuthology.task.kernel:sha1 for mon.b is 8d59ab0bd93c806231018a6729893bf309624262 2024-02-19T06:29:35.017 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "8d59ab0bd93c806231018a6729893bf309624262"... 2024-02-19T06:29:35.018 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-02-19T06:29:35.073 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-361.el9.x86_64 2024-02-19T06:29:35.073 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8d59ab0bd93c806231018a6729893bf309624262 2024-02-19T06:29:35.074 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-19T06:29:35.074 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d59ab0bd93c806231018a6729893bf309624262 2024-02-19T06:29:35.077 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-361.el9.x86_64 2024-02-19T06:29:35.077 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8d59ab0bd93c806231018a6729893bf309624262 2024-02-19T06:29:35.077 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-19T06:29:35.078 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d59ab0bd93c806231018a6729893bf309624262 2024-02-19T06:29:35.219 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum upgrade -y linux-firmware 2024-02-19T06:29:35.443 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum upgrade -y linux-firmware 2024-02-19T06:29:37.921 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 6.2 MB/s | 6.7 MB 00:01 2024-02-19T06:29:38.011 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 7.1 MB/s | 6.7 MB 00:00 2024-02-19T06:29:39.779 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 3.0 MB/s | 2.0 MB 00:00 2024-02-19T06:29:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 3.0 MB/s | 2.0 MB 00:00 2024-02-19T06:29:47.721 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.0 MB 00:07 2024-02-19T06:29:50.534 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 786 kB/s | 8.0 MB 00:10 2024-02-19T06:29:52.311 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 5.5 MB/s | 19 MB 00:03 2024-02-19T06:29:52.893 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-02-19T06:29:56.320 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.1 MB 00:00 2024-02-19T06:29:57.168 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.1 MB 00:00 2024-02-19T06:29:57.662 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 15 kB 00:00 2024-02-19T06:29:58.727 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 15 kB 00:00 2024-02-19T06:29:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2024-02-19T06:30:03.506 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 4.4 MB/s | 20 MB 00:04 2024-02-19T06:30:04.397 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-02-19T06:30:06.854 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T06:30:06.866 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T06:30:06.866 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-02-19T06:30:06.866 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T06:30:06.867 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-02-19T06:30:06.867 INFO:teuthology.orchestra.run.smithi046.stdout: linux-firmware noarch 20240109-142.el9 CentOS-BaseOS 375 M 2024-02-19T06:30:06.867 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:30:06.867 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T06:30:06.867 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T06:30:06.867 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 1 Package 2024-02-19T06:30:06.867 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:30:06.867 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 375 M 2024-02-19T06:30:06.867 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T06:30:08.361 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-02-19T06:30:10.724 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T06:30:10.728 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T06:30:10.728 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-19T06:30:10.728 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T06:30:10.728 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-02-19T06:30:10.728 INFO:teuthology.orchestra.run.smithi142.stdout: linux-firmware noarch 20240109-142.el9 CentOS-BaseOS 375 M 2024-02-19T06:30:10.729 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:30:10.729 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T06:30:10.729 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T06:30:10.729 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 1 Package 2024-02-19T06:30:10.729 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:30:10.729 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 375 M 2024-02-19T06:30:10.729 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T06:30:29.330 INFO:teuthology.orchestra.run.smithi046.stdout:linux-firmware-20240109-142.el9.noarch.rpm 17 MB/s | 375 MB 00:22 2024-02-19T06:30:29.331 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T06:30:29.331 INFO:teuthology.orchestra.run.smithi046.stdout:Total 17 MB/s | 375 MB 00:22 2024-02-19T06:30:29.331 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T06:30:29.417 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T06:30:29.417 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T06:30:31.926 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T06:30:31.926 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T06:30:38.364 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T06:30:38.624 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : linux-firmware-20240109-142.el9.noarch 1/2 2024-02-19T06:30:38.722 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-19T06:30:39.676 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-19T06:30:39.676 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : linux-firmware-20240109-142.el9.noarch 1/2 2024-02-19T06:30:40.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-19T06:30:40.075 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:30:40.075 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-02-19T06:30:40.075 INFO:teuthology.orchestra.run.smithi046.stdout: linux-firmware-20240109-142.el9.noarch 2024-02-19T06:30:40.075 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:30:40.075 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T06:30:40.357 INFO:teuthology.task.kernel:Downloading kernel 8d59ab0bd93c806231018a6729893bf309624262 on mon.a... 2024-02-19T06:30:40.358 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d59ab0bd93c806231018a6729893bf309624262 2024-02-19T06:30:40.501 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/centos/9/flavors/default/x86_64/ 2024-02-19T06:30:40.501 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc4_g8d59ab0bd93c-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-19T06:30:40.504 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi046.front.sepia.ceph.com to complete... 2024-02-19T06:30:52.824 INFO:teuthology.orchestra.run.smithi142.stdout:linux-firmware-20240109-142.el9.noarch.rpm 8.9 MB/s | 375 MB 00:42 2024-02-19T06:30:52.824 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T06:30:52.825 INFO:teuthology.orchestra.run.smithi142.stdout:Total 8.9 MB/s | 375 MB 00:42 2024-02-19T06:30:52.825 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T06:30:52.915 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T06:30:52.915 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T06:30:55.328 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T06:30:55.329 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T06:31:01.692 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T06:31:01.980 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : linux-firmware-20240109-142.el9.noarch 1/2 2024-02-19T06:31:02.054 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-19T06:31:02.970 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-19T06:31:02.970 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : linux-firmware-20240109-142.el9.noarch 1/2 2024-02-19T06:31:03.379 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-19T06:31:03.380 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:31:03.380 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-02-19T06:31:03.380 INFO:teuthology.orchestra.run.smithi142.stdout: linux-firmware-20240109-142.el9.noarch 2024-02-19T06:31:03.380 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:31:03.380 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T06:31:03.687 INFO:teuthology.task.kernel:Downloading kernel 8d59ab0bd93c806231018a6729893bf309624262 on mon.b... 2024-02-19T06:31:03.687 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d59ab0bd93c806231018a6729893bf309624262 2024-02-19T06:31:04.097 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/centos/9/flavors/default/x86_64/ 2024-02-19T06:31:04.097 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc4_g8d59ab0bd93c-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-19T06:31:04.100 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi142.front.sepia.ceph.com to complete... 2024-02-19T06:31:33.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19 06:31:33 URL:https://1.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/centos/9/flavors/default/x86_64/kernel-6.8.0_rc4_g8d59ab0bd93c-1.x86_64.rpm [333224823/333224823] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-19T06:31:33.589 INFO:teuthology.orchestra.run.smithi046.stderr:FINISHED --2024-02-19 06:31:33-- 2024-02-19T06:31:33.589 INFO:teuthology.orchestra.run.smithi046.stderr:Total wall clock time: 53s 2024-02-19T06:31:33.589 INFO:teuthology.orchestra.run.smithi046.stderr:Downloaded: 1 files, 318M in 53s (6.05 MB/s) 2024-02-19T06:31:33.592 INFO:teuthology.task.kernel:Installing kernel 8d59ab0bd93c806231018a6729893bf309624262 on mon.a... 2024-02-19T06:31:33.592 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-19T06:31:35.611 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying... ######################################## 2024-02-19T06:31:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing... ######################################## 2024-02-19T06:31:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:Updating / installing... 2024-02-19T06:31:43.569 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-6.8.0_rc4_g8d59ab0bd93c-1 ######################################## 2024-02-19T06:31:58.754 INFO:teuthology.orchestra.run.smithi046.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-19T06:32:21.776 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-19T06:32:21.776 DEBUG:teuthology.orchestra.run.smithi046:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-19T06:32:21.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:32:21.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/System.map 2024-02-19T06:32:21.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/config 2024-02-19T06:32:21.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel 2024-02-19T06:32:21.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch 2024-02-19T06:32:21.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86 2024-02-19T06:32:21.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto 2024-02-19T06:32:21.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-19T06:32:21.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-19T06:32:21.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-19T06:32:21.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-19T06:32:21.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-19T06:32:21.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-19T06:32:21.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-19T06:32:21.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-19T06:32:21.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-19T06:32:21.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-19T06:32:21.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-19T06:32:21.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-19T06:32:21.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-19T06:32:21.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu/mce 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-19T06:32:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm.ko 2024-02-19T06:32:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto 2024-02-19T06:32:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/ansi_cprng.ko 2024-02-19T06:32:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/anubis.ko 2024-02-19T06:32:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/arc4.ko 2024-02-19T06:32:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx 2024-02-19T06:32:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_memcpy.ko 2024-02-19T06:32:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_pq.ko 2024-02-19T06:32:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-19T06:32:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_tx.ko 2024-02-19T06:32:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_xor.ko 2024-02-19T06:32:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/raid6test.ko 2024-02-19T06:32:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/authenc.ko 2024-02-19T06:32:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/authencesn.ko 2024-02-19T06:32:21.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blake2b_generic.ko 2024-02-19T06:32:21.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blowfish_common.ko 2024-02-19T06:32:21.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blowfish_generic.ko 2024-02-19T06:32:21.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/camellia_generic.ko 2024-02-19T06:32:21.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast5_generic.ko 2024-02-19T06:32:21.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast6_generic.ko 2024-02-19T06:32:21.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast_common.ko 2024-02-19T06:32:21.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/ccm.ko 2024-02-19T06:32:21.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cmac.ko 2024-02-19T06:32:21.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crc32_generic.ko 2024-02-19T06:32:21.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crypto_engine.ko 2024-02-19T06:32:21.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crypto_user.ko 2024-02-19T06:32:21.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cts.ko 2024-02-19T06:32:21.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/des_generic.ko 2024-02-19T06:32:21.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/dh_generic.ko 2024-02-19T06:32:21.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/echainiv.ko 2024-02-19T06:32:21.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/essiv.ko 2024-02-19T06:32:21.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/fcrypt.ko 2024-02-19T06:32:21.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/khazad.ko 2024-02-19T06:32:21.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/lz4.ko 2024-02-19T06:32:21.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/lz4hc.ko 2024-02-19T06:32:21.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/md4.ko 2024-02-19T06:32:21.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/michael_mic.ko 2024-02-19T06:32:21.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/pcbc.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/pcrypt.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/rmd160.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/seed.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/serpent_generic.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/tcrypt.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/tea.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/twofish_common.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/twofish_generic.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/vmac.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/wp512.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xcbc.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xor.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xxhash_generic.ko 2024-02-19T06:32:21.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/acpi_pad.ko 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/custom_method.ko 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/ec_sys.ko 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/platform_profile.ko 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/sbs.ko 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/sbshc.ko 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/video.ko 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/acard-ahci.ko 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/ahci_platform.ko 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/ata_generic.ko 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/libahci_platform.ko 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_acpi.ko 2024-02-19T06:32:21.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ali.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_amd.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_artop.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_atiixp.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_atp867x.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cmd640.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cmd64x.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cypress.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_efar.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt366.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt37x.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_it8213.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_it821x.ko 2024-02-19T06:32:21.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_jmicron.ko 2024-02-19T06:32:21.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_marvell.ko 2024-02-19T06:32:21.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_mpiix.ko 2024-02-19T06:32:21.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_netcell.ko 2024-02-19T06:32:21.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ninja32.ko 2024-02-19T06:32:21.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ns87410.ko 2024-02-19T06:32:21.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ns87415.ko 2024-02-19T06:32:21.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_oldpiix.ko 2024-02-19T06:32:21.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_opti.ko 2024-02-19T06:32:21.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_optidma.ko 2024-02-19T06:32:21.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pcmcia.ko 2024-02-19T06:32:21.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-19T06:32:21.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-19T06:32:21.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_piccolo.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_rdc.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sch.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_serverworks.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sil680.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sis.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sl82c105.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_triflex.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_via.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pdc_adma.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_inic162x.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_mv.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_nv.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_promise.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_qstor.ko 2024-02-19T06:32:21.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sil.ko 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sil24.ko 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sis.ko 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_svw.ko 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sx4.ko 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_uli.ko 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_via.ko 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_vsc.ko 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/auxdisplay 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/auxdisplay/ks0108.ko 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/base 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/base/regmap 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/bcma 2024-02-19T06:32:21.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/bcma/bcma.ko 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/aoe 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/aoe/aoe.ko 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/brd.ko 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/drbd 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/drbd/drbd.ko 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/floppy.ko 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/loop.ko 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/mtip32xx 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/nbd.ko 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/null_blk 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/null_blk/null_blk.ko 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/pktcdvd.ko 2024-02-19T06:32:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/rbd.ko 2024-02-19T06:32:21.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/virtio_blk.ko 2024-02-19T06:32:21.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/xen-blkback 2024-02-19T06:32:21.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-19T06:32:21.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/xen-blkfront.ko 2024-02-19T06:32:21.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/zram 2024-02-19T06:32:21.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/zram/zram.ko 2024-02-19T06:32:21.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char 2024-02-19T06:32:21.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hangcheck-timer.ko 2024-02-19T06:32:21.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random 2024-02-19T06:32:21.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-19T06:32:21.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-19T06:32:21.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-19T06:32:21.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/via-rng.ko 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/lp.ko 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/mwave 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/mwave/mwave.ko 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ppdev.ko 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tlclk.ko 2024-02-19T06:32:21.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm.ko 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/uv_mmtimer.ko 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/virtio_console.ko 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-19T06:32:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp/ccp.ko 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_common 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/padlock-aes.ko 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/padlock-sha.ko 2024-02-19T06:32:21.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/virtio 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dca 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dca/dca.ko 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/devfreq 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/dw 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/ioat 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/amd64_edac.ko 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/e752x_edac.ko 2024-02-19T06:32:21.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/edac_mce_amd.ko 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i3000_edac.ko 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i3200_edac.ko 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i5100_edac.ko 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i5400_edac.ko 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i7300_edac.ko 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i7core_edac.ko 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i82975x_edac.ko 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/ie31200_edac.ko 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/sb_edac.ko 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/x38_edac.ko 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/edd.ko 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio 2024-02-19T06:32:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-ich.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-appleir.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-aureal.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-axff.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-dr.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-elecom.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-elo.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-emsff.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gaff.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gt683r.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gyration.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-19T06:32:21.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtekff.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-hyperv.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-icade.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-keytouch.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-kye.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-lcpower.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-led.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-lenovo.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-multitouch.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-ortek.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-penmount.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-petalynx.ko 2024-02-19T06:32:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-picolcd.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-pl.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-plantronics.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-primax.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-rmi.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-common.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-19T06:32:21.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-saitek.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-samsung.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sjoy.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sony.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-speedlink.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-steelseries.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sunplus.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-tivo.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-tmff.ko 2024-02-19T06:32:21.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-topseed.ko 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-twinhan.ko 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-uclogic.ko 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-waltop.ko 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-wiimote.ko 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-xinmo.ko 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-zpff.ko 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-zydacron.ko 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/uhid.ko 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/wacom.ko 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_balloon.ko 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_utils.ko 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_vmbus.ko 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon 2024-02-19T06:32:21.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/abituguru.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/abituguru3.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ad7414.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ad7418.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adc128d818.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1025.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1026.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1029.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1031.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm9240.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ads7828.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7410.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7411.ko 2024-02-19T06:32:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7462.ko 2024-02-19T06:32:21.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7470.ko 2024-02-19T06:32:21.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7475.ko 2024-02-19T06:32:21.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7x10.ko 2024-02-19T06:32:21.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/amc6821.ko 2024-02-19T06:32:21.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/applesmc.ko 2024-02-19T06:32:21.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asb100.ko 2024-02-19T06:32:21.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asc7621.ko 2024-02-19T06:32:21.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-19T06:32:21.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/atxp1.ko 2024-02-19T06:32:21.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/coretemp.ko 2024-02-19T06:32:21.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-19T06:32:21.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/dme1737.ko 2024-02-19T06:32:21.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ds1621.ko 2024-02-19T06:32:21.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ds620.ko 2024-02-19T06:32:21.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/emc1403.ko 2024-02-19T06:32:21.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/emc6w201.ko 2024-02-19T06:32:21.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f71805f.ko 2024-02-19T06:32:21.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f71882fg.ko 2024-02-19T06:32:21.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f75375s.ko 2024-02-19T06:32:21.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/fam15h_power.ko 2024-02-19T06:32:21.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/fschmd.ko 2024-02-19T06:32:21.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/g760a.ko 2024-02-19T06:32:21.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/g762.ko 2024-02-19T06:32:21.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/gl518sm.ko 2024-02-19T06:32:21.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/gl520sm.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/i5500_temp.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/i5k_amb.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ibmaem.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ibmpex.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ina209.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ina2xx.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/it87.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/k10temp.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/k8temp.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lineage-pem.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm63.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm73.ko 2024-02-19T06:32:21.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm75.ko 2024-02-19T06:32:21.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm77.ko 2024-02-19T06:32:21.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm78.ko 2024-02-19T06:32:21.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm80.ko 2024-02-19T06:32:21.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm83.ko 2024-02-19T06:32:21.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm85.ko 2024-02-19T06:32:21.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm87.ko 2024-02-19T06:32:21.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm90.ko 2024-02-19T06:32:21.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm92.ko 2024-02-19T06:32:21.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm93.ko 2024-02-19T06:32:21.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95234.ko 2024-02-19T06:32:21.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95241.ko 2024-02-19T06:32:21.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95245.ko 2024-02-19T06:32:21.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc2945.ko 2024-02-19T06:32:21.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4151.ko 2024-02-19T06:32:21.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4215.ko 2024-02-19T06:32:21.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4222.ko 2024-02-19T06:32:21.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4245.ko 2024-02-19T06:32:21.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4260.ko 2024-02-19T06:32:21.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4261.ko 2024-02-19T06:32:21.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max16065.ko 2024-02-19T06:32:21.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max1619.ko 2024-02-19T06:32:21.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max1668.ko 2024-02-19T06:32:21.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max197.ko 2024-02-19T06:32:21.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6639.ko 2024-02-19T06:32:21.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6650.ko 2024-02-19T06:32:21.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6697.ko 2024-02-19T06:32:21.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/mcp3021.ko 2024-02-19T06:32:21.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6683.ko 2024-02-19T06:32:21.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6775-core.ko 2024-02-19T06:32:21.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6775.ko 2024-02-19T06:32:21.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct7802.ko 2024-02-19T06:32:21.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pc87360.ko 2024-02-19T06:32:21.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pc87427.ko 2024-02-19T06:32:21.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pcf8591.ko 2024-02-19T06:32:21.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus 2024-02-19T06:32:21.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-19T06:32:21.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-19T06:32:21.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-19T06:32:21.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-19T06:32:21.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-19T06:32:21.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-19T06:32:21.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-19T06:32:21.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-19T06:32:21.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-19T06:32:21.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-19T06:32:21.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-19T06:32:21.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-19T06:32:21.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/powr1220.ko 2024-02-19T06:32:21.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch5627.ko 2024-02-19T06:32:21.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch5636.ko 2024-02-19T06:32:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-19T06:32:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sht15.ko 2024-02-19T06:32:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sht21.ko 2024-02-19T06:32:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/shtc1.ko 2024-02-19T06:32:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sis5595.ko 2024-02-19T06:32:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47b397.ko 2024-02-19T06:32:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47m1.ko 2024-02-19T06:32:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47m192.ko 2024-02-19T06:32:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/thmc50.ko 2024-02-19T06:32:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp102.ko 2024-02-19T06:32:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp103.ko 2024-02-19T06:32:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp401.ko 2024-02-19T06:32:21.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp421.ko 2024-02-19T06:32:21.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/via-cputemp.ko 2024-02-19T06:32:21.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/via686a.ko 2024-02-19T06:32:21.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/vt1211.ko 2024-02-19T06:32:21.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/vt8231.ko 2024-02-19T06:32:21.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83627ehf.ko 2024-02-19T06:32:21.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83627hf.ko 2024-02-19T06:32:21.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83781d.ko 2024-02-19T06:32:21.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83791d.ko 2024-02-19T06:32:21.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83792d.ko 2024-02-19T06:32:21.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83793.ko 2024-02-19T06:32:21.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83795.ko 2024-02-19T06:32:21.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83l785ts.ko 2024-02-19T06:32:21.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83l786ng.ko 2024-02-19T06:32:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c 2024-02-19T06:32:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos 2024-02-19T06:32:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-19T06:32:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-19T06:32:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses 2024-02-19T06:32:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-19T06:32:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-19T06:32:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-19T06:32:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-19T06:32:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-19T06:32:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-19T06:32:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-19T06:32:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-19T06:32:21.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-dev.ko 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-mux.ko 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-smbus.ko 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-stub.ko 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_core.ko 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-19T06:32:21.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-19T06:32:21.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw 2024-02-19T06:32:21.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/cxgb4 2024-02-19T06:32:21.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-19T06:32:21.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx4 2024-02-19T06:32:21.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-19T06:32:21.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx5 2024-02-19T06:32:21.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-19T06:32:21.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mthca 2024-02-19T06:32:21.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-19T06:32:21.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp 2024-02-19T06:32:21.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/ipoib 2024-02-19T06:32:21.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-19T06:32:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/iser 2024-02-19T06:32:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-19T06:32:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/isert 2024-02-19T06:32:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-19T06:32:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srp 2024-02-19T06:32:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-19T06:32:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srpt 2024-02-19T06:32:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-19T06:32:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input 2024-02-19T06:32:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport 2024-02-19T06:32:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-19T06:32:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-19T06:32:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/gameport.ko 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/joydev.ko 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/appletouch.ko 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/bcm5974.ko 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/cyapatp.ko 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/sermouse.ko 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/rmi4 2024-02-19T06:32:21.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/altera_ps2.ko 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/arc_ps2.ko 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/serio_raw.ko 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/sparse-keymap.ko 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-blinkm.ko 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lm3530.ko 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lp3944.ko 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-ss4200.ko 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-19T06:32:21.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/bcache 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/bcache/bcache.ko 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-bio-prison.ko 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-cache-smq.ko 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-cache.ko 2024-02-19T06:32:21.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-crypt.ko 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-delay.ko 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-flakey.ko 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-log-userspace.ko 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-multipath.ko 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-queue-length.ko 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-raid.ko 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-round-robin.ko 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-service-time.ko 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-switch.ko 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-thin-pool.ko 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-verity.ko 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/persistent-data 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-19T06:32:21.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid0.ko 2024-02-19T06:32:21.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid1.ko 2024-02-19T06:32:21.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid10.ko 2024-02-19T06:32:21.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid456.ko 2024-02-19T06:32:21.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message 2024-02-19T06:32:21.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion 2024-02-19T06:32:21.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptbase.ko 2024-02-19T06:32:21.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptctl.ko 2024-02-19T06:32:21.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptfc.ko 2024-02-19T06:32:21.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptlan.ko 2024-02-19T06:32:21.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptsas.ko 2024-02-19T06:32:21.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptscsih.ko 2024-02-19T06:32:21.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptspi.ko 2024-02-19T06:32:21.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd 2024-02-19T06:32:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lpc_ich.ko 2024-02-19T06:32:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lpc_sch.ko 2024-02-19T06:32:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/mfd-core.ko 2024-02-19T06:32:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/sm501.ko 2024-02-19T06:32:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/viperboard.ko 2024-02-19T06:32:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/vx855.ko 2024-02-19T06:32:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/wl1273-core.ko 2024-02-19T06:32:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc 2024-02-19T06:32:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/altera-stapl 2024-02-19T06:32:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-19T06:32:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/apds9802als.ko 2024-02-19T06:32:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/apds990x.ko 2024-02-19T06:32:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/bh1770glc.ko 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/cb710 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/cb710/cb710.ko 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/at24.ko 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/max6875.ko 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/enclosure.ko 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/hpilo.ko 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/isl29003.ko 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/isl29020.ko 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-19T06:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei-me.ko 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei-txe.ko 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei.ko 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-gru 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-xp 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tifm_7xx1.ko 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tifm_core.ko 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tsl2550.ko 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_balloon.ko 2024-02-19T06:32:21.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_vmci 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/bonding 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/bonding/bonding.ko 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/b53 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6xxx 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dummy.ko 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/eql.ko 2024-02-19T06:32:21.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/adaptec 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/agere 2024-02-19T06:32:21.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-19T06:32:21.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/alteon 2024-02-19T06:32:21.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-19T06:32:21.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/altera 2024-02-19T06:32:21.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-19T06:32:21.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd 2024-02-19T06:32:21.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-19T06:32:21.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-19T06:32:21.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-19T06:32:21.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros 2024-02-19T06:32:21.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/alx 2024-02-19T06:32:21.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-19T06:32:21.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-19T06:32:21.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/genet 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-19T06:32:21.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade/bna 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-19T06:32:21.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco/enic 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-19T06:32:21.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dnet.ko 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex/benet 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ethoc.ko 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/fealnx.ko 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000e 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/fm10k 2024-02-19T06:32:21.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/i40e 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/iavf 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igb 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igbvf 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/jme.ko 2024-02-19T06:32:21.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell 2024-02-19T06:32:21.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-19T06:32:21.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-19T06:32:21.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-19T06:32:21.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox 2024-02-19T06:32:21.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-19T06:32:21.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-19T06:32:21.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-19T06:32:21.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-19T06:32:21.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-19T06:32:21.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-19T06:32:21.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel 2024-02-19T06:32:21.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-19T06:32:21.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom 2024-02-19T06:32:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-19T06:32:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-19T06:32:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi 2024-02-19T06:32:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-19T06:32:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-19T06:32:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/neterion 2024-02-19T06:32:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-19T06:32:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/nvidia 2024-02-19T06:32:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-19T06:32:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines 2024-02-19T06:32:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-19T06:32:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-19T06:32:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rdc 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rocker 2024-02-19T06:32:21.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-19T06:32:21.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sfc 2024-02-19T06:32:21.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-19T06:32:21.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/silan 2024-02-19T06:32:21.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-19T06:32:21.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis 2024-02-19T06:32:21.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-19T06:32:21.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-19T06:32:21.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc 2024-02-19T06:32:21.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-19T06:32:21.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-19T06:32:21.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-19T06:32:21.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-19T06:32:21.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/tehuti 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ti 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via 2024-02-19T06:32:21.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/xircom 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/geneve.ko 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/hyperv 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ieee802154 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ifb.ko 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ipvlan 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-19T06:32:21.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/macvlan.ko 2024-02-19T06:32:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/macvtap.ko 2024-02-19T06:32:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio 2024-02-19T06:32:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio.ko 2024-02-19T06:32:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-19T06:32:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-19T06:32:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-19T06:32:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mii.ko 2024-02-19T06:32:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/net_failover.ko 2024-02-19T06:32:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/netconsole.ko 2024-02-19T06:32:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/nlmon.ko 2024-02-19T06:32:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs 2024-02-19T06:32:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-19T06:32:21.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-19T06:32:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy 2024-02-19T06:32:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/amd.ko 2024-02-19T06:32:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-19T06:32:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-19T06:32:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-19T06:32:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm87xx.ko 2024-02-19T06:32:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/broadcom.ko 2024-02-19T06:32:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/cicada.ko 2024-02-19T06:32:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/davicom.ko 2024-02-19T06:32:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/dp83640.ko 2024-02-19T06:32:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/et1011c.ko 2024-02-19T06:32:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/icplus.ko 2024-02-19T06:32:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/lxt.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/marvell.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/micrel.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/national.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/phylink.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/qsemi.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/realtek.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/smsc.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/ste10Xp.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/vitesse.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_async.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-19T06:32:21.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pppoe.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pppox.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pptp.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/slip 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/slip/slhc.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/slip/slip.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/sungem_phy.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/tap.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_random.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/tun.ko 2024-02-19T06:32:21.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/veth.ko 2024-02-19T06:32:21.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/virtio_net.ko 2024-02-19T06:32:21.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vmxnet3 2024-02-19T06:32:21.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-19T06:32:21.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vxlan 2024-02-19T06:32:21.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vxlan/vxlan.ko 2024-02-19T06:32:21.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/xen-netback 2024-02-19T06:32:21.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-19T06:32:21.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/xen-netfront.ko 2024-02-19T06:32:21.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ntb 2024-02-19T06:32:21.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ntb/ntb.ko 2024-02-19T06:32:21.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme 2024-02-19T06:32:21.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host/nvme-core.ko 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host/nvme.ko 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport.ko 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_cs.ko 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_pc.ko 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_serial.ko 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/pcie 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/xen-pcifront.ko 2024-02-19T06:32:21.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/i82092.ko 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/pd6729.ko 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl/intel 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/acerhdf.ko 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-19T06:32:21.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/hdaps.ko 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel_ips.ko 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-19T06:32:21.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/wmi.ko 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps_parport.ko 2024-02-19T06:32:21.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/pps_core.ko 2024-02-19T06:32:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp 2024-02-19T06:32:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp/ptp.ko 2024-02-19T06:32:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp/ptp_kvm.ko 2024-02-19T06:32:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc 2024-02-19T06:32:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-19T06:32:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-19T06:32:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-19T06:32:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-19T06:32:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-19T06:32:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-19T06:32:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-19T06:32:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-19T06:32:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-em3027.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-max6900.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-19T06:32:21.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-x1205.ko 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-9xxx.ko 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-sas.ko 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-xxxx.ko 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/BusLogic.ko 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/a100u2w.ko 2024-02-19T06:32:21.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aacraid 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/advansys.ko 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/am53c974.ko 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/arcmsr 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/atp870u.ko 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/be2iscsi 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bfa 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bfa/bfa.ko 2024-02-19T06:32:21.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2fc 2024-02-19T06:32:21.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-19T06:32:21.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2i 2024-02-19T06:32:21.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-19T06:32:21.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ch.ko 2024-02-19T06:32:21.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/csiostor 2024-02-19T06:32:21.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-19T06:32:21.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi 2024-02-19T06:32:21.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-19T06:32:21.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-19T06:32:21.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-19T06:32:21.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-19T06:32:21.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-19T06:32:21.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/dc395x.ko 2024-02-19T06:32:21.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler 2024-02-19T06:32:21.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-19T06:32:21.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-19T06:32:21.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-19T06:32:21.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-19T06:32:21.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/dmx3191d.ko 2024-02-19T06:32:21.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esas2r 2024-02-19T06:32:21.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-19T06:32:21.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esp_scsi.ko 2024-02-19T06:32:21.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe 2024-02-19T06:32:21.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-19T06:32:21.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-19T06:32:21.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fnic 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fnic/fnic.ko 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hpsa.ko 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hptiop.ko 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hv_storvsc.ko 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/initio.ko 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ipr.ko 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ips.ko 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/isci 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/isci/isci.ko 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libfc 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libfc/libfc.ko 2024-02-19T06:32:21.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libiscsi.ko 2024-02-19T06:32:21.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-19T06:32:21.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libsas 2024-02-19T06:32:21.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libsas/libsas.ko 2024-02-19T06:32:21.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/lpfc 2024-02-19T06:32:21.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-19T06:32:21.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid 2024-02-19T06:32:21.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid.ko 2024-02-19T06:32:21.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-19T06:32:21.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-19T06:32:21.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-19T06:32:21.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mpt3sas 2024-02-19T06:32:21.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-19T06:32:21.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvsas 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvumi.ko 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pm8001 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pmcraid.ko 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla1280.ko 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla4xxx 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/raid_class.ko 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_debug.ko 2024-02-19T06:32:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ses.ko 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/st.ko 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/stex.ko 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/sym53c8xx_2 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/virtio_scsi.ko 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/wd719x.ko 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ssb 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ssb/ssb.ko 2024-02-19T06:32:21.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/iscsi 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/loopback 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_file.ko 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_iblock.ko 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_mod.ko 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_pscsi.ko 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_user.ko 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/tcm_fc 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal 2024-02-19T06:32:21.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-19T06:32:21.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-19T06:32:21.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-19T06:32:21.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-19T06:32:21.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-19T06:32:21.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-19T06:32:21.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-19T06:32:21.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-19T06:32:21.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-19T06:32:21.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-19T06:32:21.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-19T06:32:21.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-19T06:32:21.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-19T06:32:21.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-19T06:32:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-19T06:32:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-19T06:32:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-19T06:32:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-19T06:32:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty 2024-02-19T06:32:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/ipwireless 2024-02-19T06:32:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-19T06:32:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/n_gsm.ko 2024-02-19T06:32:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/n_hdlc.ko 2024-02-19T06:32:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/nozomi.ko 2024-02-19T06:32:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial 2024-02-19T06:32:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/8250 2024-02-19T06:32:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/arc_uart.ko 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/jsm 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/core 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/host 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio.ko 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_aec.ko 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_cif.ko 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_pci_generic.ko 2024-02-19T06:32:21.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_sercos3.ko 2024-02-19T06:32:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb 2024-02-19T06:32:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class 2024-02-19T06:32:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/cdc-acm.ko 2024-02-19T06:32:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-19T06:32:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/usblp.ko 2024-02-19T06:32:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/usbtmc.ko 2024-02-19T06:32:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host 2024-02-19T06:32:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-19T06:32:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image 2024-02-19T06:32:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image/mdc800.ko 2024-02-19T06:32:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image/microtek.ko 2024-02-19T06:32:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc 2024-02-19T06:32:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/adutux.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/appledisplay.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/emi26.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/emi62.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ezusb.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/idmouse.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/iowarrior.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ldusb.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/legousbtower.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/sisusbvga 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usb3503.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usblcd.ko 2024-02-19T06:32:21.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/uss720.ko 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/yurex.ko 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy/phy-generic.ko 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/aircable.ko 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ark3116.ko 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ch341.ko 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cp210x.ko 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cyberjack.ko 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-19T06:32:21.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/empeg.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/io_ti.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ipaq.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ipw.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ir-usb.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/keyspan.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mct_u232.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mos7720.ko 2024-02-19T06:32:21.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mos7840.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/navman.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/omninet.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/opticon.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/option.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/oti6858.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/pl2303.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/qcaux.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/qcserial.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/quatech2.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/safe_serial.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/sierra.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ssu100.ko 2024-02-19T06:32:21.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/symbolserial.ko 2024-02-19T06:32:21.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-19T06:32:21.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-19T06:32:21.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb_debug.ko 2024-02-19T06:32:21.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-19T06:32:21.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/visor.ko 2024-02-19T06:32:21.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/whiteheat.ko 2024-02-19T06:32:21.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-19T06:32:21.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage 2024-02-19T06:32:21.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/uas.ko 2024-02-19T06:32:21.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-19T06:32:21.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-19T06:32:21.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-19T06:32:21.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-karma.ko 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/usb-storage.ko 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-19T06:32:21.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/vfio.ko 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost.ko 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_net.ko 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_scsi.ko 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/apple_bl.ko 2024-02-19T06:32:21.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/lcd.ko 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio.ko 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_balloon.ko 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_mmio.ko 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_pci.ko 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_ring.ko 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/ds2482.ko 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/ds2490.ko 2024-02-19T06:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/wire.ko 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog 2024-02-19T06:32:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/hpwdt.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/i6300esb.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ib700wdt.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ibmasr.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/it87_wdt.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/machzwd.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/nv_tco.ko 2024-02-19T06:32:21.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-19T06:32:21.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-19T06:32:21.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-19T06:32:21.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-19T06:32:21.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/softdog.ko 2024-02-19T06:32:21.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-19T06:32:21.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/via_wdt.ko 2024-02-19T06:32:21.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-19T06:32:21.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-19T06:32:21.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-19T06:32:21.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/wdt_pci.ko 2024-02-19T06:32:21.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/xen_wdt.ko 2024-02-19T06:32:21.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen 2024-02-19T06:32:21.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-evtchn.ko 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-gntalloc.ko 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-gntdev.ko 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-pciback 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-privcmd.ko 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xenfs 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/9p 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/9p/9p.ko 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/affs 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/affs/affs.ko 2024-02-19T06:32:21.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/befs 2024-02-19T06:32:21.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/befs/befs.ko 2024-02-19T06:32:21.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/binfmt_misc.ko 2024-02-19T06:32:21.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/btrfs 2024-02-19T06:32:21.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/btrfs/btrfs.ko 2024-02-19T06:32:21.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cachefiles 2024-02-19T06:32:21.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cachefiles/cachefiles.ko 2024-02-19T06:32:21.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ceph 2024-02-19T06:32:21.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ceph/ceph.ko 2024-02-19T06:32:21.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/coda 2024-02-19T06:32:21.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/coda/coda.ko 2024-02-19T06:32:21.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cramfs 2024-02-19T06:32:21.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cramfs/cramfs.ko 2024-02-19T06:32:21.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/dlm 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/dlm/dlm.ko 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ecryptfs 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/f2fs 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/f2fs/f2fs.ko 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat/fat.ko 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat/msdos.ko 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat/vfat.ko 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fuse 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fuse/cuse.ko 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fuse/fuse.ko 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/gfs2 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/gfs2/gfs2.ko 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfs 2024-02-19T06:32:21.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfs/hfs.ko 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfsplus 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfsplus/hfsplus.ko 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/isofs 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/isofs/isofs.ko 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/jfs 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/jfs/jfs.ko 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/lockd 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/lockd/lockd.ko 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/minix 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/minix/minix.ko 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/netfs 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/netfs/netfs.ko 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs 2024-02-19T06:32:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/blocklayout 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/filelayout 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/flexfilelayout 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfs.ko 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfsv3.ko 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfsv4.ko 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common/grace.ko 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common/nfs_acl.ko 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfsd 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfsd/nfsd.ko 2024-02-19T06:32:21.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nilfs2 2024-02-19T06:32:21.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nilfs2/nilfs2.ko 2024-02-19T06:32:21.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls 2024-02-19T06:32:21.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-celtic.ko 2024-02-19T06:32:21.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-centeuro.ko 2024-02-19T06:32:21.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-croatian.ko 2024-02-19T06:32:21.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-cyrillic.ko 2024-02-19T06:32:21.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-gaelic.ko 2024-02-19T06:32:21.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-greek.ko 2024-02-19T06:32:21.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-iceland.ko 2024-02-19T06:32:21.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-inuit.ko 2024-02-19T06:32:21.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-roman.ko 2024-02-19T06:32:21.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-romanian.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-turkish.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1250.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1251.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1255.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp737.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp775.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp850.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp852.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp855.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp857.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp860.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp861.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp862.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp863.ko 2024-02-19T06:32:21.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp864.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp865.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp866.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp869.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp874.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp932.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp936.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp949.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp950.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_euc-jp.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-1.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-13.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-14.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-15.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-2.ko 2024-02-19T06:32:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-3.ko 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-4.ko 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-5.ko 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-6.ko 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-7.ko 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-9.ko 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-r.ko 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-ru.ko 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-u.ko 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_utf8.ko 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/cluster 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-19T06:32:21.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlm 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlmfs 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2.ko 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/overlayfs 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/overlayfs/overlay.ko 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/pstore 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/pstore/ramoops.ko 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/reiserfs 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/reiserfs/reiserfs.ko 2024-02-19T06:32:21.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/romfs 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/romfs/romfs.ko 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/client 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/client/cifs.ko 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common/cifs_arc4.ko 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common/cifs_md4.ko 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/squashfs 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/squashfs/squashfs.ko 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/sysv 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/sysv/sysv.ko 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/udf 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/udf/udf.ko 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ufs 2024-02-19T06:32:21.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ufs/ufs.ko 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/xfs 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/xfs/xfs.ko 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/rcu 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/rcu/rcutorture.ko 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/torture.ko 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/trace 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/asn1_encoder.ko 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crc-itu-t.ko 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crc8.ko 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto/libarc4.ko 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto/libdes.ko 2024-02-19T06:32:21.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/libcrc32c.ko 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lru_cache.ko 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4/lz4_compress.ko 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4/lz4hc_compress.ko 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/math 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/math/cordic.ko 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/raid6 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/raid6/raid6_pq.ko 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/reed_solomon 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_bm.ko 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_fsm.ko 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_kmp.ko 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/zstd 2024-02-19T06:32:21.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/zstd/zstd_compress.ko 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/mm 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/mm/hwpoison-inject.ko 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/6lowpan.ko 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_dest.ko 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_fragment.ko 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_hop.ko 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_mobility.ko 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_routing.ko 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_udp.ko 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802 2024-02-19T06:32:21.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/garp.ko 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/mrp.ko 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/p8022.ko 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/psnap.ko 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/stp.ko 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/8021q 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/8021q/8021q.ko 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet.ko 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_fd.ko 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_rdma.ko 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_virtio.ko 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/batman-adv 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/batman-adv/batman-adv.ko 2024-02-19T06:32:21.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/br_netfilter.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/bridge.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtables.ko 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ceph 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ceph/libceph.ko 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/core 2024-02-19T06:32:21.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/core/failover.ko 2024-02-19T06:32:21.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/core/pktgen.ko 2024-02-19T06:32:21.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp 2024-02-19T06:32:21.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp.ko 2024-02-19T06:32:21.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_diag.ko 2024-02-19T06:32:21.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_ipv4.ko 2024-02-19T06:32:21.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_ipv6.ko 2024-02-19T06:32:21.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dns_resolver 2024-02-19T06:32:21.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dns_resolver/dns_resolver.ko 2024-02-19T06:32:21.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa 2024-02-19T06:32:21.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/dsa_core.ko 2024-02-19T06:32:21.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_brcm.ko 2024-02-19T06:32:21.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_dsa.ko 2024-02-19T06:32:21.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_none.ko 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_trailer.ko 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/6lowpan 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/ieee802154.ko 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ah4.ko 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/esp4.ko 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/fou.ko 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/gre.ko 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/inet_diag.ko 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_gre.ko 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_tunnel.ko 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_vti.ko 2024-02-19T06:32:21.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ipcomp.ko 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ipip.ko 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-19T06:32:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-19T06:32:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-19T06:32:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-19T06:32:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-19T06:32:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-19T06:32:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-19T06:32:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-19T06:32:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-19T06:32:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-19T06:32:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-19T06:32:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_bic.ko 2024-02-19T06:32:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_dctcp.ko 2024-02-19T06:32:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_diag.ko 2024-02-19T06:32:21.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_highspeed.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_htcp.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_hybla.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_illinois.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_lp.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_scalable.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_vegas.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_veno.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_westwood.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_yeah.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tunnel4.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/udp_diag.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/udp_tunnel.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6 2024-02-19T06:32:21.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ah6.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/esp6.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/fou6.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_tunnel.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_vti.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ipcomp6.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-19T06:32:21.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-19T06:32:21.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/sit.ko 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/tunnel6.ko 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/key 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/key/af_key.ko 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_core.ko 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_eth.ko 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ip.ko 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ip6.ko 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_netlink.ko 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ppp.ko 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/llc 2024-02-19T06:32:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/llc/llc.ko 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mac802154 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mac802154/mac802154.ko 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mpls 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mpls/mpls_gso.ko 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set.ko 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-19T06:32:21.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-19T06:32:21.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conncount.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-19T06:32:21.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_flow_table.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_log_syslog.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_irc.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_sip.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-19T06:32:21.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-19T06:32:21.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_tables.ko 2024-02-19T06:32:21.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink.ko 2024-02-19T06:32:21.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-19T06:32:21.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_log.ko 2024-02-19T06:32:21.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-19T06:32:21.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-19T06:32:21.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_chain_nat.ko 2024-02-19T06:32:21.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_compat.ko 2024-02-19T06:32:21.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_ct.ko 2024-02-19T06:32:21.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-19T06:32:21.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_fib.ko 2024-02-19T06:32:21.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-19T06:32:21.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_hash.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_limit.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_log.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_masq.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_nat.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_numgen.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_queue.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_quota.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_redir.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_reject.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_reject_inet.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_socket.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_tunnel.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_AUDIT.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-19T06:32:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CT.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_DSCP.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_HL.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_HMARK.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_LED.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_LOG.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NETMAP.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NFLOG.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_RATEEST.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_SECMARK.ko 2024-02-19T06:32:21.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TEE.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TPROXY.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TRACE.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_addrtype.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_bpf.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cgroup.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cluster.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_comment.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connbytes.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connlabel.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connlimit.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connmark.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_conntrack.ko 2024-02-19T06:32:21.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cpu.ko 2024-02-19T06:32:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_dccp.ko 2024-02-19T06:32:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_devgroup.ko 2024-02-19T06:32:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_dscp.ko 2024-02-19T06:32:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ecn.ko 2024-02-19T06:32:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_esp.ko 2024-02-19T06:32:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_hashlimit.ko 2024-02-19T06:32:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_helper.ko 2024-02-19T06:32:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_hl.ko 2024-02-19T06:32:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ipcomp.ko 2024-02-19T06:32:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_iprange.ko 2024-02-19T06:32:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ipvs.ko 2024-02-19T06:32:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_l2tp.ko 2024-02-19T06:32:21.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_length.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_limit.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_mac.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_mark.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_multiport.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_nat.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_nfacct.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_osf.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_owner.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_physdev.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_pkttype.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_policy.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_quota.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_rateest.ko 2024-02-19T06:32:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_realm.ko 2024-02-19T06:32:21.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_recent.ko 2024-02-19T06:32:21.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_sctp.ko 2024-02-19T06:32:21.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_set.ko 2024-02-19T06:32:21.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_socket.ko 2024-02-19T06:32:21.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_state.ko 2024-02-19T06:32:21.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_statistic.ko 2024-02-19T06:32:21.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_string.ko 2024-02-19T06:32:21.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_tcpmss.ko 2024-02-19T06:32:21.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_time.ko 2024-02-19T06:32:21.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_u32.ko 2024-02-19T06:32:21.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netlink 2024-02-19T06:32:21.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netlink/netlink_diag.ko 2024-02-19T06:32:21.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/nsh 2024-02-19T06:32:21.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/nsh/nsh.ko 2024-02-19T06:32:21.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch 2024-02-19T06:32:21.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/openvswitch.ko 2024-02-19T06:32:21.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-geneve.ko 2024-02-19T06:32:21.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-gre.ko 2024-02-19T06:32:21.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-vxlan.ko 2024-02-19T06:32:21.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/packet 2024-02-19T06:32:21.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/packet/af_packet_diag.ko 2024-02-19T06:32:21.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds 2024-02-19T06:32:21.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds.ko 2024-02-19T06:32:21.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds_rdma.ko 2024-02-19T06:32:21.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds_tcp.ko 2024-02-19T06:32:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched 2024-02-19T06:32:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_csum.ko 2024-02-19T06:32:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_gact.ko 2024-02-19T06:32:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_mirred.ko 2024-02-19T06:32:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_nat.ko 2024-02-19T06:32:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_pedit.ko 2024-02-19T06:32:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_police.ko 2024-02-19T06:32:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_simple.ko 2024-02-19T06:32:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_skbedit.ko 2024-02-19T06:32:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_vlan.ko 2024-02-19T06:32:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_basic.ko 2024-02-19T06:32:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_bpf.ko 2024-02-19T06:32:21.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_flow.ko 2024-02-19T06:32:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_fw.ko 2024-02-19T06:32:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_route.ko 2024-02-19T06:32:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_u32.ko 2024-02-19T06:32:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_cmp.ko 2024-02-19T06:32:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_ipset.ko 2024-02-19T06:32:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_meta.ko 2024-02-19T06:32:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_nbyte.ko 2024-02-19T06:32:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_text.ko 2024-02-19T06:32:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_u32.ko 2024-02-19T06:32:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_choke.ko 2024-02-19T06:32:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_codel.ko 2024-02-19T06:32:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_drr.ko 2024-02-19T06:32:21.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_fq.ko 2024-02-19T06:32:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_gred.ko 2024-02-19T06:32:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_hfsc.ko 2024-02-19T06:32:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_hhf.ko 2024-02-19T06:32:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_htb.ko 2024-02-19T06:32:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_ingress.ko 2024-02-19T06:32:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_mqprio.ko 2024-02-19T06:32:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_mqprio_lib.ko 2024-02-19T06:32:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_multiq.ko 2024-02-19T06:32:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_netem.ko 2024-02-19T06:32:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_pie.ko 2024-02-19T06:32:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_plug.ko 2024-02-19T06:32:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_prio.ko 2024-02-19T06:32:21.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_qfq.ko 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_red.ko 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_sfb.ko 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_sfq.ko 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_tbf.ko 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_teql.ko 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp/sctp.ko 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp/sctp_diag.ko 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/sunrpc.ko 2024-02-19T06:32:21.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/xprtrdma 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc/diag.ko 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc/tipc.ko 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/unix 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/unix/unix_diag.ko 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock.ko 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm 2024-02-19T06:32:22.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys/encrypted-keys 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys/trusted-keys 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys/trusted-keys/trusted.ko 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt/lib 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt/lib/irqbypass.ko 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.alias 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.alias.bin 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.alias.bin 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.bin 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.modinfo 2024-02-19T06:32:22.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.dep 2024-02-19T06:32:22.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.dep.bin 2024-02-19T06:32:22.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.devname 2024-02-19T06:32:22.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.order 2024-02-19T06:32:22.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.softdep 2024-02-19T06:32:22.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.symbols 2024-02-19T06:32:22.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.symbols.bin 2024-02-19T06:32:22.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/vmlinuz 2024-02-19T06:32:22.006 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:32:22.006 DEBUG:teuthology.orchestra.run.smithi046:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-19T06:32:22.030 INFO:teuthology.orchestra.run.smithi046.stdout:postinstall scriptlet (using /bin/sh): 2024-02-19T06:32:22.030 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-19T06:32:22.030 INFO:teuthology.orchestra.run.smithi046.stdout: /usr/bin/kernel-install add 6.8.0-rc4-g8d59ab0bd93c /lib/modules/6.8.0-rc4-g8d59ab0bd93c/vmlinuz 2024-02-19T06:32:22.030 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-02-19T06:32:22.030 INFO:teuthology.orchestra.run.smithi046.stdout:for file in vmlinuz System.map config; do 2024-02-19T06:32:22.030 INFO:teuthology.orchestra.run.smithi046.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc4-g8d59ab0bd93c/${file}" "/boot/${file}-6.8.0-rc4-g8d59ab0bd93c"; then 2024-02-19T06:32:22.030 INFO:teuthology.orchestra.run.smithi046.stdout: cp "/lib/modules/6.8.0-rc4-g8d59ab0bd93c/${file}" "/boot/${file}-6.8.0-rc4-g8d59ab0bd93c" 2024-02-19T06:32:22.030 INFO:teuthology.orchestra.run.smithi046.stdout: fi 2024-02-19T06:32:22.031 INFO:teuthology.orchestra.run.smithi046.stdout:done 2024-02-19T06:32:22.031 INFO:teuthology.orchestra.run.smithi046.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-19T06:32:22.031 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-19T06:32:22.031 INFO:teuthology.orchestra.run.smithi046.stdout:new-kernel-pkg --remove 6.8.0-rc4-g8d59ab0bd93c --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc4-g8d59ab0bd93c.img 2024-02-19T06:32:22.031 INFO:teuthology.orchestra.run.smithi046.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-19T06:32:22.031 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-install remove 6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:32:22.031 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-02-19T06:32:22.031 INFO:teuthology.orchestra.run.smithi046.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-19T06:32:22.031 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-19T06:32:22.031 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/update-bootloader --remove 6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:32:22.031 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-02-19T06:32:22.032 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-02-19T06:32:22.127 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-02-19T06:32:22.127 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-02-19T06:32:22.127 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-02-19T06:32:22.127 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 68.el9 2024-02-19T06:32:22.127 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-02-19T06:32:22.128 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-19T06:32:22.128 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-02-19T06:32:22.128 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8264254 2024-02-19T06:32:22.128 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-02-19T06:32:22.128 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-19T06:32:22.128 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-19T06:32:22.128 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-19T06:32:22.129 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-19T06:32:22.129 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-02-19T06:32:22.129 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-02-19T06:32:22.129 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-19T06:32:22.129 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-02-19T06:32:22.129 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-02-19T06:32:22.129 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:32:22.129 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-19T06:32:22.129 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-19T06:32:22.130 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-19T06:32:22.130 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-02-19T06:32:22.130 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:32:22.130 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-02-19T06:32:22.131 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-19T06:32:22.131 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:32:22.131 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-19T06:32:22.782 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-02-19T06:32:24.349 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[33266]) leaked on vgs invocation. Parent PID 14903: grub2-probe 2024-02-19T06:32:24.349 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[26363]) leaked on vgs invocation. Parent PID 14903: grub2-probe 2024-02-19T06:32:24.388 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[33266]) leaked on vgs invocation. Parent PID 14903: grub2-probe 2024-02-19T06:32:24.388 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[26363]) leaked on vgs invocation. Parent PID 14903: grub2-probe 2024-02-19T06:32:24.640 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-19T06:32:24.661 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-02-19T06:32:24.663 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-02-19T06:32:24.679 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.MVGHJxnLlF 2024-02-19T06:32:24.679 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.MVGHJxnLlF 2024-02-19T06:32:24.752 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.MVGHJxnLlF 2024-02-19T06:32:24.890 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.MVGHJxnLlF is 6KB 2024-02-19T06:32:24.939 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.MVGHJxnLlF 2024-02-19T06:32:24.954 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-02-19T06:32:25.022 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-19T06:32:25.023 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-19T06:32:25.023 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-19T06:32:25.023 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc4-g8d59ab0bd93c.conf 2024-02-19T06:32:25.024 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:32:25.174 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-02-19T06:32:55.177 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-19T06:32:55.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T06:32:55.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:33:13.532 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-19T06:33:22.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T06:33:22.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:33:25.596 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-19T06:33:37.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T06:33:37.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:33:56.028 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-19T06:34:11.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T06:34:11.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:34:14.108 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-19T06:34:32.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T06:34:32.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:34:32.433 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-02-19T06:34:33.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T06:34:33.267 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.8.0-rc4-g8d59ab0bd93c"... 2024-02-19T06:34:33.268 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-02-19T06:34:33.338 INFO:teuthology.orchestra.run.smithi046.stdout:6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:34:33.338 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc4-g8d59ab0bd93c vs 6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:34:33.339 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-19T06:34:33.339 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-19T06:34:34.340 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-19T06:34:34.340 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-19T06:34:34.520 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-02-19T06:34:34.572 DEBUG:teuthology.parallel:result is None 2024-02-19T06:41:50.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19 06:41:50 URL:https://1.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/centos/9/flavors/default/x86_64/kernel-6.8.0_rc4_g8d59ab0bd93c-1.x86_64.rpm [333224823/333224823] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-19T06:41:50.501 INFO:teuthology.orchestra.run.smithi142.stderr:FINISHED --2024-02-19 06:41:50-- 2024-02-19T06:41:50.501 INFO:teuthology.orchestra.run.smithi142.stderr:Total wall clock time: 10m 46s 2024-02-19T06:41:50.501 INFO:teuthology.orchestra.run.smithi142.stderr:Downloaded: 1 files, 318M in 10m 46s (504 KB/s) 2024-02-19T06:41:50.505 INFO:teuthology.task.kernel:Installing kernel 8d59ab0bd93c806231018a6729893bf309624262 on mon.b... 2024-02-19T06:41:50.506 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-19T06:41:52.431 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying... ######################################## 2024-02-19T06:41:52.495 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing... ######################################## 2024-02-19T06:41:52.574 INFO:teuthology.orchestra.run.smithi142.stdout:Updating / installing... 2024-02-19T06:42:00.039 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-6.8.0_rc4_g8d59ab0bd93c-1 ######################################## 2024-02-19T06:42:13.875 INFO:teuthology.orchestra.run.smithi142.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-19T06:42:36.080 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-19T06:42:36.080 DEBUG:teuthology.orchestra.run.smithi142:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-19T06:42:36.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:42:36.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/System.map 2024-02-19T06:42:36.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/config 2024-02-19T06:42:36.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel 2024-02-19T06:42:36.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch 2024-02-19T06:42:36.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86 2024-02-19T06:42:36.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto 2024-02-19T06:42:36.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-19T06:42:36.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-19T06:42:36.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-19T06:42:36.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-19T06:42:36.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-19T06:42:36.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-19T06:42:36.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-19T06:42:36.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-19T06:42:36.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-19T06:42:36.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-19T06:42:36.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-19T06:42:36.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-19T06:42:36.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-19T06:42:36.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-19T06:42:36.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-19T06:42:36.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-19T06:42:36.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-19T06:42:36.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-19T06:42:36.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-19T06:42:36.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-19T06:42:36.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel 2024-02-19T06:42:36.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu 2024-02-19T06:42:36.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu/mce 2024-02-19T06:42:36.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-19T06:42:36.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm 2024-02-19T06:42:36.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-19T06:42:36.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-19T06:42:36.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm.ko 2024-02-19T06:42:36.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto 2024-02-19T06:42:36.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/ansi_cprng.ko 2024-02-19T06:42:36.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/anubis.ko 2024-02-19T06:42:36.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/arc4.ko 2024-02-19T06:42:36.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx 2024-02-19T06:42:36.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_memcpy.ko 2024-02-19T06:42:36.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_pq.ko 2024-02-19T06:42:36.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-19T06:42:36.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_tx.ko 2024-02-19T06:42:36.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_xor.ko 2024-02-19T06:42:36.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/raid6test.ko 2024-02-19T06:42:36.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/authenc.ko 2024-02-19T06:42:36.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/authencesn.ko 2024-02-19T06:42:36.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blake2b_generic.ko 2024-02-19T06:42:36.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blowfish_common.ko 2024-02-19T06:42:36.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blowfish_generic.ko 2024-02-19T06:42:36.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/camellia_generic.ko 2024-02-19T06:42:36.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast5_generic.ko 2024-02-19T06:42:36.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast6_generic.ko 2024-02-19T06:42:36.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast_common.ko 2024-02-19T06:42:36.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/ccm.ko 2024-02-19T06:42:36.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cmac.ko 2024-02-19T06:42:36.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crc32_generic.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crypto_engine.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crypto_user.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cts.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/des_generic.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/dh_generic.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/echainiv.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/essiv.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/fcrypt.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/khazad.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/lz4.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/lz4hc.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/md4.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/michael_mic.ko 2024-02-19T06:42:36.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/pcbc.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/pcrypt.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/rmd160.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/seed.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/serpent_generic.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/tcrypt.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/tea.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/twofish_common.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/twofish_generic.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/vmac.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/wp512.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xcbc.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xor.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xxhash_generic.ko 2024-02-19T06:42:36.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/acpi_pad.ko 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/custom_method.ko 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/ec_sys.ko 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/platform_profile.ko 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/sbs.ko 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/sbshc.ko 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/video.ko 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/acard-ahci.ko 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/ahci_platform.ko 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/ata_generic.ko 2024-02-19T06:42:36.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/libahci_platform.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_acpi.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ali.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_amd.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_artop.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_atiixp.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_atp867x.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cmd640.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cmd64x.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cypress.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_efar.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt366.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt37x.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-19T06:42:36.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_it8213.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_it821x.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_jmicron.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_marvell.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_mpiix.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_netcell.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ninja32.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ns87410.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ns87415.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_oldpiix.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_opti.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_optidma.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pcmcia.ko 2024-02-19T06:42:36.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_piccolo.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_rdc.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sch.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_serverworks.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sil680.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sis.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sl82c105.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_triflex.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_via.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pdc_adma.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_inic162x.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_mv.ko 2024-02-19T06:42:36.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_nv.ko 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_promise.ko 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_qstor.ko 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sil.ko 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sil24.ko 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sis.ko 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_svw.ko 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sx4.ko 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_uli.ko 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_via.ko 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_vsc.ko 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/auxdisplay 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/auxdisplay/ks0108.ko 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/base 2024-02-19T06:42:36.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/base/regmap 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/bcma 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/bcma/bcma.ko 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/aoe 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/aoe/aoe.ko 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/brd.ko 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/drbd 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/drbd/drbd.ko 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/floppy.ko 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/loop.ko 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/mtip32xx 2024-02-19T06:42:36.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-19T06:42:36.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/nbd.ko 2024-02-19T06:42:36.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/null_blk 2024-02-19T06:42:36.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/null_blk/null_blk.ko 2024-02-19T06:42:36.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/pktcdvd.ko 2024-02-19T06:42:36.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/rbd.ko 2024-02-19T06:42:36.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/virtio_blk.ko 2024-02-19T06:42:36.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/xen-blkback 2024-02-19T06:42:36.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-19T06:42:36.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/xen-blkfront.ko 2024-02-19T06:42:36.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/zram 2024-02-19T06:42:36.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/zram/zram.ko 2024-02-19T06:42:36.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char 2024-02-19T06:42:36.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hangcheck-timer.ko 2024-02-19T06:42:36.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random 2024-02-19T06:42:36.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-19T06:42:36.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-19T06:42:36.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-19T06:42:36.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/via-rng.ko 2024-02-19T06:42:36.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-19T06:42:36.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi 2024-02-19T06:42:36.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-19T06:42:36.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-19T06:42:36.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-19T06:42:36.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-19T06:42:36.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-19T06:42:36.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-19T06:42:36.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/lp.ko 2024-02-19T06:42:36.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/mwave 2024-02-19T06:42:36.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/mwave/mwave.ko 2024-02-19T06:42:36.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ppdev.ko 2024-02-19T06:42:36.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tlclk.ko 2024-02-19T06:42:36.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm 2024-02-19T06:42:36.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm.ko 2024-02-19T06:42:36.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-19T06:42:36.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-19T06:42:36.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-19T06:42:36.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-19T06:42:36.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-19T06:42:36.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/uv_mmtimer.ko 2024-02-19T06:42:36.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/virtio_console.ko 2024-02-19T06:42:36.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq 2024-02-19T06:42:36.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-19T06:42:36.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-19T06:42:36.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-19T06:42:36.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-19T06:42:36.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-19T06:42:36.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-19T06:42:36.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto 2024-02-19T06:42:36.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp 2024-02-19T06:42:36.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-19T06:42:36.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp/ccp.ko 2024-02-19T06:42:36.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel 2024-02-19T06:42:36.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat 2024-02-19T06:42:36.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_common 2024-02-19T06:42:36.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-19T06:42:36.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-19T06:42:36.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-19T06:42:36.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/padlock-aes.ko 2024-02-19T06:42:36.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/padlock-sha.ko 2024-02-19T06:42:36.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/virtio 2024-02-19T06:42:36.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-19T06:42:36.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dca 2024-02-19T06:42:36.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dca/dca.ko 2024-02-19T06:42:36.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/devfreq 2024-02-19T06:42:36.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-19T06:42:36.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma 2024-02-19T06:42:36.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/dw 2024-02-19T06:42:36.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-19T06:42:36.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/ioat 2024-02-19T06:42:36.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-19T06:42:36.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac 2024-02-19T06:42:36.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/amd64_edac.ko 2024-02-19T06:42:36.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/e752x_edac.ko 2024-02-19T06:42:36.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/edac_mce_amd.ko 2024-02-19T06:42:36.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i3000_edac.ko 2024-02-19T06:42:36.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i3200_edac.ko 2024-02-19T06:42:36.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i5100_edac.ko 2024-02-19T06:42:36.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i5400_edac.ko 2024-02-19T06:42:36.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i7300_edac.ko 2024-02-19T06:42:36.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i7core_edac.ko 2024-02-19T06:42:36.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i82975x_edac.ko 2024-02-19T06:42:36.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/ie31200_edac.ko 2024-02-19T06:42:36.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/sb_edac.ko 2024-02-19T06:42:36.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/x38_edac.ko 2024-02-19T06:42:36.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware 2024-02-19T06:42:36.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/edd.ko 2024-02-19T06:42:36.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-19T06:42:36.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio 2024-02-19T06:42:36.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-ich.ko 2024-02-19T06:42:36.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-19T06:42:36.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid 2024-02-19T06:42:36.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-appleir.ko 2024-02-19T06:42:36.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-aureal.ko 2024-02-19T06:42:36.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-axff.ko 2024-02-19T06:42:36.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-dr.ko 2024-02-19T06:42:36.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-elecom.ko 2024-02-19T06:42:36.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-elo.ko 2024-02-19T06:42:36.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-emsff.ko 2024-02-19T06:42:36.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gaff.ko 2024-02-19T06:42:36.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gt683r.ko 2024-02-19T06:42:36.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gyration.ko 2024-02-19T06:42:36.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-19T06:42:36.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-19T06:42:36.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtekff.ko 2024-02-19T06:42:36.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-hyperv.ko 2024-02-19T06:42:36.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-icade.ko 2024-02-19T06:42:36.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-keytouch.ko 2024-02-19T06:42:36.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-kye.ko 2024-02-19T06:42:36.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-lcpower.ko 2024-02-19T06:42:36.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-led.ko 2024-02-19T06:42:36.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-lenovo.ko 2024-02-19T06:42:36.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-19T06:42:36.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-19T06:42:36.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-multitouch.ko 2024-02-19T06:42:36.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-ortek.ko 2024-02-19T06:42:36.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-penmount.ko 2024-02-19T06:42:36.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-petalynx.ko 2024-02-19T06:42:36.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-picolcd.ko 2024-02-19T06:42:36.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-pl.ko 2024-02-19T06:42:36.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-plantronics.ko 2024-02-19T06:42:36.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-primax.ko 2024-02-19T06:42:36.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-rmi.ko 2024-02-19T06:42:36.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-19T06:42:36.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-common.ko 2024-02-19T06:42:36.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-19T06:42:36.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-19T06:42:36.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-19T06:42:36.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-19T06:42:36.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-19T06:42:36.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-19T06:42:36.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-saitek.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-samsung.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sjoy.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sony.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-speedlink.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-steelseries.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sunplus.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-tivo.ko 2024-02-19T06:42:36.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-tmff.ko 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-topseed.ko 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-twinhan.ko 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-uclogic.ko 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-waltop.ko 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-wiimote.ko 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-xinmo.ko 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-zpff.ko 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-zydacron.ko 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/uhid.ko 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/wacom.ko 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_balloon.ko 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_utils.ko 2024-02-19T06:42:36.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_vmbus.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/abituguru.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/abituguru3.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ad7414.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ad7418.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adc128d818.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1025.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1026.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1029.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1031.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm9240.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ads7828.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7410.ko 2024-02-19T06:42:36.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7411.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7462.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7470.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7475.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7x10.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/amc6821.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/applesmc.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asb100.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asc7621.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/atxp1.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/coretemp.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/dme1737.ko 2024-02-19T06:42:36.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ds1621.ko 2024-02-19T06:42:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ds620.ko 2024-02-19T06:42:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/emc1403.ko 2024-02-19T06:42:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/emc6w201.ko 2024-02-19T06:42:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f71805f.ko 2024-02-19T06:42:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f71882fg.ko 2024-02-19T06:42:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f75375s.ko 2024-02-19T06:42:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/fam15h_power.ko 2024-02-19T06:42:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/fschmd.ko 2024-02-19T06:42:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/g760a.ko 2024-02-19T06:42:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/g762.ko 2024-02-19T06:42:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/gl518sm.ko 2024-02-19T06:42:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/gl520sm.ko 2024-02-19T06:42:36.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/i5500_temp.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/i5k_amb.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ibmaem.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ibmpex.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ina209.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ina2xx.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/it87.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/k10temp.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/k8temp.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lineage-pem.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm63.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm73.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm75.ko 2024-02-19T06:42:36.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm77.ko 2024-02-19T06:42:36.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm78.ko 2024-02-19T06:42:36.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm80.ko 2024-02-19T06:42:36.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm83.ko 2024-02-19T06:42:36.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm85.ko 2024-02-19T06:42:36.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm87.ko 2024-02-19T06:42:36.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm90.ko 2024-02-19T06:42:36.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm92.ko 2024-02-19T06:42:36.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm93.ko 2024-02-19T06:42:36.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95234.ko 2024-02-19T06:42:36.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95241.ko 2024-02-19T06:42:36.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95245.ko 2024-02-19T06:42:36.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc2945.ko 2024-02-19T06:42:36.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4151.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4215.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4222.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4245.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4260.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4261.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max16065.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max1619.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max1668.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max197.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6639.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6650.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6697.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/mcp3021.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6683.ko 2024-02-19T06:42:36.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6775-core.ko 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6775.ko 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct7802.ko 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pc87360.ko 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pc87427.ko 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pcf8591.ko 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-19T06:42:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/powr1220.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch5627.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch5636.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sht15.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sht21.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/shtc1.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sis5595.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47b397.ko 2024-02-19T06:42:36.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47m1.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47m192.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/thmc50.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp102.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp103.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp401.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp421.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/via-cputemp.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/via686a.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/vt1211.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/vt8231.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83627ehf.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83627hf.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83781d.ko 2024-02-19T06:42:36.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83791d.ko 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83792d.ko 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83793.ko 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83795.ko 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83l785ts.ko 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83l786ng.ko 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-19T06:42:36.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-19T06:42:36.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-19T06:42:36.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-19T06:42:36.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-19T06:42:36.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-19T06:42:36.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-19T06:42:36.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-19T06:42:36.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-19T06:42:36.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-19T06:42:36.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-19T06:42:36.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-19T06:42:36.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-19T06:42:36.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-dev.ko 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-mux.ko 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-smbus.ko 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-stub.ko 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband 2024-02-19T06:42:36.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_core.ko 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/cxgb4 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx4 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx5 2024-02-19T06:42:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mthca 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/ipoib 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/iser 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/isert 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srp 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srpt 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-19T06:42:36.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/gameport.ko 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/joydev.ko 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/appletouch.ko 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/bcm5974.ko 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/cyapatp.ko 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/sermouse.ko 2024-02-19T06:42:36.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/rmi4 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/altera_ps2.ko 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/arc_ps2.ko 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/serio_raw.ko 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/sparse-keymap.ko 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-blinkm.ko 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lm3530.ko 2024-02-19T06:42:36.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lp3944.ko 2024-02-19T06:42:36.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-ss4200.ko 2024-02-19T06:42:36.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger 2024-02-19T06:42:36.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-19T06:42:36.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-19T06:42:36.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-19T06:42:36.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-19T06:42:36.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-19T06:42:36.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-19T06:42:36.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-19T06:42:36.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-19T06:42:36.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-19T06:42:36.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md 2024-02-19T06:42:36.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/bcache 2024-02-19T06:42:36.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/bcache/bcache.ko 2024-02-19T06:42:36.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-bio-prison.ko 2024-02-19T06:42:36.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-cache-smq.ko 2024-02-19T06:42:36.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-cache.ko 2024-02-19T06:42:36.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-crypt.ko 2024-02-19T06:42:36.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-delay.ko 2024-02-19T06:42:36.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-flakey.ko 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-log-userspace.ko 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-multipath.ko 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-queue-length.ko 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-raid.ko 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-round-robin.ko 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-service-time.ko 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-switch.ko 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-thin-pool.ko 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-verity.ko 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/persistent-data 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid0.ko 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid1.ko 2024-02-19T06:42:36.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid10.ko 2024-02-19T06:42:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid456.ko 2024-02-19T06:42:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message 2024-02-19T06:42:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion 2024-02-19T06:42:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptbase.ko 2024-02-19T06:42:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptctl.ko 2024-02-19T06:42:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptfc.ko 2024-02-19T06:42:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptlan.ko 2024-02-19T06:42:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptsas.ko 2024-02-19T06:42:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptscsih.ko 2024-02-19T06:42:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptspi.ko 2024-02-19T06:42:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd 2024-02-19T06:42:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lpc_ich.ko 2024-02-19T06:42:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lpc_sch.ko 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/mfd-core.ko 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/sm501.ko 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/viperboard.ko 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/vx855.ko 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/wl1273-core.ko 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/altera-stapl 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/apds9802als.ko 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/apds990x.ko 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/bh1770glc.ko 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/cb710 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/cb710/cb710.ko 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom 2024-02-19T06:42:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/at24.ko 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/max6875.ko 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/enclosure.ko 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/hpilo.ko 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/isl29003.ko 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/isl29020.ko 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei-me.ko 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei-txe.ko 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei.ko 2024-02-19T06:42:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-gru 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-xp 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tifm_7xx1.ko 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tifm_core.ko 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tsl2550.ko 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_balloon.ko 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_vmci 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/bonding 2024-02-19T06:42:36.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/bonding/bonding.ko 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/b53 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6xxx 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dummy.ko 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/eql.ko 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-19T06:42:36.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-19T06:42:36.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-19T06:42:36.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390 2024-02-19T06:42:36.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-19T06:42:36.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-19T06:42:36.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-19T06:42:36.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-19T06:42:36.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/adaptec 2024-02-19T06:42:36.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-19T06:42:36.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/agere 2024-02-19T06:42:36.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-19T06:42:36.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/alteon 2024-02-19T06:42:36.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-19T06:42:36.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/altera 2024-02-19T06:42:36.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-19T06:42:36.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd 2024-02-19T06:42:36.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-19T06:42:36.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-19T06:42:36.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-19T06:42:36.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros 2024-02-19T06:42:36.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/alx 2024-02-19T06:42:36.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-19T06:42:36.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-19T06:42:36.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-19T06:42:36.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-19T06:42:36.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-19T06:42:36.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx 2024-02-19T06:42:36.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-19T06:42:36.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-19T06:42:36.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom 2024-02-19T06:42:36.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-19T06:42:36.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-19T06:42:36.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-19T06:42:36.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-19T06:42:36.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-19T06:42:36.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/genet 2024-02-19T06:42:36.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-19T06:42:36.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-19T06:42:36.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade 2024-02-19T06:42:36.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade/bna 2024-02-19T06:42:36.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-19T06:42:36.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio 2024-02-19T06:42:36.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-19T06:42:36.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-19T06:42:36.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-19T06:42:36.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-19T06:42:36.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-19T06:42:36.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-19T06:42:36.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-19T06:42:36.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-19T06:42:36.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-19T06:42:36.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-19T06:42:36.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco 2024-02-19T06:42:36.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco/enic 2024-02-19T06:42:36.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-19T06:42:36.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec 2024-02-19T06:42:36.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip 2024-02-19T06:42:36.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-19T06:42:36.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-19T06:42:36.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-19T06:42:36.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-19T06:42:36.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-19T06:42:36.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-19T06:42:36.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink 2024-02-19T06:42:36.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-19T06:42:36.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-19T06:42:36.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dnet.ko 2024-02-19T06:42:36.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex 2024-02-19T06:42:36.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex/benet 2024-02-19T06:42:36.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-19T06:42:36.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ethoc.ko 2024-02-19T06:42:36.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/fealnx.ko 2024-02-19T06:42:36.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel 2024-02-19T06:42:36.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-19T06:42:36.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000 2024-02-19T06:42:36.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-19T06:42:36.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000e 2024-02-19T06:42:36.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-19T06:42:36.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/fm10k 2024-02-19T06:42:36.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-19T06:42:36.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/i40e 2024-02-19T06:42:36.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-19T06:42:36.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/iavf 2024-02-19T06:42:36.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-19T06:42:36.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igb 2024-02-19T06:42:36.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-19T06:42:36.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igbvf 2024-02-19T06:42:36.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-19T06:42:36.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-19T06:42:36.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-19T06:42:36.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-19T06:42:36.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-19T06:42:36.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/jme.ko 2024-02-19T06:42:36.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell 2024-02-19T06:42:36.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-19T06:42:36.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-19T06:42:36.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-19T06:42:36.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox 2024-02-19T06:42:36.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-19T06:42:36.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-19T06:42:36.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-19T06:42:36.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-19T06:42:36.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-19T06:42:36.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-19T06:42:36.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel 2024-02-19T06:42:36.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-19T06:42:36.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom 2024-02-19T06:42:36.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-19T06:42:36.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-19T06:42:36.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi 2024-02-19T06:42:36.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-19T06:42:36.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-19T06:42:36.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/neterion 2024-02-19T06:42:36.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-19T06:42:36.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/nvidia 2024-02-19T06:42:36.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-19T06:42:36.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines 2024-02-19T06:42:36.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-19T06:42:36.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-19T06:42:36.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic 2024-02-19T06:42:36.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-19T06:42:36.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-19T06:42:36.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-19T06:42:36.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-19T06:42:36.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-19T06:42:36.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rdc 2024-02-19T06:42:36.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-19T06:42:36.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek 2024-02-19T06:42:36.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-19T06:42:36.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-19T06:42:36.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-19T06:42:36.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-19T06:42:36.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rocker 2024-02-19T06:42:36.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-19T06:42:36.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sfc 2024-02-19T06:42:36.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-19T06:42:36.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/silan 2024-02-19T06:42:36.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-19T06:42:36.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis 2024-02-19T06:42:36.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-19T06:42:36.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-19T06:42:36.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc 2024-02-19T06:42:36.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-19T06:42:36.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-19T06:42:36.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-19T06:42:36.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-19T06:42:36.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro 2024-02-19T06:42:36.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-19T06:42:36.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-19T06:42:36.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-19T06:42:36.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun 2024-02-19T06:42:36.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-19T06:42:36.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-19T06:42:36.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-19T06:42:36.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-19T06:42:36.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/tehuti 2024-02-19T06:42:36.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-19T06:42:36.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ti 2024-02-19T06:42:36.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-19T06:42:36.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via 2024-02-19T06:42:36.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-19T06:42:36.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-19T06:42:36.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet 2024-02-19T06:42:36.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-19T06:42:36.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-19T06:42:36.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/xircom 2024-02-19T06:42:36.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-19T06:42:36.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/geneve.ko 2024-02-19T06:42:36.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/hyperv 2024-02-19T06:42:36.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-19T06:42:36.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ieee802154 2024-02-19T06:42:36.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-19T06:42:36.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ifb.ko 2024-02-19T06:42:36.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ipvlan 2024-02-19T06:42:36.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-19T06:42:36.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/macvlan.ko 2024-02-19T06:42:36.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/macvtap.ko 2024-02-19T06:42:36.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio 2024-02-19T06:42:36.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio.ko 2024-02-19T06:42:36.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-19T06:42:36.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-19T06:42:36.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-19T06:42:36.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mii.ko 2024-02-19T06:42:36.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/net_failover.ko 2024-02-19T06:42:36.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/netconsole.ko 2024-02-19T06:42:36.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/nlmon.ko 2024-02-19T06:42:36.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs 2024-02-19T06:42:36.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-19T06:42:36.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-19T06:42:36.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy 2024-02-19T06:42:36.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/amd.ko 2024-02-19T06:42:36.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-19T06:42:36.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-19T06:42:36.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-19T06:42:36.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm87xx.ko 2024-02-19T06:42:36.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/broadcom.ko 2024-02-19T06:42:36.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/cicada.ko 2024-02-19T06:42:36.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/davicom.ko 2024-02-19T06:42:36.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/dp83640.ko 2024-02-19T06:42:36.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/et1011c.ko 2024-02-19T06:42:36.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/icplus.ko 2024-02-19T06:42:36.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/lxt.ko 2024-02-19T06:42:36.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/marvell.ko 2024-02-19T06:42:36.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/micrel.ko 2024-02-19T06:42:36.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/national.ko 2024-02-19T06:42:36.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/phylink.ko 2024-02-19T06:42:36.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/qsemi.ko 2024-02-19T06:42:36.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/realtek.ko 2024-02-19T06:42:36.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/smsc.ko 2024-02-19T06:42:36.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/ste10Xp.ko 2024-02-19T06:42:36.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/vitesse.ko 2024-02-19T06:42:36.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp 2024-02-19T06:42:36.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-19T06:42:36.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_async.ko 2024-02-19T06:42:36.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-19T06:42:36.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-19T06:42:36.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-19T06:42:36.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-19T06:42:36.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pppoe.ko 2024-02-19T06:42:36.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pppox.ko 2024-02-19T06:42:36.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pptp.ko 2024-02-19T06:42:36.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/slip 2024-02-19T06:42:36.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/slip/slhc.ko 2024-02-19T06:42:36.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/slip/slip.ko 2024-02-19T06:42:36.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/sungem_phy.ko 2024-02-19T06:42:36.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/tap.ko 2024-02-19T06:42:36.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team 2024-02-19T06:42:36.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team.ko 2024-02-19T06:42:36.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-19T06:42:36.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-19T06:42:36.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-19T06:42:36.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_random.ko 2024-02-19T06:42:36.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-19T06:42:36.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/tun.ko 2024-02-19T06:42:36.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/veth.ko 2024-02-19T06:42:36.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/virtio_net.ko 2024-02-19T06:42:36.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vmxnet3 2024-02-19T06:42:36.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-19T06:42:36.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vxlan 2024-02-19T06:42:36.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vxlan/vxlan.ko 2024-02-19T06:42:36.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/xen-netback 2024-02-19T06:42:36.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-19T06:42:36.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/xen-netfront.ko 2024-02-19T06:42:36.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ntb 2024-02-19T06:42:36.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ntb/ntb.ko 2024-02-19T06:42:36.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme 2024-02-19T06:42:36.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host 2024-02-19T06:42:36.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host/nvme-core.ko 2024-02-19T06:42:36.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host/nvme.ko 2024-02-19T06:42:36.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport 2024-02-19T06:42:36.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport.ko 2024-02-19T06:42:36.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_cs.ko 2024-02-19T06:42:36.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_pc.ko 2024-02-19T06:42:36.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_serial.ko 2024-02-19T06:42:36.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci 2024-02-19T06:42:36.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug 2024-02-19T06:42:36.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-19T06:42:36.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/pcie 2024-02-19T06:42:36.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-19T06:42:36.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/xen-pcifront.ko 2024-02-19T06:42:36.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia 2024-02-19T06:42:36.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/i82092.ko 2024-02-19T06:42:36.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/pd6729.ko 2024-02-19T06:42:36.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-19T06:42:36.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl 2024-02-19T06:42:36.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl/intel 2024-02-19T06:42:36.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-19T06:42:36.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform 2024-02-19T06:42:36.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86 2024-02-19T06:42:36.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-19T06:42:36.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/acerhdf.ko 2024-02-19T06:42:36.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-19T06:42:36.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-19T06:42:36.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-19T06:42:36.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-19T06:42:36.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-19T06:42:36.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-19T06:42:36.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-19T06:42:36.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-19T06:42:36.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-19T06:42:36.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/hdaps.ko 2024-02-19T06:42:36.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel 2024-02-19T06:42:36.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-19T06:42:36.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel_ips.ko 2024-02-19T06:42:36.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-19T06:42:36.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-19T06:42:36.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-19T06:42:36.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-19T06:42:36.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-19T06:42:36.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-19T06:42:36.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-19T06:42:36.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-19T06:42:36.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-19T06:42:36.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/wmi.ko 2024-02-19T06:42:36.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap 2024-02-19T06:42:36.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-19T06:42:36.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-19T06:42:36.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps 2024-02-19T06:42:36.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients 2024-02-19T06:42:36.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-19T06:42:36.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-19T06:42:36.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps_parport.ko 2024-02-19T06:42:36.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/pps_core.ko 2024-02-19T06:42:36.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp 2024-02-19T06:42:36.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp/ptp.ko 2024-02-19T06:42:36.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp/ptp_kvm.ko 2024-02-19T06:42:36.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc 2024-02-19T06:42:36.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-19T06:42:36.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-19T06:42:36.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-19T06:42:36.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-19T06:42:36.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-19T06:42:36.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-19T06:42:36.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-19T06:42:36.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-19T06:42:36.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-19T06:42:36.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-19T06:42:36.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-em3027.ko 2024-02-19T06:42:36.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-19T06:42:36.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-19T06:42:36.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-19T06:42:36.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-19T06:42:36.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-19T06:42:36.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-19T06:42:36.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-max6900.ko 2024-02-19T06:42:36.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-19T06:42:36.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-19T06:42:36.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-19T06:42:36.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-19T06:42:36.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-19T06:42:36.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-19T06:42:36.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-19T06:42:36.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-19T06:42:36.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-19T06:42:36.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-19T06:42:36.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-19T06:42:36.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-19T06:42:36.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-x1205.ko 2024-02-19T06:42:36.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi 2024-02-19T06:42:36.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-9xxx.ko 2024-02-19T06:42:36.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-sas.ko 2024-02-19T06:42:36.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-xxxx.ko 2024-02-19T06:42:36.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/BusLogic.ko 2024-02-19T06:42:36.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/a100u2w.ko 2024-02-19T06:42:36.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aacraid 2024-02-19T06:42:36.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-19T06:42:36.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/advansys.ko 2024-02-19T06:42:36.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx 2024-02-19T06:42:36.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-19T06:42:36.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-19T06:42:36.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/am53c974.ko 2024-02-19T06:42:36.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/arcmsr 2024-02-19T06:42:36.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-19T06:42:36.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/atp870u.ko 2024-02-19T06:42:36.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/be2iscsi 2024-02-19T06:42:36.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-19T06:42:36.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bfa 2024-02-19T06:42:36.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bfa/bfa.ko 2024-02-19T06:42:36.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2fc 2024-02-19T06:42:36.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-19T06:42:36.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2i 2024-02-19T06:42:36.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-19T06:42:36.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ch.ko 2024-02-19T06:42:36.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/csiostor 2024-02-19T06:42:36.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-19T06:42:36.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi 2024-02-19T06:42:36.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-19T06:42:36.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-19T06:42:36.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-19T06:42:36.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-19T06:42:36.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-19T06:42:36.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/dc395x.ko 2024-02-19T06:42:36.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler 2024-02-19T06:42:36.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-19T06:42:36.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-19T06:42:36.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-19T06:42:36.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-19T06:42:36.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/dmx3191d.ko 2024-02-19T06:42:36.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esas2r 2024-02-19T06:42:36.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-19T06:42:36.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esp_scsi.ko 2024-02-19T06:42:36.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe 2024-02-19T06:42:36.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-19T06:42:36.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-19T06:42:36.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fnic 2024-02-19T06:42:36.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fnic/fnic.ko 2024-02-19T06:42:36.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hpsa.ko 2024-02-19T06:42:36.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hptiop.ko 2024-02-19T06:42:36.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hv_storvsc.ko 2024-02-19T06:42:36.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/initio.ko 2024-02-19T06:42:36.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ipr.ko 2024-02-19T06:42:36.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ips.ko 2024-02-19T06:42:36.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/isci 2024-02-19T06:42:36.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/isci/isci.ko 2024-02-19T06:42:36.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-19T06:42:36.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-19T06:42:36.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libfc 2024-02-19T06:42:36.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libfc/libfc.ko 2024-02-19T06:42:36.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libiscsi.ko 2024-02-19T06:42:36.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-19T06:42:36.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libsas 2024-02-19T06:42:36.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libsas/libsas.ko 2024-02-19T06:42:36.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/lpfc 2024-02-19T06:42:36.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-19T06:42:36.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid 2024-02-19T06:42:36.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid.ko 2024-02-19T06:42:36.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-19T06:42:36.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-19T06:42:36.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-19T06:42:36.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mpt3sas 2024-02-19T06:42:36.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-19T06:42:36.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvsas 2024-02-19T06:42:36.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-19T06:42:36.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvumi.ko 2024-02-19T06:42:36.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pm8001 2024-02-19T06:42:36.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-19T06:42:36.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pmcraid.ko 2024-02-19T06:42:36.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla1280.ko 2024-02-19T06:42:36.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx 2024-02-19T06:42:36.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-19T06:42:36.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-19T06:42:36.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla4xxx 2024-02-19T06:42:36.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-19T06:42:36.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/raid_class.ko 2024-02-19T06:42:36.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_debug.ko 2024-02-19T06:42:36.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-19T06:42:36.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-19T06:42:36.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-19T06:42:36.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-19T06:42:36.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-19T06:42:36.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ses.ko 2024-02-19T06:42:36.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/st.ko 2024-02-19T06:42:36.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/stex.ko 2024-02-19T06:42:36.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/sym53c8xx_2 2024-02-19T06:42:36.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-19T06:42:36.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/virtio_scsi.ko 2024-02-19T06:42:36.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-19T06:42:36.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/wd719x.ko 2024-02-19T06:42:36.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ssb 2024-02-19T06:42:36.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ssb/ssb.ko 2024-02-19T06:42:36.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target 2024-02-19T06:42:36.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/iscsi 2024-02-19T06:42:36.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-19T06:42:36.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/loopback 2024-02-19T06:42:36.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-19T06:42:36.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_file.ko 2024-02-19T06:42:36.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_iblock.ko 2024-02-19T06:42:36.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_mod.ko 2024-02-19T06:42:36.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_pscsi.ko 2024-02-19T06:42:36.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_user.ko 2024-02-19T06:42:36.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/tcm_fc 2024-02-19T06:42:36.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-19T06:42:36.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal 2024-02-19T06:42:36.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel 2024-02-19T06:42:36.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal 2024-02-19T06:42:36.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-19T06:42:36.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-19T06:42:36.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-19T06:42:36.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-19T06:42:36.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-19T06:42:36.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-19T06:42:36.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-19T06:42:36.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-19T06:42:36.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-19T06:42:36.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-19T06:42:36.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-19T06:42:36.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-19T06:42:36.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-19T06:42:36.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-19T06:42:36.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-19T06:42:36.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-19T06:42:36.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-19T06:42:36.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-19T06:42:36.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty 2024-02-19T06:42:36.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/ipwireless 2024-02-19T06:42:36.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-19T06:42:36.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/n_gsm.ko 2024-02-19T06:42:36.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/n_hdlc.ko 2024-02-19T06:42:36.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/nozomi.ko 2024-02-19T06:42:36.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial 2024-02-19T06:42:36.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/8250 2024-02-19T06:42:36.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-19T06:42:36.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/arc_uart.ko 2024-02-19T06:42:36.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/jsm 2024-02-19T06:42:36.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-19T06:42:36.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs 2024-02-19T06:42:36.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/core 2024-02-19T06:42:36.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-19T06:42:36.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/host 2024-02-19T06:42:36.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-19T06:42:36.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio 2024-02-19T06:42:36.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio.ko 2024-02-19T06:42:36.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_aec.ko 2024-02-19T06:42:36.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_cif.ko 2024-02-19T06:42:36.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_pci_generic.ko 2024-02-19T06:42:36.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_sercos3.ko 2024-02-19T06:42:36.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb 2024-02-19T06:42:36.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class 2024-02-19T06:42:36.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/cdc-acm.ko 2024-02-19T06:42:36.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-19T06:42:36.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/usblp.ko 2024-02-19T06:42:36.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/usbtmc.ko 2024-02-19T06:42:36.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host 2024-02-19T06:42:36.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-19T06:42:36.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image 2024-02-19T06:42:36.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image/mdc800.ko 2024-02-19T06:42:36.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image/microtek.ko 2024-02-19T06:42:36.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc 2024-02-19T06:42:36.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/adutux.ko 2024-02-19T06:42:36.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/appledisplay.ko 2024-02-19T06:42:36.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/emi26.ko 2024-02-19T06:42:36.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/emi62.ko 2024-02-19T06:42:36.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ezusb.ko 2024-02-19T06:42:36.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/idmouse.ko 2024-02-19T06:42:36.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/iowarrior.ko 2024-02-19T06:42:36.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-19T06:42:36.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ldusb.ko 2024-02-19T06:42:36.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/legousbtower.ko 2024-02-19T06:42:36.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/sisusbvga 2024-02-19T06:42:36.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-19T06:42:36.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-19T06:42:36.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usb3503.ko 2024-02-19T06:42:36.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usblcd.ko 2024-02-19T06:42:36.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-19T06:42:36.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/uss720.ko 2024-02-19T06:42:36.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/yurex.ko 2024-02-19T06:42:36.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy 2024-02-19T06:42:36.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy/phy-generic.ko 2024-02-19T06:42:36.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial 2024-02-19T06:42:36.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/aircable.ko 2024-02-19T06:42:36.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ark3116.ko 2024-02-19T06:42:36.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-19T06:42:36.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ch341.ko 2024-02-19T06:42:36.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cp210x.ko 2024-02-19T06:42:36.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cyberjack.ko 2024-02-19T06:42:36.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-19T06:42:36.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-19T06:42:36.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/empeg.ko 2024-02-19T06:42:36.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-19T06:42:36.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-19T06:42:36.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-19T06:42:36.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/io_ti.ko 2024-02-19T06:42:36.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ipaq.ko 2024-02-19T06:42:36.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ipw.ko 2024-02-19T06:42:36.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ir-usb.ko 2024-02-19T06:42:36.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-19T06:42:36.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/keyspan.ko 2024-02-19T06:42:36.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-19T06:42:36.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-19T06:42:36.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-19T06:42:36.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mct_u232.ko 2024-02-19T06:42:36.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mos7720.ko 2024-02-19T06:42:36.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mos7840.ko 2024-02-19T06:42:36.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/navman.ko 2024-02-19T06:42:36.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/omninet.ko 2024-02-19T06:42:36.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/opticon.ko 2024-02-19T06:42:36.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/option.ko 2024-02-19T06:42:36.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/oti6858.ko 2024-02-19T06:42:36.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/pl2303.ko 2024-02-19T06:42:36.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/qcaux.ko 2024-02-19T06:42:36.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/qcserial.ko 2024-02-19T06:42:36.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/quatech2.ko 2024-02-19T06:42:36.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/safe_serial.ko 2024-02-19T06:42:36.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/sierra.ko 2024-02-19T06:42:36.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-19T06:42:36.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ssu100.ko 2024-02-19T06:42:36.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/symbolserial.ko 2024-02-19T06:42:36.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-19T06:42:36.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-19T06:42:36.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb_debug.ko 2024-02-19T06:42:36.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-19T06:42:36.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/visor.ko 2024-02-19T06:42:36.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/whiteheat.ko 2024-02-19T06:42:36.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-19T06:42:36.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage 2024-02-19T06:42:36.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/uas.ko 2024-02-19T06:42:36.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-19T06:42:36.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-19T06:42:36.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-19T06:42:36.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-19T06:42:36.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-19T06:42:36.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-19T06:42:36.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-19T06:42:36.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-karma.ko 2024-02-19T06:42:36.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-19T06:42:36.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-19T06:42:36.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-19T06:42:36.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-19T06:42:36.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-19T06:42:36.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/usb-storage.ko 2024-02-19T06:42:36.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip 2024-02-19T06:42:36.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-19T06:42:36.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-19T06:42:36.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-19T06:42:36.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio 2024-02-19T06:42:36.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci 2024-02-19T06:42:36.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-19T06:42:36.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-19T06:42:36.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/vfio.ko 2024-02-19T06:42:36.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-19T06:42:36.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost 2024-02-19T06:42:36.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost.ko 2024-02-19T06:42:36.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-19T06:42:36.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_net.ko 2024-02-19T06:42:36.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_scsi.ko 2024-02-19T06:42:36.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video 2024-02-19T06:42:36.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight 2024-02-19T06:42:36.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/apple_bl.ko 2024-02-19T06:42:36.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/lcd.ko 2024-02-19T06:42:36.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-19T06:42:36.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio 2024-02-19T06:42:36.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio.ko 2024-02-19T06:42:36.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_balloon.ko 2024-02-19T06:42:36.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_mmio.ko 2024-02-19T06:42:36.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_pci.ko 2024-02-19T06:42:36.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-19T06:42:36.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-19T06:42:36.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_ring.ko 2024-02-19T06:42:36.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1 2024-02-19T06:42:36.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters 2024-02-19T06:42:36.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/ds2482.ko 2024-02-19T06:42:36.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/ds2490.ko 2024-02-19T06:42:36.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves 2024-02-19T06:42:36.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-19T06:42:36.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-19T06:42:36.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-19T06:42:36.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-19T06:42:36.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-19T06:42:36.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-19T06:42:36.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-19T06:42:36.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-19T06:42:36.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-19T06:42:36.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-19T06:42:36.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-19T06:42:36.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/wire.ko 2024-02-19T06:42:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog 2024-02-19T06:42:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-19T06:42:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-19T06:42:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-19T06:42:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/hpwdt.ko 2024-02-19T06:42:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/i6300esb.ko 2024-02-19T06:42:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-19T06:42:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-19T06:42:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ib700wdt.ko 2024-02-19T06:42:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ibmasr.ko 2024-02-19T06:42:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-19T06:42:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-19T06:42:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/it87_wdt.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/machzwd.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/nv_tco.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/softdog.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/via_wdt.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/wdt_pci.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/xen_wdt.ko 2024-02-19T06:42:36.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen 2024-02-19T06:42:36.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-19T06:42:36.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-evtchn.ko 2024-02-19T06:42:36.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-gntalloc.ko 2024-02-19T06:42:36.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-gntdev.ko 2024-02-19T06:42:36.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-pciback 2024-02-19T06:42:36.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-19T06:42:36.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-privcmd.ko 2024-02-19T06:42:36.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xenfs 2024-02-19T06:42:36.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-19T06:42:36.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs 2024-02-19T06:42:36.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/9p 2024-02-19T06:42:36.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/9p/9p.ko 2024-02-19T06:42:36.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/affs 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/affs/affs.ko 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/befs 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/befs/befs.ko 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/binfmt_misc.ko 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/btrfs 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/btrfs/btrfs.ko 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cachefiles 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cachefiles/cachefiles.ko 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ceph 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ceph/ceph.ko 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/coda 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/coda/coda.ko 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cramfs 2024-02-19T06:42:36.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cramfs/cramfs.ko 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/dlm 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/dlm/dlm.ko 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ecryptfs 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/f2fs 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/f2fs/f2fs.ko 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat/fat.ko 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat/msdos.ko 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat/vfat.ko 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fuse 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fuse/cuse.ko 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fuse/fuse.ko 2024-02-19T06:42:36.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/gfs2 2024-02-19T06:42:36.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/gfs2/gfs2.ko 2024-02-19T06:42:36.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfs 2024-02-19T06:42:36.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfs/hfs.ko 2024-02-19T06:42:36.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfsplus 2024-02-19T06:42:36.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfsplus/hfsplus.ko 2024-02-19T06:42:36.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/isofs 2024-02-19T06:42:36.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/isofs/isofs.ko 2024-02-19T06:42:36.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/jfs 2024-02-19T06:42:36.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/jfs/jfs.ko 2024-02-19T06:42:36.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/lockd 2024-02-19T06:42:36.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/lockd/lockd.ko 2024-02-19T06:42:36.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/minix 2024-02-19T06:42:36.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/minix/minix.ko 2024-02-19T06:42:36.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/netfs 2024-02-19T06:42:36.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/netfs/netfs.ko 2024-02-19T06:42:36.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs 2024-02-19T06:42:36.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/blocklayout 2024-02-19T06:42:36.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-19T06:42:36.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/filelayout 2024-02-19T06:42:36.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-19T06:42:36.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/flexfilelayout 2024-02-19T06:42:36.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-19T06:42:36.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfs.ko 2024-02-19T06:42:36.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfsv3.ko 2024-02-19T06:42:36.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfsv4.ko 2024-02-19T06:42:36.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common 2024-02-19T06:42:36.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common/grace.ko 2024-02-19T06:42:36.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common/nfs_acl.ko 2024-02-19T06:42:36.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfsd 2024-02-19T06:42:36.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfsd/nfsd.ko 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nilfs2 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nilfs2/nilfs2.ko 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-celtic.ko 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-centeuro.ko 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-croatian.ko 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-cyrillic.ko 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-gaelic.ko 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-greek.ko 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-iceland.ko 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-inuit.ko 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-roman.ko 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-romanian.ko 2024-02-19T06:42:36.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-turkish.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1250.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1251.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1255.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp737.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp775.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp850.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp852.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp855.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp857.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp860.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp861.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp862.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp863.ko 2024-02-19T06:42:36.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp864.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp865.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp866.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp869.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp874.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp932.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp936.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp949.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp950.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_euc-jp.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-1.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-13.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-14.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-15.ko 2024-02-19T06:42:36.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-2.ko 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-3.ko 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-4.ko 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-5.ko 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-6.ko 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-7.ko 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-9.ko 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-r.ko 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-ru.ko 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-u.ko 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_utf8.ko 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/cluster 2024-02-19T06:42:36.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlm 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlmfs 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2.ko 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/overlayfs 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/overlayfs/overlay.ko 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/pstore 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/pstore/ramoops.ko 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/reiserfs 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/reiserfs/reiserfs.ko 2024-02-19T06:42:36.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/romfs 2024-02-19T06:42:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/romfs/romfs.ko 2024-02-19T06:42:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb 2024-02-19T06:42:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/client 2024-02-19T06:42:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/client/cifs.ko 2024-02-19T06:42:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common 2024-02-19T06:42:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common/cifs_arc4.ko 2024-02-19T06:42:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common/cifs_md4.ko 2024-02-19T06:42:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/squashfs 2024-02-19T06:42:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/squashfs/squashfs.ko 2024-02-19T06:42:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/sysv 2024-02-19T06:42:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/sysv/sysv.ko 2024-02-19T06:42:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/udf 2024-02-19T06:42:36.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/udf/udf.ko 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ufs 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ufs/ufs.ko 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/xfs 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/xfs/xfs.ko 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/rcu 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/rcu/rcutorture.ko 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/torture.ko 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/trace 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/asn1_encoder.ko 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crc-itu-t.ko 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crc8.ko 2024-02-19T06:42:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto 2024-02-19T06:42:36.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto/libarc4.ko 2024-02-19T06:42:36.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto/libdes.ko 2024-02-19T06:42:36.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/libcrc32c.ko 2024-02-19T06:42:36.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lru_cache.ko 2024-02-19T06:42:36.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4 2024-02-19T06:42:36.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4/lz4_compress.ko 2024-02-19T06:42:36.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4/lz4hc_compress.ko 2024-02-19T06:42:36.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/math 2024-02-19T06:42:36.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/math/cordic.ko 2024-02-19T06:42:36.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/raid6 2024-02-19T06:42:36.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/raid6/raid6_pq.ko 2024-02-19T06:42:36.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/reed_solomon 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_bm.ko 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_fsm.ko 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_kmp.ko 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/zstd 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/zstd/zstd_compress.ko 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/mm 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/mm/hwpoison-inject.ko 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/6lowpan.ko 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_dest.ko 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_fragment.ko 2024-02-19T06:42:36.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_hop.ko 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_mobility.ko 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_routing.ko 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_udp.ko 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/garp.ko 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/mrp.ko 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/p8022.ko 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/psnap.ko 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/stp.ko 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/8021q 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/8021q/8021q.ko 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet.ko 2024-02-19T06:42:36.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_fd.ko 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_rdma.ko 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_virtio.ko 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/batman-adv 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/batman-adv/batman-adv.ko 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/br_netfilter.ko 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/bridge.ko 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-19T06:42:36.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-19T06:42:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtables.ko 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ceph 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ceph/libceph.ko 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/core 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/core/failover.ko 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/core/pktgen.ko 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp.ko 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_diag.ko 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_ipv4.ko 2024-02-19T06:42:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_ipv6.ko 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dns_resolver 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dns_resolver/dns_resolver.ko 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/dsa_core.ko 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_brcm.ko 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_dsa.ko 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_none.ko 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_trailer.ko 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/6lowpan 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/ieee802154.ko 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4 2024-02-19T06:42:36.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ah4.ko 2024-02-19T06:42:36.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/esp4.ko 2024-02-19T06:42:36.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/fou.ko 2024-02-19T06:42:36.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/gre.ko 2024-02-19T06:42:36.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/inet_diag.ko 2024-02-19T06:42:36.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_gre.ko 2024-02-19T06:42:36.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_tunnel.ko 2024-02-19T06:42:36.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_vti.ko 2024-02-19T06:42:36.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ipcomp.ko 2024-02-19T06:42:36.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ipip.ko 2024-02-19T06:42:36.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter 2024-02-19T06:42:36.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-19T06:42:36.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-19T06:42:36.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-19T06:42:36.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_bic.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_dctcp.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_diag.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_highspeed.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_htcp.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_hybla.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_illinois.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_lp.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_scalable.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_vegas.ko 2024-02-19T06:42:36.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_veno.ko 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_westwood.ko 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_yeah.ko 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tunnel4.ko 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/udp_diag.ko 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/udp_tunnel.ko 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ah6.ko 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/esp6.ko 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/fou6.ko 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_tunnel.ko 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_vti.ko 2024-02-19T06:42:36.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ipcomp6.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-19T06:42:36.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-19T06:42:36.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-19T06:42:36.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-19T06:42:36.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-19T06:42:36.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-19T06:42:36.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-19T06:42:36.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-19T06:42:36.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-19T06:42:36.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-19T06:42:36.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-19T06:42:36.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-19T06:42:36.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/sit.ko 2024-02-19T06:42:36.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/tunnel6.ko 2024-02-19T06:42:36.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/key 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/key/af_key.ko 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_core.ko 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_eth.ko 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ip.ko 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ip6.ko 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_netlink.ko 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ppp.ko 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/llc 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/llc/llc.ko 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mac802154 2024-02-19T06:42:36.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mac802154/mac802154.ko 2024-02-19T06:42:36.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mpls 2024-02-19T06:42:36.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mpls/mpls_gso.ko 2024-02-19T06:42:36.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter 2024-02-19T06:42:36.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset 2024-02-19T06:42:36.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set.ko 2024-02-19T06:42:36.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-19T06:42:36.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-19T06:42:36.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-19T06:42:36.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-19T06:42:36.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-19T06:42:36.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-19T06:42:36.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-19T06:42:36.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-19T06:42:36.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conncount.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-19T06:42:36.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_flow_table.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_log_syslog.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-19T06:42:36.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_irc.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_sip.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_tables.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_log.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_chain_nat.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_compat.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_ct.ko 2024-02-19T06:42:36.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_fib.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_hash.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_limit.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_log.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_masq.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_nat.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_numgen.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_queue.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_quota.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_redir.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_reject.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_reject_inet.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_socket.ko 2024-02-19T06:42:36.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_tunnel.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_AUDIT.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CT.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_DSCP.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_HL.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_HMARK.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_LED.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_LOG.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NETMAP.ko 2024-02-19T06:42:36.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NFLOG.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_RATEEST.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_SECMARK.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TEE.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TPROXY.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TRACE.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_addrtype.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_bpf.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cgroup.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cluster.ko 2024-02-19T06:42:36.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_comment.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connbytes.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connlabel.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connlimit.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connmark.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_conntrack.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cpu.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_dccp.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_devgroup.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_dscp.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ecn.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_esp.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_hashlimit.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_helper.ko 2024-02-19T06:42:36.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_hl.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ipcomp.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_iprange.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ipvs.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_l2tp.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_length.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_limit.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_mac.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_mark.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_multiport.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_nat.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_nfacct.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_osf.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_owner.ko 2024-02-19T06:42:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_physdev.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_pkttype.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_policy.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_quota.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_rateest.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_realm.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_recent.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_sctp.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_set.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_socket.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_state.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_statistic.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_string.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_tcpmss.ko 2024-02-19T06:42:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_time.ko 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_u32.ko 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netlink 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netlink/netlink_diag.ko 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/nsh 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/nsh/nsh.ko 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/openvswitch.ko 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-geneve.ko 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-gre.ko 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-vxlan.ko 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/packet 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/packet/af_packet_diag.ko 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds 2024-02-19T06:42:36.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds.ko 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds_rdma.ko 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds_tcp.ko 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_csum.ko 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_gact.ko 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_mirred.ko 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_nat.ko 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_pedit.ko 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_police.ko 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_simple.ko 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_skbedit.ko 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_vlan.ko 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_basic.ko 2024-02-19T06:42:36.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_bpf.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_flow.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_fw.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_route.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_u32.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_cmp.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_ipset.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_meta.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_nbyte.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_text.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_u32.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_choke.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_codel.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_drr.ko 2024-02-19T06:42:36.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_fq.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_gred.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_hfsc.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_hhf.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_htb.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_ingress.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_mqprio.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_mqprio_lib.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_multiq.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_netem.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_pie.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_plug.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_prio.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_qfq.ko 2024-02-19T06:42:36.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_red.ko 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_sfb.ko 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_sfq.ko 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_tbf.ko 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_teql.ko 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp/sctp.ko 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp/sctp_diag.ko 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/sunrpc.ko 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/xprtrdma 2024-02-19T06:42:36.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc/diag.ko 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc/tipc.ko 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/unix 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/unix/unix_diag.ko 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock.ko 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-19T06:42:36.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys/encrypted-keys 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys/trusted-keys 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys/trusted-keys/trusted.ko 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt/lib 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt/lib/irqbypass.ko 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.alias 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.alias.bin 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.alias.bin 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.bin 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.modinfo 2024-02-19T06:42:36.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.dep 2024-02-19T06:42:36.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.dep.bin 2024-02-19T06:42:36.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.devname 2024-02-19T06:42:36.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.order 2024-02-19T06:42:36.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.softdep 2024-02-19T06:42:36.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.symbols 2024-02-19T06:42:36.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.symbols.bin 2024-02-19T06:42:36.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/vmlinuz 2024-02-19T06:42:36.344 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:42:36.344 DEBUG:teuthology.orchestra.run.smithi142:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-19T06:42:36.366 INFO:teuthology.orchestra.run.smithi142.stdout:postinstall scriptlet (using /bin/sh): 2024-02-19T06:42:36.366 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-19T06:42:36.366 INFO:teuthology.orchestra.run.smithi142.stdout: /usr/bin/kernel-install add 6.8.0-rc4-g8d59ab0bd93c /lib/modules/6.8.0-rc4-g8d59ab0bd93c/vmlinuz 2024-02-19T06:42:36.366 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-02-19T06:42:36.366 INFO:teuthology.orchestra.run.smithi142.stdout:for file in vmlinuz System.map config; do 2024-02-19T06:42:36.366 INFO:teuthology.orchestra.run.smithi142.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc4-g8d59ab0bd93c/${file}" "/boot/${file}-6.8.0-rc4-g8d59ab0bd93c"; then 2024-02-19T06:42:36.366 INFO:teuthology.orchestra.run.smithi142.stdout: cp "/lib/modules/6.8.0-rc4-g8d59ab0bd93c/${file}" "/boot/${file}-6.8.0-rc4-g8d59ab0bd93c" 2024-02-19T06:42:36.366 INFO:teuthology.orchestra.run.smithi142.stdout: fi 2024-02-19T06:42:36.366 INFO:teuthology.orchestra.run.smithi142.stdout:done 2024-02-19T06:42:36.367 INFO:teuthology.orchestra.run.smithi142.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-19T06:42:36.367 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-19T06:42:36.367 INFO:teuthology.orchestra.run.smithi142.stdout:new-kernel-pkg --remove 6.8.0-rc4-g8d59ab0bd93c --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc4-g8d59ab0bd93c.img 2024-02-19T06:42:36.367 INFO:teuthology.orchestra.run.smithi142.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-19T06:42:36.367 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-install remove 6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:42:36.367 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-02-19T06:42:36.367 INFO:teuthology.orchestra.run.smithi142.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-19T06:42:36.367 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-19T06:42:36.367 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/update-bootloader --remove 6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:42:36.367 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-02-19T06:42:36.368 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-02-19T06:42:36.444 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-02-19T06:42:36.444 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-02-19T06:42:36.444 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-02-19T06:42:36.445 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 68.el9 2024-02-19T06:42:36.445 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-02-19T06:42:36.445 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-19T06:42:36.445 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-02-19T06:42:36.448 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8264254 2024-02-19T06:42:36.449 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-02-19T06:42:36.449 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-19T06:42:36.449 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-19T06:42:36.449 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-19T06:42:36.449 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-19T06:42:36.449 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-02-19T06:42:36.449 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-02-19T06:42:36.449 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-19T06:42:36.450 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-02-19T06:42:36.450 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-02-19T06:42:36.450 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:42:36.450 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-19T06:42:36.450 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-19T06:42:36.450 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-19T06:42:36.451 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-02-19T06:42:36.451 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:42:36.451 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-02-19T06:42:36.452 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-19T06:42:36.452 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:42:36.452 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-19T06:42:37.052 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-02-19T06:42:38.468 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-19T06:42:38.521 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-02-19T06:42:38.524 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-02-19T06:42:38.539 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.xTG6XS8i83 2024-02-19T06:42:38.540 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xTG6XS8i83 2024-02-19T06:42:38.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.xTG6XS8i83 2024-02-19T06:42:38.743 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.xTG6XS8i83 is 6KB 2024-02-19T06:42:38.792 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.xTG6XS8i83 2024-02-19T06:42:38.807 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-02-19T06:42:38.872 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-19T06:42:38.872 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-19T06:42:38.872 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-19T06:42:38.872 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc4-g8d59ab0bd93c.conf 2024-02-19T06:42:38.873 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:42:39.023 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-02-19T06:43:09.026 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-19T06:43:09.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T06:43:09.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:43:27.423 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-02-19T06:43:36.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T06:43:36.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:43:39.484 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-02-19T06:43:51.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T06:43:51.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:44:09.916 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-02-19T06:44:24.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T06:44:24.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:44:28.507 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-02-19T06:44:29.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T06:44:29.102 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.8.0-rc4-g8d59ab0bd93c"... 2024-02-19T06:44:29.102 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-02-19T06:44:29.144 INFO:teuthology.orchestra.run.smithi142.stdout:6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:44:29.144 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc4-g8d59ab0bd93c vs 6.8.0-rc4-g8d59ab0bd93c 2024-02-19T06:44:29.144 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-19T06:44:29.144 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-19T06:44:30.145 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-19T06:44:30.145 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-19T06:44:30.310 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-02-19T06:44:30.365 DEBUG:teuthology.parallel:result is None 2024-02-19T06:44:30.365 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-19T06:44:30.378 INFO:teuthology.task.internal:Creating test directory... 2024-02-19T06:44:30.378 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-19T06:44:30.387 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-19T06:44:30.442 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-19T06:44:30.449 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-19T06:44:30.459 INFO:teuthology.task.internal:Creating archive directory... 2024-02-19T06:44:30.459 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-19T06:44:30.464 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-19T06:44:30.548 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-19T06:44:30.559 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-19T06:44:30.560 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-19T06:44:30.568 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-19T06:44:30.655 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T06:44:30.667 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T06:44:30.689 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T06:44:30.710 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T06:44:30.715 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-19T06:44:30.722 INFO:teuthology.task.internal:Configuring sudo... 2024-02-19T06:44:30.723 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-19T06:44:30.731 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-19T06:44:30.826 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-19T06:44:30.837 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-19T06:44:30.837 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-19T06:44:30.845 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-19T06:44:30.897 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T06:44:30.987 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T06:44:31.100 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T06:44:31.193 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T06:44:31.290 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:44:31.290 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-19T06:44:31.393 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T06:44:31.470 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T06:44:31.552 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T06:44:31.623 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T06:44:31.718 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:44:31.718 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-19T06:44:31.787 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-02-19T06:44:31.794 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-02-19T06:44:31.919 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T06:44:31.955 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T06:44:32.201 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-19T06:44:32.210 INFO:teuthology.task.internal:Starting timer... 2024-02-19T06:44:32.210 INFO:teuthology.run_tasks:Running task pcp... 2024-02-19T06:44:32.220 INFO:teuthology.run_tasks:Running task selinux... 2024-02-19T06:44:32.228 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-02-19T06:44:32.353 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-02-19T06:44:32.359 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-02-19T06:44:32.473 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-02-19T06:44:32.478 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-19T06:44:32.478 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-02-19T06:44:32.538 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-02-19T06:44:32.538 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-02-19T06:44:32.598 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-02-19T06:44:32.598 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-02-19T06:44:32.598 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T06:44:32.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T06:44:32.691 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T06:44:32.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T06:44:32.772 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-19T06:44:32.772 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-02-19T06:44:32.868 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-02-19T06:44:32.950 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-19T06:44:32.961 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-19T06:44:32.979 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-19T06:44:32.980 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-19T06:51:09.452 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-02-19T06:51:09.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T06:51:09.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:51:09.601 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-02-19T06:51:09.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T06:51:09.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T06:51:09.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:51:09.903 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-02-19T06:51:10.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T06:51:10.057 INFO:teuthology.run_tasks:Running task clock... 2024-02-19T06:51:10.067 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-19T06:51:10.067 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-19T06:51:10.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T06:51:10.076 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-19T06:51:10.077 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T06:51:10.176 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-19T06:51:10.178 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-19T06:51:10.229 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-19T06:51:10.234 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-19T06:51:10.327 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-02-19T06:51:10.332 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-02-19T06:51:10.369 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-02-19T06:51:10.378 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-02-19T06:51:10.420 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-19T06:51:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-19T06:51:10.475 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-19T06:51:10.488 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-19T06:51:10.601 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-02-19T06:51:10.610 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T06:51:10.610 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-02-19T06:51:10.610 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T06:51:10.610 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T06:51:10.610 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T06:51:10.610 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T06:51:10.621 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-02-19T06:51:10.628 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T06:51:10.628 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-02-19T06:51:10.628 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T06:51:10.629 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T06:51:10.629 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T06:51:10.629 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T06:51:10.630 INFO:teuthology.run_tasks:Running task install... 2024-02-19T06:51:10.638 DEBUG:teuthology.task.install:project ceph 2024-02-19T06:51:10.638 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'}} 2024-02-19T06:51:10.639 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'} 2024-02-19T06:51:10.639 INFO:teuthology.task.install:Using flavor: default 2024-02-19T06:51:10.645 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-19T06:51:10.645 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-02-19T06:51:10.645 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'tag': None, 'wait_for_package': False} 2024-02-19T06:51:10.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-19T06:51:10.647 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'tag': None, 'wait_for_package': False} 2024-02-19T06:51:10.648 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-19T06:51:10.814 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/ 2024-02-19T06:51:10.814 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1514.g25296a8f 2024-02-19T06:51:10.820 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/ 2024-02-19T06:51:10.820 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1514.g25296a8f 2024-02-19T06:51:11.139 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-19T06:51:11.140 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:51:11.140 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-19T06:51:11.145 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-19T06:51:11.145 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:51:11.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-19T06:51:11.241 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-19T06:51:11.242 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/25296a8f176256aea5ed8b5850b25167dce0ae33/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-19T06:51:11.251 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-19T06:51:11.252 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/25296a8f176256aea5ed8b5850b25167dce0ae33/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-19T06:51:11.379 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-19T06:51:11.396 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-19T06:51:11.514 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-19T06:51:11.541 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-19T06:51:11.607 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-02-19T06:51:11.611 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-02-19T06:51:11.637 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-02-19T06:51:11.642 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-02-19T06:51:11.970 INFO:teuthology.orchestra.run.smithi142.stdout:74 files removed 2024-02-19T06:51:12.010 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-19T06:51:12.030 INFO:teuthology.orchestra.run.smithi046.stdout:74 files removed 2024-02-19T06:51:12.077 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-19T06:51:13.496 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 91 kB/s | 82 kB 00:00 2024-02-19T06:51:13.586 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 76 kB/s | 82 kB 00:01 2024-02-19T06:51:14.554 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 10 kB/s | 10 kB 00:00 2024-02-19T06:51:14.580 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 11 kB/s | 10 kB 00:00 2024-02-19T06:51:15.505 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 2.2 kB/s | 1.9 kB 00:00 2024-02-19T06:51:15.555 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 2.1 kB/s | 1.9 kB 00:00 2024-02-19T06:51:16.525 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 7.1 MB/s | 6.7 MB 00:00 2024-02-19T06:51:16.883 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 5.4 MB/s | 6.7 MB 00:01 2024-02-19T06:51:18.201 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2024-02-19T06:51:18.533 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 5.5 MB/s | 2.0 MB 00:00 2024-02-19T06:51:20.979 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.0 MB 00:02 2024-02-19T06:51:23.694 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-02-19T06:51:26.445 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.0 MB 00:07 2024-02-19T06:51:28.515 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 6.1 MB 00:00 2024-02-19T06:51:29.159 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-02-19T06:51:30.240 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 15 kB 00:00 2024-02-19T06:51:31.542 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2024-02-19T06:51:37.475 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-02-19T06:51:40.380 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-19T06:51:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-19T06:51:40.403 INFO:teuthology.orchestra.run.smithi046.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-19T06:51:40.404 INFO:teuthology.orchestra.run.smithi046.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-19T06:51:40.406 INFO:teuthology.orchestra.run.smithi046.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-19T06:51:40.407 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-19T06:51:40.410 INFO:teuthology.orchestra.run.smithi046.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-19T06:51:40.413 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-19T06:51:40.415 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-19T06:51:40.510 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T06:51:40.526 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================================ 2024-02-19T06:51:40.527 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-02-19T06:51:40.527 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================================ 2024-02-19T06:51:40.527 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T06:51:40.527 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-19T06:51:40.527 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 6.6 k 2024-02-19T06:51:40.527 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.3 M 2024-02-19T06:51:40.527 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 886 k 2024-02-19T06:51:40.528 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 145 k 2024-02-19T06:51:40.528 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 1.5 M 2024-02-19T06:51:40.528 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 138 k 2024-02-19T06:51:40.528 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 1.8 M 2024-02-19T06:51:40.528 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 7.4 M 2024-02-19T06:51:40.528 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 52 k 2024-02-19T06:51:40.528 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 9.7 M 2024-02-19T06:51:40.529 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 47 M 2024-02-19T06:51:40.529 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 264 k 2024-02-19T06:51:40.529 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 748 k 2024-02-19T06:51:40.529 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 217 k 2024-02-19T06:51:40.529 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 27 k 2024-02-19T06:51:40.529 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 18 k 2024-02-19T06:51:40.529 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-19T06:51:40.529 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-19T06:51:40.529 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-19T06:51:40.529 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 31 k 2024-02-19T06:51:40.529 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 743 k 2024-02-19T06:51:40.529 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 127 k 2024-02-19T06:51:40.530 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-19T06:51:40.530 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-19T06:51:40.530 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-19T06:51:40.530 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-19T06:51:40.530 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-19T06:51:40.530 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-19T06:51:40.530 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 161 k 2024-02-19T06:51:40.530 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 320 k 2024-02-19T06:51:40.530 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 298 k 2024-02-19T06:51:40.530 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 99 k 2024-02-19T06:51:40.530 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 85 k 2024-02-19T06:51:40.530 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-19T06:51:40.530 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 171 k 2024-02-19T06:51:40.531 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-19T06:51:40.531 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-02-19T06:51:40.531 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-19T06:51:40.531 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-19T06:51:40.531 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-19T06:51:40.531 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-19T06:51:40.531 INFO:teuthology.orchestra.run.smithi046.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-19T06:51:40.531 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-19T06:51:40.531 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-19T06:51:40.531 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-19T06:51:40.531 INFO:teuthology.orchestra.run.smithi046.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-19T06:51:40.531 INFO:teuthology.orchestra.run.smithi046.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-19T06:51:40.532 INFO:teuthology.orchestra.run.smithi046.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-19T06:51:40.532 INFO:teuthology.orchestra.run.smithi046.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-19T06:51:40.532 INFO:teuthology.orchestra.run.smithi046.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-19T06:51:40.532 INFO:teuthology.orchestra.run.smithi046.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-19T06:51:40.532 INFO:teuthology.orchestra.run.smithi046.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-19T06:51:40.532 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.4 M 2024-02-19T06:51:40.532 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-19T06:51:40.532 INFO:teuthology.orchestra.run.smithi046.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-19T06:51:40.532 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-19T06:51:40.532 INFO:teuthology.orchestra.run.smithi046.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-19T06:51:40.532 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-19T06:51:40.532 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-19T06:51:40.533 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-19T06:51:40.533 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-19T06:51:40.533 INFO:teuthology.orchestra.run.smithi046.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-19T06:51:40.533 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-19T06:51:40.533 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-02-19T06:51:40.533 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-19T06:51:40.533 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-19T06:51:40.533 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-19T06:51:40.533 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 20 M 2024-02-19T06:51:40.533 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 31 k 2024-02-19T06:51:40.533 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 2.1 M 2024-02-19T06:51:40.533 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 247 k 2024-02-19T06:51:40.533 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 4.7 M 2024-02-19T06:51:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 17 M 2024-02-19T06:51:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 15 k 2024-02-19T06:51:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 25 k 2024-02-19T06:51:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-19T06:51:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-19T06:51:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-19T06:51:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-19T06:51:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-19T06:51:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-19T06:51:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-19T06:51:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-19T06:51:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-19T06:51:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 163 k 2024-02-19T06:51:40.535 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-19T06:51:40.535 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-19T06:51:40.535 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-19T06:51:40.535 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-19T06:51:40.535 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-19T06:51:40.535 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 498 k 2024-02-19T06:51:40.535 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-19T06:51:40.535 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.1 M 2024-02-19T06:51:40.535 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-19T06:51:40.535 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-19T06:51:40.535 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-19T06:51:40.535 INFO:teuthology.orchestra.run.smithi046.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-19T06:51:40.535 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-19T06:51:40.536 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-19T06:51:40.536 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-19T06:51:40.536 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-19T06:51:40.536 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-19T06:51:40.536 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-19T06:51:40.536 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-19T06:51:40.536 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-19T06:51:40.536 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-19T06:51:40.536 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-19T06:51:40.536 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-19T06:51:40.536 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-19T06:51:40.536 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 45 k 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 131 k 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-19T06:51:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-19T06:51:40.538 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-19T06:51:40.538 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-19T06:51:40.538 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-19T06:51:40.538 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-19T06:51:40.538 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-19T06:51:40.538 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-19T06:51:40.538 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-19T06:51:40.538 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-19T06:51:40.538 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-19T06:51:40.538 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-19T06:51:40.538 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-19T06:51:40.538 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-19T06:51:40.538 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-19T06:51:40.539 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-19T06:51:40.540 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-19T06:51:40.540 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-19T06:51:40.540 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-19T06:51:40.540 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-19T06:51:40.540 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-19T06:51:40.540 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-19T06:51:40.540 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-19T06:51:40.540 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-19T06:51:40.540 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-19T06:51:40.540 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-19T06:51:40.540 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-19T06:51:40.540 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-19T06:51:40.541 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-02-19T06:51:40.542 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-19T06:51:40.542 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:51:40.542 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T06:51:40.542 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================================ 2024-02-19T06:51:40.542 INFO:teuthology.orchestra.run.smithi046.stdout:Install 150 Packages 2024-02-19T06:51:40.542 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 26 Packages 2024-02-19T06:51:40.542 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:51:40.543 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 223 M 2024-02-19T06:51:40.543 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T06:51:41.485 INFO:teuthology.orchestra.run.smithi046.stdout:(1/176): ceph-19.0.0-1514.g25296a8f.el9.x86_64. 11 kB/s | 6.6 kB 00:00 2024-02-19T06:51:42.744 INFO:teuthology.orchestra.run.smithi046.stdout:(2/176): ceph-fuse-19.0.0-1514.g25296a8f.el9.x8 704 kB/s | 886 kB 00:01 2024-02-19T06:51:42.952 INFO:teuthology.orchestra.run.smithi046.stdout:(3/176): ceph-immutable-object-cache-19.0.0-151 701 kB/s | 145 kB 00:00 2024-02-19T06:51:43.894 INFO:teuthology.orchestra.run.smithi046.stdout:(4/176): ceph-base-19.0.0-1514.g25296a8f.el9.x8 1.8 MB/s | 5.3 MB 00:02 2024-02-19T06:51:44.653 INFO:teuthology.orchestra.run.smithi046.stdout:(5/176): ceph-mgr-19.0.0-1514.g25296a8f.el9.x86 2.0 MB/s | 1.5 MB 00:00 2024-02-19T06:51:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:(6/176): ceph-mds-19.0.0-1514.g25296a8f.el9.x86 749 kB/s | 2.1 MB 00:02 2024-02-19T06:51:47.236 INFO:teuthology.orchestra.run.smithi046.stdout:(7/176): ceph-mon-19.0.0-1514.g25296a8f.el9.x86 1.8 MB/s | 4.7 MB 00:02 2024-02-19T06:52:00.011 INFO:teuthology.orchestra.run.smithi046.stdout:(8/176): ceph-radosgw-19.0.0-1514.g25296a8f.el9 781 kB/s | 9.7 MB 00:12 2024-02-19T06:52:00.119 INFO:teuthology.orchestra.run.smithi046.stdout:(9/176): ceph-selinux-19.0.0-1514.g25296a8f.el9 234 kB/s | 25 kB 00:00 2024-02-19T06:52:12.134 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 158 kB/s | 6.1 MB 00:39 2024-02-19T06:52:13.701 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 15 kB 00:00 2024-02-19T06:52:15.791 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2024-02-19T06:52:21.603 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-02-19T06:52:24.421 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-19T06:52:24.423 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-19T06:52:24.443 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-19T06:52:24.444 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-19T06:52:24.445 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-19T06:52:24.447 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-19T06:52:24.449 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-19T06:52:24.452 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-19T06:52:24.453 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-19T06:52:24.548 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T06:52:24.571 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-02-19T06:52:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-19T06:52:24.571 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-02-19T06:52:24.571 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T06:52:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-19T06:52:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 6.6 k 2024-02-19T06:52:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.3 M 2024-02-19T06:52:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 886 k 2024-02-19T06:52:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 145 k 2024-02-19T06:52:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 1.5 M 2024-02-19T06:52:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 138 k 2024-02-19T06:52:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 1.8 M 2024-02-19T06:52:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 7.4 M 2024-02-19T06:52:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 52 k 2024-02-19T06:52:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 9.7 M 2024-02-19T06:52:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 47 M 2024-02-19T06:52:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 264 k 2024-02-19T06:52:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 748 k 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 217 k 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 27 k 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 18 k 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 31 k 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 743 k 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 127 k 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-19T06:52:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-19T06:52:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 161 k 2024-02-19T06:52:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 320 k 2024-02-19T06:52:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 298 k 2024-02-19T06:52:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 99 k 2024-02-19T06:52:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 85 k 2024-02-19T06:52:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-19T06:52:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 171 k 2024-02-19T06:52:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-19T06:52:24.574 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-02-19T06:52:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-19T06:52:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-19T06:52:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-19T06:52:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-19T06:52:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-19T06:52:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-19T06:52:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-19T06:52:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-19T06:52:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-19T06:52:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-19T06:52:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-19T06:52:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-19T06:52:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-19T06:52:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-19T06:52:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-19T06:52:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.4 M 2024-02-19T06:52:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-19T06:52:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-19T06:52:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-19T06:52:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-19T06:52:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-19T06:52:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-19T06:52:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-19T06:52:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-19T06:52:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-19T06:52:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-19T06:52:24.576 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-19T06:52:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-19T06:52:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-19T06:52:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-19T06:52:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 20 M 2024-02-19T06:52:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 31 k 2024-02-19T06:52:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 2.1 M 2024-02-19T06:52:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 247 k 2024-02-19T06:52:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 4.7 M 2024-02-19T06:52:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 17 M 2024-02-19T06:52:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 15 k 2024-02-19T06:52:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 25 k 2024-02-19T06:52:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-19T06:52:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-19T06:52:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-19T06:52:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-19T06:52:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 163 k 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 498 k 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.1 M 2024-02-19T06:52:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-19T06:52:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-19T06:52:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-19T06:52:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-19T06:52:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-19T06:52:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 45 k 2024-02-19T06:52:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 131 k 2024-02-19T06:52:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-19T06:52:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-19T06:52:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-19T06:52:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-19T06:52:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-19T06:52:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-19T06:52:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-19T06:52:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-19T06:52:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-19T06:52:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-19T06:52:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-19T06:52:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-19T06:52:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-19T06:52:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-19T06:52:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-19T06:52:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-19T06:52:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-19T06:52:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-19T06:52:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-19T06:52:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-19T06:52:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-19T06:52:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-19T06:52:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-19T06:52:24.584 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-02-19T06:52:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-19T06:52:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:52:24.585 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T06:52:24.585 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-02-19T06:52:24.585 INFO:teuthology.orchestra.run.smithi142.stdout:Install 150 Packages 2024-02-19T06:52:24.585 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 26 Packages 2024-02-19T06:52:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:52:24.585 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 223 M 2024-02-19T06:52:24.586 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T06:52:25.262 INFO:teuthology.orchestra.run.smithi142.stdout:(1/176): ceph-19.0.0-1514.g25296a8f.el9.x86_64. 13 kB/s | 6.6 kB 00:00 2024-02-19T06:52:26.293 INFO:teuthology.orchestra.run.smithi046.stdout:(10/176): ceph-common-19.0.0-1514.g25296a8f.el9 449 kB/s | 20 MB 00:45 2024-02-19T06:52:27.426 INFO:teuthology.orchestra.run.smithi046.stdout:(11/176): cephfs-mirror-19.0.0-1514.g25296a8f.e 192 kB/s | 217 kB 00:01 2024-02-19T06:52:27.835 INFO:teuthology.orchestra.run.smithi046.stdout:(12/176): cephfs-shell-19.0.0-1514.g25296a8f.el 66 kB/s | 27 kB 00:00 2024-02-19T06:52:28.076 INFO:teuthology.orchestra.run.smithi046.stdout:(13/176): libcephfs-devel-19.0.0-1514.g25296a8f 129 kB/s | 31 kB 00:00 2024-02-19T06:52:28.512 INFO:teuthology.orchestra.run.smithi142.stdout:(2/176): ceph-fuse-19.0.0-1514.g25296a8f.el9.x8 273 kB/s | 886 kB 00:03 2024-02-19T06:52:29.146 INFO:teuthology.orchestra.run.smithi142.stdout:(3/176): ceph-immutable-object-cache-19.0.0-151 230 kB/s | 145 kB 00:00 2024-02-19T06:52:31.968 INFO:teuthology.orchestra.run.smithi046.stdout:(14/176): libcephfs2-19.0.0-1514.g25296a8f.el9. 191 kB/s | 743 kB 00:03 2024-02-19T06:52:32.843 INFO:teuthology.orchestra.run.smithi046.stdout:(15/176): libcephsqlite-19.0.0-1514.g25296a8f.e 187 kB/s | 163 kB 00:00 2024-02-19T06:52:33.719 INFO:teuthology.orchestra.run.smithi046.stdout:(16/176): librados-devel-19.0.0-1514.g25296a8f. 145 kB/s | 127 kB 00:00 2024-02-19T06:52:35.852 INFO:teuthology.orchestra.run.smithi046.stdout:(17/176): libradosstriper1-19.0.0-1514.g25296a8 234 kB/s | 498 kB 00:02 2024-02-19T06:52:37.686 INFO:teuthology.orchestra.run.smithi142.stdout:(4/176): ceph-mds-19.0.0-1514.g25296a8f.el9.x86 254 kB/s | 2.1 MB 00:08 2024-02-19T06:52:40.436 INFO:teuthology.orchestra.run.smithi142.stdout:(5/176): ceph-base-19.0.0-1514.g25296a8f.el9.x8 349 kB/s | 5.3 MB 00:15 2024-02-19T06:52:41.444 INFO:teuthology.orchestra.run.smithi142.stdout:(6/176): ceph-mgr-19.0.0-1514.g25296a8f.el9.x86 405 kB/s | 1.5 MB 00:03 2024-02-19T06:52:45.293 INFO:teuthology.orchestra.run.smithi046.stdout:(18/176): ceph-osd-19.0.0-1514.g25296a8f.el9.x8 289 kB/s | 17 MB 00:59 2024-02-19T06:52:45.993 INFO:teuthology.orchestra.run.smithi046.stdout:(19/176): python3-ceph-argparse-19.0.0-1514.g25 64 kB/s | 45 kB 00:00 2024-02-19T06:52:46.793 INFO:teuthology.orchestra.run.smithi046.stdout:(20/176): python3-ceph-common-19.0.0-1514.g2529 164 kB/s | 131 kB 00:00 2024-02-19T06:52:48.193 INFO:teuthology.orchestra.run.smithi046.stdout:(21/176): python3-cephfs-19.0.0-1514.g25296a8f. 115 kB/s | 161 kB 00:01 2024-02-19T06:52:50.160 INFO:teuthology.orchestra.run.smithi046.stdout:(22/176): python3-rados-19.0.0-1514.g25296a8f.e 163 kB/s | 320 kB 00:01 2024-02-19T06:52:52.085 INFO:teuthology.orchestra.run.smithi046.stdout:(23/176): python3-rbd-19.0.0-1514.g25296a8f.el9 155 kB/s | 298 kB 00:01 2024-02-19T06:52:52.952 INFO:teuthology.orchestra.run.smithi046.stdout:(24/176): python3-rgw-19.0.0-1514.g25296a8f.el9 115 kB/s | 99 kB 00:00 2024-02-19T06:52:53.669 INFO:teuthology.orchestra.run.smithi046.stdout:(25/176): rbd-fuse-19.0.0-1514.g25296a8f.el9.x8 119 kB/s | 85 kB 00:00 2024-02-19T06:52:57.552 INFO:teuthology.orchestra.run.smithi046.stdout:(26/176): librgw2-19.0.0-1514.g25296a8f.el9.x86 241 kB/s | 5.1 MB 00:21 2024-02-19T06:52:58.561 INFO:teuthology.orchestra.run.smithi046.stdout:(27/176): rbd-nbd-19.0.0-1514.g25296a8f.el9.x86 169 kB/s | 171 kB 00:01 2024-02-19T06:52:58.753 INFO:teuthology.orchestra.run.smithi046.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1514.g 165 kB/s | 31 kB 00:00 2024-02-19T06:53:00.020 INFO:teuthology.orchestra.run.smithi046.stdout:(29/176): ceph-mgr-cephadm-19.0.0-1514.g25296a8 109 kB/s | 138 kB 00:01 2024-02-19T06:53:01.609 INFO:teuthology.orchestra.run.smithi142.stdout:(7/176): ceph-mon-19.0.0-1514.g25296a8f.el9.x86 227 kB/s | 4.7 MB 00:21 2024-02-19T06:53:04.786 INFO:teuthology.orchestra.run.smithi046.stdout:(30/176): ceph-mgr-dashboard-19.0.0-1514.g25296 383 kB/s | 1.8 MB 00:04 2024-02-19T06:53:12.152 INFO:teuthology.orchestra.run.smithi046.stdout:(31/176): rbd-mirror-19.0.0-1514.g25296a8f.el9. 171 kB/s | 3.1 MB 00:18 2024-02-19T06:53:12.985 INFO:teuthology.orchestra.run.smithi046.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1514.g25 297 kB/s | 247 kB 00:00 2024-02-19T06:53:13.302 INFO:teuthology.orchestra.run.smithi046.stdout:(33/176): ceph-mgr-rook-19.0.0-1514.g25296a8f.e 165 kB/s | 52 kB 00:00 2024-02-19T06:53:13.428 INFO:teuthology.orchestra.run.smithi046.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1514.g2 123 kB/s | 15 kB 00:00 2024-02-19T06:53:14.403 INFO:teuthology.orchestra.run.smithi046.stdout:(35/176): ceph-volume-19.0.0-1514.g25296a8f.el9 271 kB/s | 264 kB 00:00 2024-02-19T06:53:16.586 INFO:teuthology.orchestra.run.smithi046.stdout:(36/176): cephadm-19.0.0-1514.g25296a8f.el9.noa 343 kB/s | 748 kB 00:02 2024-02-19T06:53:16.712 INFO:teuthology.orchestra.run.smithi046.stdout:(37/176): cephfs-top-19.0.0-1514.g25296a8f.el9. 147 kB/s | 18 kB 00:00 2024-02-19T06:53:16.920 INFO:teuthology.orchestra.run.smithi046.stdout:(38/176): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 662 kB 00:00 2024-02-19T06:53:16.987 INFO:teuthology.orchestra.run.smithi046.stdout:(39/176): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 920 kB 00:00 2024-02-19T06:53:17.029 INFO:teuthology.orchestra.run.smithi046.stdout:(40/176): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-02-19T06:53:17.063 INFO:teuthology.orchestra.run.smithi046.stdout:(41/176): elfutils-libelf-devel-0.190-2.el9.x86 625 kB/s | 20 kB 00:00 2024-02-19T06:53:17.113 INFO:teuthology.orchestra.run.smithi046.stdout:(42/176): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 307 kB 00:00 2024-02-19T06:53:17.147 INFO:teuthology.orchestra.run.smithi046.stdout:(43/176): flexiblas-3.0.4-8.el9.x86_64.rpm 974 kB/s | 32 kB 00:00 2024-02-19T06:53:17.264 INFO:teuthology.orchestra.run.smithi046.stdout:(44/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-02-19T06:53:17.297 INFO:teuthology.orchestra.run.smithi046.stdout:(45/176): flexiblas-openblas-openmp-3.0.4-8.el9 529 kB/s | 17 kB 00:00 2024-02-19T06:53:17.331 INFO:teuthology.orchestra.run.smithi046.stdout:(46/176): libaio-devel-0.3.111-13.el9.x86_64.rp 308 kB/s | 10 kB 00:00 2024-02-19T06:53:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:(47/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.2 MB/s | 159 kB 00:00 2024-02-19T06:53:17.440 INFO:teuthology.orchestra.run.smithi046.stdout:(48/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.2 MB/s | 44 kB 00:00 2024-02-19T06:53:17.499 INFO:teuthology.orchestra.run.smithi046.stdout:(49/176): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-02-19T06:53:17.548 INFO:teuthology.orchestra.run.smithi046.stdout:(50/176): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-02-19T06:53:17.574 INFO:teuthology.orchestra.run.smithi046.stdout:(51/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 990 kB/s | 24 kB 00:00 2024-02-19T06:53:17.599 INFO:teuthology.orchestra.run.smithi046.stdout:(52/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.9 MB/s | 46 kB 00:00 2024-02-19T06:53:17.649 INFO:teuthology.orchestra.run.smithi046.stdout:(53/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2024-02-19T06:53:17.691 INFO:teuthology.orchestra.run.smithi046.stdout:(54/176): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2024-02-19T06:53:17.717 INFO:teuthology.orchestra.run.smithi046.stdout:(55/176): openblas-0.3.21-2.el9.x86_64.rpm 1.4 MB/s | 34 kB 00:00 2024-02-19T06:53:17.867 INFO:teuthology.orchestra.run.smithi046.stdout:(56/176): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2024-02-19T06:53:17.992 INFO:teuthology.orchestra.run.smithi046.stdout:(57/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 24 MB/s | 3.0 MB 00:00 2024-02-19T06:53:18.068 INFO:teuthology.orchestra.run.smithi046.stdout:(58/176): postgresql-13.11-1.el9.x86_64.rpm 20 MB/s | 1.5 MB 00:00 2024-02-19T06:53:18.135 INFO:teuthology.orchestra.run.smithi046.stdout:(59/176): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2024-02-19T06:53:18.176 INFO:teuthology.orchestra.run.smithi046.stdout:(60/176): postgresql-private-libs-13.11-1.el9.x 3.2 MB/s | 134 kB 00:00 2024-02-19T06:53:18.352 INFO:teuthology.orchestra.run.smithi046.stdout:(61/176): postgresql-server-13.11-1.el9.x86_64. 33 MB/s | 5.7 MB 00:00 2024-02-19T06:53:18.410 INFO:teuthology.orchestra.run.smithi046.stdout:(62/176): protobuf-3.14.0-13.el9.x86_64.rpm 18 MB/s | 1.0 MB 00:00 2024-02-19T06:53:18.444 INFO:teuthology.orchestra.run.smithi046.stdout:(63/176): python3-attrs-20.3.0-7.el9.noarch.rpm 2.3 MB/s | 78 kB 00:00 2024-02-19T06:53:18.628 INFO:teuthology.orchestra.run.smithi046.stdout:(64/176): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 5.8 MB 00:00 2024-02-19T06:53:18.678 INFO:teuthology.orchestra.run.smithi046.stdout:(65/176): python3-jinja2-2.11.3-5.el9.noarch.rp 4.5 MB/s | 227 kB 00:00 2024-02-19T06:53:18.711 INFO:teuthology.orchestra.run.smithi046.stdout:(66/176): python3-jsonpatch-1.21-16.el9.noarch. 750 kB/s | 24 kB 00:00 2024-02-19T06:53:18.745 INFO:teuthology.orchestra.run.smithi046.stdout:(67/176): python3-jsonpointer-2.0-4.el9.noarch. 553 kB/s | 18 kB 00:00 2024-02-19T06:53:18.787 INFO:teuthology.orchestra.run.smithi046.stdout:(68/176): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-02-19T06:53:18.821 INFO:teuthology.orchestra.run.smithi046.stdout:(69/176): python3-markupsafe-1.1.1-12.el9.x86_6 966 kB/s | 32 kB 00:00 2024-02-19T06:53:19.004 INFO:teuthology.orchestra.run.smithi046.stdout:(70/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2024-02-19T06:53:19.047 INFO:teuthology.orchestra.run.smithi046.stdout:(71/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.2 MB/s | 217 kB 00:00 2024-02-19T06:53:19.088 INFO:teuthology.orchestra.run.smithi046.stdout:(72/176): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2024-02-19T06:53:19.122 INFO:teuthology.orchestra.run.smithi046.stdout:(73/176): python3-packaging-20.9-5.el9.noarch.r 2.1 MB/s | 69 kB 00:00 2024-02-19T06:53:19.156 INFO:teuthology.orchestra.run.smithi046.stdout:(74/176): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-02-19T06:53:19.198 INFO:teuthology.orchestra.run.smithi046.stdout:(75/176): python3-protobuf-3.14.0-13.el9.noarch 5.7 MB/s | 238 kB 00:00 2024-02-19T06:53:19.239 INFO:teuthology.orchestra.run.smithi046.stdout:(76/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2024-02-19T06:53:19.281 INFO:teuthology.orchestra.run.smithi046.stdout:(77/176): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2024-02-19T06:53:19.315 INFO:teuthology.orchestra.run.smithi046.stdout:(78/176): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-02-19T06:53:19.349 INFO:teuthology.orchestra.run.smithi046.stdout:(79/176): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2024-02-19T06:53:19.733 INFO:teuthology.orchestra.run.smithi046.stdout:(80/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-02-19T06:53:19.766 INFO:teuthology.orchestra.run.smithi046.stdout:(81/176): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 39 kB 00:00 2024-02-19T06:53:19.800 INFO:teuthology.orchestra.run.smithi046.stdout:(82/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.2 MB/s | 41 kB 00:00 2024-02-19T06:53:19.841 INFO:teuthology.orchestra.run.smithi046.stdout:(83/176): qatlib-23.11.0-1.el9.x86_64.rpm 5.1 MB/s | 215 kB 00:00 2024-02-19T06:53:19.875 INFO:teuthology.orchestra.run.smithi046.stdout:(84/176): qatlib-service-23.11.0-1.el9.x86_64.r 1.0 MB/s | 34 kB 00:00 2024-02-19T06:53:19.909 INFO:teuthology.orchestra.run.smithi046.stdout:(85/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2024-02-19T06:53:19.959 INFO:teuthology.orchestra.run.smithi046.stdout:(86/176): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 300 kB 00:00 2024-02-19T06:53:19.992 INFO:teuthology.orchestra.run.smithi046.stdout:(87/176): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2024-02-19T06:53:20.034 INFO:teuthology.orchestra.run.smithi046.stdout:(88/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.1 MB/s | 87 kB 00:00 2024-02-19T06:53:20.068 INFO:teuthology.orchestra.run.smithi046.stdout:(89/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2024-02-19T06:53:20.102 INFO:teuthology.orchestra.run.smithi046.stdout:(90/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-02-19T06:53:20.144 INFO:teuthology.orchestra.run.smithi046.stdout:(91/176): fuse-2.9.9-15.el9.x86_64.rpm 1.9 MB/s | 79 kB 00:00 2024-02-19T06:53:20.186 INFO:teuthology.orchestra.run.smithi046.stdout:(92/176): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2024-02-19T06:53:20.244 INFO:teuthology.orchestra.run.smithi046.stdout:(93/176): libgfortran-11.4.1-3.el9.x86_64.rpm 14 MB/s | 802 kB 00:00 2024-02-19T06:53:20.295 INFO:teuthology.orchestra.run.smithi046.stdout:(94/176): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 194 kB 00:00 2024-02-19T06:53:20.337 INFO:teuthology.orchestra.run.smithi046.stdout:(95/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2024-02-19T06:53:20.387 INFO:teuthology.orchestra.run.smithi046.stdout:(96/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.8 MB/s | 241 kB 00:00 2024-02-19T06:53:20.454 INFO:teuthology.orchestra.run.smithi046.stdout:(97/176): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2024-02-19T06:53:20.495 INFO:teuthology.orchestra.run.smithi046.stdout:(98/176): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 103 kB 00:00 2024-02-19T06:53:20.538 INFO:teuthology.orchestra.run.smithi046.stdout:(99/176): python3-pycparser-2.20-6.el9.noarch.r 3.0 MB/s | 124 kB 00:00 2024-02-19T06:53:20.588 INFO:teuthology.orchestra.run.smithi046.stdout:(100/176): python3-requests-2.25.1-8.el9.noarch 2.2 MB/s | 113 kB 00:00 2024-02-19T06:53:20.638 INFO:teuthology.orchestra.run.smithi046.stdout:(101/176): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-02-19T06:53:20.855 INFO:teuthology.orchestra.run.smithi046.stdout:(102/176): python3-devel-3.9.17-2.el9.x86_64.rp 1.1 MB/s | 245 kB 00:00 2024-02-19T06:53:20.914 INFO:teuthology.orchestra.run.smithi046.stdout:(103/176): lua-devel-5.4.4-4.el9.x86_64.rpm 388 kB/s | 22 kB 00:00 2024-02-19T06:53:21.081 INFO:teuthology.orchestra.run.smithi046.stdout:(104/176): protobuf-compiler-3.14.0-13.el9.x86_ 5.1 MB/s | 863 kB 00:00 2024-02-19T06:53:21.348 INFO:teuthology.orchestra.run.smithi046.stdout:(105/176): abseil-cpp-20211102.0-3.el9.x86_64.r 2.0 MB/s | 548 kB 00:00 2024-02-19T06:53:21.432 INFO:teuthology.orchestra.run.smithi046.stdout:(106/176): gperftools-libs-2.9.1-2.el9.x86_64.r 3.7 MB/s | 309 kB 00:00 2024-02-19T06:53:21.491 INFO:teuthology.orchestra.run.smithi046.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-02-19T06:53:21.908 INFO:teuthology.orchestra.run.smithi046.stdout:(108/176): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-02-19T06:53:21.983 INFO:teuthology.orchestra.run.smithi046.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 351 kB/s | 26 kB 00:00 2024-02-19T06:53:22.100 INFO:teuthology.orchestra.run.smithi046.stdout:(110/176): liboath-2.6.7-2.el9.x86_64.rpm 418 kB/s | 49 kB 00:00 2024-02-19T06:53:22.168 INFO:teuthology.orchestra.run.smithi046.stdout:(111/176): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-02-19T06:53:22.235 INFO:teuthology.orchestra.run.smithi046.stdout:(112/176): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-02-19T06:53:22.352 INFO:teuthology.orchestra.run.smithi046.stdout:(113/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.1 MB/s | 838 kB 00:00 2024-02-19T06:53:22.452 INFO:teuthology.orchestra.run.smithi046.stdout:(114/176): python3-asyncssh-2.13.2-4.el9.noarch 5.4 MB/s | 548 kB 00:00 2024-02-19T06:53:22.519 INFO:teuthology.orchestra.run.smithi046.stdout:(115/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 661 kB/s | 43 kB 00:00 2024-02-19T06:53:22.577 INFO:teuthology.orchestra.run.smithi046.stdout:(116/176): python3-cachetools-4.2.4-1.el9.noarc 557 kB/s | 32 kB 00:00 2024-02-19T06:53:22.636 INFO:teuthology.orchestra.run.smithi046.stdout:(117/176): python3-certifi-2021.10.8-2.el9.noar 259 kB/s | 15 kB 00:00 2024-02-19T06:53:22.703 INFO:teuthology.orchestra.run.smithi046.stdout:(118/176): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-02-19T06:53:22.795 INFO:teuthology.orchestra.run.smithi046.stdout:(119/176): python3-cherrypy-18.6.1-2.el9.noarch 3.9 MB/s | 358 kB 00:00 2024-02-19T06:53:22.878 INFO:teuthology.orchestra.run.smithi046.stdout:(120/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.6 MB/s | 303 kB 00:00 2024-02-19T06:53:22.929 INFO:teuthology.orchestra.run.smithi046.stdout:(121/176): python3-colorama-0.4.4-12.el9.noarch 715 kB/s | 35 kB 00:00 2024-02-19T06:53:23.004 INFO:teuthology.orchestra.run.smithi046.stdout:(122/176): python3-google-auth-2.27.0-1.el9.noa 2.7 MB/s | 203 kB 00:00 2024-02-19T06:53:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:(123/176): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-02-19T06:53:23.272 INFO:teuthology.orchestra.run.smithi046.stdout:(124/176): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-02-19T06:53:23.330 INFO:teuthology.orchestra.run.smithi046.stdout:(125/176): python3-jaraco-8.2.1-3.el9.noarch.rp 185 kB/s | 11 kB 00:00 2024-02-19T06:53:23.389 INFO:teuthology.orchestra.run.smithi046.stdout:(126/176): python3-jaraco-classes-3.2.1-5.el9.n 306 kB/s | 18 kB 00:00 2024-02-19T06:53:23.456 INFO:teuthology.orchestra.run.smithi046.stdout:(127/176): python3-jaraco-collections-3.0.0-8.e 351 kB/s | 23 kB 00:00 2024-02-19T06:53:23.514 INFO:teuthology.orchestra.run.smithi046.stdout:(128/176): python3-jaraco-functools-3.5.0-2.el9 338 kB/s | 19 kB 00:00 2024-02-19T06:53:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:(129/176): python3-jaraco-text-3.2.0-6.el9.noar 341 kB/s | 20 kB 00:00 2024-02-19T06:53:23.707 INFO:teuthology.orchestra.run.smithi046.stdout:(130/176): python3-kubernetes-26.1.0-2.el9.noar 7.7 MB/s | 1.0 MB 00:00 2024-02-19T06:53:23.794 INFO:teuthology.orchestra.run.smithi046.stdout:(131/176): python3-logutils-0.3.5-21.el9.noarch 535 kB/s | 46 kB 00:00 2024-02-19T06:53:23.899 INFO:teuthology.orchestra.run.smithi046.stdout:(132/176): python3-more-itertools-8.12.0-2.el9. 762 kB/s | 79 kB 00:00 2024-02-19T06:53:24.032 INFO:teuthology.orchestra.run.smithi046.stdout:(133/176): python3-natsort-7.1.1-5.el9.noarch.r 435 kB/s | 58 kB 00:00 2024-02-19T06:53:24.149 INFO:teuthology.orchestra.run.smithi046.stdout:(134/176): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-02-19T06:53:24.275 INFO:teuthology.orchestra.run.smithi046.stdout:(135/176): python3-portend-3.1.0-2.el9.noarch.r 132 kB/s | 16 kB 00:00 2024-02-19T06:53:24.400 INFO:teuthology.orchestra.run.smithi046.stdout:(136/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 724 kB/s | 90 kB 00:00 2024-02-19T06:53:24.509 INFO:teuthology.orchestra.run.smithi046.stdout:(137/176): python3-pyperclip-1.8.2-2.el9.noarch 262 kB/s | 28 kB 00:00 2024-02-19T06:53:24.559 INFO:teuthology.orchestra.run.smithi046.stdout:(138/176): python3-repoze-lru-0.7-16.el9.noarch 623 kB/s | 31 kB 00:00 2024-02-19T06:53:24.626 INFO:teuthology.orchestra.run.smithi046.stdout:(139/176): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-02-19T06:53:24.693 INFO:teuthology.orchestra.run.smithi046.stdout:(140/176): python3-rsa-4.9-2.el9.noarch.rpm 897 kB/s | 59 kB 00:00 2024-02-19T06:53:24.751 INFO:teuthology.orchestra.run.smithi046.stdout:(141/176): python3-tempora-5.0.0-2.el9.noarch.r 620 kB/s | 36 kB 00:00 2024-02-19T06:53:24.810 INFO:teuthology.orchestra.run.smithi046.stdout:(142/176): python3-typing-extensions-4.4.0-2.el 883 kB/s | 51 kB 00:00 2024-02-19T06:53:24.877 INFO:teuthology.orchestra.run.smithi046.stdout:(143/176): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-02-19T06:53:24.944 INFO:teuthology.orchestra.run.smithi046.stdout:(144/176): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-02-19T06:53:25.028 INFO:teuthology.orchestra.run.smithi046.stdout:(145/176): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-02-19T06:53:25.086 INFO:teuthology.orchestra.run.smithi046.stdout:(146/176): python3-zc-lockfile-2.0-10.el9.noarc 346 kB/s | 20 kB 00:00 2024-02-19T06:53:25.161 INFO:teuthology.orchestra.run.smithi046.stdout:(147/176): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-02-19T06:53:25.354 INFO:teuthology.orchestra.run.smithi046.stdout:(148/176): thrift-0.15.0-2.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-02-19T06:53:37.445 INFO:teuthology.orchestra.run.smithi046.stdout:(149/176): ceph-mgr-diskprediction-local-19.0.0 232 kB/s | 7.4 MB 00:32 2024-02-19T06:53:39.103 INFO:teuthology.orchestra.run.smithi046.stdout:(150/176): librados2-19.0.0-1514.g25296a8f.el9. 251 kB/s | 3.4 MB 00:13 2024-02-19T06:53:39.137 INFO:teuthology.orchestra.run.smithi046.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2024-02-19T06:53:39.237 INFO:teuthology.orchestra.run.smithi046.stdout:(152/176): NetworkManager-1.45.91-1.el9.x86_64. 23 MB/s | 2.3 MB 00:00 2024-02-19T06:53:39.337 INFO:teuthology.orchestra.run.smithi046.stdout:(153/176): NetworkManager-libnm-1.45.91-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-02-19T06:53:39.379 INFO:teuthology.orchestra.run.smithi046.stdout:(154/176): NetworkManager-team-1.45.91-1.el9.x8 1.0 MB/s | 41 kB 00:00 2024-02-19T06:53:39.421 INFO:teuthology.orchestra.run.smithi046.stdout:(155/176): NetworkManager-tui-1.45.91-1.el9.x86 5.9 MB/s | 246 kB 00:00 2024-02-19T06:53:39.463 INFO:teuthology.orchestra.run.smithi046.stdout:(156/176): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2024-02-19T06:53:39.505 INFO:teuthology.orchestra.run.smithi046.stdout:(157/176): elfutils-debuginfod-client-0.190-2.e 861 kB/s | 35 kB 00:00 2024-02-19T06:53:39.546 INFO:teuthology.orchestra.run.smithi046.stdout:(158/176): elfutils-libelf-0.190-2.el9.x86_64.r 4.6 MB/s | 191 kB 00:00 2024-02-19T06:53:39.589 INFO:teuthology.orchestra.run.smithi046.stdout:(159/176): elfutils-libs-0.190-2.el9.x86_64.rpm 6.1 MB/s | 254 kB 00:00 2024-02-19T06:53:39.647 INFO:teuthology.orchestra.run.smithi046.stdout:(160/176): iproute-6.7.0-2.el9.x86_64.rpm 14 MB/s | 802 kB 00:00 2024-02-19T06:53:39.697 INFO:teuthology.orchestra.run.smithi046.stdout:(161/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 8.6 MB/s | 433 kB 00:00 2024-02-19T06:53:39.731 INFO:teuthology.orchestra.run.smithi046.stdout:(162/176): libacl-2.3.1-4.el9.x86_64.rpm 675 kB/s | 22 kB 00:00 2024-02-19T06:53:39.773 INFO:teuthology.orchestra.run.smithi046.stdout:(163/176): libblkid-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 107 kB 00:00 2024-02-19T06:53:39.815 INFO:teuthology.orchestra.run.smithi046.stdout:(164/176): libfdisk-2.37.4-18.el9.x86_64.rpm 3.7 MB/s | 154 kB 00:00 2024-02-19T06:53:39.857 INFO:teuthology.orchestra.run.smithi046.stdout:(165/176): libmount-2.37.4-18.el9.x86_64.rpm 3.2 MB/s | 135 kB 00:00 2024-02-19T06:53:39.890 INFO:teuthology.orchestra.run.smithi046.stdout:(166/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.9 MB/s | 63 kB 00:00 2024-02-19T06:53:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:(167/176): libuuid-2.37.4-18.el9.x86_64.rpm 668 kB/s | 28 kB 00:00 2024-02-19T06:53:40.000 INFO:teuthology.orchestra.run.smithi046.stdout:(168/176): openssl-3.0.7-25.el9.x86_64.rpm 18 MB/s | 1.2 MB 00:00 2024-02-19T06:53:40.100 INFO:teuthology.orchestra.run.smithi046.stdout:(169/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 22 MB/s | 2.1 MB 00:00 2024-02-19T06:53:40.200 INFO:teuthology.orchestra.run.smithi046.stdout:(170/176): util-linux-2.37.4-18.el9.x86_64.rpm 22 MB/s | 2.2 MB 00:00 2024-02-19T06:53:40.251 INFO:teuthology.orchestra.run.smithi046.stdout:(171/176): util-linux-core-2.37.4-18.el9.x86_64 8.7 MB/s | 438 kB 00:00 2024-02-19T06:53:40.284 INFO:teuthology.orchestra.run.smithi046.stdout:(172/176): util-linux-user-2.37.4-18.el9.x86_64 922 kB/s | 30 kB 00:00 2024-02-19T06:53:40.335 INFO:teuthology.orchestra.run.smithi046.stdout:(173/176): xfsdump-3.1.12-4.el9.x86_64.rpm 6.4 MB/s | 321 kB 00:00 2024-02-19T06:53:40.402 INFO:teuthology.orchestra.run.smithi046.stdout:(174/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-02-19T06:53:47.686 INFO:teuthology.orchestra.run.smithi142.stdout:(8/176): ceph-radosgw-19.0.0-1514.g25296a8f.el9 216 kB/s | 9.7 MB 00:46 2024-02-19T06:53:48.044 INFO:teuthology.orchestra.run.smithi142.stdout:(9/176): ceph-selinux-19.0.0-1514.g25296a8f.el9 70 kB/s | 25 kB 00:00 2024-02-19T06:53:50.159 INFO:teuthology.orchestra.run.smithi046.stdout:(175/176): librbd1-19.0.0-1514.g25296a8f.el9.x8 252 kB/s | 3.1 MB 00:12 2024-02-19T06:53:57.102 INFO:teuthology.orchestra.run.smithi142.stdout:(10/176): ceph-osd-19.0.0-1514.g25296a8f.el9.x8 227 kB/s | 17 MB 01:15 2024-02-19T06:53:57.802 INFO:teuthology.orchestra.run.smithi142.stdout:(11/176): cephfs-mirror-19.0.0-1514.g25296a8f.e 311 kB/s | 217 kB 00:00 2024-02-19T06:53:57.919 INFO:teuthology.orchestra.run.smithi142.stdout:(12/176): cephfs-shell-19.0.0-1514.g25296a8f.el 233 kB/s | 27 kB 00:00 2024-02-19T06:53:58.036 INFO:teuthology.orchestra.run.smithi142.stdout:(13/176): libcephfs-devel-19.0.0-1514.g25296a8f 269 kB/s | 31 kB 00:00 2024-02-19T06:54:00.369 INFO:teuthology.orchestra.run.smithi142.stdout:(14/176): libcephfs2-19.0.0-1514.g25296a8f.el9. 319 kB/s | 743 kB 00:02 2024-02-19T06:54:00.869 INFO:teuthology.orchestra.run.smithi142.stdout:(15/176): libcephsqlite-19.0.0-1514.g25296a8f.e 327 kB/s | 163 kB 00:00 2024-02-19T06:54:01.194 INFO:teuthology.orchestra.run.smithi142.stdout:(16/176): librados-devel-19.0.0-1514.g25296a8f. 390 kB/s | 127 kB 00:00 2024-02-19T06:54:02.344 INFO:teuthology.orchestra.run.smithi142.stdout:(17/176): libradosstriper1-19.0.0-1514.g25296a8 434 kB/s | 498 kB 00:01 2024-02-19T06:54:08.703 INFO:teuthology.orchestra.run.smithi142.stdout:(18/176): ceph-common-19.0.0-1514.g25296a8f.el9 196 kB/s | 20 MB 01:43 2024-02-19T06:54:09.011 INFO:teuthology.orchestra.run.smithi142.stdout:(19/176): python3-ceph-argparse-19.0.0-1514.g25 147 kB/s | 45 kB 00:00 2024-02-19T06:54:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:(20/176): python3-ceph-common-19.0.0-1514.g2529 259 kB/s | 131 kB 00:00 2024-02-19T06:54:10.120 INFO:teuthology.orchestra.run.smithi142.stdout:(21/176): python3-cephfs-19.0.0-1514.g25296a8f. 269 kB/s | 161 kB 00:00 2024-02-19T06:54:11.111 INFO:teuthology.orchestra.run.smithi142.stdout:(22/176): python3-rados-19.0.0-1514.g25296a8f.e 323 kB/s | 320 kB 00:00 2024-02-19T06:54:12.103 INFO:teuthology.orchestra.run.smithi142.stdout:(23/176): python3-rbd-19.0.0-1514.g25296a8f.el9 301 kB/s | 298 kB 00:00 2024-02-19T06:54:12.529 INFO:teuthology.orchestra.run.smithi142.stdout:(24/176): python3-rgw-19.0.0-1514.g25296a8f.el9 234 kB/s | 99 kB 00:00 2024-02-19T06:54:12.962 INFO:teuthology.orchestra.run.smithi142.stdout:(25/176): rbd-fuse-19.0.0-1514.g25296a8f.el9.x8 197 kB/s | 85 kB 00:00 2024-02-19T06:54:23.769 INFO:teuthology.orchestra.run.smithi142.stdout:(26/176): librgw2-19.0.0-1514.g25296a8f.el9.x86 244 kB/s | 5.1 MB 00:21 2024-02-19T06:54:24.578 INFO:teuthology.orchestra.run.smithi142.stdout:(27/176): rbd-nbd-19.0.0-1514.g25296a8f.el9.x86 211 kB/s | 171 kB 00:00 2024-02-19T06:54:24.811 INFO:teuthology.orchestra.run.smithi142.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1514.g 135 kB/s | 31 kB 00:00 2024-02-19T06:54:25.437 INFO:teuthology.orchestra.run.smithi142.stdout:(29/176): ceph-mgr-cephadm-19.0.0-1514.g25296a8 221 kB/s | 138 kB 00:00 2024-02-19T06:54:27.270 INFO:teuthology.orchestra.run.smithi142.stdout:(30/176): rbd-mirror-19.0.0-1514.g25296a8f.el9. 221 kB/s | 3.1 MB 00:14 2024-02-19T06:54:32.328 INFO:teuthology.orchestra.run.smithi142.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1514.g25296 265 kB/s | 1.8 MB 00:06 2024-02-19T06:54:33.328 INFO:teuthology.orchestra.run.smithi142.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1514.g25 248 kB/s | 247 kB 00:00 2024-02-19T06:54:33.545 INFO:teuthology.orchestra.run.smithi142.stdout:(33/176): ceph-mgr-rook-19.0.0-1514.g25296a8f.e 242 kB/s | 52 kB 00:00 2024-02-19T06:54:33.681 INFO:teuthology.orchestra.run.smithi142.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1514.g2 113 kB/s | 15 kB 00:00 2024-02-19T06:54:34.681 INFO:teuthology.orchestra.run.smithi142.stdout:(35/176): ceph-volume-19.0.0-1514.g25296a8f.el9 264 kB/s | 264 kB 00:00 2024-02-19T06:54:39.598 INFO:teuthology.orchestra.run.smithi142.stdout:(36/176): cephadm-19.0.0-1514.g25296a8f.el9.noa 152 kB/s | 748 kB 00:04 2024-02-19T06:54:39.815 INFO:teuthology.orchestra.run.smithi142.stdout:(37/176): cephfs-top-19.0.0-1514.g25296a8f.el9. 84 kB/s | 18 kB 00:00 2024-02-19T06:54:40.006 INFO:teuthology.orchestra.run.smithi142.stdout:(38/176): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2024-02-19T06:54:40.065 INFO:teuthology.orchestra.run.smithi142.stdout:(39/176): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 920 kB 00:00 2024-02-19T06:54:40.128 INFO:teuthology.orchestra.run.smithi142.stdout:(40/176): boost-program-options-1.75.0-8.el9.x8 1.7 MB/s | 106 kB 00:00 2024-02-19T06:54:40.166 INFO:teuthology.orchestra.run.smithi142.stdout:(41/176): elfutils-libelf-devel-0.190-2.el9.x86 553 kB/s | 20 kB 00:00 2024-02-19T06:54:40.199 INFO:teuthology.orchestra.run.smithi142.stdout:(42/176): flex-2.6.4-9.el9.x86_64.rpm 9.2 MB/s | 307 kB 00:00 2024-02-19T06:54:40.233 INFO:teuthology.orchestra.run.smithi142.stdout:(43/176): flexiblas-3.0.4-8.el9.x86_64.rpm 965 kB/s | 32 kB 00:00 2024-02-19T06:54:40.341 INFO:teuthology.orchestra.run.smithi142.stdout:(44/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-02-19T06:54:40.375 INFO:teuthology.orchestra.run.smithi142.stdout:(45/176): flexiblas-openblas-openmp-3.0.4-8.el9 525 kB/s | 17 kB 00:00 2024-02-19T06:54:40.408 INFO:teuthology.orchestra.run.smithi142.stdout:(46/176): libaio-devel-0.3.111-13.el9.x86_64.rp 307 kB/s | 10 kB 00:00 2024-02-19T06:54:40.450 INFO:teuthology.orchestra.run.smithi142.stdout:(47/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2024-02-19T06:54:40.518 INFO:teuthology.orchestra.run.smithi142.stdout:(48/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 667 kB/s | 44 kB 00:00 2024-02-19T06:54:40.568 INFO:teuthology.orchestra.run.smithi142.stdout:(49/176): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-02-19T06:54:40.618 INFO:teuthology.orchestra.run.smithi142.stdout:(50/176): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2024-02-19T06:54:40.652 INFO:teuthology.orchestra.run.smithi142.stdout:(51/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 745 kB/s | 24 kB 00:00 2024-02-19T06:54:40.685 INFO:teuthology.orchestra.run.smithi142.stdout:(52/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-02-19T06:54:40.727 INFO:teuthology.orchestra.run.smithi142.stdout:(53/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.7 MB/s | 282 kB 00:00 2024-02-19T06:54:40.769 INFO:teuthology.orchestra.run.smithi142.stdout:(54/176): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2024-02-19T06:54:40.803 INFO:teuthology.orchestra.run.smithi142.stdout:(55/176): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-02-19T06:54:40.978 INFO:teuthology.orchestra.run.smithi142.stdout:(56/176): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-02-19T06:54:41.112 INFO:teuthology.orchestra.run.smithi142.stdout:(57/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 22 MB/s | 3.0 MB 00:00 2024-02-19T06:54:41.229 INFO:teuthology.orchestra.run.smithi142.stdout:(58/176): postgresql-13.11-1.el9.x86_64.rpm 13 MB/s | 1.5 MB 00:00 2024-02-19T06:54:41.296 INFO:teuthology.orchestra.run.smithi142.stdout:(59/176): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2024-02-19T06:54:41.329 INFO:teuthology.orchestra.run.smithi142.stdout:(60/176): postgresql-private-libs-13.11-1.el9.x 4.0 MB/s | 134 kB 00:00 2024-02-19T06:54:41.538 INFO:teuthology.orchestra.run.smithi142.stdout:(61/176): postgresql-server-13.11-1.el9.x86_64. 27 MB/s | 5.7 MB 00:00 2024-02-19T06:54:41.622 INFO:teuthology.orchestra.run.smithi142.stdout:(62/176): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-02-19T06:54:41.664 INFO:teuthology.orchestra.run.smithi142.stdout:(63/176): python3-attrs-20.3.0-7.el9.noarch.rpm 1.9 MB/s | 78 kB 00:00 2024-02-19T06:54:41.856 INFO:teuthology.orchestra.run.smithi142.stdout:(64/176): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 5.8 MB 00:00 2024-02-19T06:54:41.897 INFO:teuthology.orchestra.run.smithi142.stdout:(65/176): python3-jinja2-2.11.3-5.el9.noarch.rp 5.4 MB/s | 227 kB 00:00 2024-02-19T06:54:41.973 INFO:teuthology.orchestra.run.smithi142.stdout:(66/176): python3-jsonpatch-1.21-16.el9.noarch. 327 kB/s | 24 kB 00:00 2024-02-19T06:54:42.007 INFO:teuthology.orchestra.run.smithi142.stdout:(67/176): python3-jsonpointer-2.0-4.el9.noarch. 556 kB/s | 18 kB 00:00 2024-02-19T06:54:42.048 INFO:teuthology.orchestra.run.smithi142.stdout:(68/176): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-02-19T06:54:42.099 INFO:teuthology.orchestra.run.smithi142.stdout:(69/176): python3-markupsafe-1.1.1-12.el9.x86_6 638 kB/s | 32 kB 00:00 2024-02-19T06:54:42.312 INFO:teuthology.orchestra.run.smithi142.stdout:(70/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2024-02-19T06:54:42.383 INFO:teuthology.orchestra.run.smithi142.stdout:(71/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.1 MB/s | 217 kB 00:00 2024-02-19T06:54:42.425 INFO:teuthology.orchestra.run.smithi142.stdout:(72/176): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2024-02-19T06:54:42.466 INFO:teuthology.orchestra.run.smithi142.stdout:(73/176): python3-packaging-20.9-5.el9.noarch.r 1.7 MB/s | 69 kB 00:00 2024-02-19T06:54:42.500 INFO:teuthology.orchestra.run.smithi142.stdout:(74/176): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-02-19T06:54:42.542 INFO:teuthology.orchestra.run.smithi142.stdout:(75/176): python3-protobuf-3.14.0-13.el9.noarch 5.7 MB/s | 238 kB 00:00 2024-02-19T06:54:42.575 INFO:teuthology.orchestra.run.smithi142.stdout:(76/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 4.0 MB/s | 132 kB 00:00 2024-02-19T06:54:42.617 INFO:teuthology.orchestra.run.smithi142.stdout:(77/176): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2024-02-19T06:54:42.651 INFO:teuthology.orchestra.run.smithi142.stdout:(78/176): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-02-19T06:54:42.718 INFO:teuthology.orchestra.run.smithi142.stdout:(79/176): python3-requests-oauthlib-1.3.0-12.el 646 kB/s | 43 kB 00:00 2024-02-19T06:54:43.252 INFO:teuthology.orchestra.run.smithi142.stdout:(80/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-02-19T06:54:43.294 INFO:teuthology.orchestra.run.smithi142.stdout:(81/176): python3-toml-0.10.2-6.el9.noarch.rpm 953 kB/s | 39 kB 00:00 2024-02-19T06:54:43.336 INFO:teuthology.orchestra.run.smithi142.stdout:(82/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 998 kB/s | 41 kB 00:00 2024-02-19T06:54:43.377 INFO:teuthology.orchestra.run.smithi142.stdout:(83/176): qatlib-23.11.0-1.el9.x86_64.rpm 5.1 MB/s | 215 kB 00:00 2024-02-19T06:54:43.437 INFO:teuthology.orchestra.run.smithi142.stdout:(84/176): qatlib-service-23.11.0-1.el9.x86_64.r 580 kB/s | 34 kB 00:00 2024-02-19T06:54:43.470 INFO:teuthology.orchestra.run.smithi142.stdout:(85/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2024-02-19T06:54:43.512 INFO:teuthology.orchestra.run.smithi142.stdout:(86/176): socat-1.7.4.1-5.el9.x86_64.rpm 7.2 MB/s | 300 kB 00:00 2024-02-19T06:54:43.545 INFO:teuthology.orchestra.run.smithi142.stdout:(87/176): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2024-02-19T06:54:43.579 INFO:teuthology.orchestra.run.smithi142.stdout:(88/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.6 MB/s | 87 kB 00:00 2024-02-19T06:54:43.613 INFO:teuthology.orchestra.run.smithi142.stdout:(89/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2024-02-19T06:54:43.646 INFO:teuthology.orchestra.run.smithi142.stdout:(90/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-02-19T06:54:43.680 INFO:teuthology.orchestra.run.smithi142.stdout:(91/176): fuse-2.9.9-15.el9.x86_64.rpm 2.4 MB/s | 79 kB 00:00 2024-02-19T06:54:43.722 INFO:teuthology.orchestra.run.smithi142.stdout:(92/176): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2024-02-19T06:54:43.823 INFO:teuthology.orchestra.run.smithi142.stdout:(93/176): libgfortran-11.4.1-3.el9.x86_64.rpm 7.9 MB/s | 802 kB 00:00 2024-02-19T06:54:43.889 INFO:teuthology.orchestra.run.smithi142.stdout:(94/176): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 194 kB 00:00 2024-02-19T06:54:43.948 INFO:teuthology.orchestra.run.smithi142.stdout:(95/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.7 MB/s | 217 kB 00:00 2024-02-19T06:54:44.015 INFO:teuthology.orchestra.run.smithi142.stdout:(96/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2024-02-19T06:54:44.157 INFO:teuthology.orchestra.run.smithi142.stdout:(97/176): python3-cryptography-36.0.1-4.el9.x86 8.1 MB/s | 1.1 MB 00:00 2024-02-19T06:54:44.199 INFO:teuthology.orchestra.run.smithi142.stdout:(98/176): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 103 kB 00:00 2024-02-19T06:54:44.241 INFO:teuthology.orchestra.run.smithi142.stdout:(99/176): python3-pycparser-2.20-6.el9.noarch.r 3.0 MB/s | 124 kB 00:00 2024-02-19T06:54:44.283 INFO:teuthology.orchestra.run.smithi142.stdout:(100/176): python3-requests-2.25.1-8.el9.noarch 2.7 MB/s | 113 kB 00:00 2024-02-19T06:54:44.325 INFO:teuthology.orchestra.run.smithi142.stdout:(101/176): python3-urllib3-1.26.5-5.el9.noarch. 4.5 MB/s | 187 kB 00:00 2024-02-19T06:54:44.567 INFO:teuthology.orchestra.run.smithi142.stdout:(102/176): python3-devel-3.9.17-2.el9.x86_64.rp 1.0 MB/s | 245 kB 00:00 2024-02-19T06:54:44.659 INFO:teuthology.orchestra.run.smithi142.stdout:(103/176): lua-devel-5.4.4-4.el9.x86_64.rpm 246 kB/s | 22 kB 00:00 2024-02-19T06:54:44.817 INFO:teuthology.orchestra.run.smithi142.stdout:(104/176): protobuf-compiler-3.14.0-13.el9.x86_ 5.4 MB/s | 863 kB 00:00 2024-02-19T06:54:45.495 INFO:teuthology.orchestra.run.smithi046.stdout:(176/176): ceph-test-19.0.0-1514.g25296a8f.el9. 293 kB/s | 47 MB 02:45 2024-02-19T06:54:45.500 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T06:54:45.500 INFO:teuthology.orchestra.run.smithi046.stdout:Total 1.2 MB/s | 223 MB 03:04 2024-02-19T06:54:45.624 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T06:54:46.025 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T06:54:46.025 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T06:54:47.084 INFO:teuthology.orchestra.run.smithi142.stdout:(105/176): abseil-cpp-20211102.0-3.el9.x86_64.r 242 kB/s | 548 kB 00:02 2024-02-19T06:54:48.034 INFO:teuthology.orchestra.run.smithi142.stdout:(106/176): gperftools-libs-2.9.1-2.el9.x86_64.r 325 kB/s | 309 kB 00:00 2024-02-19T06:54:48.176 INFO:teuthology.orchestra.run.smithi142.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 138 kB/s | 19 kB 00:00 2024-02-19T06:54:48.447 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T06:54:48.452 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T06:54:55.859 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T06:54:55.960 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-19T06:54:56.009 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-19T06:54:56.047 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-19T06:54:56.138 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-19T06:54:56.191 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-19T06:54:56.271 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-19T06:54:56.503 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-19T06:54:56.562 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-19T06:54:56.597 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-19T06:54:56.692 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-19T06:54:57.131 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-19T06:54:57.177 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-19T06:54:57.331 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-19T06:54:57.362 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-19T06:54:57.487 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-19T06:54:57.519 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-19T06:54:57.764 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-19T06:54:57.816 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-19T06:54:57.841 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-19T06:54:57.987 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-19T06:54:58.017 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-19T06:54:58.107 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-19T06:54:58.161 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-19T06:54:58.185 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-19T06:54:58.248 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-19T06:54:58.434 INFO:teuthology.orchestra.run.smithi142.stdout:(108/176): libarrow-9.0.0-10.el9.x86_64.rpm 441 kB/s | 4.4 MB 00:10 2024-02-19T06:54:58.534 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-19T06:54:58.550 INFO:teuthology.orchestra.run.smithi142.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 225 kB/s | 26 kB 00:00 2024-02-19T06:54:58.585 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-19T06:54:58.627 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-19T06:54:58.776 INFO:teuthology.orchestra.run.smithi142.stdout:(110/176): liboath-2.6.7-2.el9.x86_64.rpm 217 kB/s | 49 kB 00:00 2024-02-19T06:54:58.986 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-19T06:54:59.001 INFO:teuthology.orchestra.run.smithi142.stdout:(111/176): libunwind-1.6.2-1.el9.x86_64.rpm 300 kB/s | 67 kB 00:00 2024-02-19T06:54:59.159 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-19T06:54:59.254 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-19T06:54:59.359 INFO:teuthology.orchestra.run.smithi142.stdout:(112/176): ceph-mgr-diskprediction-local-19.0.0 236 kB/s | 7.4 MB 00:32 2024-02-19T06:54:59.443 INFO:teuthology.orchestra.run.smithi142.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 342 kB/s | 151 kB 00:00 2024-02-19T06:54:59.465 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-19T06:54:59.504 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-19T06:54:59.865 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-19T06:55:00.049 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-19T06:55:00.174 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-19T06:55:00.212 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-19T06:55:00.309 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-19T06:55:00.373 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-19T06:55:00.407 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-19T06:55:00.445 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-19T06:55:00.498 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-19T06:55:00.613 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-19T06:55:00.668 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-19T06:55:00.685 INFO:teuthology.orchestra.run.smithi142.stdout:(114/176): python3-asyncssh-2.13.2-4.el9.noarch 441 kB/s | 548 kB 00:01 2024-02-19T06:55:00.736 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-19T06:55:00.782 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-19T06:55:00.810 INFO:teuthology.orchestra.run.smithi142.stdout:(115/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 349 kB/s | 43 kB 00:00 2024-02-19T06:55:00.838 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-19T06:55:00.963 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-19T06:55:01.002 INFO:teuthology.orchestra.run.smithi142.stdout:(116/176): python3-cachetools-4.2.4-1.el9.noarc 168 kB/s | 32 kB 00:00 2024-02-19T06:55:01.008 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 39/202 2024-02-19T06:55:01.043 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 40/202 2024-02-19T06:55:01.064 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 41/202 2024-02-19T06:55:01.144 INFO:teuthology.orchestra.run.smithi142.stdout:(117/176): python3-certifi-2021.10.8-2.el9.noar 106 kB/s | 15 kB 00:00 2024-02-19T06:55:01.166 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-19T06:55:01.223 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-19T06:55:01.334 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-19T06:55:01.519 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-19T06:55:01.579 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-19T06:55:01.594 INFO:teuthology.orchestra.run.smithi142.stdout:(118/176): python3-cheroot-8.6.0-4.el9.noarch.r 382 kB/s | 172 kB 00:00 2024-02-19T06:55:02.307 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-19T06:55:02.395 INFO:teuthology.orchestra.run.smithi142.stdout:(119/176): python3-cherrypy-18.6.1-2.el9.noarch 448 kB/s | 358 kB 00:00 2024-02-19T06:55:02.402 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-19T06:55:02.511 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-19T06:55:02.576 INFO:teuthology.orchestra.run.smithi142.stdout:(120/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 261 kB/s | 838 kB 00:03 2024-02-19T06:55:02.693 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-19T06:55:02.720 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-19T06:55:02.793 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-19T06:55:02.812 INFO:teuthology.orchestra.run.smithi142.stdout:(121/176): python3-colorama-0.4.4-12.el9.noarch 150 kB/s | 35 kB 00:00 2024-02-19T06:55:02.857 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 52/202 2024-02-19T06:55:02.919 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-19T06:55:03.087 INFO:teuthology.orchestra.run.smithi142.stdout:(122/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 438 kB/s | 303 kB 00:00 2024-02-19T06:55:03.104 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-19T06:55:03.148 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-19T06:55:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:(123/176): python3-google-auth-2.27.0-1.el9.noa 338 kB/s | 203 kB 00:00 2024-02-19T06:55:03.526 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-19T06:55:03.728 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-19T06:55:03.801 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-19T06:55:03.804 INFO:teuthology.orchestra.run.smithi142.stdout:(124/176): python3-grpcio-tools-1.46.7-10.el9.x 370 kB/s | 144 kB 00:00 2024-02-19T06:55:03.864 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-19T06:55:03.938 INFO:teuthology.orchestra.run.smithi142.stdout:(125/176): python3-jaraco-8.2.1-3.el9.noarch.rp 80 kB/s | 11 kB 00:00 2024-02-19T06:55:04.055 INFO:teuthology.orchestra.run.smithi142.stdout:(126/176): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2024-02-19T06:55:04.070 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-19T06:55:04.121 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-19T06:55:04.172 INFO:teuthology.orchestra.run.smithi142.stdout:(127/176): python3-jaraco-collections-3.0.0-8.e 200 kB/s | 23 kB 00:00 2024-02-19T06:55:04.199 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-19T06:55:04.294 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-19T06:55:04.297 INFO:teuthology.orchestra.run.smithi142.stdout:(128/176): python3-jaraco-functools-3.5.0-2.el9 156 kB/s | 19 kB 00:00 2024-02-19T06:55:04.338 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-19T06:55:04.378 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-19T06:55:04.422 INFO:teuthology.orchestra.run.smithi142.stdout:(129/176): python3-jaraco-text-3.2.0-6.el9.noar 158 kB/s | 20 kB 00:00 2024-02-19T06:55:04.447 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-19T06:55:04.486 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-19T06:55:04.550 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-19T06:55:04.616 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-19T06:55:04.824 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-19T06:55:04.884 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-19T06:55:04.923 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-19T06:55:04.981 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-19T06:55:05.125 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-19T06:55:05.254 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-19T06:55:05.302 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-19T06:55:05.339 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-19T06:55:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-19T06:55:05.554 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-19T06:55:05.729 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-19T06:55:05.866 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-19T06:55:05.923 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-19T06:55:06.002 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-19T06:55:06.078 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-19T06:55:06.331 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-19T06:55:06.385 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-19T06:55:06.561 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-19T06:55:06.607 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-02-19T06:55:06.631 INFO:teuthology.orchestra.run.smithi142.stdout:(130/176): python3-grpcio-1.46.7-10.el9.x86_64. 589 kB/s | 2.0 MB 00:03 2024-02-19T06:55:06.648 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-19T06:55:06.689 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-19T06:55:06.737 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-19T06:55:06.747 INFO:teuthology.orchestra.run.smithi142.stdout:(131/176): python3-logutils-0.3.5-21.el9.noarch 399 kB/s | 46 kB 00:00 2024-02-19T06:55:06.773 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-19T06:55:06.817 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-19T06:55:06.871 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-19T06:55:06.881 INFO:teuthology.orchestra.run.smithi142.stdout:(132/176): python3-kubernetes-26.1.0-2.el9.noar 425 kB/s | 1.0 MB 00:02 2024-02-19T06:55:06.938 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-19T06:55:06.988 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-19T06:55:06.998 INFO:teuthology.orchestra.run.smithi142.stdout:(133/176): python3-more-itertools-8.12.0-2.el9. 316 kB/s | 79 kB 00:00 2024-02-19T06:55:07.032 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-19T06:55:07.115 INFO:teuthology.orchestra.run.smithi142.stdout:(134/176): python3-natsort-7.1.1-5.el9.noarch.r 248 kB/s | 58 kB 00:00 2024-02-19T06:55:07.165 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-19T06:55:07.213 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-19T06:55:07.232 INFO:teuthology.orchestra.run.smithi142.stdout:(135/176): python3-portend-3.1.0-2.el9.noarch.r 141 kB/s | 16 kB 00:00 2024-02-19T06:55:07.255 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-19T06:55:07.339 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-19T06:55:07.385 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-19T06:55:07.457 INFO:teuthology.orchestra.run.smithi142.stdout:(136/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 401 kB/s | 90 kB 00:00 2024-02-19T06:55:07.507 INFO:teuthology.orchestra.run.smithi142.stdout:(137/176): python3-pecan-1.4.2-3.el9.noarch.rpm 536 kB/s | 272 kB 00:00 2024-02-19T06:55:07.537 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-19T06:55:07.574 INFO:teuthology.orchestra.run.smithi142.stdout:(138/176): python3-pyperclip-1.8.2-2.el9.noarch 243 kB/s | 28 kB 00:00 2024-02-19T06:55:07.655 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-19T06:55:07.705 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-19T06:55:07.724 INFO:teuthology.orchestra.run.smithi142.stdout:(139/176): python3-repoze-lru-0.7-16.el9.noarch 142 kB/s | 31 kB 00:00 2024-02-19T06:55:07.740 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-19T06:55:07.800 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-19T06:55:07.841 INFO:teuthology.orchestra.run.smithi142.stdout:(140/176): python3-rsa-4.9-2.el9.noarch.rpm 511 kB/s | 59 kB 00:00 2024-02-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-19T06:55:07.967 INFO:teuthology.orchestra.run.smithi142.stdout:(141/176): python3-tempora-5.0.0-2.el9.noarch.r 288 kB/s | 36 kB 00:00 2024-02-19T06:55:08.006 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-19T06:55:08.050 INFO:teuthology.orchestra.run.smithi142.stdout:(142/176): python3-routes-2.5.1-5.el9.noarch.rp 397 kB/s | 188 kB 00:00 2024-02-19T06:55:08.084 INFO:teuthology.orchestra.run.smithi142.stdout:(143/176): python3-typing-extensions-4.4.0-2.el 438 kB/s | 51 kB 00:00 2024-02-19T06:55:08.301 INFO:teuthology.orchestra.run.smithi142.stdout:(144/176): python3-websocket-client-1.2.3-2.el9 415 kB/s | 90 kB 00:00 2024-02-19T06:55:08.543 INFO:teuthology.orchestra.run.smithi142.stdout:(145/176): python3-webob-1.8.7-6.el9.noarch.rpm 467 kB/s | 230 kB 00:00 2024-02-19T06:55:08.668 INFO:teuthology.orchestra.run.smithi142.stdout:(146/176): python3-zc-lockfile-2.0-10.el9.noarc 161 kB/s | 20 kB 00:00 2024-02-19T06:55:08.993 INFO:teuthology.orchestra.run.smithi142.stdout:(147/176): python3-werkzeug-2.0.3-3.el9.1.noarc 618 kB/s | 427 kB 00:00 2024-02-19T06:55:09.024 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-19T06:55:09.069 INFO:teuthology.orchestra.run.smithi142.stdout:(148/176): re2-20211101-3.el9.x86_64.rpm 479 kB/s | 192 kB 00:00 2024-02-19T06:55:09.080 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-19T06:55:09.105 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-19T06:55:09.162 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-19T06:55:09.277 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-19T06:55:09.314 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-19T06:55:09.551 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-19T06:55:09.585 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-19T06:55:09.681 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-19T06:55:10.525 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-19T06:55:10.671 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-19T06:55:11.286 INFO:teuthology.orchestra.run.smithi142.stdout:(149/176): thrift-0.15.0-2.el9.x86_64.rpm 707 kB/s | 1.6 MB 00:02 2024-02-19T06:55:12.292 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-19T06:55:12.375 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-19T06:55:12.409 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-19T06:55:12.779 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-19T06:55:12.812 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-19T06:55:12.942 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-19T06:55:12.977 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 126/202 2024-02-19T06:55:13.033 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-19T06:55:13.569 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-19T06:55:13.630 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-19T06:55:13.733 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-19T06:55:13.750 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 130/202 2024-02-19T06:55:16.018 INFO:teuthology.orchestra.run.smithi142.stdout:(150/176): librados2-19.0.0-1514.g25296a8f.el9. 497 kB/s | 3.4 MB 00:06 2024-02-19T06:55:16.060 INFO:teuthology.orchestra.run.smithi142.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2024-02-19T06:55:16.219 INFO:teuthology.orchestra.run.smithi142.stdout:(152/176): NetworkManager-1.45.91-1.el9.x86_64. 14 MB/s | 2.3 MB 00:00 2024-02-19T06:55:16.361 INFO:teuthology.orchestra.run.smithi142.stdout:(153/176): NetworkManager-libnm-1.45.91-1.el9.x 13 MB/s | 1.8 MB 00:00 2024-02-19T06:55:16.363 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-19T06:55:16.394 INFO:teuthology.orchestra.run.smithi142.stdout:(154/176): NetworkManager-team-1.45.91-1.el9.x8 1.2 MB/s | 41 kB 00:00 2024-02-19T06:55:16.436 INFO:teuthology.orchestra.run.smithi142.stdout:(155/176): NetworkManager-tui-1.45.91-1.el9.x86 5.9 MB/s | 246 kB 00:00 2024-02-19T06:55:16.462 INFO:teuthology.orchestra.run.smithi142.stdout:(156/176): acl-2.3.1-4.el9.x86_64.rpm 2.8 MB/s | 69 kB 00:00 2024-02-19T06:55:16.495 INFO:teuthology.orchestra.run.smithi142.stdout:(157/176): elfutils-debuginfod-client-0.190-2.e 1.1 MB/s | 35 kB 00:00 2024-02-19T06:55:16.537 INFO:teuthology.orchestra.run.smithi142.stdout:(158/176): elfutils-libelf-0.190-2.el9.x86_64.r 4.6 MB/s | 191 kB 00:00 2024-02-19T06:55:16.579 INFO:teuthology.orchestra.run.smithi142.stdout:(159/176): elfutils-libs-0.190-2.el9.x86_64.rpm 6.1 MB/s | 254 kB 00:00 2024-02-19T06:55:16.580 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-19T06:55:16.654 INFO:teuthology.orchestra.run.smithi142.stdout:(160/176): iproute-6.7.0-2.el9.x86_64.rpm 10 MB/s | 802 kB 00:00 2024-02-19T06:55:16.713 INFO:teuthology.orchestra.run.smithi142.stdout:(161/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 7.4 MB/s | 433 kB 00:00 2024-02-19T06:55:16.747 INFO:teuthology.orchestra.run.smithi142.stdout:(162/176): libacl-2.3.1-4.el9.x86_64.rpm 672 kB/s | 22 kB 00:00 2024-02-19T06:55:16.780 INFO:teuthology.orchestra.run.smithi142.stdout:(163/176): libblkid-2.37.4-18.el9.x86_64.rpm 3.2 MB/s | 107 kB 00:00 2024-02-19T06:55:16.822 INFO:teuthology.orchestra.run.smithi142.stdout:(164/176): libfdisk-2.37.4-18.el9.x86_64.rpm 3.7 MB/s | 154 kB 00:00 2024-02-19T06:55:16.855 INFO:teuthology.orchestra.run.smithi142.stdout:(165/176): libmount-2.37.4-18.el9.x86_64.rpm 4.0 MB/s | 135 kB 00:00 2024-02-19T06:55:16.881 INFO:teuthology.orchestra.run.smithi142.stdout:(166/176): libsmartcols-2.37.4-18.el9.x86_64.rp 2.5 MB/s | 63 kB 00:00 2024-02-19T06:55:16.906 INFO:teuthology.orchestra.run.smithi142.stdout:(167/176): libuuid-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 28 kB 00:00 2024-02-19T06:55:16.982 INFO:teuthology.orchestra.run.smithi142.stdout:(168/176): openssl-3.0.7-25.el9.x86_64.rpm 16 MB/s | 1.2 MB 00:00 2024-02-19T06:55:17.099 INFO:teuthology.orchestra.run.smithi142.stdout:(169/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 19 MB/s | 2.1 MB 00:00 2024-02-19T06:55:17.224 INFO:teuthology.orchestra.run.smithi142.stdout:(170/176): util-linux-2.37.4-18.el9.x86_64.rpm 18 MB/s | 2.2 MB 00:00 2024-02-19T06:55:17.258 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-19T06:55:17.274 INFO:teuthology.orchestra.run.smithi142.stdout:(171/176): util-linux-core-2.37.4-18.el9.x86_64 8.8 MB/s | 438 kB 00:00 2024-02-19T06:55:17.299 INFO:teuthology.orchestra.run.smithi142.stdout:(172/176): util-linux-user-2.37.4-18.el9.x86_64 1.2 MB/s | 30 kB 00:00 2024-02-19T06:55:17.309 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-19T06:55:17.341 INFO:teuthology.orchestra.run.smithi142.stdout:(173/176): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2024-02-19T06:55:17.433 INFO:teuthology.orchestra.run.smithi142.stdout:(174/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-02-19T06:55:17.464 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-19T06:55:17.465 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-19T06:55:17.465 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-19T06:55:17.465 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-19T06:55:18.217 INFO:teuthology.orchestra.run.smithi142.stdout:(175/176): librbd1-19.0.0-1514.g25296a8f.el9.x8 462 kB/s | 3.1 MB 00:06 2024-02-19T06:55:26.033 INFO:teuthology.orchestra.run.smithi142.stdout:(176/176): ceph-test-19.0.0-1514.g25296a8f.el9. 494 kB/s | 47 MB 01:37 2024-02-19T06:55:26.038 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T06:55:26.038 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.2 MB/s | 223 MB 03:01 2024-02-19T06:55:26.153 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T06:55:26.526 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T06:55:26.526 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T06:55:28.866 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T06:55:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-19T06:55:30.715 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-02-19T06:55:30.715 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-02-19T06:55:30.715 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-02-19T06:55:30.715 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-02-19T06:55:30.715 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-02-19T06:55:30.715 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-02-19T06:55:30.715 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-02-19T06:55:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:30.917 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-19T06:55:30.964 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-19T06:55:30.964 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:55:30.964 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-19T06:55:30.964 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:32.602 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-19T06:55:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-19T06:55:32.683 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:55:32.683 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-19T06:55:32.683 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-19T06:55:32.683 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-19T06:55:32.683 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:32.935 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-19T06:55:33.038 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-19T06:55:33.038 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:55:33.038 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-19T06:55:33.038 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-19T06:55:33.038 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-19T06:55:33.038 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:33.561 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-19T06:55:33.652 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-19T06:55:33.652 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:55:33.652 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-19T06:55:33.652 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-19T06:55:33.653 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-19T06:55:33.653 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:33.780 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-19T06:55:34.305 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-19T06:55:34.339 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-19T06:55:34.388 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 140/202 2024-02-19T06:55:34.493 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 141/202 2024-02-19T06:55:34.526 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-19T06:55:34.868 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-19T06:55:34.902 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-19T06:55:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-19T06:55:36.102 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-19T06:55:36.251 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-19T06:55:36.432 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 145/202 2024-02-19T06:55:36.436 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T06:55:36.463 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-19T06:55:36.537 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-19T06:55:36.553 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-19T06:55:36.553 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:55:36.553 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-19T06:55:36.554 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-19T06:55:36.554 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-19T06:55:36.554 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:36.580 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-19T06:55:36.613 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-19T06:55:36.651 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-19T06:55:36.653 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-19T06:55:36.746 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-19T06:55:36.749 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 148/202 2024-02-19T06:55:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-19T06:55:36.891 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-19T06:55:36.989 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-19T06:55:37.051 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-19T06:55:37.084 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-19T06:55:37.182 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-19T06:55:37.592 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-19T06:55:37.648 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-19T06:55:37.758 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-19T06:55:37.790 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-19T06:55:37.827 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-19T06:55:37.858 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-19T06:55:37.882 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-19T06:55:37.882 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:55:37.882 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-19T06:55:37.882 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-19T06:55:37.883 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-19T06:55:37.883 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:37.941 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-19T06:55:37.979 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-19T06:55:38.013 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-19T06:55:38.039 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-19T06:55:38.039 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:55:38.039 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-19T06:55:38.040 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:38.117 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-19T06:55:38.225 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-19T06:55:38.225 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:55:38.225 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-19T06:55:38.225 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-19T06:55:38.226 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-19T06:55:38.226 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:38.286 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-19T06:55:38.336 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-19T06:55:38.353 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-19T06:55:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-19T06:55:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-19T06:55:38.634 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-19T06:55:38.634 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-19T06:55:38.679 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-19T06:55:38.706 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-19T06:55:38.734 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-19T06:55:38.734 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:55:38.735 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-19T06:55:38.735 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-19T06:55:38.735 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-19T06:55:38.735 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:38.771 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-19T06:55:39.099 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-19T06:55:39.141 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-19T06:55:39.198 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-19T06:55:39.702 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-19T06:55:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-19T06:55:39.891 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-19T06:55:40.072 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-19T06:55:40.125 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-19T06:55:40.475 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-19T06:55:40.664 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-19T06:55:40.795 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-19T06:55:40.835 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-19T06:55:40.928 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-19T06:55:40.986 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-19T06:55:41.043 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-19T06:55:41.100 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-19T06:55:41.154 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-19T06:55:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-19T06:55:41.294 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-19T06:55:41.356 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-19T06:55:41.414 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-19T06:55:41.448 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-19T06:55:41.553 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-19T06:55:41.593 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 39/202 2024-02-19T06:55:41.643 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 40/202 2024-02-19T06:55:41.674 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 41/202 2024-02-19T06:55:41.787 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-19T06:55:41.851 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-19T06:55:41.948 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-19T06:55:42.464 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-19T06:55:42.541 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-19T06:55:43.238 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-19T06:55:43.336 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-19T06:55:43.485 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-19T06:55:43.538 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-19T06:55:43.567 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-19T06:55:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-19T06:55:43.708 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 52/202 2024-02-19T06:55:43.760 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-19T06:55:43.774 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 154/202 2024-02-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 155/202 2024-02-19T06:55:43.845 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 156/202 2024-02-19T06:55:43.916 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-19T06:55:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-19T06:55:44.076 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-19T06:55:44.206 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 158/202 2024-02-19T06:55:44.346 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-19T06:55:44.399 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 160/202 2024-02-19T06:55:44.455 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-19T06:55:44.460 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-19T06:55:44.515 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-19T06:55:44.635 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-19T06:55:44.675 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-19T06:55:44.704 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-19T06:55:44.721 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-19T06:55:44.748 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 166/202 2024-02-19T06:55:44.800 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-19T06:55:44.859 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-19T06:55:44.886 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-19T06:55:44.923 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-19T06:55:44.995 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-19T06:55:45.033 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-19T06:55:45.093 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-19T06:55:45.167 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-19T06:55:45.243 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-19T06:55:45.338 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-19T06:55:45.374 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-19T06:55:45.456 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-19T06:55:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-19T06:55:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-19T06:55:45.636 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-19T06:55:45.703 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-19T06:55:45.901 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-19T06:55:45.953 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-19T06:55:45.988 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-19T06:55:45.991 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-19T06:55:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-19T06:55:46.060 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-19T06:55:46.119 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-19T06:55:46.189 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-19T06:55:46.239 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-19T06:55:46.297 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-19T06:55:46.331 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-19T06:55:46.364 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-19T06:55:46.536 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-19T06:55:46.716 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-19T06:55:46.859 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-19T06:55:46.916 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-19T06:55:46.977 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-19T06:55:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-19T06:55:47.304 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-19T06:55:47.361 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-19T06:55:47.534 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-19T06:55:47.566 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 172/202 2024-02-19T06:55:47.625 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-02-19T06:55:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-19T06:55:47.668 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-19T06:55:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-19T06:55:47.718 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-19T06:55:47.766 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-19T06:55:47.809 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-19T06:55:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-19T06:55:47.848 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-19T06:55:47.853 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-19T06:55:47.880 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-19T06:55:47.915 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-19T06:55:47.916 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-19T06:55:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-19T06:55:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-19T06:55:47.999 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-19T06:55:48.055 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-19T06:55:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-19T06:55:48.109 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-19T06:55:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-19T06:55:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-19T06:55:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-19T06:55:48.248 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-19T06:55:48.321 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-19T06:55:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-19T06:55:48.365 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-19T06:55:48.385 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-19T06:55:48.431 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-19T06:55:48.434 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-19T06:55:48.472 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-19T06:55:48.476 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-19T06:55:48.516 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-19T06:55:48.566 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-19T06:55:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-19T06:55:48.640 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-19T06:55:48.715 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-19T06:55:48.762 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-19T06:55:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-19T06:55:48.795 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-19T06:55:48.828 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-19T06:55:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-19T06:55:48.862 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-19T06:55:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-19T06:55:48.895 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-19T06:55:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-19T06:55:48.934 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-19T06:55:48.935 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-19T06:55:49.070 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-19T06:55:49.140 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-19T06:55:49.254 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-19T06:55:49.254 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-19T06:55:49.423 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-19T06:55:49.457 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-19T06:55:49.490 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-19T06:55:49.548 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-19T06:55:49.670 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-19T06:55:49.940 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-19T06:55:49.940 INFO:teuthology.orchestra.run.smithi046.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-19T06:55:49.940 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:50.108 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-19T06:55:50.190 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-19T06:55:50.232 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-19T06:55:50.304 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-19T06:55:50.426 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-19T06:55:50.474 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-19T06:55:50.737 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-19T06:55:50.770 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-19T06:55:50.862 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-19T06:55:51.652 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-19T06:55:51.790 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-19T06:55:53.311 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-19T06:55:53.417 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-19T06:55:53.453 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-19T06:55:53.804 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-19T06:55:53.838 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-19T06:55:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-19T06:55:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 126/202 2024-02-19T06:55:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-19T06:55:54.541 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-19T06:55:54.583 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-19T06:55:54.602 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 1/202 2024-02-19T06:55:54.602 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2/202 2024-02-19T06:55:54.602 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 3/202 2024-02-19T06:55:54.602 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 4/202 2024-02-19T06:55:54.602 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1514.g25296 5/202 2024-02-19T06:55:54.602 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 6/202 2024-02-19T06:55:54.602 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 7/202 2024-02-19T06:55:54.602 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 8/202 2024-02-19T06:55:54.602 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 9/202 2024-02-19T06:55:54.602 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 10/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 14/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 15/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 17/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 18/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 19/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 20/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 21/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 22/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 23/202 2024-02-19T06:55:54.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 24/202 2024-02-19T06:55:54.604 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 25/202 2024-02-19T06:55:54.604 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 26/202 2024-02-19T06:55:54.604 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 27/202 2024-02-19T06:55:54.604 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 28/202 2024-02-19T06:55:54.604 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 29/202 2024-02-19T06:55:54.604 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 30/202 2024-02-19T06:55:54.618 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 31/202 2024-02-19T06:55:54.618 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 32/202 2024-02-19T06:55:54.618 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 33/202 2024-02-19T06:55:54.618 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 34/202 2024-02-19T06:55:54.618 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 35/202 2024-02-19T06:55:54.618 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 36/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 37/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 38/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 39/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-19T06:55:54.619 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-19T06:55:54.620 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-19T06:55:54.620 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-19T06:55:54.620 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-19T06:55:54.620 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-19T06:55:54.620 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-19T06:55:54.620 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-19T06:55:54.620 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-19T06:55:54.620 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-19T06:55:54.620 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-19T06:55:54.620 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-19T06:55:54.620 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-19T06:55:54.620 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-19T06:55:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-19T06:55:54.622 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-19T06:55:54.623 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-19T06:55:54.623 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-19T06:55:54.623 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-19T06:55:54.623 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-19T06:55:54.623 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-19T06:55:54.623 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-19T06:55:54.623 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-19T06:55:54.623 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-19T06:55:54.623 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-19T06:55:54.623 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-19T06:55:54.623 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-19T06:55:54.623 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-19T06:55:54.623 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-19T06:55:54.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-19T06:55:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-19T06:55:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 151/202 2024-02-19T06:55:54.627 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-19T06:55:54.627 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-19T06:55:54.627 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-19T06:55:54.627 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-19T06:55:54.627 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-19T06:55:54.627 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-19T06:55:54.627 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-19T06:55:54.627 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-19T06:55:54.627 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-19T06:55:54.627 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-19T06:55:54.627 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-19T06:55:54.627 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-19T06:55:54.627 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-19T06:55:54.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-19T06:55:54.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-19T06:55:54.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-19T06:55:54.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-19T06:55:54.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-19T06:55:54.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-19T06:55:54.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-19T06:55:54.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-19T06:55:54.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-19T06:55:54.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-19T06:55:54.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-19T06:55:54.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-19T06:55:54.628 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-19T06:55:54.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-19T06:55:54.630 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-19T06:55:54.630 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-19T06:55:54.630 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-19T06:55:54.630 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-19T06:55:54.630 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-19T06:55:54.630 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-19T06:55:54.630 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-19T06:55:54.630 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-19T06:55:54.630 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-19T06:55:54.630 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-19T06:55:54.674 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-19T06:55:54.702 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 130/202 2024-02-19T06:55:57.076 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-19T06:55:57.076 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:57.076 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-02-19T06:55:57.076 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-19T06:55:57.076 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-19T06:55:57.076 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-19T06:55:57.076 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-19T06:55:57.076 INFO:teuthology.orchestra.run.smithi046.stdout: acl-2.3.1-4.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-19T06:55:57.077 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-19T06:55:57.078 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-19T06:55:57.078 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-19T06:55:57.078 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-19T06:55:57.078 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-19T06:55:57.078 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-19T06:55:57.078 INFO:teuthology.orchestra.run.smithi046.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-19T06:55:57.078 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-19T06:55:57.078 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T06:55:57.078 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-19T06:55:57.078 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.2-8.el9.noarch 2024-02-19T06:55:57.078 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.7.4-5.el9.x86_64 2024-02-19T06:55:57.078 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-19T06:55:57.078 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:55:57.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:55:57.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:55:57.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:55:57.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:55:57.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:55:57.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.4-9.el9.x86_64 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-19T06:55:57.080 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: jq-1.6-16.el9.x86_64 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-19T06:55:57.081 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: lua-5.4.4-4.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-19T06:55:57.082 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-13.11-1.el9.x86_64 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.083 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-19T06:55:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-19T06:55:57.087 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-19T06:55:57.088 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-19T06:55:57.088 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-19T06:55:57.088 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.088 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.088 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:55:57.088 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-3.el9.x86_64 2024-02-19T06:55:57.088 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-19T06:55:57.088 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-19T06:55:57.088 INFO:teuthology.orchestra.run.smithi046.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-19T06:55:57.088 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-19T06:55:57.088 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-19T06:55:57.089 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-19T06:55:57.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:55:57.089 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T06:55:57.282 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-19T06:55:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-19T06:55:57.694 DEBUG:teuthology.parallel:result is None 2024-02-19T06:55:57.981 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-19T06:55:58.018 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-19T06:55:58.178 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-19T06:55:58.178 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-19T06:55:58.178 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-19T06:55:58.179 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:55:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-19T06:56:11.241 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-19T06:56:11.241 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-02-19T06:56:11.241 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-02-19T06:56:11.241 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-02-19T06:56:11.241 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-02-19T06:56:11.241 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-02-19T06:56:11.241 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-02-19T06:56:11.241 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-02-19T06:56:11.241 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:11.466 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-19T06:56:11.526 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-19T06:56:11.526 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:56:11.526 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-19T06:56:11.526 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-19T06:56:13.241 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-19T06:56:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:56:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-19T06:56:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-19T06:56:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-19T06:56:13.242 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-19T06:56:13.574 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-19T06:56:13.574 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:56:13.574 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-19T06:56:13.574 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-19T06:56:13.574 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-19T06:56:13.574 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:14.060 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-19T06:56:14.140 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-19T06:56:14.140 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:56:14.141 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-19T06:56:14.141 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-19T06:56:14.141 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-19T06:56:14.141 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:14.254 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-19T06:56:14.876 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-19T06:56:14.913 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-19T06:56:14.962 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 140/202 2024-02-19T06:56:15.063 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 141/202 2024-02-19T06:56:15.117 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-19T06:56:15.444 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-19T06:56:15.513 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-19T06:56:16.605 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-19T06:56:16.635 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-19T06:56:16.778 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-19T06:56:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 145/202 2024-02-19T06:56:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-19T06:56:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-19T06:56:17.047 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:56:17.047 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-19T06:56:17.047 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-19T06:56:17.047 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-19T06:56:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:17.104 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-19T06:56:17.141 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-19T06:56:17.203 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 148/202 2024-02-19T06:56:18.162 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-19T06:56:18.198 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-19T06:56:18.264 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-19T06:56:18.264 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:56:18.265 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-19T06:56:18.265 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-19T06:56:18.265 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-19T06:56:18.265 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:18.307 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-19T06:56:18.377 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-19T06:56:18.377 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:56:18.377 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-19T06:56:18.378 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:18.458 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-19T06:56:18.528 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-19T06:56:18.528 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:56:18.528 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-19T06:56:18.528 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-19T06:56:18.528 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-19T06:56:18.528 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:18.900 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-19T06:56:18.970 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-19T06:56:18.970 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T06:56:18.970 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-19T06:56:18.970 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-19T06:56:18.971 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-19T06:56:18.971 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:23.697 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 154/202 2024-02-19T06:56:23.739 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 155/202 2024-02-19T06:56:23.805 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 156/202 2024-02-19T06:56:23.849 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-19T06:56:24.120 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 158/202 2024-02-19T06:56:24.271 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-19T06:56:24.322 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 160/202 2024-02-19T06:56:24.371 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-19T06:56:24.421 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-19T06:56:24.515 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-19T06:56:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-19T06:56:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-19T06:56:24.629 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 166/202 2024-02-19T06:56:24.681 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-19T06:56:24.810 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-19T06:56:24.925 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-19T06:56:24.974 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-19T06:56:25.909 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-19T06:56:25.987 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-19T06:56:26.045 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-19T06:56:27.360 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 172/202 2024-02-19T06:56:27.450 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-19T06:56:27.502 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-19T06:56:27.637 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-19T06:56:27.677 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-19T06:56:27.710 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-19T06:56:27.747 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-19T06:56:27.812 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-19T06:56:27.812 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-19T06:56:27.921 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-19T06:56:27.972 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-19T06:56:28.017 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-19T06:56:28.018 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-19T06:56:28.160 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-19T06:56:28.208 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-19T06:56:28.257 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-19T06:56:28.296 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-19T06:56:28.338 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-19T06:56:28.380 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-19T06:56:28.453 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-19T06:56:28.551 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-19T06:56:28.593 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-19T06:56:28.625 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-19T06:56:28.659 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-19T06:56:28.693 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-19T06:56:28.726 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-19T06:56:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-19T06:56:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-19T06:56:29.068 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-19T06:56:29.068 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-19T06:56:29.199 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-19T06:56:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-19T06:56:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-19T06:56:29.329 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-19T06:56:29.387 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-19T06:56:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-19T06:56:29.788 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-19T06:56:29.788 INFO:teuthology.orchestra.run.smithi142.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-19T06:56:29.789 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 1/202 2024-02-19T06:56:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2/202 2024-02-19T06:56:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 3/202 2024-02-19T06:56:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 4/202 2024-02-19T06:56:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1514.g25296 5/202 2024-02-19T06:56:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 6/202 2024-02-19T06:56:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 7/202 2024-02-19T06:56:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 8/202 2024-02-19T06:56:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 9/202 2024-02-19T06:56:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 10/202 2024-02-19T06:56:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-19T06:56:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-19T06:56:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-19T06:56:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 14/202 2024-02-19T06:56:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 15/202 2024-02-19T06:56:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-19T06:56:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 17/202 2024-02-19T06:56:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 18/202 2024-02-19T06:56:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 19/202 2024-02-19T06:56:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 20/202 2024-02-19T06:56:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 21/202 2024-02-19T06:56:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 22/202 2024-02-19T06:56:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 23/202 2024-02-19T06:56:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 24/202 2024-02-19T06:56:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 25/202 2024-02-19T06:56:34.610 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 26/202 2024-02-19T06:56:34.610 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 27/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 28/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 29/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 30/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 31/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 32/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 33/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 34/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 35/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 36/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 37/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 38/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 39/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-19T06:56:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-19T06:56:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-19T06:56:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-19T06:56:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-19T06:56:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-19T06:56:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-19T06:56:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-19T06:56:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-19T06:56:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-19T06:56:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-19T06:56:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-19T06:56:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-19T06:56:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-19T06:56:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-19T06:56:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-19T06:56:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-19T06:56:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-19T06:56:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-19T06:56:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-19T06:56:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-19T06:56:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-19T06:56:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-19T06:56:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-19T06:56:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-19T06:56:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-19T06:56:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-19T06:56:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-19T06:56:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-19T06:56:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-19T06:56:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-19T06:56:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-19T06:56:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-19T06:56:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-19T06:56:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-19T06:56:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-19T06:56:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-19T06:56:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-19T06:56:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-19T06:56:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-19T06:56:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-19T06:56:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-19T06:56:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-19T06:56:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-19T06:56:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-19T06:56:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-19T06:56:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-19T06:56:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-19T06:56:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-19T06:56:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-19T06:56:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-19T06:56:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-19T06:56:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-19T06:56:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-19T06:56:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-19T06:56:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-19T06:56:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-19T06:56:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-19T06:56:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-19T06:56:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-19T06:56:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-19T06:56:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-19T06:56:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-19T06:56:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-19T06:56:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-19T06:56:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-19T06:56:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-19T06:56:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-19T06:56:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-19T06:56:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-19T06:56:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-19T06:56:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-19T06:56:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-19T06:56:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-19T06:56:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-19T06:56:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-19T06:56:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-19T06:56:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-19T06:56:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-19T06:56:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-19T06:56:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-19T06:56:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-19T06:56:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-19T06:56:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-19T06:56:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 151/202 2024-02-19T06:56:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-19T06:56:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-19T06:56:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-19T06:56:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-19T06:56:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-19T06:56:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-19T06:56:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-19T06:56:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-19T06:56:37.212 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-19T06:56:37.212 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:37.212 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-02-19T06:56:37.212 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-19T06:56:37.212 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-19T06:56:37.212 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-19T06:56:37.212 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-19T06:56:37.212 INFO:teuthology.orchestra.run.smithi142.stdout: acl-2.3.1-4.el9.x86_64 2024-02-19T06:56:37.212 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-19T06:56:37.212 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-19T06:56:37.213 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.2-8.el9.noarch 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.7.4-5.el9.x86_64 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.214 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:56:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:56:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:56:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:56:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:56:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:56:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:56:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:56:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:56:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-19T06:56:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-19T06:56:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.4-9.el9.x86_64 2024-02-19T06:56:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-19T06:56:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-19T06:56:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-19T06:56:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-19T06:56:37.217 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-19T06:56:37.217 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-19T06:56:37.217 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.6-16.el9.x86_64 2024-02-19T06:56:37.217 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-19T06:56:37.217 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-19T06:56:37.217 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-19T06:56:37.217 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.217 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.217 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.217 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-19T06:56:37.217 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-19T06:56:37.217 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-19T06:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-19T06:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-19T06:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-19T06:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-19T06:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-19T06:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-19T06:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-19T06:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-19T06:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2024-02-19T06:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-13.11-1.el9.x86_64 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-19T06:56:37.219 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-19T06:56:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-19T06:56:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-19T06:56:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-19T06:56:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-19T06:56:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-19T06:56:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-19T06:56:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-19T06:56:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-19T06:56:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-19T06:56:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-19T06:56:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-19T06:56:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-19T06:56:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-19T06:56:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-19T06:56:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-19T06:56:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-19T06:56:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-19T06:56:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-19T06:56:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-19T06:56:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-19T06:56:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-19T06:56:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-19T06:56:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-19T06:56:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-19T06:56:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-19T06:56:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-19T06:56:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-19T06:56:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-19T06:56:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-19T06:56:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-19T06:56:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-19T06:56:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-19T06:56:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-19T06:56:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-19T06:56:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-3.el9.x86_64 2024-02-19T06:56:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-19T06:56:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-19T06:56:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-19T06:56:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-19T06:56:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-19T06:56:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-19T06:56:37.226 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:37.226 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T06:56:37.951 DEBUG:teuthology.parallel:result is None 2024-02-19T06:56:37.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-19T06:56:38.096 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-19T06:56:38.175 INFO:teuthology.orchestra.run.smithi046.stdout:19.0.0-1514.g25296a8f.el9 2024-02-19T06:56:38.175 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1514.g25296a8f.el9 2024-02-19T06:56:38.175 INFO:teuthology.task.install:The correct ceph version 19.0.0-1514.g25296a8f is installed. 2024-02-19T06:56:38.177 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-19T06:56:38.395 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-19T06:56:38.450 INFO:teuthology.orchestra.run.smithi142.stdout:19.0.0-1514.g25296a8f.el9 2024-02-19T06:56:38.450 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1514.g25296a8f.el9 2024-02-19T06:56:38.450 INFO:teuthology.task.install:The correct ceph version 19.0.0-1514.g25296a8f is installed. 2024-02-19T06:56:38.452 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-19T06:56:38.452 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:56:38.453 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-19T06:56:38.563 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:56:38.563 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-19T06:56:38.644 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-19T06:56:38.644 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:56:38.644 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-02-19T06:56:38.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-19T06:56:38.851 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:56:38.851 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-02-19T06:56:38.929 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-19T06:56:39.039 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-19T06:56:39.039 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:56:39.039 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-19T06:56:39.143 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-19T06:56:39.289 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:56:39.289 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-19T06:56:39.364 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-19T06:56:39.476 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-19T06:56:39.476 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:56:39.476 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-02-19T06:56:39.583 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-19T06:56:39.689 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:56:39.689 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-02-19T06:56:39.767 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-19T06:56:39.882 INFO:teuthology.run_tasks:Running task ceph... 2024-02-19T06:56:39.960 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-19T06:56:39.961 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2024-02-19T06:56:39.968 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-02-19T06:56:40.056 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-19T06:56:40.056 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-19T06:56:40.061 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-19T06:56:40.152 INFO:tasks.ceph:Creating extra log directories... 2024-02-19T06:56:40.152 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-19T06:56:40.159 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-19T06:56:40.259 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-02-19T06:56:40.259 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-02-19T06:56:40.260 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-02-19T06:56:40.260 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:56:40.260 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-19T06:56:40.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-19T06:56:40.603 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-19T06:56:40.711 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:56:40.712 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-19T06:56:40.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-19T06:56:40.967 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-19T06:56:41.044 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-19T06:56:41.045 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-19T06:56:41.045 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566145', 'branch': 'wip-vshankar-testing-20240216.060239', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7566145', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8d59ab0bd93c806231018a6729893bf309624262'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240216.060239'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240216.060239', 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8780, 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'sleep_before_teardown': 0, 'subset': '669/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240216.060239', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_25296a8f176256aea5ed8b5850b25167dce0ae33/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCRwEqQUB0oGPS+8VezED5jT+Def1467E1i1lJkuWvaJ3Sabp3+5KeluxXag7qGvwpMzSW2LbO2ky51pIqLp9ko=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOu7dUQvGBMCo6lD45JCEYWKDYPKDCnUGkeliFEJ+PhMRVo9YmePA3uDYWpOhAUQF9/NmDIyeniAeolTA2gxiFk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8d59ab0bd93c806231018a6729893bf309624262'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-19_06:18:55', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-19T06:56:41.045 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-19T06:56:41.052 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-19T06:56:41.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2024-02-19T06:56:41.113 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-02-19T06:56:41.207 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:56:41.208 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-02-19T06:56:41.265 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-19T06:56:41.266 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-02-19T06:56:41.319 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-19T06:56:41.320 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T06:56:41.320 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 772 Links: 1 2024-02-19T06:56:41.320 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T06:56:41.320 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T06:56:41.320 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-02-19 06:55:50.392367498 +0000 2024-02-19T06:56:41.320 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-02-19 06:50:36.924515279 +0000 2024-02-19T06:56:41.320 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-02-19 06:50:36.924515279 +0000 2024-02-19T06:56:41.320 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-02-19 06:50:36.924515279 +0000 2024-02-19T06:56:41.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-19T06:56:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-02-19T06:56:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-02-19T06:56:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000235665 s, 2.2 MB/s 2024-02-19T06:56:41.419 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-19T06:56:41.480 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-02-19T06:56:41.535 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-19T06:56:41.535 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T06:56:41.535 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 788 Links: 1 2024-02-19T06:56:41.535 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T06:56:41.535 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T06:56:41.535 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-02-19 06:55:50.392367498 +0000 2024-02-19T06:56:41.535 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-02-19 06:50:37.498508912 +0000 2024-02-19T06:56:41.535 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-02-19 06:50:37.498508912 +0000 2024-02-19T06:56:41.535 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-02-19 06:50:37.498508912 +0000 2024-02-19T06:56:41.535 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-19T06:56:41.633 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-02-19T06:56:41.633 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-02-19T06:56:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000254256 s, 2.0 MB/s 2024-02-19T06:56:41.638 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-19T06:56:41.700 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-02-19T06:56:41.751 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-19T06:56:41.751 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T06:56:41.751 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 810 Links: 1 2024-02-19T06:56:41.751 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T06:56:41.751 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T06:56:41.751 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-02-19 06:55:50.393367487 +0000 2024-02-19T06:56:41.751 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-02-19 06:50:38.071502555 +0000 2024-02-19T06:56:41.751 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-02-19 06:50:38.071502555 +0000 2024-02-19T06:56:41.752 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-02-19 06:50:38.071502555 +0000 2024-02-19T06:56:41.752 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-19T06:56:41.847 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-02-19T06:56:41.847 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-02-19T06:56:41.847 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000231676 s, 2.2 MB/s 2024-02-19T06:56:41.852 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-19T06:56:41.912 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-02-19T06:56:41.965 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-19T06:56:41.965 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T06:56:41.965 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 826 Links: 1 2024-02-19T06:56:41.966 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T06:56:41.966 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T06:56:41.966 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-02-19 06:55:50.394367476 +0000 2024-02-19T06:56:41.966 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-02-19 06:50:38.660496022 +0000 2024-02-19T06:56:41.966 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-02-19 06:50:38.660496022 +0000 2024-02-19T06:56:41.966 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-02-19 06:50:38.660496022 +0000 2024-02-19T06:56:41.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-19T06:56:42.059 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-02-19T06:56:42.059 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-02-19T06:56:42.059 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000223149 s, 2.3 MB/s 2024-02-19T06:56:42.063 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-19T06:56:42.120 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-19T06:56:42.120 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:56:42.121 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-02-19T06:56:42.163 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-19T06:56:42.164 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-02-19T06:56:42.245 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-19T06:56:42.246 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T06:56:42.246 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-02-19T06:56:42.246 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T06:56:42.246 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T06:56:42.246 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-19 06:56:30.253467003 +0000 2024-02-19T06:56:42.246 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-19 06:50:18.660830255 +0000 2024-02-19T06:56:42.246 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-19 06:50:18.660830255 +0000 2024-02-19T06:56:42.246 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-19 06:50:18.660830255 +0000 2024-02-19T06:56:42.246 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-19T06:56:42.351 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-19T06:56:42.351 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-19T06:56:42.351 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000361512 s, 1.4 MB/s 2024-02-19T06:56:42.354 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-19T06:56:42.391 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-02-19T06:56:42.470 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-19T06:56:42.471 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T06:56:42.471 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-02-19T06:56:42.471 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T06:56:42.471 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T06:56:42.471 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-19 06:56:30.253467003 +0000 2024-02-19T06:56:42.471 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-19 06:50:19.235819850 +0000 2024-02-19T06:56:42.471 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-19 06:50:19.235819850 +0000 2024-02-19T06:56:42.471 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-19 06:50:19.235819850 +0000 2024-02-19T06:56:42.471 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-19T06:56:42.574 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-19T06:56:42.574 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-19T06:56:42.574 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000287247 s, 1.8 MB/s 2024-02-19T06:56:42.577 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-19T06:56:42.613 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-02-19T06:56:42.698 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-19T06:56:42.698 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T06:56:42.698 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-02-19T06:56:42.698 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T06:56:42.698 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T06:56:42.698 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-19 06:56:30.254466984 +0000 2024-02-19T06:56:42.698 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-19 06:50:19.830809086 +0000 2024-02-19T06:56:42.698 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-19 06:50:19.830809086 +0000 2024-02-19T06:56:42.698 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-19 06:50:19.830809086 +0000 2024-02-19T06:56:42.699 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-19T06:56:42.822 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-19T06:56:42.822 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-19T06:56:42.822 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000300176 s, 1.7 MB/s 2024-02-19T06:56:42.826 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-19T06:56:42.878 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-02-19T06:56:42.925 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-19T06:56:42.925 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T06:56:42.925 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-02-19T06:56:42.925 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T06:56:42.925 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T06:56:42.925 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-19 06:56:30.254466984 +0000 2024-02-19T06:56:42.926 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-19 06:50:20.400798774 +0000 2024-02-19T06:56:42.926 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-19 06:50:20.400798774 +0000 2024-02-19T06:56:42.926 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-19 06:50:20.400798774 +0000 2024-02-19T06:56:42.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-19T06:56:43.057 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-19T06:56:43.057 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-19T06:56:43.057 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000329329 s, 1.6 MB/s 2024-02-19T06:56:43.061 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-19T06:56:43.112 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-19T06:56:43.112 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-19T06:56:43.112 INFO:tasks.ceph:Generating config... 2024-02-19T06:56:43.114 INFO:tasks.ceph:[client] client mount timeout = 600 2024-02-19T06:56:43.114 INFO:tasks.ceph:[client] debug client = 20 2024-02-19T06:56:43.114 INFO:tasks.ceph:[client] debug ms = 1 2024-02-19T06:56:43.114 INFO:tasks.ceph:[client] pid file = 2024-02-19T06:56:43.114 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-02-19T06:56:43.114 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-02-19T06:56:43.114 INFO:tasks.ceph:[mds] debug mds = 20 2024-02-19T06:56:43.114 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-02-19T06:56:43.114 INFO:tasks.ceph:[mds] debug ms = 1 2024-02-19T06:56:43.114 INFO:tasks.ceph:[mds] mds debug frag = True 2024-02-19T06:56:43.114 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-02-19T06:56:43.115 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-02-19T06:56:43.115 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-02-19T06:56:43.115 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-02-19T06:56:43.115 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-02-19T06:56:43.115 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-02-19T06:56:43.115 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-19T06:56:43.115 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-19T06:56:43.115 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-19T06:56:43.115 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-19T06:56:43.115 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-19T06:56:43.115 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-02-19T06:56:43.115 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-19T06:56:43.115 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-19T06:56:43.115 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-19T06:56:43.115 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-19T06:56:43.116 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-19T06:56:43.116 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-19T06:56:43.116 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-02-19T06:56:43.116 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-19T06:56:43.116 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-19T06:56:43.116 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-19T06:56:43.116 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-19T06:56:43.116 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-19T06:56:43.116 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-19T06:56:43.116 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-19T06:56:43.116 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-19T06:56:43.116 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-02-19T06:56:43.117 INFO:tasks.ceph:Setting up mon.a... 2024-02-19T06:56:43.117 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-19T06:56:43.266 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2024-02-19T06:56:43.276 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-19T06:56:43.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-19T06:56:43.510 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46'), ('mon.b', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]')] 2024-02-19T06:56:43.510 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-02-19T06:56:43.511 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:56:43.511 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-19T06:56:43.568 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --add b 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:56:43.731 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:56:43.731 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid 858a958e-c459-4ec6-89ff-1327e8665984 2024-02-19T06:56:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = quincy 2024-02-19T06:56:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2024-02-19T06:56:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:fsid 858a958e-c459-4ec6-89ff-1327e8665984 2024-02-19T06:56:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2024-02-19T06:56:43.730990+0000 2024-02-19T06:56:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T06:56:43.730990+0000 2024-02-19T06:56:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 17 (quincy) 2024-02-19T06:56:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2024-02-19T06:56:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-02-19T06:56:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.b 2024-02-19T06:56:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-19T06:56:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-19T06:56:43.735 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-19T06:56:43.787 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 858a958e-c459-4ec6-89ff-1327e8665984... 2024-02-19T06:56:43.788 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-19T06:56:43.793 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-19T06:56:43.951 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-02-19T06:56:43.951 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-02-19T06:56:43.951 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-19T06:56:43.951 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-02-19T06:56:43.951 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.951 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-02-19T06:56:43.951 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.951 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-02-19T06:56:43.951 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-02-19T06:56:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-02-19T06:56:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-02-19T06:56:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-02-19T06:56:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-19T06:56:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-02-19T06:56:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-02-19T06:56:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-19T06:56:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-19T06:56:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.46,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 858a958e-c459-4ec6-89ff-1327e8665984 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-02-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-02-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-02-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-02-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-02-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-02-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-02-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-02-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: bdev async discard = True 2024-02-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: bdev enable discard = True 2024-02-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore allocator = bitmap 2024-02-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 1/20 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 1/20 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 4/10 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-02-19T06:56:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-02-19T06:56:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-02-19T06:56:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-02-19T06:56:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2024-02-19T06:56:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T06:56:43.960 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-02-19T06:56:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-02-19T06:56:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-02-19T06:56:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-02-19T06:56:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-19T06:56:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-19T06:56:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2024-02-19T06:56:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2024-02-19T06:56:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds balancer = 20 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-19T06:56:43.961 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2024-02-19T06:56:43.962 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2024-02-19T06:56:43.962 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2024-02-19T06:56:43.962 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2024-02-19T06:56:43.962 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-02-19T06:56:43.962 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-02-19T06:56:43.962 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-02-19T06:56:43.966 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-02-19T06:56:43.966 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2024-02-19T06:56:43.966 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-19T06:56:43.966 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2024-02-19T06:56:43.966 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.966 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2024-02-19T06:56:43.966 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.966 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2024-02-19T06:56:43.966 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2024-02-19T06:56:43.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.968 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = "172.21.15.46,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 858a958e-c459-4ec6-89ff-1327e8665984 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2024-02-19T06:56:43.969 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug trim objects = true 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2024-02-19T06:56:43.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: bdev async discard = True 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: bdev enable discard = True 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore allocator = bitmap 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore block size = 96636764160 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore fsck on mount = True 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluefs = 1/20 2024-02-19T06:56:43.971 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluestore = 1/20 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout: debug rocksdb = 4/10 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd backfillfull_ratio = 0.85 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd full ratio = 0.9 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd nearfull ratio = 0.8 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout: osd failsafe full ratio = 0.95 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = bluestore 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2024-02-19T06:56:43.972 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-02-19T06:56:43.973 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-02-19T06:56:43.973 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-02-19T06:56:43.973 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-02-19T06:56:43.973 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2024-02-19T06:56:43.973 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.973 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2024-02-19T06:56:43.973 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-02-19T06:56:43.973 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-02-19T06:56:43.973 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2024-02-19T06:56:43.973 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-19T06:56:43.975 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout: mon op complaint time = 120 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout: client mount timeout = 600 2024-02-19T06:56:43.976 INFO:teuthology.orchestra.run.smithi046.stdout: debug client = 20 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = "" 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.b] 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.c] 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout:[mds] 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds = 20 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds balancer = 20 2024-02-19T06:56:43.977 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-02-19T06:56:43.978 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug frag = True 2024-02-19T06:56:43.978 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug scatterstat = True 2024-02-19T06:56:43.978 INFO:teuthology.orchestra.run.smithi046.stdout: mds op complaint time = 180 2024-02-19T06:56:43.978 INFO:teuthology.orchestra.run.smithi046.stdout: mds verify scatter = True 2024-02-19T06:56:43.978 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-02-19T06:56:43.978 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-02-19T06:56:43.978 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-02-19T06:56:44.013 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-19T06:56:44.013 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-19T06:56:44.173 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-19T06:56:44.173 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:56:44.173 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-19T06:56:44.226 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:56:44.226 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-19T06:56:44.278 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T06:56:44.279 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:56:44.279 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-19T06:56:44.279 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-19T06:56:44.422 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:56:44.422 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:56:44.523 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T06:56:44.523 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:56:44.523 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-19T06:56:44.523 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-19T06:56:44.671 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:56:44.671 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:56:44.766 INFO:tasks.ceph:Setting up mon nodes... 2024-02-19T06:56:44.766 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-19T06:56:44.766 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-19T06:56:44.962 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-19T06:56:45.166 INFO:tasks.ceph:Setting up mds nodes... 2024-02-19T06:56:45.166 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-02-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-02-19T06:56:45.379 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-02-19T06:56:45.484 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-02-19T06:56:45.672 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-02-19T06:56:45.681 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-02-19T06:56:45.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-02-19T06:56:45.969 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-02-19T06:56:45.978 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-02-19T06:56:46.071 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-02-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-02-19T06:56:46.256 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-02-19T06:56:46.350 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-19T06:56:46.351 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-19T06:56:46.489 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-19T06:56:46.555 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-02-19T06:56:46.689 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-02-19T06:56:46.753 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-19T06:56:46.883 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-02-19T06:56:46.934 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-02-19T06:56:47.052 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-02-19T06:56:47.111 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-19T06:56:47.111 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-19T06:56:47.111 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-19T06:56:47.216 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-19T06:56:47.216 INFO:tasks.ceph:role: osd.0 2024-02-19T06:56:47.216 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T06:56:47.216 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-19T06:56:47.315 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-19T06:56:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-19T06:56:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-19T06:56:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-19T06:56:47.315 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-19T06:56:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-02-19T06:56:47.316 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-19T06:56:47.316 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-19T06:56:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-19T06:56:47.316 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-19T06:56:47.348 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-02-19T06:56:47.355 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-02-19T06:56:47.355 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-19T06:56:47.476 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-19T06:56:47.565 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-19T06:56:47.656 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-19T06:56:47.657 INFO:tasks.ceph:role: osd.1 2024-02-19T06:56:47.657 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T06:56:47.657 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-19T06:56:47.755 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-19T06:56:47.755 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-19T06:56:47.755 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-19T06:56:47.755 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-19T06:56:47.755 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-19T06:56:47.755 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-02-19T06:56:47.755 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-19T06:56:47.755 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-19T06:56:47.755 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-19T06:56:47.755 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-19T06:56:47.789 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-02-19T06:56:47.795 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-02-19T06:56:47.796 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-02-19T06:56:47.911 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-19T06:56:47.999 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-19T06:56:48.088 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-19T06:56:48.088 INFO:tasks.ceph:role: osd.2 2024-02-19T06:56:48.088 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T06:56:48.088 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-19T06:56:48.188 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-19T06:56:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-19T06:56:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-19T06:56:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-19T06:56:48.189 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-19T06:56:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-02-19T06:56:48.189 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-19T06:56:48.189 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-19T06:56:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-19T06:56:48.189 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-19T06:56:48.222 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-02-19T06:56:48.228 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-02-19T06:56:48.228 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-02-19T06:56:48.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-19T06:56:48.445 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-19T06:56:48.540 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-19T06:56:48.541 INFO:tasks.ceph:role: osd.3 2024-02-19T06:56:48.541 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T06:56:48.541 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-19T06:56:48.636 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-19T06:56:48.637 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-19T06:56:48.637 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-19T06:56:48.637 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-19T06:56:48.637 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-19T06:56:48.637 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-02-19T06:56:48.637 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-19T06:56:48.637 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-19T06:56:48.637 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-19T06:56:48.637 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-19T06:56:48.673 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-02-19T06:56:48.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-02-19T06:56:48.679 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-02-19T06:56:48.795 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-19T06:56:48.874 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:56:49.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:49.012+0000 7f3c228d7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-19T06:56:49.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:49.012+0000 7f3c228d7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-19T06:56:49.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:49.013+0000 7f3c228d7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-19T06:56:49.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:49.013+0000 7f3c228d7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-19T06:56:49.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:49.013+0000 7f3c228d7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-19T06:56:49.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:49.016+0000 7f3c228d7640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-19T06:56:51.946 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-19T06:56:52.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:52.194+0000 7f3982611640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:52.196+0000 7f3982611640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:52.196+0000 7f3982611640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:52.196+0000 7f3982611640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:52.196+0000 7f3982611640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-19T06:56:52.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:52.197+0000 7f3982611640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-19T06:56:55.386 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-19T06:56:55.492 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:56:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:55.638+0000 7f2c9e79a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-19T06:56:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:55.638+0000 7f2c9e79a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-19T06:56:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:55.639+0000 7f2c9e79a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-19T06:56:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:55.639+0000 7f2c9e79a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-19T06:56:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:55.639+0000 7f2c9e79a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-19T06:56:55.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:55.641+0000 7f2c9e79a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-19T06:56:58.817 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-19T06:56:58.920 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:56:59.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:59.059+0000 7f7ac720d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-19T06:56:59.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:59.060+0000 7f7ac720d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-19T06:56:59.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:59.060+0000 7f7ac720d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-19T06:56:59.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:59.060+0000 7f7ac720d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-19T06:56:59.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:59.060+0000 7f7ac720d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-19T06:56:59.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:56:59.062+0000 7f7ac720d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-19T06:57:02.245 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-19T06:57:02.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-19T06:57:02.448 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-19T06:57:02.449 INFO:tasks.ceph:role: osd.4 2024-02-19T06:57:02.449 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T06:57:02.449 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-19T06:57:02.550 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-19T06:57:02.550 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-19T06:57:02.550 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-19T06:57:02.550 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-19T06:57:02.550 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-19T06:57:02.550 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-19T06:57:02.550 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-19T06:57:02.550 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-19T06:57:02.550 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-19T06:57:02.551 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-19T06:57:03.067 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-19T06:57:03.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-19T06:57:03.073 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-02-19T06:57:03.275 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-19T06:57:03.385 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-19T06:57:03.464 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-19T06:57:03.464 INFO:tasks.ceph:role: osd.5 2024-02-19T06:57:03.464 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T06:57:03.464 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-19T06:57:03.548 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-19T06:57:03.548 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-19T06:57:03.548 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-19T06:57:03.548 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-19T06:57:03.548 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-19T06:57:03.548 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-19T06:57:03.548 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-19T06:57:03.548 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-19T06:57:03.549 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-19T06:57:03.549 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-19T06:57:04.014 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-19T06:57:04.021 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-19T06:57:04.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-19T06:57:04.150 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-19T06:57:04.229 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-19T06:57:04.304 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-19T06:57:04.304 INFO:tasks.ceph:role: osd.6 2024-02-19T06:57:04.304 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T06:57:04.304 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-19T06:57:04.388 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-19T06:57:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-19T06:57:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-19T06:57:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-19T06:57:04.389 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-19T06:57:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-19T06:57:04.389 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-19T06:57:04.389 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-19T06:57:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-19T06:57:04.389 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-19T06:57:04.918 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-19T06:57:04.923 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-19T06:57:04.924 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-19T06:57:05.083 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-19T06:57:05.179 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-19T06:57:05.267 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-19T06:57:05.267 INFO:tasks.ceph:role: osd.7 2024-02-19T06:57:05.267 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T06:57:05.268 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-19T06:57:05.365 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-19T06:57:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-19T06:57:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-19T06:57:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-19T06:57:05.365 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-19T06:57:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-19T06:57:05.365 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-19T06:57:05.365 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-19T06:57:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-19T06:57:05.365 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-19T06:57:05.835 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-19T06:57:05.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-19T06:57:05.841 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-02-19T06:57:05.949 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-19T06:57:06.032 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:57:06.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:06.166+0000 7f68f1d73640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-19T06:57:06.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:06.167+0000 7f68f1d73640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-19T06:57:06.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:06.167+0000 7f68f1d73640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-19T06:57:06.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:06.167+0000 7f68f1d73640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-19T06:57:06.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:06.167+0000 7f68f1d73640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-19T06:57:06.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:06.170+0000 7f68f1d73640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-19T06:57:09.359 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-19T06:57:09.456 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:57:09.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:09.591+0000 7f0c0b6d1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-19T06:57:09.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:09.591+0000 7f0c0b6d1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-19T06:57:09.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:09.591+0000 7f0c0b6d1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-19T06:57:09.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:09.591+0000 7f0c0b6d1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-19T06:57:09.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:09.591+0000 7f0c0b6d1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-19T06:57:09.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:09.594+0000 7f0c0b6d1640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-19T06:57:11.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T06:57:11.055 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T06:57:12.782 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-19T06:57:12.874 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:57:13.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:13.005+0000 7faccbe15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-19T06:57:13.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:13.005+0000 7faccbe15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-19T06:57:13.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:13.005+0000 7faccbe15640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-19T06:57:13.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:13.005+0000 7faccbe15640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-19T06:57:13.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:13.005+0000 7faccbe15640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-19T06:57:13.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:13.008+0000 7faccbe15640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-19T06:57:16.192 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-19T06:57:16.290 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:57:16.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:16.424+0000 7f6f3fb1d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-19T06:57:16.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:16.425+0000 7f6f3fb1d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-19T06:57:16.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:16.425+0000 7f6f3fb1d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-19T06:57:16.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:16.425+0000 7f6f3fb1d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-19T06:57:16.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:16.425+0000 7f6f3fb1d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-19T06:57:16.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:16.427+0000 7f6f3fb1d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-19T06:57:19.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-19T06:57:19.696 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-19T06:57:19.696 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:57:19.696 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-19T06:57:19.804 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:57:19.804 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-02-19T06:57:19.908 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:57:19.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-02-19T06:57:20.010 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:57:20.010 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-19T06:57:20.115 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:57:20.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-19T06:57:20.221 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:57:20.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-19T06:57:20.325 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:57:20.325 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-19T06:57:20.431 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:57:20.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-19T06:57:20.529 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:57:20.530 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-02-19T06:57:20.618 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:57:20.618 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-02-19T06:57:20.705 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:57:20.705 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-19T06:57:20.837 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:57:20.837 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-19T06:57:20.920 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:57:20.920 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-19T06:57:21.053 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:57:21.053 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-19T06:57:21.148 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:57:21.148 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-19T06:57:21.208 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:57:21.208 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-02-19T06:57:21.262 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:57:21.262 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-02-19T06:57:21.319 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:57:21.319 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-02-19T06:57:21.373 INFO:tasks.ceph:Adding keys to all mons... 2024-02-19T06:57:21.373 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-19T06:57:21.381 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-19T06:57:21.472 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2024-02-19T06:57:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCs+9JlaS21OBAAGN7RdD9qajdAUx/oSt4rTg== 2024-02-19T06:57:21.472 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-02-19T06:57:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCt+9JlWPf2FRAADy8CvIJ6R6hilRbwRsDetw== 2024-02-19T06:57:21.472 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2024-02-19T06:57:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCt+9JloHoKKBAAIto0p8ISw1bsliHW4XlhxA== 2024-02-19T06:57:21.472 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCx+9JlLaLWABAAr/aqeynIX+3LXH/LdHxtxQ== 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC0+9JlZ4i1CxAAYMh4PGXVgbyTvbcRJgibig== 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC3+9JlWxMaJhAA0WqdQ3DKPD+3SGZAjXrWOA== 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC7+9JlxCScAxAANQcgw4OSY+W9S2UGcBIBFQ== 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCt+9Jlu9g2CRAARKEGi9TYB5n7ybtD5cDMtg== 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCt+9Jl6ri7ORAAYiLMnhgMt4KRWUji0/RN1A== 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCu+9JlI+6wDhAAPGbxaekSaMp4JM6hDwLS/Q== 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDC+9JlitcFChAATt3HmxFhwfWKF2+pyFKVbw== 2024-02-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2024-02-19T06:57:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDF+9JlPKNRIxAA3DGL79ZFVr1C7zE8jjbGNQ== 2024-02-19T06:57:21.474 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2024-02-19T06:57:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDJ+9Jls0VjABAAMe0SoBm2wfIELsg2aWOJUg== 2024-02-19T06:57:21.474 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2024-02-19T06:57:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDM+9JlcEhjGRAApMith0g9UEIHOo39T8iwEA== 2024-02-19T06:57:21.474 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2024-02-19T06:57:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCu+9JlV/odHRAAsbrC4WBcXYprN1RbsTyFWA== 2024-02-19T06:57:21.474 INFO:teuthology.orchestra.run.smithi142.stdout:[client.2] 2024-02-19T06:57:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCu+9JlquUWKRAA/O5D7DaL9e+akuPEU9taFA== 2024-02-19T06:57:21.474 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2024-02-19T06:57:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCu+9Jlw7OfNBAAGkbmZTqIo3aQZqhnSo34cw== 2024-02-19T06:57:21.474 INFO:teuthology.orchestra.run.smithi142.stdout:[client.3] 2024-02-19T06:57:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCv+9JlqowOAxAA1xht2AsVeHgsgho8LAj5uQ== 2024-02-19T06:57:21.475 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.y] 2024-02-19T06:57:21.475 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCs+9JlaS21OBAAGN7RdD9qajdAUx/oSt4rTg== 2024-02-19T06:57:21.475 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-02-19T06:57:21.475 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCt+9JlWPf2FRAADy8CvIJ6R6hilRbwRsDetw== 2024-02-19T06:57:21.475 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-02-19T06:57:21.475 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCt+9JloHoKKBAAIto0p8ISw1bsliHW4XlhxA== 2024-02-19T06:57:21.475 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2024-02-19T06:57:21.475 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCx+9JlLaLWABAAr/aqeynIX+3LXH/LdHxtxQ== 2024-02-19T06:57:21.475 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2024-02-19T06:57:21.475 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQC0+9JlZ4i1CxAAYMh4PGXVgbyTvbcRJgibig== 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQC3+9JlWxMaJhAA0WqdQ3DKPD+3SGZAjXrWOA== 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQC7+9JlxCScAxAANQcgw4OSY+W9S2UGcBIBFQ== 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCt+9Jlu9g2CRAARKEGi9TYB5n7ybtD5cDMtg== 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCt+9Jl6ri7ORAAYiLMnhgMt4KRWUji0/RN1A== 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCu+9JlI+6wDhAAPGbxaekSaMp4JM6hDwLS/Q== 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.4] 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDC+9JlitcFChAATt3HmxFhwfWKF2+pyFKVbw== 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.5] 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDF+9JlPKNRIxAA3DGL79ZFVr1C7zE8jjbGNQ== 2024-02-19T06:57:21.476 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.6] 2024-02-19T06:57:21.477 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDJ+9Jls0VjABAAMe0SoBm2wfIELsg2aWOJUg== 2024-02-19T06:57:21.477 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.7] 2024-02-19T06:57:21.477 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDM+9JlcEhjGRAApMith0g9UEIHOo39T8iwEA== 2024-02-19T06:57:21.477 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-02-19T06:57:21.477 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCu+9JlV/odHRAAsbrC4WBcXYprN1RbsTyFWA== 2024-02-19T06:57:21.477 INFO:teuthology.orchestra.run.smithi046.stdout:[client.2] 2024-02-19T06:57:21.477 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCu+9JlquUWKRAA/O5D7DaL9e+akuPEU9taFA== 2024-02-19T06:57:21.477 INFO:teuthology.orchestra.run.smithi046.stdout:[client.1] 2024-02-19T06:57:21.477 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCu+9Jlw7OfNBAAGkbmZTqIo3aQZqhnSo34cw== 2024-02-19T06:57:21.477 INFO:teuthology.orchestra.run.smithi046.stdout:[client.3] 2024-02-19T06:57:21.477 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCv+9JlqowOAxAA1xht2AsVeHgsgho8LAj5uQ== 2024-02-19T06:57:21.479 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-19T06:57:21.487 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-19T06:57:21.634 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-19T06:57:21.639 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-19T06:57:21.786 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-19T06:57:21.791 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-19T06:57:21.938 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:21.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:22.088 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:22.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:22.234 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:22.241 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:22.386 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:22.392 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:22.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-19T06:57:22.542 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-19T06:57:22.696 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-19T06:57:22.703 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-19T06:57:22.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-19T06:57:22.853 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-19T06:57:22.996 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:23.000 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:23.140 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:23.146 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:23.290 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:23.297 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:23.439 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:23.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-19T06:57:23.595 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-19T06:57:23.600 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-19T06:57:23.750 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-19T06:57:23.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-19T06:57:23.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-19T06:57:23.910 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-19T06:57:24.063 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-19T06:57:24.069 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-19T06:57:24.218 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-19T06:57:24.218 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-19T06:57:24.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-19T06:57:24.491 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-19T06:57:24.590 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-19T06:57:24.687 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-19T06:57:24.839 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-19T06:57:24.918 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-19T06:57:25.008 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-19T06:57:25.158 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-19T06:57:25.235 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:57:25.242 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-19T06:57:25.294 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-19T06:57:25.295 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-19T06:57:25.295 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-19T06:57:25.300 INFO:tasks.ceph.mon.a:Started 2024-02-19T06:57:25.300 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-19T06:57:25.301 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-19T06:57:25.307 INFO:tasks.ceph.mon.b:Started 2024-02-19T06:57:25.307 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-19T06:57:25.307 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-19T06:57:25.314 INFO:tasks.ceph.mon.c:Started 2024-02-19T06:57:25.314 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-19T06:57:25.314 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-19T06:57:25.314 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-19T06:57:25.320 INFO:tasks.ceph.mgr.y:Started 2024-02-19T06:57:25.320 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-19T06:57:25.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-19T06:57:25.324 INFO:tasks.ceph.mgr.x:Started 2024-02-19T06:57:25.324 INFO:tasks.ceph:Setting crush tunables to default 2024-02-19T06:57:25.325 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2024-02-19T06:57:25.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.502+0000 7eff6f000640 1 Processor -- start 2024-02-19T06:57:25.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.502+0000 7eff6f000640 1 -- start start 2024-02-19T06:57:25.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.503+0000 7eff6f000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:25.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.503+0000 7eff6f000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:25.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.503+0000 7eff6f000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff680ce630 con 0x7eff680d1950 2024-02-19T06:57:25.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.503+0000 7eff6f000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6815dfa0 con 0x7eff680d2510 2024-02-19T06:57:25.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.503+0000 7eff6f000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff680ce860 con 0x7eff6815dbc0 2024-02-19T06:57:25.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.504+0000 7eff6d000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:25.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.504+0000 7eff67400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7eff680d1950 0x7eff680d1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60316/0 (socket says 172.21.15.46:60316) 2024-02-19T06:57:25.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.504+0000 7eff67400640 1 -- 172.21.15.46:0/907378647 learned_addr learned my addr 172.21.15.46:0/907378647 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:57:25.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.504+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:25.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.504+0000 7eff6d000640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 msgr2=0x7eff680cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-19T06:57:25.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.504+0000 7eff6d000640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 msgr2=0x7eff680cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-19T06:57:25.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.504+0000 7eff6d000640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T06:57:25.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.504+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 msgr2=0x7eff680d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-19T06:57:25.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.504+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 msgr2=0x7eff680d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-19T06:57:25.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.504+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T06:57:25.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.504+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T06:57:25.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.504+0000 7eff6d000640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T06:57:25.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.705+0000 7eff6d000640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:25.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.706+0000 7eff6d000640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 msgr2=0x7eff680cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-19T06:57:25.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.706+0000 7eff6d000640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 msgr2=0x7eff680cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-19T06:57:25.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.706+0000 7eff6d000640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T06:57:25.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.706+0000 7eff6d000640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T06:57:25.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.706+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:25.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.706+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 msgr2=0x7eff680d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-19T06:57:25.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.706+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 msgr2=0x7eff680d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-19T06:57:25.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.706+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T06:57:25.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:25.706+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T06:57:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.107+0000 7eff6d000640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.107+0000 7eff6d000640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 msgr2=0x7eff680cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-19T06:57:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.107+0000 7eff6d000640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 msgr2=0x7eff680cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-19T06:57:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.107+0000 7eff6d000640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T06:57:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.108+0000 7eff6d000640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-19T06:57:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.108+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:26.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.108+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 msgr2=0x7eff680d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-19T06:57:26.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.108+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 msgr2=0x7eff680d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-19T06:57:26.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.108+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T06:57:26.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.108+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-19T06:57:26.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.909+0000 7eff6d000640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.910+0000 7eff6d000640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 msgr2=0x7eff680cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-19T06:57:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.910+0000 7eff6d000640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 msgr2=0x7eff680cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-19T06:57:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.910+0000 7eff6d000640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T06:57:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.910+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.910+0000 7eff6d000640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-19T06:57:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.910+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 msgr2=0x7eff680d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-19T06:57:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.910+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 msgr2=0x7eff680d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-19T06:57:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.910+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T06:57:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:26.910+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-19T06:57:28.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.504+0000 7eff65600640 1 -- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 msgr2=0x7eff680d1410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-19T06:57:28.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.504+0000 7eff65600640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff6815dbc0 0x7eff680d1410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:28.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.504+0000 7eff65600640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 msgr2=0x7eff680cf900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-19T06:57:28.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.504+0000 7eff65600640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.46:3300/0 conn(0x7eff680d2510 0x7eff680cf900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:28.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.504+0000 7eff65600640 1 -- 172.21.15.46:0/907378647 >> v1:172.21.15.46:6789/0 conn(0x7eff680d1950 legacy=0x7eff680d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:28.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.504+0000 7eff65600640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:28.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.504+0000 7eff65600640 1 -- 172.21.15.46:0/907378647 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff680ceb40 con 0x7eff48006170 2024-02-19T06:57:28.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.504+0000 7eff65600640 1 -- 172.21.15.46:0/907378647 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6815dfa0 con 0x7eff480036a0 2024-02-19T06:57:28.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.505+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:28.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.505+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 msgr2=0x7eff48005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-19T06:57:28.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.505+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 msgr2=0x7eff48005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-19T06:57:28.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.505+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T06:57:28.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.505+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T06:57:28.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.706+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:28.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.707+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 msgr2=0x7eff48005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-19T06:57:28.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.707+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 msgr2=0x7eff48005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-19T06:57:28.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.707+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T06:57:28.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:28.707+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T06:57:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:29.108+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:29.109+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 msgr2=0x7eff48005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-19T06:57:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:29.109+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 msgr2=0x7eff48005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-19T06:57:29.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:29.109+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T06:57:29.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:29.109+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-19T06:57:29.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:29.910+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:29.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:29.911+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 msgr2=0x7eff48005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-19T06:57:29.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:29.911+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 msgr2=0x7eff48005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-19T06:57:29.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:29.911+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T06:57:29.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:29.911+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-19T06:57:30.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.561+0000 7eff66a00640 1 -- 172.21.15.46:0/907378647 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798806533 0 0) 0x7eff680ceb40 con 0x7eff48006170 2024-02-19T06:57:30.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.561+0000 7eff66a00640 1 -- 172.21.15.46:0/907378647 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff4c003520 con 0x7eff48006170 2024-02-19T06:57:30.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.562+0000 7eff66a00640 1 -- 172.21.15.46:0/907378647 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 88949931 0 0) 0x7eff4c003520 con 0x7eff48006170 2024-02-19T06:57:30.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.562+0000 7eff66a00640 1 -- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 msgr2=0x7eff48005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-19T06:57:30.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.562+0000 7eff66a00640 1 --2- 172.21.15.46:0/907378647 >> v2:172.21.15.142:3300/0 conn(0x7eff480036a0 0x7eff48005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:30.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.562+0000 7eff66a00640 1 -- 172.21.15.46:0/907378647 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4800aef0 con 0x7eff48006170 2024-02-19T06:57:30.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.562+0000 7eff66a00640 1 -- 172.21.15.46:0/907378647 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7eff54005110 con 0x7eff48006170 2024-02-19T06:57:30.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.563+0000 7eff66a00640 1 -- 172.21.15.46:0/907378647 >> v1:172.21.15.142:6789/0 conn(0x7eff48006170 legacy=0x7eff48008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:30.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.563+0000 7eff6d000640 1 -- 172.21.15.46:0/907378647 reap_dead start 2024-02-19T06:57:30.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.563+0000 7eff66a00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4c0039c0 0x7eff4c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:30.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.563+0000 7eff66a00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff4c0047c0 0x7eff4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:30.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.563+0000 7eff66a00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff4c005380 0x7eff4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:30.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.563+0000 7eff66a00640 1 -- 172.21.15.46:0/907378647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6815dfa0 con 0x7eff4c0039c0 2024-02-19T06:57:30.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.563+0000 7eff66a00640 1 -- 172.21.15.46:0/907378647 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c00c240 con 0x7eff4c0047c0 2024-02-19T06:57:30.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.563+0000 7eff66a00640 1 -- 172.21.15.46:0/907378647 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c00c400 con 0x7eff4c005380 2024-02-19T06:57:30.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.564+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4c0039c0 0x7eff4c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:30.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.564+0000 7eff6d000640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff4c005380 0x7eff4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.564+0000 7eff67400640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff4c0047c0 0x7eff4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.565+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff4c005380 msgr2=0x7eff4c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.565+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff4c005380 0x7eff4c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.565+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff4c0047c0 msgr2=0x7eff4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.565+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff4c0047c0 0x7eff4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.565+0000 7eff67e00640 1 -- 172.21.15.46:0/907378647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c003520 con 0x7eff4c0039c0 2024-02-19T06:57:30.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.568+0000 7eff67e00640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4c0039c0 0x7eff4c003dc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7eff58019ce0 tx=0x7eff4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57637d282bcf4772 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:30.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.572+0000 7eff66a00640 1 -- 172.21.15.46:0/907378647 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58004030 con 0x7eff4c0039c0 2024-02-19T06:57:30.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.572+0000 7eff66a00640 1 -- 172.21.15.46:0/907378647 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff580041b0 con 0x7eff4c0039c0 2024-02-19T06:57:30.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.572+0000 7eff66a00640 1 -- 172.21.15.46:0/907378647 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58003610 con 0x7eff4c0039c0 2024-02-19T06:57:30.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.574+0000 7eff6f000640 1 -- 172.21.15.46:0/907378647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4c0039c0 msgr2=0x7eff4c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:30.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.574+0000 7eff6f000640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4c0039c0 0x7eff4c003dc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7eff58019ce0 tx=0x7eff4c0057f0 comp rx=0 tx=0).stop 2024-02-19T06:57:30.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.574+0000 7eff6f000640 1 -- 172.21.15.46:0/907378647 shutdown_connections 2024-02-19T06:57:30.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.574+0000 7eff6f000640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff4c005380 0x7eff4c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:30.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.574+0000 7eff6f000640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff4c0047c0 0x7eff4c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:30.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.574+0000 7eff6f000640 1 --2- 172.21.15.46:0/907378647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4c0039c0 0x7eff4c003dc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:30.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.574+0000 7eff6f000640 1 -- 172.21.15.46:0/907378647 >> 172.21.15.46:0/907378647 conn(0x7eff6808afc0 msgr2=0x7eff680d3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:30.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.574+0000 7eff6f000640 1 -- 172.21.15.46:0/907378647 shutdown_connections 2024-02-19T06:57:30.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.575+0000 7eff6f000640 1 -- 172.21.15.46:0/907378647 wait complete. 2024-02-19T06:57:30.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.580+0000 7eff6f000640 1 Processor -- start 2024-02-19T06:57:30.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.581+0000 7eff6f000640 1 -- start start 2024-02-19T06:57:30.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.583+0000 7eff6f000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff4c0039c0 0x7eff68152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:30.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.583+0000 7eff6f000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4c0047c0 0x7eff68152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:30.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.583+0000 7eff6f000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff4c005380 0x7eff680ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:30.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.584+0000 7eff6f000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff680b18d0 con 0x7eff4c0047c0 2024-02-19T06:57:30.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.584+0000 7eff6f000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff68152b70 con 0x7eff4c005380 2024-02-19T06:57:30.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.584+0000 7eff6f000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff68153580 con 0x7eff4c0039c0 2024-02-19T06:57:30.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.584+0000 7eff67e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff4c0039c0 0x7eff68152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:30.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.584+0000 7eff67400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4c0047c0 0x7eff68152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:30.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.584+0000 7eff67e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff4c0039c0 0x7eff68152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:41430/0 (socket says 172.21.15.46:41430) 2024-02-19T06:57:30.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.584+0000 7eff67e00640 1 -- 172.21.15.46:0/255293759 learned_addr learned my addr 172.21.15.46:0/255293759 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:30.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.584+0000 7eff6d000640 1 --2- 172.21.15.46:0/255293759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff4c005380 0x7eff680ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.584+0000 7eff67e00640 1 -- 172.21.15.46:0/255293759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff4c005380 msgr2=0x7eff680ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.584+0000 7eff67e00640 1 --2- 172.21.15.46:0/255293759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff4c005380 0x7eff680ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.584+0000 7eff67e00640 1 -- 172.21.15.46:0/255293759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4c0047c0 msgr2=0x7eff68152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.584+0000 7eff67e00640 1 --2- 172.21.15.46:0/255293759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4c0047c0 0x7eff68152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.584+0000 7eff67e00640 1 -- 172.21.15.46:0/255293759 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff68153860 con 0x7eff4c0039c0 2024-02-19T06:57:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.585+0000 7eff6d000640 1 --2- 172.21.15.46:0/255293759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff4c005380 0x7eff680ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:57:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.585+0000 7eff67400640 1 --2- 172.21.15.46:0/255293759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4c0047c0 0x7eff68152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:57:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.585+0000 7eff67e00640 1 --2- 172.21.15.46:0/255293759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff4c0039c0 0x7eff68152630 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7eff58019e00 tx=0x7eff580046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.585+0000 7eff5fe00640 1 -- 172.21.15.46:0/255293759 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58003820 con 0x7eff4c0039c0 2024-02-19T06:57:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.586+0000 7eff5fe00640 1 -- 172.21.15.46:0/255293759 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff580039c0 con 0x7eff4c0039c0 2024-02-19T06:57:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.586+0000 7eff5fe00640 1 -- 172.21.15.46:0/255293759 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58003d70 con 0x7eff4c0039c0 2024-02-19T06:57:30.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.586+0000 7eff6f000640 1 -- 172.21.15.46:0/255293759 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff68153b40 con 0x7eff4c0039c0 2024-02-19T06:57:30.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.586+0000 7eff6f000640 1 -- 172.21.15.46:0/255293759 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff68154100 con 0x7eff4c0039c0 2024-02-19T06:57:30.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.586+0000 7eff5fe00640 1 -- 172.21.15.46:0/255293759 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7eff5802f500 con 0x7eff4c0039c0 2024-02-19T06:57:30.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.586+0000 7eff5fe00640 1 -- 172.21.15.46:0/255293759 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7eff58040070 con 0x7eff4c0039c0 2024-02-19T06:57:30.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.588+0000 7eff6f000640 1 -- 172.21.15.46:0/255293759 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff68154290 con 0x7eff4c0039c0 2024-02-19T06:57:30.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.591+0000 7eff5fe00640 1 -- 172.21.15.46:0/255293759 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7eff58049070 con 0x7eff4c0039c0 2024-02-19T06:57:30.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.666+0000 7eff6f000640 1 -- 172.21.15.46:0/255293759 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7eff68067ba0 con 0x7eff4c0039c0 2024-02-19T06:57:30.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.674+0000 7eff5fe00640 1 -- 172.21.15.46:0/255293759 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7eff58019960 con 0x7eff4c0039c0 2024-02-19T06:57:30.676 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-02-19T06:57:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.676+0000 7eff6f000640 1 -- 172.21.15.46:0/255293759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff4c0039c0 msgr2=0x7eff68152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.676+0000 7eff6f000640 1 --2- 172.21.15.46:0/255293759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff4c0039c0 0x7eff68152630 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7eff58019e00 tx=0x7eff580046c0 comp rx=0 tx=0).stop 2024-02-19T06:57:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.676+0000 7eff6f000640 1 -- 172.21.15.46:0/255293759 shutdown_connections 2024-02-19T06:57:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.676+0000 7eff6f000640 1 --2- 172.21.15.46:0/255293759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff4c005380 0x7eff680ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.676+0000 7eff6f000640 1 --2- 172.21.15.46:0/255293759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff4c0047c0 0x7eff68152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.676+0000 7eff6f000640 1 --2- 172.21.15.46:0/255293759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff4c0039c0 0x7eff68152630 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.676+0000 7eff6f000640 1 -- 172.21.15.46:0/255293759 >> 172.21.15.46:0/255293759 conn(0x7eff6808afc0 msgr2=0x7eff680d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.676+0000 7eff6f000640 1 -- 172.21.15.46:0/255293759 shutdown_connections 2024-02-19T06:57:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:30.676+0000 7eff6f000640 1 -- 172.21.15.46:0/255293759 wait complete. 2024-02-19T06:57:30.696 INFO:tasks.ceph:check_enable_crimson: False 2024-02-19T06:57:30.696 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-19T06:57:30.696 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:57:30.696 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-19T06:57:30.776 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:57:30.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-19T06:57:30.922 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:57:30.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-19T06:57:31.024 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:57:31.024 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-19T06:57:31.127 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:57:31.127 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-19T06:57:31.137 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:31.136+0000 7f97d0212040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-19T06:57:31.203 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:31.202+0000 7f97d0212040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-19T06:57:31.210 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:57:31.210 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-19T06:57:31.334 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:57:31.334 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-19T06:57:31.465 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:57:31.465 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-19T06:57:31.591 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 32e44df5-7121-4e93-9704-0f2a33fd2223 0 2024-02-19T06:57:31.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.828+0000 7f0bdde00640 1 Processor -- start 2024-02-19T06:57:31.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.828+0000 7f0bdde00640 1 -- start start 2024-02-19T06:57:31.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.829+0000 7f0bdde00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0bd80b19a0 0x7f0bd80d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:31.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.829+0000 7f0bdde00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0bd80d3530 0x7f0bd80d3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:31.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.829+0000 7f0bdde00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd80b0500 con 0x7f0bd815d980 2024-02-19T06:57:31.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.829+0000 7f0bdde00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd806d2d0 con 0x7f0bd80b19a0 2024-02-19T06:57:31.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.829+0000 7f0bdde00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd815dd60 con 0x7f0bd80d3530 2024-02-19T06:57:31.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.830+0000 7f0bdd400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0bd80d3530 0x7f0bd80d3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:31.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.830+0000 7f0bdca00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0bd815d980 0x7f0bd806cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:59362/0 (socket says 172.21.15.142:59362) 2024-02-19T06:57:31.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.830+0000 7f0bdca00640 1 -- 172.21.15.142:0/3843854547 learned_addr learned my addr 172.21.15.142:0/3843854547 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-02-19T06:57:31.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.830+0000 7f0bd7e00640 1 --2- 172.21.15.142:0/3843854547 >> v2:172.21.15.46:3300/0 conn(0x7f0bd80b19a0 0x7f0bd80d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:31.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.830+0000 7f0bdd400640 1 -- 172.21.15.142:0/3843854547 >> v2:172.21.15.46:3300/0 conn(0x7f0bd80b19a0 msgr2=0x7f0bd80d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:31.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.830+0000 7f0bdd400640 1 --2- 172.21.15.142:0/3843854547 >> v2:172.21.15.46:3300/0 conn(0x7f0bd80b19a0 0x7f0bd80d2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:31.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.830+0000 7f0bdd400640 1 -- 172.21.15.142:0/3843854547 >> v1:172.21.15.142:6789/0 conn(0x7f0bd815d980 legacy=0x7f0bd806cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:31.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.830+0000 7f0bdd400640 1 -- 172.21.15.142:0/3843854547 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd80b01b0 con 0x7f0bd80d3530 2024-02-19T06:57:31.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.830+0000 7f0bd7e00640 1 --2- 172.21.15.142:0/3843854547 >> v2:172.21.15.46:3300/0 conn(0x7f0bd80b19a0 0x7f0bd80d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:31.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.831+0000 7f0bdd400640 1 --2- 172.21.15.142:0/3843854547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80d3530 0x7f0bd80d3980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0bd809d170 tx=0x7f0bd002bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4e5d6ebc76e5f80 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:31.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.831+0000 7f0bd7400640 1 -- 172.21.15.142:0/3843854547 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd002cc70 con 0x7f0bd80d3530 2024-02-19T06:57:31.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.832+0000 7f0bd7400640 1 -- 172.21.15.142:0/3843854547 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd002cdd0 con 0x7f0bd80d3530 2024-02-19T06:57:31.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.832+0000 7f0bd7400640 1 -- 172.21.15.142:0/3843854547 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0034660 con 0x7f0bd80d3530 2024-02-19T06:57:31.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.832+0000 7f0bdde00640 1 -- 172.21.15.142:0/3843854547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80d3530 msgr2=0x7f0bd80d3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:31.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.832+0000 7f0bdde00640 1 --2- 172.21.15.142:0/3843854547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80d3530 0x7f0bd80d3980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0bd809d170 tx=0x7f0bd002bec0 comp rx=0 tx=0).stop 2024-02-19T06:57:31.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.832+0000 7f0bdde00640 1 -- 172.21.15.142:0/3843854547 shutdown_connections 2024-02-19T06:57:31.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.832+0000 7f0bdde00640 1 --2- 172.21.15.142:0/3843854547 >> v2:172.21.15.46:3300/0 conn(0x7f0bd80b19a0 0x7f0bd80d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:31.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.832+0000 7f0bdde00640 1 --2- 172.21.15.142:0/3843854547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80d3530 0x7f0bd80d3980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:31.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.832+0000 7f0bdde00640 1 -- 172.21.15.142:0/3843854547 >> 172.21.15.142:0/3843854547 conn(0x7f0bd809ca60 msgr2=0x7f0bd808afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:31.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.832+0000 7f0bdde00640 1 -- 172.21.15.142:0/3843854547 shutdown_connections 2024-02-19T06:57:31.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.832+0000 7f0bdde00640 1 -- 172.21.15.142:0/3843854547 wait complete. 2024-02-19T06:57:31.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.834+0000 7f0bdde00640 1 Processor -- start 2024-02-19T06:57:31.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.834+0000 7f0bdde00640 1 -- start start 2024-02-19T06:57:31.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.835+0000 7f0bdde00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80b19a0 0x7f0bd81f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:31.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.835+0000 7f0bdde00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bd80d3530 0x7f0bd81526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:31.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.835+0000 7f0bdde00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bd815d980 0x7f0bd80c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:31.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.835+0000 7f0bdde00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd8159070 con 0x7f0bd80d3530 2024-02-19T06:57:31.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.835+0000 7f0bdde00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd81f3ef0 con 0x7f0bd80b19a0 2024-02-19T06:57:31.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.835+0000 7f0bdde00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd8158460 con 0x7f0bd815d980 2024-02-19T06:57:31.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.835+0000 7f0bdca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80b19a0 0x7f0bd81f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:31.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.835+0000 7f0bdca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80b19a0 0x7f0bd81f39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47716/0 (socket says 172.21.15.142:47716) 2024-02-19T06:57:31.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.836+0000 7f0bdd400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bd815d980 0x7f0bd80c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:31.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.836+0000 7f0bdca00640 1 -- 172.21.15.142:0/2983959938 learned_addr learned my addr 172.21.15.142:0/2983959938 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T06:57:31.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.836+0000 7f0bd7e00640 1 --2- 172.21.15.142:0/2983959938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bd80d3530 0x7f0bd81526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:31.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.836+0000 7f0bdca00640 1 -- 172.21.15.142:0/2983959938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bd815d980 msgr2=0x7f0bd80c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:31.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.836+0000 7f0bdca00640 1 --2- 172.21.15.142:0/2983959938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bd815d980 0x7f0bd80c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:31.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.836+0000 7f0bdca00640 1 -- 172.21.15.142:0/2983959938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bd80d3530 msgr2=0x7f0bd81526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:31.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.836+0000 7f0bdca00640 1 --2- 172.21.15.142:0/2983959938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bd80d3530 0x7f0bd81526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:31.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.836+0000 7f0bdca00640 1 -- 172.21.15.142:0/2983959938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd0009a70 con 0x7f0bd80b19a0 2024-02-19T06:57:31.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.836+0000 7f0bdca00640 1 --2- 172.21.15.142:0/2983959938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80b19a0 0x7f0bd81f39b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00c3c0 tx=0x7f0bcc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:31.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.837+0000 7f0bd4c00640 1 -- 172.21.15.142:0/2983959938 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0074e0 con 0x7f0bd80b19a0 2024-02-19T06:57:31.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.837+0000 7f0bd4c00640 1 -- 172.21.15.142:0/2983959938 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc007640 con 0x7f0bd80b19a0 2024-02-19T06:57:31.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.837+0000 7f0bd4c00640 1 -- 172.21.15.142:0/2983959938 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0059a0 con 0x7f0bd80b19a0 2024-02-19T06:57:31.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.837+0000 7f0bdde00640 1 -- 172.21.15.142:0/2983959938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd8158740 con 0x7f0bd80b19a0 2024-02-19T06:57:31.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.837+0000 7f0bdde00640 1 -- 172.21.15.142:0/2983959938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd8158d00 con 0x7f0bd80b19a0 2024-02-19T06:57:31.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.837+0000 7f0bd4c00640 1 -- 172.21.15.142:0/2983959938 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0bcc005b00 con 0x7f0bd80b19a0 2024-02-19T06:57:31.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.837+0000 7f0bd4c00640 1 -- 172.21.15.142:0/2983959938 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0bcc012780 con 0x7f0bd80b19a0 2024-02-19T06:57:31.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.838+0000 7f0bdde00640 1 -- 172.21.15.142:0/2983959938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd8158e90 con 0x7f0bd80b19a0 2024-02-19T06:57:31.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.841+0000 7f0bd4c00640 1 -- 172.21.15.142:0/2983959938 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0bcc021060 con 0x7f0bd80b19a0 2024-02-19T06:57:31.842 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:31.841+0000 7f97d0212040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-19T06:57:31.906 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:31.905+0000 7f97d0212040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-19T06:57:31.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.920+0000 7f0bdde00640 1 -- 172.21.15.142:0/2983959938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "32e44df5-7121-4e93-9704-0f2a33fd2223", "id": 0} v 0) v1 -- 0x7f0bd804eee0 con 0x7f0bd80b19a0 2024-02-19T06:57:31.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.927+0000 7f0bd4c00640 1 -- 172.21.15.142:0/2983959938 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "32e44df5-7121-4e93-9704-0f2a33fd2223", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0bcc017070 con 0x7f0bd80b19a0 2024-02-19T06:57:31.929 INFO:teuthology.orchestra.run.smithi142.stdout:0 2024-02-19T06:57:31.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.929+0000 7f0bdde00640 1 -- 172.21.15.142:0/2983959938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80b19a0 msgr2=0x7f0bd81f39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:31.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.929+0000 7f0bdde00640 1 --2- 172.21.15.142:0/2983959938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80b19a0 0x7f0bd81f39b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00c3c0 tx=0x7f0bcc00c880 comp rx=0 tx=0).stop 2024-02-19T06:57:31.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.929+0000 7f0bdde00640 1 -- 172.21.15.142:0/2983959938 shutdown_connections 2024-02-19T06:57:31.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.929+0000 7f0bdde00640 1 --2- 172.21.15.142:0/2983959938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bd815d980 0x7f0bd80c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:31.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.929+0000 7f0bdde00640 1 --2- 172.21.15.142:0/2983959938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bd80d3530 0x7f0bd81526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:31.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.929+0000 7f0bdde00640 1 --2- 172.21.15.142:0/2983959938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bd80b19a0 0x7f0bd81f39b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:31.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.929+0000 7f0bdde00640 1 -- 172.21.15.142:0/2983959938 >> 172.21.15.142:0/2983959938 conn(0x7f0bd809ca60 msgr2=0x7f0bd815e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:31.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.930+0000 7f0bdde00640 1 -- 172.21.15.142:0/2983959938 shutdown_connections 2024-02-19T06:57:31.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:31.930+0000 7f0bdde00640 1 -- 172.21.15.142:0/2983959938 wait complete. 2024-02-19T06:57:31.947 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd 1 2024-02-19T06:57:31.960 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:31.960+0000 7f97d0212040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-19T06:57:32.027 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:32.026+0000 7f97d0212040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-19T06:57:32.079 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:32.078+0000 7f97d0212040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-19T06:57:32.103 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:32.102+0000 7fd4ab613040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-19T06:57:32.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.135+0000 7f5b7b200640 1 Processor -- start 2024-02-19T06:57:32.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.135+0000 7f5b7b200640 1 -- start start 2024-02-19T06:57:32.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.137+0000 7f5b7b200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5b7c15d980 0x7f5b7c0d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.137+0000 7f5b7b200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5b7c06cbc0 0x7f5b7c0d3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.137+0000 7f5b7b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06d010 0x7f5b7c0d3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.137+0000 7f5b7b200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c0d3fb0 con 0x7f5b7c15d980 2024-02-19T06:57:32.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.137+0000 7f5b7b200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c0b0500 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.137+0000 7f5b7b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c15dd60 con 0x7f5b7c06d010 2024-02-19T06:57:32.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.137+0000 7f5b79400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5b7c06cbc0 0x7f5b7c0d3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.137+0000 7f5b7a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06d010 0x7f5b7c0d3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.137+0000 7f5b79400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5b7c06cbc0 0x7f5b7c0d3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47728/0 (socket says 172.21.15.142:47728) 2024-02-19T06:57:32.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.137+0000 7f5b79400640 1 -- 172.21.15.142:0/2500148878 learned_addr learned my addr 172.21.15.142:0/2500148878 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T06:57:32.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.137+0000 7f5b7a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06d010 0x7f5b7c0d3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:59896/0 (socket says 172.21.15.142:59896) 2024-02-19T06:57:32.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.138+0000 7f5b79e00640 1 --2- 172.21.15.142:0/2500148878 >> v2:172.21.15.46:3300/0 conn(0x7f5b7c15d980 0x7f5b7c0d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.138+0000 7f5b7a800640 1 -- 172.21.15.142:0/2500148878 >> v2:172.21.15.142:3300/0 conn(0x7f5b7c06cbc0 msgr2=0x7f5b7c0d3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:32.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.138+0000 7f5b7a800640 1 --2- 172.21.15.142:0/2500148878 >> v2:172.21.15.142:3300/0 conn(0x7f5b7c06cbc0 0x7f5b7c0d3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.138+0000 7f5b7a800640 1 -- 172.21.15.142:0/2500148878 >> v2:172.21.15.46:3300/0 conn(0x7f5b7c15d980 msgr2=0x7f5b7c0d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:32.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.138+0000 7f5b7a800640 1 --2- 172.21.15.142:0/2500148878 >> v2:172.21.15.46:3300/0 conn(0x7f5b7c15d980 0x7f5b7c0d2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.138+0000 7f5b7a800640 1 -- 172.21.15.142:0/2500148878 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0b01b0 con 0x7f5b7c06d010 2024-02-19T06:57:32.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.139+0000 7f5b7a800640 1 --2- 172.21.15.142:0/2500148878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06d010 0x7f5b7c0d3a70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0b03a0 tx=0x7f5b7402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5cac18eadab9c89 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:32.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.139+0000 7f5b78a00640 1 -- 172.21.15.142:0/2500148878 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7402cbd0 con 0x7f5b7c06d010 2024-02-19T06:57:32.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.139+0000 7f5b78a00640 1 -- 172.21.15.142:0/2500148878 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7402cd30 con 0x7f5b7c06d010 2024-02-19T06:57:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.139+0000 7f5b78a00640 1 -- 172.21.15.142:0/2500148878 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7402cea0 con 0x7f5b7c06d010 2024-02-19T06:57:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.140+0000 7f5b7b200640 1 -- 172.21.15.142:0/2500148878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06d010 msgr2=0x7f5b7c0d3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.140+0000 7f5b7b200640 1 --2- 172.21.15.142:0/2500148878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06d010 0x7f5b7c0d3a70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0b03a0 tx=0x7f5b7402be20 comp rx=0 tx=0).stop 2024-02-19T06:57:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.140+0000 7f5b7b200640 1 -- 172.21.15.142:0/2500148878 shutdown_connections 2024-02-19T06:57:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.140+0000 7f5b7b200640 1 --2- 172.21.15.142:0/2500148878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06d010 0x7f5b7c0d3a70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.140+0000 7f5b7b200640 1 --2- 172.21.15.142:0/2500148878 >> v2:172.21.15.142:3300/0 conn(0x7f5b7c06cbc0 0x7f5b7c0d3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.140+0000 7f5b7b200640 1 --2- 172.21.15.142:0/2500148878 >> v2:172.21.15.46:3300/0 conn(0x7f5b7c15d980 0x7f5b7c0d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.140+0000 7f5b7b200640 1 -- 172.21.15.142:0/2500148878 >> 172.21.15.142:0/2500148878 conn(0x7f5b7c09ca60 msgr2=0x7f5b7c08afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:32.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.140+0000 7f5b7b200640 1 -- 172.21.15.142:0/2500148878 shutdown_connections 2024-02-19T06:57:32.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.140+0000 7f5b7b200640 1 -- 172.21.15.142:0/2500148878 wait complete. 2024-02-19T06:57:32.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.141+0000 7f5b7b200640 1 Processor -- start 2024-02-19T06:57:32.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.142+0000 7f5b7b200640 1 -- start start 2024-02-19T06:57:32.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.142+0000 7f5b7b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06cbc0 0x7f5b7c15adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.142+0000 7f5b7b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b7c06d010 0x7f5b7c1f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.142+0000 7f5b7b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b7c15d980 0x7f5b7c15bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.142+0000 7f5b7b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1f4360 con 0x7f5b7c15d980 2024-02-19T06:57:32.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.142+0000 7f5b7b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1f3b10 con 0x7f5b7c06d010 2024-02-19T06:57:32.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.142+0000 7f5b7b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1f3df0 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.143+0000 7f5b79e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06cbc0 0x7f5b7c15adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.143+0000 7f5b79400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b7c06d010 0x7f5b7c1f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.143+0000 7f5b79e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06cbc0 0x7f5b7c15adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:59902/0 (socket says 172.21.15.142:59902) 2024-02-19T06:57:32.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.143+0000 7f5b79e00640 1 -- 172.21.15.142:0/2990270441 learned_addr learned my addr 172.21.15.142:0/2990270441 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T06:57:32.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.143+0000 7f5b7a800640 1 --2- 172.21.15.142:0/2990270441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b7c15d980 0x7f5b7c15bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.143+0000 7f5b79e00640 1 -- 172.21.15.142:0/2990270441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b7c06d010 msgr2=0x7f5b7c1f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.143+0000 7f5b79e00640 1 --2- 172.21.15.142:0/2990270441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b7c06d010 0x7f5b7c1f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.143+0000 7f5b79e00640 1 -- 172.21.15.142:0/2990270441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b7c15d980 msgr2=0x7f5b7c15bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.143+0000 7f5b79e00640 1 --2- 172.21.15.142:0/2990270441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b7c15d980 0x7f5b7c15bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.143+0000 7f5b79e00640 1 -- 172.21.15.142:0/2990270441 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74009a70 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.143+0000 7f5b7a800640 1 --2- 172.21.15.142:0/2990270441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b7c15d980 0x7f5b7c15bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:32.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.143+0000 7f5b79e00640 1 --2- 172.21.15.142:0/2990270441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06cbc0 0x7f5b7c15adf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00d7d0 tx=0x7f5b6c00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:32.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.144+0000 7f5b72000640 1 -- 172.21.15.142:0/2990270441 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0096c0 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.144+0000 7f5b72000640 1 -- 172.21.15.142:0/2990270441 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c009820 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.144+0000 7f5b7b200640 1 -- 172.21.15.142:0/2990270441 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c1f40d0 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.144+0000 7f5b72000640 1 -- 172.21.15.142:0/2990270441 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c009bd0 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.144+0000 7f5b7b200640 1 -- 172.21.15.142:0/2990270441 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c15f7f0 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.144+0000 7f5b72000640 1 -- 172.21.15.142:0/2990270441 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5b6c0147a0 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.144+0000 7f5b72000640 1 -- 172.21.15.142:0/2990270441 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f5b6c01dd30 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.145+0000 7f5b7b200640 1 -- 172.21.15.142:0/2990270441 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c04eee0 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.147+0000 7f5b72000640 1 -- 172.21.15.142:0/2990270441 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5b6c03cdd0 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.173 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:32.172+0000 7fd4ab613040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-19T06:57:32.217 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:32.216+0000 7f97d0212040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-19T06:57:32.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.223+0000 7f5b7b200640 1 -- 172.21.15.142:0/2990270441 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd", "id": 1} v 0) v1 -- 0x7f5b7c0b5c20 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.231+0000 7f5b72000640 1 -- 172.21.15.142:0/2990270441 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5b6c02b070 con 0x7f5b7c06cbc0 2024-02-19T06:57:32.267 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-02-19T06:57:32.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.232+0000 7f5b7b200640 1 -- 172.21.15.142:0/2990270441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06cbc0 msgr2=0x7f5b7c15adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.232+0000 7f5b7b200640 1 --2- 172.21.15.142:0/2990270441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06cbc0 0x7f5b7c15adf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00d7d0 tx=0x7f5b6c00dc90 comp rx=0 tx=0).stop 2024-02-19T06:57:32.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.232+0000 7f5b7b200640 1 -- 172.21.15.142:0/2990270441 shutdown_connections 2024-02-19T06:57:32.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.232+0000 7f5b7b200640 1 --2- 172.21.15.142:0/2990270441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b7c15d980 0x7f5b7c15bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.232+0000 7f5b7b200640 1 --2- 172.21.15.142:0/2990270441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b7c06d010 0x7f5b7c1f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.232+0000 7f5b7b200640 1 --2- 172.21.15.142:0/2990270441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b7c06cbc0 0x7f5b7c15adf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.232+0000 7f5b7b200640 1 -- 172.21.15.142:0/2990270441 >> 172.21.15.142:0/2990270441 conn(0x7f5b7c09ca60 msgr2=0x7f5b7c0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:32.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.232+0000 7f5b7b200640 1 -- 172.21.15.142:0/2990270441 shutdown_connections 2024-02-19T06:57:32.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.233+0000 7f5b7b200640 1 -- 172.21.15.142:0/2990270441 wait complete. 2024-02-19T06:57:32.269 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new d6e6d8e0-b34b-40f6-8178-844f431ece4e 2 2024-02-19T06:57:32.302 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:32.300+0000 7f97d0212040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-19T06:57:32.361 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:32.360+0000 7f97d0212040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-19T06:57:32.425 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:32.424+0000 7f97d0212040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-19T06:57:32.483 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:32.482+0000 7f97d0212040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-19T06:57:32.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.493+0000 7f5ce5600640 1 Processor -- start 2024-02-19T06:57:32.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.493+0000 7f5ce5600640 1 -- start start 2024-02-19T06:57:32.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.494+0000 7f5ce5600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5ce0160f50 0x7f5ce00cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.494+0000 7f5ce5600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce00ceed0 con 0x7f5ce00d2330 2024-02-19T06:57:32.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.494+0000 7f5ce5600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce00ce5e0 con 0x7f5ce00d0b30 2024-02-19T06:57:32.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.494+0000 7f5ce5600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce0161330 con 0x7f5ce0160f50 2024-02-19T06:57:32.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.494+0000 7f5cdea00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5ce0160f50 0x7f5ce00cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.494+0000 7f5cdea00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5ce0160f50 0x7f5ce00cf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47736/0 (socket says 172.21.15.142:47736) 2024-02-19T06:57:32.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.494+0000 7f5cde000640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5ce00d0b30 0x7f5ce00d1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:59376/0 (socket says 172.21.15.142:59376) 2024-02-19T06:57:32.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.494+0000 7f5cdea00640 1 -- 172.21.15.142:0/3260802225 learned_addr learned my addr 172.21.15.142:0/3260802225 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T06:57:32.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.495+0000 7f5cdea00640 1 -- 172.21.15.142:0/3260802225 >> v1:172.21.15.142:6789/0 conn(0x7f5ce00d0b30 legacy=0x7f5ce00d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.495+0000 7f5cdea00640 1 -- 172.21.15.142:0/3260802225 >> v1:172.21.15.46:6789/0 conn(0x7f5ce00d2330 legacy=0x7f5ce00b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:32.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.495+0000 7f5cdea00640 1 -- 172.21.15.142:0/3260802225 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce00ce880 con 0x7f5ce0160f50 2024-02-19T06:57:32.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.496+0000 7f5cdea00640 1 --2- 172.21.15.142:0/3260802225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ce0160f50 0x7f5ce00cf360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009870 tx=0x7f5cd002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93fa37d150e6ba64 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:32.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.496+0000 7f5cdd600640 1 -- 172.21.15.142:0/3260802225 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0030860 con 0x7f5ce0160f50 2024-02-19T06:57:32.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.496+0000 7f5cdd600640 1 -- 172.21.15.142:0/3260802225 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd00309c0 con 0x7f5ce0160f50 2024-02-19T06:57:32.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.496+0000 7f5cdd600640 1 -- 172.21.15.142:0/3260802225 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0030d50 con 0x7f5ce0160f50 2024-02-19T06:57:32.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.497+0000 7f5ce5600640 1 -- 172.21.15.142:0/3260802225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ce0160f50 msgr2=0x7f5ce00cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.497+0000 7f5ce5600640 1 --2- 172.21.15.142:0/3260802225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ce0160f50 0x7f5ce00cf360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009870 tx=0x7f5cd002b9a0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.497+0000 7f5ce5600640 1 -- 172.21.15.142:0/3260802225 shutdown_connections 2024-02-19T06:57:32.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.497+0000 7f5ce5600640 1 --2- 172.21.15.142:0/3260802225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ce0160f50 0x7f5ce00cf360 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.497+0000 7f5ce5600640 1 -- 172.21.15.142:0/3260802225 >> 172.21.15.142:0/3260802225 conn(0x7f5ce008afc0 msgr2=0x7f5ce00d38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:32.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.497+0000 7f5ce5600640 1 -- 172.21.15.142:0/3260802225 shutdown_connections 2024-02-19T06:57:32.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.497+0000 7f5ce5600640 1 -- 172.21.15.142:0/3260802225 wait complete. 2024-02-19T06:57:32.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.499+0000 7f5ce5600640 1 Processor -- start 2024-02-19T06:57:32.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.499+0000 7f5ce5600640 1 -- start start 2024-02-19T06:57:32.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.500+0000 7f5ce5600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ce00d0b30 0x7f5ce0159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.500+0000 7f5ce5600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ce00d2330 0x7f5ce00c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.500+0000 7f5ce5600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ce0160f50 0x7f5ce00c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.500+0000 7f5ce5600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00cca90 con 0x7f5ce0160f50 2024-02-19T06:57:32.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.500+0000 7f5ce5600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00c7f80 con 0x7f5ce00d0b30 2024-02-19T06:57:32.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.500+0000 7f5ce5600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00c8260 con 0x7f5ce00d2330 2024-02-19T06:57:32.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.500+0000 7f5cdea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ce00d0b30 0x7f5ce0159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.500+0000 7f5cdea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ce00d0b30 0x7f5ce0159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47746/0 (socket says 172.21.15.142:47746) 2024-02-19T06:57:32.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.500+0000 7f5cdea00640 1 -- 172.21.15.142:0/1697722520 learned_addr learned my addr 172.21.15.142:0/1697722520 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T06:57:32.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.500+0000 7f5cde000640 1 --2- 172.21.15.142:0/1697722520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ce00d2330 0x7f5ce00c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.500+0000 7f5cdf400640 1 --2- 172.21.15.142:0/1697722520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ce0160f50 0x7f5ce00c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.501+0000 7f5cdea00640 1 -- 172.21.15.142:0/1697722520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ce00d2330 msgr2=0x7f5ce00c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.501+0000 7f5cdea00640 1 --2- 172.21.15.142:0/1697722520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ce00d2330 0x7f5ce00c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.501+0000 7f5cdea00640 1 -- 172.21.15.142:0/1697722520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ce0160f50 msgr2=0x7f5ce00c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.501+0000 7f5cdea00640 1 --2- 172.21.15.142:0/1697722520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ce0160f50 0x7f5ce00c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.501+0000 7f5cdea00640 1 -- 172.21.15.142:0/1697722520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd00094d0 con 0x7f5ce00d0b30 2024-02-19T06:57:32.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.501+0000 7f5cdf400640 1 --2- 172.21.15.142:0/1697722520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ce0160f50 0x7f5ce00c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:32.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.501+0000 7f5cdea00640 1 --2- 172.21.15.142:0/1697722520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ce00d0b30 0x7f5ce0159e50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009870 tx=0x7f5cd0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:32.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.501+0000 7f5cd6a00640 1 -- 172.21.15.142:0/1697722520 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0030810 con 0x7f5ce00d0b30 2024-02-19T06:57:32.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.501+0000 7f5cd6a00640 1 -- 172.21.15.142:0/1697722520 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd0039d90 con 0x7f5ce00d0b30 2024-02-19T06:57:32.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.501+0000 7f5cd6a00640 1 -- 172.21.15.142:0/1697722520 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0043630 con 0x7f5ce00d0b30 2024-02-19T06:57:32.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.501+0000 7f5ce5600640 1 -- 172.21.15.142:0/1697722520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce00c8540 con 0x7f5ce00d0b30 2024-02-19T06:57:32.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.501+0000 7f5ce5600640 1 -- 172.21.15.142:0/1697722520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce015a390 con 0x7f5ce00d0b30 2024-02-19T06:57:32.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.501+0000 7f5cd6a00640 1 -- 172.21.15.142:0/1697722520 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5cd0043790 con 0x7f5ce00d0b30 2024-02-19T06:57:32.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.502+0000 7f5cd6a00640 1 -- 172.21.15.142:0/1697722520 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f5cd004c3f0 con 0x7f5ce00d0b30 2024-02-19T06:57:32.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.502+0000 7f5ce5600640 1 -- 172.21.15.142:0/1697722520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce00b70d0 con 0x7f5ce00d0b30 2024-02-19T06:57:32.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.505+0000 7f5cd6a00640 1 -- 172.21.15.142:0/1697722520 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5ce00b70d0 con 0x7f5ce00d0b30 2024-02-19T06:57:32.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.584+0000 7f5ce5600640 1 -- 172.21.15.142:0/1697722520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d6e6d8e0-b34b-40f6-8178-844f431ece4e", "id": 2} v 0) v1 -- 0x7f5ce00682b0 con 0x7f5ce00d0b30 2024-02-19T06:57:32.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.590+0000 7f5cd6a00640 1 -- 172.21.15.142:0/1697722520 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6e6d8e0-b34b-40f6-8178-844f431ece4e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5cd0048070 con 0x7f5ce00d0b30 2024-02-19T06:57:32.591 INFO:teuthology.orchestra.run.smithi142.stdout:2 2024-02-19T06:57:32.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.591+0000 7f5ce5600640 1 -- 172.21.15.142:0/1697722520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ce00d0b30 msgr2=0x7f5ce0159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.591+0000 7f5ce5600640 1 --2- 172.21.15.142:0/1697722520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ce00d0b30 0x7f5ce0159e50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009870 tx=0x7f5cd0004730 comp rx=0 tx=0).stop 2024-02-19T06:57:32.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.591+0000 7f5ce5600640 1 -- 172.21.15.142:0/1697722520 shutdown_connections 2024-02-19T06:57:32.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.591+0000 7f5ce5600640 1 --2- 172.21.15.142:0/1697722520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ce0160f50 0x7f5ce00c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.591+0000 7f5ce5600640 1 --2- 172.21.15.142:0/1697722520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ce00d2330 0x7f5ce00c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.591+0000 7f5ce5600640 1 --2- 172.21.15.142:0/1697722520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ce00d0b30 0x7f5ce0159e50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.591+0000 7f5ce5600640 1 -- 172.21.15.142:0/1697722520 >> 172.21.15.142:0/1697722520 conn(0x7f5ce008afc0 msgr2=0x7f5ce00d1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:32.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.591+0000 7f5ce5600640 1 -- 172.21.15.142:0/1697722520 shutdown_connections 2024-02-19T06:57:32.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.591+0000 7f5ce5600640 1 -- 172.21.15.142:0/1697722520 wait complete. 2024-02-19T06:57:32.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new e7245607-ce11-4972-b684-0e71b5e690f8 3 2024-02-19T06:57:32.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.788+0000 7f368d400640 1 Processor -- start 2024-02-19T06:57:32.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.789+0000 7f368d400640 1 -- start start 2024-02-19T06:57:32.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.790+0000 7f368d400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368815dbc0 0x7f36880d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.790+0000 7f368d400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36880ce630 con 0x7f36880d1950 2024-02-19T06:57:32.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.790+0000 7f368d400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36880ce860 con 0x7f36880d2510 2024-02-19T06:57:32.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.790+0000 7f368d400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368815dfa0 con 0x7f368815dbc0 2024-02-19T06:57:32.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.790+0000 7f3686800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368815dbc0 0x7f36880d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.790+0000 7f3686800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368815dbc0 0x7f36880d1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:59926/0 (socket says 172.21.15.142:59926) 2024-02-19T06:57:32.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.790+0000 7f3686800640 1 -- 172.21.15.142:0/3242583583 learned_addr learned my addr 172.21.15.142:0/3242583583 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T06:57:32.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.790+0000 7f3687200640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f36880d2510 0x7f36880cf900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:59378/0 (socket says 172.21.15.142:59378) 2024-02-19T06:57:32.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.791+0000 7f3686800640 1 -- 172.21.15.142:0/3242583583 >> v1:172.21.15.142:6789/0 conn(0x7f36880d2510 legacy=0x7f36880cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.791+0000 7f3686800640 1 -- 172.21.15.142:0/3242583583 >> v1:172.21.15.46:6789/0 conn(0x7f36880d1950 legacy=0x7f36880d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.791+0000 7f3685400640 1 -- 172.21.15.142:0/3242583583 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991787049 0 0) 0x7f36880ce860 con 0x7f36880d2510 2024-02-19T06:57:32.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.791+0000 7f3686800640 1 -- 172.21.15.142:0/3242583583 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36880ceb40 con 0x7f368815dbc0 2024-02-19T06:57:32.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.792+0000 7f3686800640 1 --2- 172.21.15.142:0/3242583583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368815dbc0 0x7f36880d1410 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f36780098a0 tx=0x7f367802ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66a024969d054884 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:32.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.792+0000 7f3685400640 1 -- 172.21.15.142:0/3242583583 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367802f830 con 0x7f368815dbc0 2024-02-19T06:57:32.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.792+0000 7f3685400640 1 -- 172.21.15.142:0/3242583583 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367802f990 con 0x7f368815dbc0 2024-02-19T06:57:32.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.792+0000 7f3685400640 1 -- 172.21.15.142:0/3242583583 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367802fd20 con 0x7f368815dbc0 2024-02-19T06:57:32.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.793+0000 7f368d400640 1 -- 172.21.15.142:0/3242583583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368815dbc0 msgr2=0x7f36880d1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.793+0000 7f368d400640 1 --2- 172.21.15.142:0/3242583583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368815dbc0 0x7f36880d1410 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f36780098a0 tx=0x7f367802ba10 comp rx=0 tx=0).stop 2024-02-19T06:57:32.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.793+0000 7f368d400640 1 -- 172.21.15.142:0/3242583583 shutdown_connections 2024-02-19T06:57:32.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.793+0000 7f368d400640 1 --2- 172.21.15.142:0/3242583583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368815dbc0 0x7f36880d1410 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.793+0000 7f368d400640 1 -- 172.21.15.142:0/3242583583 >> 172.21.15.142:0/3242583583 conn(0x7f368808afc0 msgr2=0x7f36880d3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:32.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.793+0000 7f368d400640 1 -- 172.21.15.142:0/3242583583 shutdown_connections 2024-02-19T06:57:32.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.793+0000 7f368d400640 1 -- 172.21.15.142:0/3242583583 wait complete. 2024-02-19T06:57:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.795+0000 7f368d400640 1 Processor -- start 2024-02-19T06:57:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.795+0000 7f368d400640 1 -- start start 2024-02-19T06:57:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.796+0000 7f368d400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36880d1950 0x7f36880b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.796+0000 7f368d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36880d2510 0x7f368814f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.796+0000 7f368d400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f368815dbc0 0x7f36880b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.796+0000 7f368d400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36880b2f80 con 0x7f36880d2510 2024-02-19T06:57:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.796+0000 7f368d400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36880b8160 con 0x7f368815dbc0 2024-02-19T06:57:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.796+0000 7f368d400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368814e3a0 con 0x7f36880d1950 2024-02-19T06:57:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.796+0000 7f3686800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36880d1950 0x7f36880b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.796+0000 7f3686800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36880d1950 0x7f36880b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:59940/0 (socket says 172.21.15.142:59940) 2024-02-19T06:57:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.796+0000 7f3686800640 1 -- 172.21.15.142:0/3624529382 learned_addr learned my addr 172.21.15.142:0/3624529382 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T06:57:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.796+0000 7f3687200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f368815dbc0 0x7f36880b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.797+0000 7f3685e00640 1 --2- 172.21.15.142:0/3624529382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36880d2510 0x7f368814f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.797+0000 7f3687200640 1 -- 172.21.15.142:0/3624529382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36880d1950 msgr2=0x7f36880b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.797+0000 7f3687200640 1 --2- 172.21.15.142:0/3624529382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36880d1950 0x7f36880b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.797+0000 7f3687200640 1 -- 172.21.15.142:0/3624529382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36880d2510 msgr2=0x7f368814f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.797+0000 7f3687200640 1 --2- 172.21.15.142:0/3624529382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36880d2510 0x7f368814f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.797+0000 7f3687200640 1 -- 172.21.15.142:0/3624529382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36780094d0 con 0x7f368815dbc0 2024-02-19T06:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.797+0000 7f3686800640 1 --2- 172.21.15.142:0/3624529382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36880d1950 0x7f36880b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.797+0000 7f3687200640 1 --2- 172.21.15.142:0/3624529382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f368815dbc0 0x7f36880b63f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f368000c700 tx=0x7f368000cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.797+0000 7f367ea00640 1 -- 172.21.15.142:0/3624529382 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368000ce10 con 0x7f368815dbc0 2024-02-19T06:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.797+0000 7f367ea00640 1 -- 172.21.15.142:0/3624529382 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368000a640 con 0x7f368815dbc0 2024-02-19T06:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.797+0000 7f367ea00640 1 -- 172.21.15.142:0/3624529382 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368000a9f0 con 0x7f368815dbc0 2024-02-19T06:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.797+0000 7f368d400640 1 -- 172.21.15.142:0/3624529382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368814f000 con 0x7f368815dbc0 2024-02-19T06:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.798+0000 7f368d400640 1 -- 172.21.15.142:0/3624529382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368814fd70 con 0x7f368815dbc0 2024-02-19T06:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.798+0000 7f367ea00640 1 -- 172.21.15.142:0/3624529382 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f368000ab50 con 0x7f368815dbc0 2024-02-19T06:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.798+0000 7f367ea00640 1 -- 172.21.15.142:0/3624529382 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f368000ae00 con 0x7f368815dbc0 2024-02-19T06:57:32.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.799+0000 7f368d400640 1 -- 172.21.15.142:0/3624529382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36880b7f30 con 0x7f368815dbc0 2024-02-19T06:57:32.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.801+0000 7f367ea00640 1 -- 172.21.15.142:0/3624529382 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f36880b7f30 con 0x7f368815dbc0 2024-02-19T06:57:32.817 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:32.816+0000 7fd4ab613040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-19T06:57:32.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.880+0000 7f368d400640 1 -- 172.21.15.142:0/3624529382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e7245607-ce11-4972-b684-0e71b5e690f8", "id": 3} v 0) v1 -- 0x7f36880b82d0 con 0x7f368815dbc0 2024-02-19T06:57:32.884 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:32.882+0000 7fd4ab613040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-19T06:57:32.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.887+0000 7f367ea00640 1 -- 172.21.15.142:0/3624529382 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e7245607-ce11-4972-b684-0e71b5e690f8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f36880b82d0 con 0x7f368815dbc0 2024-02-19T06:57:32.888 INFO:teuthology.orchestra.run.smithi142.stdout:3 2024-02-19T06:57:32.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.889+0000 7f368d400640 1 -- 172.21.15.142:0/3624529382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f368815dbc0 msgr2=0x7f36880b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:32.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.889+0000 7f368d400640 1 --2- 172.21.15.142:0/3624529382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f368815dbc0 0x7f36880b63f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f368000c700 tx=0x7f368000cbc0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.889+0000 7f368d400640 1 -- 172.21.15.142:0/3624529382 shutdown_connections 2024-02-19T06:57:32.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.889+0000 7f368d400640 1 --2- 172.21.15.142:0/3624529382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f368815dbc0 0x7f36880b63f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.889+0000 7f368d400640 1 --2- 172.21.15.142:0/3624529382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36880d2510 0x7f368814f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.889+0000 7f368d400640 1 --2- 172.21.15.142:0/3624529382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36880d1950 0x7f36880b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:32.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.889+0000 7f368d400640 1 -- 172.21.15.142:0/3624529382 >> 172.21.15.142:0/3624529382 conn(0x7f368808afc0 msgr2=0x7f368815c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:32.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.889+0000 7f368d400640 1 -- 172.21.15.142:0/3624529382 shutdown_connections 2024-02-19T06:57:32.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:32.889+0000 7f368d400640 1 -- 172.21.15.142:0/3624529382 wait complete. 2024-02-19T06:57:32.906 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 49d431b2-5dd9-4bc8-a94d-f12603470f17 4 2024-02-19T06:57:32.937 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:32.935+0000 7fd4ab613040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-19T06:57:32.957 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:32.957+0000 7f97d0212040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-19T06:57:33.002 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:33.001+0000 7fd4ab613040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-19T06:57:33.054 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:33.053+0000 7fd4ab613040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-19T06:57:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.093+0000 7fbecf200640 1 Processor -- start 2024-02-19T06:57:33.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.094+0000 7fbecf200640 1 -- start start 2024-02-19T06:57:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.095+0000 7fbecf200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbec80b19a0 0x7fbec80d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.095+0000 7fbecf200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec80b0500 con 0x7fbec815d980 2024-02-19T06:57:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.095+0000 7fbecf200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec815dd60 con 0x7fbec80d3530 2024-02-19T06:57:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.095+0000 7fbecf200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec806d2d0 con 0x7fbec80b19a0 2024-02-19T06:57:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.095+0000 7fbecd400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbec80b19a0 0x7fbec80d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.095+0000 7fbecd400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbec80b19a0 0x7fbec80d2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:59944/0 (socket says 172.21.15.142:59944) 2024-02-19T06:57:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.095+0000 7fbecd400640 1 -- 172.21.15.142:0/2412259208 learned_addr learned my addr 172.21.15.142:0/2412259208 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T06:57:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.095+0000 7fbece800640 1 --1- 172.21.15.142:0/2412259208 >> v1:172.21.15.142:6789/0 conn(0x7fbec80d3530 0x7fbec80d39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:59382/0 (socket says 172.21.15.142:59382) 2024-02-19T06:57:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.096+0000 7fbecd400640 1 -- 172.21.15.142:0/2412259208 >> v1:172.21.15.142:6789/0 conn(0x7fbec80d3530 legacy=0x7fbec80d39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.096+0000 7fbecd400640 1 -- 172.21.15.142:0/2412259208 >> v1:172.21.15.46:6789/0 conn(0x7fbec815d980 legacy=0x7fbec806cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:33.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.096+0000 7fbecd400640 1 -- 172.21.15.142:0/2412259208 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec80b01b0 con 0x7fbec80b19a0 2024-02-19T06:57:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.097+0000 7fbecd400640 1 --2- 172.21.15.142:0/2412259208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbec80b19a0 0x7fbec80d2220 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8009880 tx=0x7fbeb802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa9cced98f46a65 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.097+0000 7fbecca00640 1 -- 172.21.15.142:0/2412259208 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8004230 con 0x7fbec80b19a0 2024-02-19T06:57:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.097+0000 7fbecca00640 1 -- 172.21.15.142:0/2412259208 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb8004390 con 0x7fbec80b19a0 2024-02-19T06:57:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.097+0000 7fbecca00640 1 -- 172.21.15.142:0/2412259208 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8003810 con 0x7fbec80b19a0 2024-02-19T06:57:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.098+0000 7fbecf200640 1 -- 172.21.15.142:0/2412259208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbec80b19a0 msgr2=0x7fbec80d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.098+0000 7fbecf200640 1 --2- 172.21.15.142:0/2412259208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbec80b19a0 0x7fbec80d2220 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8009880 tx=0x7fbeb802b960 comp rx=0 tx=0).stop 2024-02-19T06:57:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.098+0000 7fbecf200640 1 -- 172.21.15.142:0/2412259208 shutdown_connections 2024-02-19T06:57:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.098+0000 7fbecf200640 1 --2- 172.21.15.142:0/2412259208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbec80b19a0 0x7fbec80d2220 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.098+0000 7fbecf200640 1 -- 172.21.15.142:0/2412259208 >> 172.21.15.142:0/2412259208 conn(0x7fbec809ca60 msgr2=0x7fbec808afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.098+0000 7fbecf200640 1 -- 172.21.15.142:0/2412259208 shutdown_connections 2024-02-19T06:57:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.098+0000 7fbecf200640 1 -- 172.21.15.142:0/2412259208 wait complete. 2024-02-19T06:57:33.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.100+0000 7fbecf200640 1 Processor -- start 2024-02-19T06:57:33.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.100+0000 7fbecf200640 1 -- start start 2024-02-19T06:57:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.100+0000 7fbecf200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbec80b19a0 0x7fbec8152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecf200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbec80d3530 0x7fbec815bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecf200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbec815d980 0x7fbec80b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecf200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8153360 con 0x7fbec80d3530 2024-02-19T06:57:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecf200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8156360 con 0x7fbec80b19a0 2024-02-19T06:57:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecf200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8155a30 con 0x7fbec815d980 2024-02-19T06:57:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecde00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbec80b19a0 0x7fbec8152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbece800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbec815d980 0x7fbec80b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecde00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbec80b19a0 0x7fbec8152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47764/0 (socket says 172.21.15.142:47764) 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecde00640 1 -- 172.21.15.142:0/220531150 learned_addr learned my addr 172.21.15.142:0/220531150 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecd400640 1 --2- 172.21.15.142:0/220531150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbec80d3530 0x7fbec815bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecde00640 1 -- 172.21.15.142:0/220531150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbec815d980 msgr2=0x7fbec80b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecde00640 1 --2- 172.21.15.142:0/220531150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbec815d980 0x7fbec80b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecde00640 1 -- 172.21.15.142:0/220531150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbec80d3530 msgr2=0x7fbec815bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecde00640 1 --2- 172.21.15.142:0/220531150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbec80d3530 0x7fbec815bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecde00640 1 -- 172.21.15.142:0/220531150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb8009460 con 0x7fbec80b19a0 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.101+0000 7fbecd400640 1 --2- 172.21.15.142:0/220531150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbec80d3530 0x7fbec815bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.102+0000 7fbecde00640 1 --2- 172.21.15.142:0/220531150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbec80b19a0 0x7fbec8152e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00b3e0 tx=0x7fbebc00b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.102+0000 7fbec2000640 1 -- 172.21.15.142:0/220531150 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc011830 con 0x7fbec80b19a0 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.102+0000 7fbec2000640 1 -- 172.21.15.142:0/220531150 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc0119b0 con 0x7fbec80b19a0 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.102+0000 7fbec2000640 1 -- 172.21.15.142:0/220531150 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc011da0 con 0x7fbec80b19a0 2024-02-19T06:57:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.102+0000 7fbecf200640 1 -- 172.21.15.142:0/220531150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec8155d10 con 0x7fbec80b19a0 2024-02-19T06:57:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.102+0000 7fbecf200640 1 -- 172.21.15.142:0/220531150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec8160b30 con 0x7fbec80b19a0 2024-02-19T06:57:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.102+0000 7fbec2000640 1 -- 172.21.15.142:0/220531150 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fbebc01a790 con 0x7fbec80b19a0 2024-02-19T06:57:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.102+0000 7fbec2000640 1 -- 172.21.15.142:0/220531150 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fbebc0193b0 con 0x7fbec80b19a0 2024-02-19T06:57:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.103+0000 7fbecf200640 1 -- 172.21.15.142:0/220531150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec8168450 con 0x7fbec80b19a0 2024-02-19T06:57:33.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.105+0000 7fbec2000640 1 -- 172.21.15.142:0/220531150 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fbebc039dd0 con 0x7fbec80b19a0 2024-02-19T06:57:33.128 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:33.126+0000 7f97d0212040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-19T06:57:33.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.185+0000 7fbecf200640 1 -- 172.21.15.142:0/220531150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49d431b2-5dd9-4bc8-a94d-f12603470f17", "id": 4} v 0) v1 -- 0x7fbec804eee0 con 0x7fbec80b19a0 2024-02-19T06:57:33.190 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:33.188+0000 7fd4ab613040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-19T06:57:33.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.191+0000 7fbec2000640 1 -- 172.21.15.142:0/220531150 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49d431b2-5dd9-4bc8-a94d-f12603470f17", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbebc028070 con 0x7fbec80b19a0 2024-02-19T06:57:33.192 INFO:teuthology.orchestra.run.smithi142.stdout:4 2024-02-19T06:57:33.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.193+0000 7fbecf200640 1 -- 172.21.15.142:0/220531150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbec80b19a0 msgr2=0x7fbec8152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.193+0000 7fbecf200640 1 --2- 172.21.15.142:0/220531150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbec80b19a0 0x7fbec8152e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00b3e0 tx=0x7fbebc00b8a0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.193+0000 7fbecf200640 1 -- 172.21.15.142:0/220531150 shutdown_connections 2024-02-19T06:57:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.193+0000 7fbecf200640 1 --2- 172.21.15.142:0/220531150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbec815d980 0x7fbec80b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.193+0000 7fbecf200640 1 --2- 172.21.15.142:0/220531150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbec80d3530 0x7fbec815bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.193+0000 7fbecf200640 1 --2- 172.21.15.142:0/220531150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbec80b19a0 0x7fbec8152e20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.193+0000 7fbecf200640 1 -- 172.21.15.142:0/220531150 >> 172.21.15.142:0/220531150 conn(0x7fbec809ca60 msgr2=0x7fbec80cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.194+0000 7fbecf200640 1 -- 172.21.15.142:0/220531150 shutdown_connections 2024-02-19T06:57:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.194+0000 7fbecf200640 1 -- 172.21.15.142:0/220531150 wait complete. 2024-02-19T06:57:33.211 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 558aa125-1d1a-48c3-bb8a-c04e1c95b0f8 5 2024-02-19T06:57:33.272 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:33.271+0000 7f97d0212040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-19T06:57:33.274 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:33.272+0000 7fd4ab613040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-19T06:57:33.328 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:33.327+0000 7f97d0212040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-19T06:57:33.330 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:33.328+0000 7fd4ab613040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-19T06:57:33.393 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:33.392+0000 7fd4ab613040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-19T06:57:33.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.402+0000 7f3446800640 1 Processor -- start 2024-02-19T06:57:33.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.402+0000 7f3446800640 1 -- start start 2024-02-19T06:57:33.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.404+0000 7f3446800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f34400b3980 0x7f3440166420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:33.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.404+0000 7f3446800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34400cd2d0 con 0x7f34400cc0c0 2024-02-19T06:57:33.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.404+0000 7f3446800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34400b3dd0 con 0x7f344015ebc0 2024-02-19T06:57:33.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.404+0000 7f3446800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34400cc6c0 con 0x7f34400b3980 2024-02-19T06:57:33.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.404+0000 7f3445400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f344015ebc0 0x7f34400cd760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:59388/0 (socket says 172.21.15.142:59388) 2024-02-19T06:57:33.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.404+0000 7f3445400640 1 -- 172.21.15.142:0/1823763329 learned_addr learned my addr 172.21.15.142:0/1823763329 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-02-19T06:57:33.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.404+0000 7f3445e00640 1 --2- 172.21.15.142:0/1823763329 >> v2:172.21.15.142:3300/0 conn(0x7f34400b3980 0x7f3440166420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:33.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.405+0000 7f343fe00640 1 -- 172.21.15.142:0/1823763329 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325502545 0 0) 0x7f34400b3dd0 con 0x7f344015ebc0 2024-02-19T06:57:33.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.405+0000 7f343fe00640 1 -- 172.21.15.142:0/1823763329 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3428003520 con 0x7f344015ebc0 2024-02-19T06:57:33.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.405+0000 7f3445e00640 1 -- 172.21.15.142:0/1823763329 >> v1:172.21.15.142:6789/0 conn(0x7f344015ebc0 legacy=0x7f34400cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.405+0000 7f3445e00640 1 -- 172.21.15.142:0/1823763329 >> v1:172.21.15.46:6789/0 conn(0x7f34400cc0c0 legacy=0x7f34400b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.405+0000 7f3445e00640 1 -- 172.21.15.142:0/1823763329 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34400cc9a0 con 0x7f34400b3980 2024-02-19T06:57:33.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.406+0000 7f3445e00640 1 --2- 172.21.15.142:0/1823763329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400b3980 0x7f3440166420 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3438009d90 tx=0x7f343802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6893a84a49ce36e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:33.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.406+0000 7f343fe00640 1 -- 172.21.15.142:0/1823763329 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343802cd00 con 0x7f34400b3980 2024-02-19T06:57:33.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.407+0000 7f343fe00640 1 -- 172.21.15.142:0/1823763329 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343802ce60 con 0x7f34400b3980 2024-02-19T06:57:33.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.407+0000 7f343fe00640 1 -- 172.21.15.142:0/1823763329 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3438034660 con 0x7f34400b3980 2024-02-19T06:57:33.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.407+0000 7f3446800640 1 -- 172.21.15.142:0/1823763329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400b3980 msgr2=0x7f3440166420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.407+0000 7f3446800640 1 --2- 172.21.15.142:0/1823763329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400b3980 0x7f3440166420 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3438009d90 tx=0x7f343802bf50 comp rx=0 tx=0).stop 2024-02-19T06:57:33.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.407+0000 7f3446800640 1 -- 172.21.15.142:0/1823763329 shutdown_connections 2024-02-19T06:57:33.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.407+0000 7f3446800640 1 --2- 172.21.15.142:0/1823763329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400b3980 0x7f3440166420 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.407+0000 7f3446800640 1 -- 172.21.15.142:0/1823763329 >> 172.21.15.142:0/1823763329 conn(0x7f34400d0420 msgr2=0x7f34400d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:33.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.407+0000 7f3446800640 1 -- 172.21.15.142:0/1823763329 shutdown_connections 2024-02-19T06:57:33.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.407+0000 7f3446800640 1 -- 172.21.15.142:0/1823763329 wait complete. 2024-02-19T06:57:33.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.409+0000 7f3446800640 1 Processor -- start 2024-02-19T06:57:33.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.409+0000 7f3446800640 1 -- start start 2024-02-19T06:57:33.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.410+0000 7f3446800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34400b3980 0x7f3440151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:33.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.410+0000 7f3446800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400cc0c0 0x7f34400ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:33.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.410+0000 7f3446800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344015ebc0 0x7f34400c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:33.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.410+0000 7f3446800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34400b3ff0 con 0x7f344015ebc0 2024-02-19T06:57:33.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.410+0000 7f3446800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34400b4890 con 0x7f34400cc0c0 2024-02-19T06:57:33.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.410+0000 7f3446800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34400ae560 con 0x7f34400b3980 2024-02-19T06:57:33.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.410+0000 7f3444a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400cc0c0 0x7f34400ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:33.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.410+0000 7f3445400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34400b3980 0x7f3440151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:33.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.410+0000 7f3444a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400cc0c0 0x7f34400ae020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47782/0 (socket says 172.21.15.142:47782) 2024-02-19T06:57:33.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.410+0000 7f3444a00640 1 -- 172.21.15.142:0/1084206172 learned_addr learned my addr 172.21.15.142:0/1084206172 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T06:57:33.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.411+0000 7f3445e00640 1 --2- 172.21.15.142:0/1084206172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344015ebc0 0x7f34400c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:33.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.411+0000 7f3444a00640 1 -- 172.21.15.142:0/1084206172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34400b3980 msgr2=0x7f3440151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.411+0000 7f3444a00640 1 --2- 172.21.15.142:0/1084206172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34400b3980 0x7f3440151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.411+0000 7f3444a00640 1 -- 172.21.15.142:0/1084206172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344015ebc0 msgr2=0x7f34400c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.411+0000 7f3444a00640 1 --2- 172.21.15.142:0/1084206172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344015ebc0 0x7f34400c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.411+0000 7f3444a00640 1 -- 172.21.15.142:0/1084206172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3438009a70 con 0x7f34400cc0c0 2024-02-19T06:57:33.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.411+0000 7f3444a00640 1 --2- 172.21.15.142:0/1084206172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400cc0c0 0x7f34400ae020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f342c00c400 tx=0x7f342c00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:33.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.411+0000 7f343d600640 1 -- 172.21.15.142:0/1084206172 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c0052d0 con 0x7f34400cc0c0 2024-02-19T06:57:33.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.411+0000 7f343d600640 1 -- 172.21.15.142:0/1084206172 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c005450 con 0x7f34400cc0c0 2024-02-19T06:57:33.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.411+0000 7f343d600640 1 -- 172.21.15.142:0/1084206172 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c007260 con 0x7f34400cc0c0 2024-02-19T06:57:33.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.411+0000 7f3446800640 1 -- 172.21.15.142:0/1084206172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34400ae800 con 0x7f34400cc0c0 2024-02-19T06:57:33.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.411+0000 7f3446800640 1 -- 172.21.15.142:0/1084206172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34400b4520 con 0x7f34400cc0c0 2024-02-19T06:57:33.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.412+0000 7f343d600640 1 -- 172.21.15.142:0/1084206172 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f342c0073c0 con 0x7f34400cc0c0 2024-02-19T06:57:33.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.412+0000 7f343d600640 1 -- 172.21.15.142:0/1084206172 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f342c0067d0 con 0x7f34400cc0c0 2024-02-19T06:57:33.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.413+0000 7f3446800640 1 -- 172.21.15.142:0/1084206172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344004eee0 con 0x7f34400cc0c0 2024-02-19T06:57:33.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.415+0000 7f343d600640 1 -- 172.21.15.142:0/1084206172 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f342c020060 con 0x7f34400cc0c0 2024-02-19T06:57:33.450 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:33.449+0000 7fd4ab613040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-19T06:57:33.463 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:33.462+0000 7f97d0212040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-19T06:57:33.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.494+0000 7f3446800640 1 -- 172.21.15.142:0/1084206172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "558aa125-1d1a-48c3-bb8a-c04e1c95b0f8", "id": 5} v 0) v1 -- 0x7f34400b49d0 con 0x7f34400cc0c0 2024-02-19T06:57:33.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.499+0000 7f343d600640 1 -- 172.21.15.142:0/1084206172 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "558aa125-1d1a-48c3-bb8a-c04e1c95b0f8", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f342c007670 con 0x7f34400cc0c0 2024-02-19T06:57:33.501 INFO:teuthology.orchestra.run.smithi142.stdout:5 2024-02-19T06:57:33.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.501+0000 7f3446800640 1 -- 172.21.15.142:0/1084206172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400cc0c0 msgr2=0x7f34400ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.501+0000 7f3446800640 1 --2- 172.21.15.142:0/1084206172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400cc0c0 0x7f34400ae020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f342c00c400 tx=0x7f342c00c8c0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.501+0000 7f3446800640 1 -- 172.21.15.142:0/1084206172 shutdown_connections 2024-02-19T06:57:33.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.501+0000 7f3446800640 1 --2- 172.21.15.142:0/1084206172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f344015ebc0 0x7f34400c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.501+0000 7f3446800640 1 --2- 172.21.15.142:0/1084206172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400cc0c0 0x7f34400ae020 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.501+0000 7f3446800640 1 --2- 172.21.15.142:0/1084206172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34400b3980 0x7f3440151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.501+0000 7f3446800640 1 -- 172.21.15.142:0/1084206172 >> 172.21.15.142:0/1084206172 conn(0x7f34400d0420 msgr2=0x7f344015b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:33.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.501+0000 7f3446800640 1 -- 172.21.15.142:0/1084206172 shutdown_connections 2024-02-19T06:57:33.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.501+0000 7f3446800640 1 -- 172.21.15.142:0/1084206172 wait complete. 2024-02-19T06:57:33.518 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 752fd739-8486-4611-a766-0f306e7d4a9a 6 2024-02-19T06:57:33.583 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:33.581+0000 7f97d0212040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-19T06:57:33.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.708+0000 7f546e000640 1 Processor -- start 2024-02-19T06:57:33.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.708+0000 7f546e000640 1 -- start start 2024-02-19T06:57:33.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.710+0000 7f546e000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f546815dcb0 0x7f54680b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:33.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.710+0000 7f546e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54680b34f0 0x7f54680d4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:33.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.710+0000 7f546e000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54680b3980 con 0x7f5468161600 2024-02-19T06:57:33.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.710+0000 7f546e000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54680d4660 con 0x7f546815dcb0 2024-02-19T06:57:33.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.710+0000 7f546e000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54680b3bd0 con 0x7f54680b34f0 2024-02-19T06:57:33.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.710+0000 7f546cc00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5468161600 0x7f54681619e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:59404/0 (socket says 172.21.15.142:59404) 2024-02-19T06:57:33.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.710+0000 7f546cc00640 1 -- 172.21.15.142:0/26100427 learned_addr learned my addr 172.21.15.142:0/26100427 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-02-19T06:57:33.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.710+0000 7f546d600640 1 --2- 172.21.15.142:0/26100427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54680b34f0 0x7f54680d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:33.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.711+0000 7f5467e00640 1 --2- 172.21.15.142:0/26100427 >> v2:172.21.15.46:3300/0 conn(0x7f546815dcb0 0x7f54680b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:33.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.711+0000 7f5467400640 1 -- 172.21.15.142:0/26100427 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350012541 0 0) 0x7f54680b3980 con 0x7f5468161600 2024-02-19T06:57:33.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.711+0000 7f546d600640 1 -- 172.21.15.142:0/26100427 >> v2:172.21.15.46:3300/0 conn(0x7f546815dcb0 msgr2=0x7f54680b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:33.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.711+0000 7f546d600640 1 --2- 172.21.15.142:0/26100427 >> v2:172.21.15.46:3300/0 conn(0x7f546815dcb0 0x7f54680b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.711+0000 7f546d600640 1 -- 172.21.15.142:0/26100427 >> v1:172.21.15.142:6789/0 conn(0x7f5468161600 legacy=0x7f54681619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.711+0000 7f546d600640 1 -- 172.21.15.142:0/26100427 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54680b3eb0 con 0x7f54680b34f0 2024-02-19T06:57:33.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.712+0000 7f546d600640 1 --2- 172.21.15.142:0/26100427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54680b34f0 0x7f54680d4120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5460009d90 tx=0x7f546002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41801b18fce6ea03 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:33.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.712+0000 7f5467400640 1 -- 172.21.15.142:0/26100427 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546002cc50 con 0x7f54680b34f0 2024-02-19T06:57:33.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.712+0000 7f5467400640 1 -- 172.21.15.142:0/26100427 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546002cdb0 con 0x7f54680b34f0 2024-02-19T06:57:33.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.712+0000 7f5467400640 1 -- 172.21.15.142:0/26100427 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460034660 con 0x7f54680b34f0 2024-02-19T06:57:33.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.713+0000 7f546e000640 1 -- 172.21.15.142:0/26100427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54680b34f0 msgr2=0x7f54680d4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.713+0000 7f546e000640 1 --2- 172.21.15.142:0/26100427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54680b34f0 0x7f54680d4120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5460009d90 tx=0x7f546002bea0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.713+0000 7f546e000640 1 -- 172.21.15.142:0/26100427 shutdown_connections 2024-02-19T06:57:33.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.713+0000 7f546e000640 1 --2- 172.21.15.142:0/26100427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54680b34f0 0x7f54680d4120 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.713+0000 7f546e000640 1 --2- 172.21.15.142:0/26100427 >> v2:172.21.15.46:3300/0 conn(0x7f546815dcb0 0x7f54680b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.713+0000 7f546e000640 1 -- 172.21.15.142:0/26100427 >> 172.21.15.142:0/26100427 conn(0x7f546808afc0 msgr2=0x7f54680d36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:33.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.713+0000 7f546e000640 1 -- 172.21.15.142:0/26100427 shutdown_connections 2024-02-19T06:57:33.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.713+0000 7f546e000640 1 -- 172.21.15.142:0/26100427 wait complete. 2024-02-19T06:57:33.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.715+0000 7f546e000640 1 Processor -- start 2024-02-19T06:57:33.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.715+0000 7f546e000640 1 -- start start 2024-02-19T06:57:33.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54680b34f0 0x7f5468160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:33.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546e000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f546815dcb0 0x7f546814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:33.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5468161600 0x7f54680c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:33.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546e000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5468160eb0 con 0x7f5468161600 2024-02-19T06:57:33.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546e000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54680cbc30 con 0x7f546815dcb0 2024-02-19T06:57:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546e000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54680cbf10 con 0x7f54680b34f0 2024-02-19T06:57:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546cc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54680b34f0 0x7f5468160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f5467e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f546815dcb0 0x7f546814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546cc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54680b34f0 0x7f5468160970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:59982/0 (socket says 172.21.15.142:59982) 2024-02-19T06:57:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546cc00640 1 -- 172.21.15.142:0/1711882973 learned_addr learned my addr 172.21.15.142:0/1711882973 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T06:57:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546cc00640 1 -- 172.21.15.142:0/1711882973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f546815dcb0 msgr2=0x7f546814e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546cc00640 1 --2- 172.21.15.142:0/1711882973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f546815dcb0 0x7f546814e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546cc00640 1 -- 172.21.15.142:0/1711882973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5468161600 msgr2=0x7f54680c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546cc00640 1 --2- 172.21.15.142:0/1711882973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5468161600 0x7f54680c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.716+0000 7f546cc00640 1 -- 172.21.15.142:0/1711882973 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460009a70 con 0x7f54680b34f0 2024-02-19T06:57:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.717+0000 7f546cc00640 1 --2- 172.21.15.142:0/1711882973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54680b34f0 0x7f5468160970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f545c00c400 tx=0x7f545c00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.717+0000 7f5464c00640 1 -- 172.21.15.142:0/1711882973 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c0074e0 con 0x7f54680b34f0 2024-02-19T06:57:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.717+0000 7f5464c00640 1 -- 172.21.15.142:0/1711882973 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c007640 con 0x7f54680b34f0 2024-02-19T06:57:33.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.717+0000 7f5464c00640 1 -- 172.21.15.142:0/1711882973 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c0059e0 con 0x7f54680b34f0 2024-02-19T06:57:33.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.717+0000 7f546e000640 1 -- 172.21.15.142:0/1711882973 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54680cc1f0 con 0x7f54680b34f0 2024-02-19T06:57:33.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.717+0000 7f546e000640 1 -- 172.21.15.142:0/1711882973 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54680cc7b0 con 0x7f54680b34f0 2024-02-19T06:57:33.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.717+0000 7f5464c00640 1 -- 172.21.15.142:0/1711882973 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f545c005b40 con 0x7f54680b34f0 2024-02-19T06:57:33.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.717+0000 7f5464c00640 1 -- 172.21.15.142:0/1711882973 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f545c005df0 con 0x7f54680b34f0 2024-02-19T06:57:33.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.718+0000 7f546e000640 1 -- 172.21.15.142:0/1711882973 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546808b8e0 con 0x7f54680b34f0 2024-02-19T06:57:33.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.722+0000 7f5464c00640 1 -- 172.21.15.142:0/1711882973 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f545c017070 con 0x7f54680b34f0 2024-02-19T06:57:33.771 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:33.770+0000 7f97d0212040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-19T06:57:33.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.801+0000 7f546e000640 1 -- 172.21.15.142:0/1711882973 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "752fd739-8486-4611-a766-0f306e7d4a9a", "id": 6} v 0) v1 -- 0x7f546804eee0 con 0x7f54680b34f0 2024-02-19T06:57:33.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.810+0000 7f5464c00640 1 -- 172.21.15.142:0/1711882973 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "752fd739-8486-4611-a766-0f306e7d4a9a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f545c01c510 con 0x7f54680b34f0 2024-02-19T06:57:33.811 INFO:teuthology.orchestra.run.smithi142.stdout:6 2024-02-19T06:57:33.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.811+0000 7f546e000640 1 -- 172.21.15.142:0/1711882973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54680b34f0 msgr2=0x7f5468160970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:33.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.811+0000 7f546e000640 1 --2- 172.21.15.142:0/1711882973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54680b34f0 0x7f5468160970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f545c00c400 tx=0x7f545c00c8c0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.811+0000 7f546e000640 1 -- 172.21.15.142:0/1711882973 shutdown_connections 2024-02-19T06:57:33.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.811+0000 7f546e000640 1 --2- 172.21.15.142:0/1711882973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5468161600 0x7f54680c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.811+0000 7f546e000640 1 --2- 172.21.15.142:0/1711882973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f546815dcb0 0x7f546814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.811+0000 7f546e000640 1 --2- 172.21.15.142:0/1711882973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54680b34f0 0x7f5468160970 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:33.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.811+0000 7f546e000640 1 -- 172.21.15.142:0/1711882973 >> 172.21.15.142:0/1711882973 conn(0x7f546808afc0 msgr2=0x7f54680d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:33.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.811+0000 7f546e000640 1 -- 172.21.15.142:0/1711882973 shutdown_connections 2024-02-19T06:57:33.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:33.811+0000 7f546e000640 1 -- 172.21.15.142:0/1711882973 wait complete. 2024-02-19T06:57:33.825 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:33.824+0000 7f97d0212040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-19T06:57:33.828 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f 7 2024-02-19T06:57:33.922 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:33.920+0000 7fd4ab613040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.003+0000 7f72f4600640 1 Processor -- start 2024-02-19T06:57:34.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.003+0000 7f72f4600640 1 -- start start 2024-02-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.004+0000 7f72f4600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f72ec15dbc0 0x7f72ec0d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.004+0000 7f72f4600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f72ec0d1950 0x7f72ec0d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.004+0000 7f72f4600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ec0ce630 con 0x7f72ec0d2340 2024-02-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.004+0000 7f72f4600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec15dfa0 con 0x7f72ec15dbc0 2024-02-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.004+0000 7f72f4600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec0d27b0 con 0x7f72ec0d1950 2024-02-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.005+0000 7f72f1200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f72ec0d1950 0x7f72ec0d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.005+0000 7f72f1200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f72ec0d1950 0x7f72ec0d1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47786/0 (socket says 172.21.15.142:47786) 2024-02-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.005+0000 7f72f1200640 1 -- 172.21.15.142:0/1913169933 learned_addr learned my addr 172.21.15.142:0/1913169933 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.005+0000 7f72f1200640 1 -- 172.21.15.142:0/1913169933 >> v2:172.21.15.46:3300/0 conn(0x7f72ec15dbc0 msgr2=0x7f72ec0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.005+0000 7f72f1200640 1 --2- 172.21.15.142:0/1913169933 >> v2:172.21.15.46:3300/0 conn(0x7f72ec15dbc0 0x7f72ec0d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.005+0000 7f72f1200640 1 -- 172.21.15.142:0/1913169933 >> v1:172.21.15.46:6789/0 conn(0x7f72ec0d2340 legacy=0x7f72ec0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.005+0000 7f72f1200640 1 -- 172.21.15.142:0/1913169933 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec0ce860 con 0x7f72ec0d1950 2024-02-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.006+0000 7f72f1200640 1 --2- 172.21.15.142:0/1913169933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec0d1950 0x7f72ec0d1e00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f72ec073080 tx=0x7f72d802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb4a79be3fd78077 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.006+0000 7f72ebe00640 1 -- 172.21.15.142:0/1913169933 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8004230 con 0x7f72ec0d1950 2024-02-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.006+0000 7f72ebe00640 1 -- 172.21.15.142:0/1913169933 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d8004390 con 0x7f72ec0d1950 2024-02-19T06:57:34.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.006+0000 7f72ebe00640 1 -- 172.21.15.142:0/1913169933 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8003810 con 0x7f72ec0d1950 2024-02-19T06:57:34.008 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:34.007+0000 7f97d0212040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.007+0000 7f72f4600640 1 -- 172.21.15.142:0/1913169933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec0d1950 msgr2=0x7f72ec0d1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.007+0000 7f72f4600640 1 --2- 172.21.15.142:0/1913169933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec0d1950 0x7f72ec0d1e00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f72ec073080 tx=0x7f72d802b8f0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.007+0000 7f72f4600640 1 -- 172.21.15.142:0/1913169933 shutdown_connections 2024-02-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.007+0000 7f72f4600640 1 --2- 172.21.15.142:0/1913169933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec0d1950 0x7f72ec0d1e00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.007+0000 7f72f4600640 1 --2- 172.21.15.142:0/1913169933 >> v2:172.21.15.46:3300/0 conn(0x7f72ec15dbc0 0x7f72ec0d1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.007+0000 7f72f4600640 1 -- 172.21.15.142:0/1913169933 >> 172.21.15.142:0/1913169933 conn(0x7f72ec08afc0 msgr2=0x7f72ec0d3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.007+0000 7f72f4600640 1 -- 172.21.15.142:0/1913169933 shutdown_connections 2024-02-19T06:57:34.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.007+0000 7f72f4600640 1 -- 172.21.15.142:0/1913169933 wait complete. 2024-02-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.009+0000 7f72f4600640 1 Processor -- start 2024-02-19T06:57:34.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.009+0000 7f72f4600640 1 -- start start 2024-02-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.010+0000 7f72f4600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec0d1950 0x7f72ec1f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.010+0000 7f72f4600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec0d2340 0x7f72ec15b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.010+0000 7f72f4600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec15dbc0 0x7f72ec154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.010+0000 7f72f4600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0b65e0 con 0x7f72ec0d1950 2024-02-19T06:57:34.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.010+0000 7f72f4600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0b68a0 con 0x7f72ec15dbc0 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.010+0000 7f72f4600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0b6b80 con 0x7f72ec0d2340 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.010+0000 7f72f1200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec0d2340 0x7f72ec15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.010+0000 7f72f1200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec0d2340 0x7f72ec15b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:59990/0 (socket says 172.21.15.142:59990) 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.010+0000 7f72f1200640 1 -- 172.21.15.142:0/2800823983 learned_addr learned my addr 172.21.15.142:0/2800823983 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.010+0000 7f72f2600640 1 --2- 172.21.15.142:0/2800823983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec15dbc0 0x7f72ec154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.011+0000 7f72f1c00640 1 --2- 172.21.15.142:0/2800823983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec0d1950 0x7f72ec1f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.011+0000 7f72f1200640 1 -- 172.21.15.142:0/2800823983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec15dbc0 msgr2=0x7f72ec154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.011+0000 7f72f1200640 1 --2- 172.21.15.142:0/2800823983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec15dbc0 0x7f72ec154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.011+0000 7f72f1200640 1 -- 172.21.15.142:0/2800823983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec0d1950 msgr2=0x7f72ec1f7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.011+0000 7f72f1200640 1 --2- 172.21.15.142:0/2800823983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec0d1950 0x7f72ec1f7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.011+0000 7f72f1200640 1 -- 172.21.15.142:0/2800823983 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8009460 con 0x7f72ec0d2340 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.011+0000 7f72f1200640 1 --2- 172.21.15.142:0/2800823983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec0d2340 0x7f72ec15b080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f72d80090b0 tx=0x7f72d80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.011+0000 7f72e9600640 1 -- 172.21.15.142:0/2800823983 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8003c40 con 0x7f72ec0d2340 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.011+0000 7f72e9600640 1 -- 172.21.15.142:0/2800823983 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d803f070 con 0x7f72ec0d2340 2024-02-19T06:57:34.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.011+0000 7f72e9600640 1 -- 172.21.15.142:0/2800823983 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8004500 con 0x7f72ec0d2340 2024-02-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.011+0000 7f72f4600640 1 -- 172.21.15.142:0/2800823983 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec0b6e60 con 0x7f72ec0d2340 2024-02-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.011+0000 7f72f4600640 1 -- 172.21.15.142:0/2800823983 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ec1f83d0 con 0x7f72ec0d2340 2024-02-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.012+0000 7f72e9600640 1 -- 172.21.15.142:0/2800823983 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f72d8041030 con 0x7f72ec0d2340 2024-02-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.012+0000 7f72e9600640 1 -- 172.21.15.142:0/2800823983 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f72d803a460 con 0x7f72ec0d2340 2024-02-19T06:57:34.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.013+0000 7f72f4600640 1 -- 172.21.15.142:0/2800823983 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ec0b7380 con 0x7f72ec0d2340 2024-02-19T06:57:34.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.015+0000 7f72e9600640 1 -- 172.21.15.142:0/2800823983 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f72d8062dd0 con 0x7f72ec0d2340 2024-02-19T06:57:34.090 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:34.089+0000 7fd4ab613040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-19T06:57:34.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.094+0000 7f72f4600640 1 -- 172.21.15.142:0/2800823983 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f", "id": 7} v 0) v1 -- 0x7f72ec0d2d10 con 0x7f72ec0d2340 2024-02-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.103+0000 7f72e9600640 1 -- 172.21.15.142:0/2800823983 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72d8051070 con 0x7f72ec0d2340 2024-02-19T06:57:34.104 INFO:teuthology.orchestra.run.smithi142.stdout:7 2024-02-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.105+0000 7f72f4600640 1 -- 172.21.15.142:0/2800823983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec0d2340 msgr2=0x7f72ec15b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.105+0000 7f72f4600640 1 --2- 172.21.15.142:0/2800823983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec0d2340 0x7f72ec15b080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f72d80090b0 tx=0x7f72d80046c0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.105+0000 7f72f4600640 1 -- 172.21.15.142:0/2800823983 shutdown_connections 2024-02-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.105+0000 7f72f4600640 1 --2- 172.21.15.142:0/2800823983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec15dbc0 0x7f72ec154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.105+0000 7f72f4600640 1 --2- 172.21.15.142:0/2800823983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72ec0d2340 0x7f72ec15b080 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.105+0000 7f72f4600640 1 --2- 172.21.15.142:0/2800823983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec0d1950 0x7f72ec1f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.105+0000 7f72f4600640 1 -- 172.21.15.142:0/2800823983 >> 172.21.15.142:0/2800823983 conn(0x7f72ec08afc0 msgr2=0x7f72ec06cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.105+0000 7f72f4600640 1 -- 172.21.15.142:0/2800823983 shutdown_connections 2024-02-19T06:57:34.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:57:34.105+0000 7f72f4600640 1 -- 172.21.15.142:0/2800823983 wait complete. 2024-02-19T06:57:34.123 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-19T06:57:34.123 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-19T06:57:34.130 INFO:tasks.ceph.osd.0:Started 2024-02-19T06:57:34.131 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-19T06:57:34.131 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-19T06:57:34.138 INFO:tasks.ceph.osd.1:Started 2024-02-19T06:57:34.138 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-19T06:57:34.138 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-19T06:57:34.144 INFO:tasks.ceph.osd.2:Started 2024-02-19T06:57:34.144 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-19T06:57:34.144 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-19T06:57:34.148 INFO:tasks.ceph.osd.3:Started 2024-02-19T06:57:34.148 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-19T06:57:34.148 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-02-19T06:57:34.152 INFO:tasks.ceph.osd.4:Started 2024-02-19T06:57:34.153 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-19T06:57:34.153 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-02-19T06:57:34.157 INFO:tasks.ceph.osd.5:Started 2024-02-19T06:57:34.157 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-19T06:57:34.157 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-02-19T06:57:34.162 INFO:tasks.ceph.osd.6:Started 2024-02-19T06:57:34.162 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-19T06:57:34.162 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-02-19T06:57:34.167 INFO:tasks.ceph.osd.7:Started 2024-02-19T06:57:34.167 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:57:34.261 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:34.260+0000 7fd4ab613040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-19T06:57:34.341 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:34.340+0000 7fd4ab613040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.403+0000 7f44bf200640 1 Processor -- start 2024-02-19T06:57:34.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.403+0000 7f44bf200640 1 -- start start 2024-02-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.405+0000 7f44bf200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f44b80d22f0 0x7f44b81620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.405+0000 7f44bf200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b80d1710 con 0x7f44b80d0640 2024-02-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.405+0000 7f44bf200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b80d0a20 con 0x7f44b80ce250 2024-02-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.405+0000 7f44bf200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b815eec0 con 0x7f44b80d22f0 2024-02-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.405+0000 7f44bde00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f44b80d0640 0x7f44b80d1be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60384/0 (socket says 172.21.15.46:60384) 2024-02-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.405+0000 7f44bde00640 1 -- 172.21.15.46:0/1858095503 learned_addr learned my addr 172.21.15.46:0/1858095503 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:57:34.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.405+0000 7f44bd400640 1 --2- 172.21.15.46:0/1858095503 >> v2:172.21.15.142:3300/0 conn(0x7f44b80d22f0 0x7f44b81620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.406+0000 7f44bca00640 1 -- 172.21.15.46:0/1858095503 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582903770 0 0) 0x7f44b80d1710 con 0x7f44b80d0640 2024-02-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.406+0000 7f44bca00640 1 -- 172.21.15.46:0/1858095503 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a0003520 con 0x7f44b80d0640 2024-02-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.406+0000 7f44bca00640 1 -- 172.21.15.46:0/1858095503 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034848260 0 0) 0x7f44b80d0a20 con 0x7f44b80ce250 2024-02-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.406+0000 7f44bca00640 1 -- 172.21.15.46:0/1858095503 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44b80d1710 con 0x7f44b80ce250 2024-02-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.406+0000 7f44bd400640 1 -- 172.21.15.46:0/1858095503 >> v1:172.21.15.142:6789/0 conn(0x7f44b80ce250 legacy=0x7f44b80ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.406+0000 7f44bd400640 1 -- 172.21.15.46:0/1858095503 >> v1:172.21.15.46:6789/0 conn(0x7f44b80d0640 legacy=0x7f44b80d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:34.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.406+0000 7f44bd400640 1 -- 172.21.15.46:0/1858095503 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b815ebe0 con 0x7f44b80d22f0 2024-02-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.407+0000 7f44bd400640 1 --2- 172.21.15.46:0/1858095503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b80d22f0 0x7f44b81620c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009790 tx=0x7f44a802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68b23c5278655afc server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.407+0000 7f44bca00640 1 -- 172.21.15.46:0/1858095503 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8030610 con 0x7f44b80d22f0 2024-02-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.407+0000 7f44bca00640 1 -- 172.21.15.46:0/1858095503 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a8030770 con 0x7f44b80d22f0 2024-02-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.407+0000 7f44bca00640 1 -- 172.21.15.46:0/1858095503 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8030b00 con 0x7f44b80d22f0 2024-02-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.408+0000 7f44bf200640 1 -- 172.21.15.46:0/1858095503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b80d22f0 msgr2=0x7f44b81620c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:34.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.408+0000 7f44bf200640 1 --2- 172.21.15.46:0/1858095503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b80d22f0 0x7f44b81620c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009790 tx=0x7f44a802b960 comp rx=0 tx=0).stop 2024-02-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.408+0000 7f44bf200640 1 -- 172.21.15.46:0/1858095503 shutdown_connections 2024-02-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.408+0000 7f44bf200640 1 --2- 172.21.15.46:0/1858095503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b80d22f0 0x7f44b81620c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.408+0000 7f44bf200640 1 -- 172.21.15.46:0/1858095503 >> 172.21.15.46:0/1858095503 conn(0x7f44b809ca80 msgr2=0x7f44b808afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.408+0000 7f44bf200640 1 -- 172.21.15.46:0/1858095503 shutdown_connections 2024-02-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.408+0000 7f44bf200640 1 -- 172.21.15.46:0/1858095503 wait complete. 2024-02-19T06:57:34.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.409+0000 7f44bf200640 1 Processor -- start 2024-02-19T06:57:34.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.409+0000 7f44bf200640 1 -- start start 2024-02-19T06:57:34.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.410+0000 7f44bf200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44b80ce250 0x7f44b80a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.410+0000 7f44bf200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b80d0640 0x7f44b81f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.410+0000 7f44bf200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b80d22f0 0x7f44b81f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.410+0000 7f44bf200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80a1090 con 0x7f44b80ce250 2024-02-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.410+0000 7f44bf200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80cafd0 con 0x7f44b80d22f0 2024-02-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.410+0000 7f44bf200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80cb2b0 con 0x7f44b80d0640 2024-02-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.411+0000 7f44bde00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44b80ce250 0x7f44b80a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.411+0000 7f44bde00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44b80ce250 0x7f44b80a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44470/0 (socket says 172.21.15.46:44470) 2024-02-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.411+0000 7f44bde00640 1 -- 172.21.15.46:0/1508063280 learned_addr learned my addr 172.21.15.46:0/1508063280 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.411+0000 7f44be800640 1 --2- 172.21.15.46:0/1508063280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b80d22f0 0x7f44b81f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.411+0000 7f44bd400640 1 --2- 172.21.15.46:0/1508063280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b80d0640 0x7f44b81f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.411+0000 7f44be800640 1 -- 172.21.15.46:0/1508063280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b80d0640 msgr2=0x7f44b81f3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.411+0000 7f44be800640 1 --2- 172.21.15.46:0/1508063280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b80d0640 0x7f44b81f3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.411+0000 7f44be800640 1 -- 172.21.15.46:0/1508063280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44b80ce250 msgr2=0x7f44b80a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.411+0000 7f44be800640 1 --2- 172.21.15.46:0/1508063280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44b80ce250 0x7f44b80a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.411+0000 7f44be800640 1 -- 172.21.15.46:0/1508063280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a80093a0 con 0x7f44b80d22f0 2024-02-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.411+0000 7f44bde00640 1 --2- 172.21.15.46:0/1508063280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44b80ce250 0x7f44b80a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:57:34.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.411+0000 7f44be800640 1 --2- 172.21.15.46:0/1508063280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b80d22f0 0x7f44b81f4100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f44b400c6f0 tx=0x7f44b400cbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.412+0000 7f44b2000640 1 -- 172.21.15.46:0/1508063280 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4003970 con 0x7f44b80d22f0 2024-02-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.412+0000 7f44b2000640 1 -- 172.21.15.46:0/1508063280 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b4003af0 con 0x7f44b80d22f0 2024-02-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.412+0000 7f44bf200640 1 -- 172.21.15.46:0/1508063280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b80cb590 con 0x7f44b80d22f0 2024-02-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.412+0000 7f44b2000640 1 -- 172.21.15.46:0/1508063280 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4003ea0 con 0x7f44b80d22f0 2024-02-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.412+0000 7f44bf200640 1 -- 172.21.15.46:0/1508063280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b80b6fe0 con 0x7f44b80d22f0 2024-02-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.412+0000 7f44b2000640 1 -- 172.21.15.46:0/1508063280 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f44b400a850 con 0x7f44b80d22f0 2024-02-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.412+0000 7f44b2000640 1 -- 172.21.15.46:0/1508063280 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f44b400ab00 con 0x7f44b80d22f0 2024-02-19T06:57:34.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.413+0000 7f44bf200640 1 -- 172.21.15.46:0/1508063280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b80cbab0 con 0x7f44b80d22f0 2024-02-19T06:57:34.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.417+0000 7f44b2000640 1 -- 172.21.15.46:0/1508063280 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f44b80cbab0 con 0x7f44b80d22f0 2024-02-19T06:57:34.479 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:34.478+0000 7fd4ab613040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-19T06:57:34.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.482+0000 7f44bf200640 1 -- 172.21.15.46:0/1508063280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44b8067c80 con 0x7f44b80d22f0 2024-02-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.483+0000 7f44b2000640 1 -- 172.21.15.46:0/1508063280 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f44b400ad60 con 0x7f44b80d22f0 2024-02-19T06:57:34.484 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:34.095888+0000","last_up_change":"0.000000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.484+0000 7f44bf200640 1 -- 172.21.15.46:0/1508063280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b80d22f0 msgr2=0x7f44b81f4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.484+0000 7f44bf200640 1 --2- 172.21.15.46:0/1508063280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b80d22f0 0x7f44b81f4100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f44b400c6f0 tx=0x7f44b400cbb0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.484+0000 7f44bf200640 1 -- 172.21.15.46:0/1508063280 shutdown_connections 2024-02-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.484+0000 7f44bf200640 1 --2- 172.21.15.46:0/1508063280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b80d22f0 0x7f44b81f4100 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.484+0000 7f44bf200640 1 --2- 172.21.15.46:0/1508063280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b80d0640 0x7f44b81f3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.484+0000 7f44bf200640 1 --2- 172.21.15.46:0/1508063280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44b80ce250 0x7f44b80a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.484+0000 7f44bf200640 1 -- 172.21.15.46:0/1508063280 >> 172.21.15.46:0/1508063280 conn(0x7f44b809ca80 msgr2=0x7f44b80d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.485+0000 7f44bf200640 1 -- 172.21.15.46:0/1508063280 shutdown_connections 2024-02-19T06:57:34.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:34.485+0000 7f44bf200640 1 -- 172.21.15.46:0/1508063280 wait complete. 2024-02-19T06:57:34.502 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-19T06:57:34.502 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-19T06:57:34.598 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:34.597+0000 7fd4ab613040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-19T06:57:34.782 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:34.780+0000 7fd4ab613040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-19T06:57:34.834 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:34.832+0000 7fd4ab613040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-19T06:57:34.834 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T06:57:34.833+0000 7f35b05e1640 -1 Falling back to public interface 2024-02-19T06:57:34.836 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T06:57:34.835+0000 7fc968502640 -1 Falling back to public interface 2024-02-19T06:57:34.846 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T06:57:34.846+0000 7f7187837640 -1 Falling back to public interface 2024-02-19T06:57:34.852 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-02-19T06:57:34.851+0000 7f5e6aad3640 -1 Falling back to public interface 2024-02-19T06:57:34.856 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T06:57:34.855+0000 7f8a0d9a8640 -1 Falling back to public interface 2024-02-19T06:57:34.858 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T06:57:34.856+0000 7f8a0c400640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6814/0: (98) Address already in use 2024-02-19T06:57:34.862 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T06:57:34.861+0000 7f3c08d9e640 -1 Falling back to public interface 2024-02-19T06:57:34.881 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T06:57:34.880+0000 7f99f9d93640 -1 Falling back to public interface 2024-02-19T06:57:34.890 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-02-19T06:57:34.889+0000 7f3519415640 -1 Falling back to public interface 2024-02-19T06:57:35.022 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:35.021+0000 7fd4ab613040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-19T06:57:35.130 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:35.129+0000 7f97d0212040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-19T06:57:35.309 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-19T06:57:35.444 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:35.443+0000 7f97d0212040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-19T06:57:35.475 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.473+0000 7f420b400640 1 Processor -- start 2024-02-19T06:57:35.475 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.474+0000 7f420b400640 1 -- start start 2024-02-19T06:57:35.476 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.475+0000 7f420b400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42040710a0 0x7f42040714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:35.477 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.475+0000 7f420b400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f420415be50 0x7f420415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:35.477 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.475+0000 7f420b400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4204071a20 con 0x7f420415ee20 2024-02-19T06:57:35.477 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.475+0000 7f420b400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420406d580 con 0x7f420415be50 2024-02-19T06:57:35.477 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.475+0000 7f420b400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420406d860 con 0x7f42040710a0 2024-02-19T06:57:35.477 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.475+0000 7f4203e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42040710a0 0x7f42040714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:35.477 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.475+0000 7f4209400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f420415be50 0x7f420415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:35.477 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.475+0000 7f4209400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f420415be50 0x7f420415c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:53720/0 (socket says 172.21.15.46:53720) 2024-02-19T06:57:35.477 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.475+0000 7f4203e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42040710a0 0x7f42040714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:55682/0 (socket says 172.21.15.46:55682) 2024-02-19T06:57:35.477 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.475+0000 7f4209400640 1 -- 172.21.15.46:0/1746969984 learned_addr learned my addr 172.21.15.46:0/1746969984 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:35.478 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.476+0000 7f4203e00640 1 -- 172.21.15.46:0/1746969984 >> v2:172.21.15.142:3300/0 conn(0x7f420415be50 msgr2=0x7f420415c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:35.478 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.476+0000 7f4203e00640 1 --2- 172.21.15.46:0/1746969984 >> v2:172.21.15.142:3300/0 conn(0x7f420415be50 0x7f420415c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:35.478 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.476+0000 7f4203e00640 1 -- 172.21.15.46:0/1746969984 >> v1:172.21.15.142:6789/0 conn(0x7f420415ee20 legacy=0x7f420415fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:35.478 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.476+0000 7f4203e00640 1 -- 172.21.15.46:0/1746969984 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420406db40 con 0x7f42040710a0 2024-02-19T06:57:35.478 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.476+0000 7f4203400640 1 -- 172.21.15.46:0/1746969984 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266765924 0 0) 0x7f4204071a20 con 0x7f420415ee20 2024-02-19T06:57:35.478 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.476+0000 7f4209400640 1 --2- 172.21.15.46:0/1746969984 >> v2:172.21.15.142:3300/0 conn(0x7f420415be50 0x7f420415c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:57:35.479 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.477+0000 7f4203e00640 1 --2- 172.21.15.46:0/1746969984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42040710a0 0x7f42040714e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f41f00097a0 tx=0x7f41f002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3343a8b170e24fb1 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:35.479 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.477+0000 7f4203400640 1 -- 172.21.15.46:0/1746969984 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0031830 con 0x7f42040710a0 2024-02-19T06:57:35.479 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.477+0000 7f4203400640 1 -- 172.21.15.46:0/1746969984 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f0031990 con 0x7f42040710a0 2024-02-19T06:57:35.479 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.477+0000 7f4203400640 1 -- 172.21.15.46:0/1746969984 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0031d20 con 0x7f42040710a0 2024-02-19T06:57:35.480 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.478+0000 7f420b400640 1 -- 172.21.15.46:0/1746969984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42040710a0 msgr2=0x7f42040714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:35.480 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.478+0000 7f420b400640 1 --2- 172.21.15.46:0/1746969984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42040710a0 0x7f42040714e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f41f00097a0 tx=0x7f41f002b8d0 comp rx=0 tx=0).stop 2024-02-19T06:57:35.480 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.478+0000 7f420b400640 1 -- 172.21.15.46:0/1746969984 shutdown_connections 2024-02-19T06:57:35.480 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.478+0000 7f420b400640 1 --2- 172.21.15.46:0/1746969984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42040710a0 0x7f42040714e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:35.480 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.478+0000 7f420b400640 1 --2- 172.21.15.46:0/1746969984 >> v2:172.21.15.142:3300/0 conn(0x7f420415be50 0x7f420415c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:35.480 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.478+0000 7f420b400640 1 -- 172.21.15.46:0/1746969984 >> 172.21.15.46:0/1746969984 conn(0x7f4204067030 msgr2=0x7f420406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:35.480 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.478+0000 7f420b400640 1 -- 172.21.15.46:0/1746969984 shutdown_connections 2024-02-19T06:57:35.480 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.478+0000 7f420b400640 1 -- 172.21.15.46:0/1746969984 wait complete. 2024-02-19T06:57:35.482 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.481+0000 7f420b400640 1 Processor -- start 2024-02-19T06:57:35.482 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.481+0000 7f420b400640 1 -- start start 2024-02-19T06:57:35.486 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.483+0000 7f420b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42040710a0 0x7f42040c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:35.486 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.483+0000 7f420b400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f420415be50 0x7f42040ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:35.486 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.483+0000 7f420b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420415ee20 0x7f420413dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:35.486 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.483+0000 7f420b400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42040c4c90 con 0x7f42040710a0 2024-02-19T06:57:35.486 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.483+0000 7f420b400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42040b4770 con 0x7f420415ee20 2024-02-19T06:57:35.486 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.483+0000 7f420b400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42040adcf0 con 0x7f420415be50 2024-02-19T06:57:35.486 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.483+0000 7f4208a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42040710a0 0x7f42040c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:35.486 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.483+0000 7f4208a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42040710a0 0x7f42040c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33600/0 (socket says 172.21.15.46:33600) 2024-02-19T06:57:35.486 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.483+0000 7f4208a00640 1 -- 172.21.15.46:0/100711694 learned_addr learned my addr 172.21.15.46:0/100711694 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:35.486 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.483+0000 7f4203e00640 1 --2- 172.21.15.46:0/100711694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f420415be50 0x7f42040ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:35.486 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.483+0000 7f4209400640 1 --2- 172.21.15.46:0/100711694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420415ee20 0x7f420413dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:35.486 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.484+0000 7f4208a00640 1 -- 172.21.15.46:0/100711694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f420415be50 msgr2=0x7f42040ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:35.487 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.484+0000 7f4208a00640 1 --2- 172.21.15.46:0/100711694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f420415be50 0x7f42040ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:35.487 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.484+0000 7f4208a00640 1 -- 172.21.15.46:0/100711694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420415ee20 msgr2=0x7f420413dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:35.487 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.484+0000 7f4208a00640 1 --2- 172.21.15.46:0/100711694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420415ee20 0x7f420413dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:35.487 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.484+0000 7f4208a00640 1 -- 172.21.15.46:0/100711694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc009b30 con 0x7f42040710a0 2024-02-19T06:57:35.487 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.484+0000 7f4208a00640 1 --2- 172.21.15.46:0/100711694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42040710a0 0x7f42040c4750 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f41f800c470 tx=0x7f41f800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:35.487 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.484+0000 7f4200c00640 1 -- 172.21.15.46:0/100711694 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8005480 con 0x7f42040710a0 2024-02-19T06:57:35.487 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.484+0000 7f4200c00640 1 -- 172.21.15.46:0/100711694 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f80035f0 con 0x7f42040710a0 2024-02-19T06:57:35.487 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.484+0000 7f420b400640 1 -- 172.21.15.46:0/100711694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f0009400 con 0x7f42040710a0 2024-02-19T06:57:35.487 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.484+0000 7f4200c00640 1 -- 172.21.15.46:0/100711694 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f80039a0 con 0x7f42040710a0 2024-02-19T06:57:35.487 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.484+0000 7f420b400640 1 -- 172.21.15.46:0/100711694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42040b4490 con 0x7f42040710a0 2024-02-19T06:57:35.487 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.485+0000 7f4200c00640 1 -- 172.21.15.46:0/100711694 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f41f8003b00 con 0x7f42040710a0 2024-02-19T06:57:35.487 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.485+0000 7f4200c00640 1 -- 172.21.15.46:0/100711694 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f41f8012ad0 con 0x7f42040710a0 2024-02-19T06:57:35.488 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.485+0000 7f420b400640 1 -- 172.21.15.46:0/100711694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420406bb10 con 0x7f42040710a0 2024-02-19T06:57:35.490 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.489+0000 7f4200c00640 1 -- 172.21.15.46:0/100711694 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f41f8017070 con 0x7f42040710a0 2024-02-19T06:57:35.506 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:35.506+0000 7f97d0212040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-19T06:57:35.558 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.557+0000 7f420b400640 1 -- 172.21.15.46:0/100711694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f420404eee0 con 0x7f42040710a0 2024-02-19T06:57:35.559 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.558+0000 7f4200c00640 1 -- 172.21.15.46:0/100711694 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f41f8012400 con 0x7f42040710a0 2024-02-19T06:57:35.560 INFO:teuthology.misc.health.smithi046.stdout: 2024-02-19T06:57:35.560 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":10,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:34.095888+0000","last_up_change":"0.000000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:57:35.561 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.559+0000 7f420b400640 1 -- 172.21.15.46:0/100711694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42040710a0 msgr2=0x7f42040c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:35.561 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.560+0000 7f420b400640 1 --2- 172.21.15.46:0/100711694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42040710a0 0x7f42040c4750 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f41f800c470 tx=0x7f41f800c930 comp rx=0 tx=0).stop 2024-02-19T06:57:35.561 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.560+0000 7f420b400640 1 -- 172.21.15.46:0/100711694 shutdown_connections 2024-02-19T06:57:35.561 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.560+0000 7f420b400640 1 --2- 172.21.15.46:0/100711694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420415ee20 0x7f420413dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:35.561 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.560+0000 7f420b400640 1 --2- 172.21.15.46:0/100711694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f420415be50 0x7f42040ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:35.562 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.560+0000 7f420b400640 1 --2- 172.21.15.46:0/100711694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42040710a0 0x7f42040c4750 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:35.562 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.560+0000 7f420b400640 1 -- 172.21.15.46:0/100711694 >> 172.21.15.46:0/100711694 conn(0x7f4204067030 msgr2=0x7f42040b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:35.562 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.560+0000 7f420b400640 1 -- 172.21.15.46:0/100711694 shutdown_connections 2024-02-19T06:57:35.562 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:35.560+0000 7f420b400640 1 -- 172.21.15.46:0/100711694 wait complete. 2024-02-19T06:57:35.577 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-19T06:57:35.636 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:35.635+0000 7f97d0212040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-19T06:57:36.104 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:36.102+0000 7fd4ab613040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-19T06:57:36.451 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:36.450+0000 7fd4ab613040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-19T06:57:36.515 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:36.514+0000 7fd4ab613040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-19T06:57:36.654 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-02-19T06:57:36.652+0000 7fd4ab613040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-19T06:57:36.673 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:36.672+0000 7f9770800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-19T06:57:36.674 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-19T06:57:36.672+0000 7f9770800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-19T06:57:38.354 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T06:57:38.353+0000 7f35b05e1640 -1 osd.4 0 log_to_monitors true 2024-02-19T06:57:38.375 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T06:57:38.374+0000 7fc968502640 -1 osd.2 0 log_to_monitors true 2024-02-19T06:57:38.418 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T06:57:38.417+0000 7f99f9d93640 -1 osd.7 0 log_to_monitors true 2024-02-19T06:57:38.424 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-02-19T06:57:38.423+0000 7f5e6aad3640 -1 osd.0 0 log_to_monitors true 2024-02-19T06:57:38.665 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T06:57:38.664+0000 7f7187837640 -1 osd.5 0 log_to_monitors true 2024-02-19T06:57:38.680 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T06:57:38.678+0000 7f8a0d9a8640 -1 osd.1 0 log_to_monitors true 2024-02-19T06:57:38.698 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T06:57:38.697+0000 7f3c08d9e640 -1 osd.6 0 log_to_monitors true 2024-02-19T06:57:38.705 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-02-19T06:57:38.704+0000 7f3519415640 -1 osd.3 0 log_to_monitors true 2024-02-19T06:57:41.110 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-02-19T06:57:41.108+0000 7f5e66e00640 -1 osd.0 0 waiting for initial osdmap 2024-02-19T06:57:41.115 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T06:57:41.114+0000 7fc962a00640 -1 osd.2 0 waiting for initial osdmap 2024-02-19T06:57:41.119 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-02-19T06:57:41.118+0000 7f5e5ba00640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T06:57:41.132 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T06:57:41.131+0000 7fc959400640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T06:57:41.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T06:57:41.244 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T06:57:41.388 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T06:57:41.388+0000 7f35ac800640 -1 osd.4 0 waiting for initial osdmap 2024-02-19T06:57:41.413 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T06:57:41.412+0000 7f35a1400640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T06:57:41.432 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T06:57:41.432+0000 7f99f4200640 -1 osd.7 0 waiting for initial osdmap 2024-02-19T06:57:41.456 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T06:57:41.455+0000 7f99eac00640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T06:57:42.009 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T06:57:42.007+0000 7f8a07e00640 -1 osd.1 0 waiting for initial osdmap 2024-02-19T06:57:42.016 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T06:57:42.014+0000 7f89fe800640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T06:57:42.019 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-02-19T06:57:42.018+0000 7f3513200640 -1 osd.3 0 waiting for initial osdmap 2024-02-19T06:57:42.030 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-02-19T06:57:42.029+0000 7f3509c00640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T06:57:42.211 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T06:57:42.210+0000 7f7181c00640 -1 osd.5 0 waiting for initial osdmap 2024-02-19T06:57:42.222 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T06:57:42.221+0000 7f7178600640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T06:57:42.223 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T06:57:42.222+0000 7f3c03200640 -1 osd.6 0 waiting for initial osdmap 2024-02-19T06:57:42.234 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T06:57:42.233+0000 7f3bf9c00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T06:57:42.384 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-19T06:57:42.579 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.577+0000 7fdd8b200640 1 Processor -- start 2024-02-19T06:57:42.579 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.578+0000 7fdd8b200640 1 -- start start 2024-02-19T06:57:42.584 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.579+0000 7fdd8b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd8c0d1970 0x7fdd8c0d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:42.584 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.579+0000 7fdd8b200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c0d0ff0 con 0x7fdd8c15db60 2024-02-19T06:57:42.584 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.579+0000 7fdd8b200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c0d1f30 con 0x7fdd8c0d0b60 2024-02-19T06:57:42.584 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.579+0000 7fdd8b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c0d2210 con 0x7fdd8c0d1970 2024-02-19T06:57:42.584 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.580+0000 7fdd89e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdd8c15db60 0x7fdd8c0d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59150/0 (socket says 172.21.15.46:59150) 2024-02-19T06:57:42.584 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.580+0000 7fdd89e00640 1 -- 172.21.15.46:0/1099115246 learned_addr learned my addr 172.21.15.46:0/1099115246 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:57:42.584 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.580+0000 7fdd83e00640 1 --2- 172.21.15.46:0/1099115246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd8c0d1970 0x7fdd8c0d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:42.584 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.580+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833809372 0 0) 0x7fdd7c001110 con 0x7fdd8c15db60 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.580+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd70003520 con 0x7fdd8c15db60 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3243064464 0 0) 0x7fdd70003520 con 0x7fdd8c15db60 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd8c0d1970 msgr2=0x7fdd8c0d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd89400640 1 --2- 172.21.15.46:0/1099115246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd8c0d1970 0x7fdd8c0d0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 >> v1:172.21.15.142:6789/0 conn(0x7fdd8c0d0b60 legacy=0x7fdd8c0b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c0d24f0 con 0x7fdd8c15db60 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fdd7c001800 con 0x7fdd8c15db60 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd83e00640 1 --2- 172.21.15.46:0/1099115246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd8c0d1970 0x7fdd8c0d0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 >> v1:172.21.15.46:6789/0 conn(0x7fdd8c15db60 legacy=0x7fdd8c0d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd89400640 1 --2- 172.21.15.46:0/1099115246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd8c0d1970 0x7fdd700039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd89400640 1 --2- 172.21.15.46:0/1099115246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd70003f30 0x7fdd700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd89400640 1 --2- 172.21.15.46:0/1099115246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd70004d00 0x7fdd70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c0d2210 con 0x7fdd70003f30 2024-02-19T06:57:42.585 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7000ba90 con 0x7fdd70004d00 2024-02-19T06:57:42.586 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7000bc50 con 0x7fdd8c0d1970 2024-02-19T06:57:42.586 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.581+0000 7fdd83e00640 1 --2- 172.21.15.46:0/1099115246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd70003f30 0x7fdd700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:42.586 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.582+0000 7fdd83e00640 1 -- 172.21.15.46:0/1099115246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd8c0d1970 msgr2=0x7fdd700039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:42.586 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.582+0000 7fdd8a800640 1 --2- 172.21.15.46:0/1099115246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd70004d00 0x7fdd70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:42.586 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.582+0000 7fdd83e00640 1 --2- 172.21.15.46:0/1099115246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd8c0d1970 0x7fdd700039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:42.586 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.582+0000 7fdd83e00640 1 -- 172.21.15.46:0/1099115246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd70004d00 msgr2=0x7fdd70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:42.586 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.582+0000 7fdd83e00640 1 --2- 172.21.15.46:0/1099115246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd70004d00 0x7fdd70005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:42.586 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.582+0000 7fdd83e00640 1 -- 172.21.15.46:0/1099115246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740093a0 con 0x7fdd70003f30 2024-02-19T06:57:42.586 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.582+0000 7fdd8a800640 1 --2- 172.21.15.46:0/1099115246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd70004d00 0x7fdd70005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:42.586 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.583+0000 7fdd83e00640 1 --2- 172.21.15.46:0/1099115246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd70003f30 0x7fdd700047c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009c50 tx=0x7fdd700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d994bca2019ff0e server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:42.589 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.583+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7402c8f0 con 0x7fdd70003f30 2024-02-19T06:57:42.589 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.583+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7402ca50 con 0x7fdd70003f30 2024-02-19T06:57:42.590 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.583+0000 7fdd89400640 1 -- 172.21.15.46:0/1099115246 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7402ce40 con 0x7fdd70003f30 2024-02-19T06:57:42.590 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.583+0000 7fdd8b200640 1 -- 172.21.15.46:0/1099115246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd70003f30 msgr2=0x7fdd700047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:42.590 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.583+0000 7fdd8b200640 1 --2- 172.21.15.46:0/1099115246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd70003f30 0x7fdd700047c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009c50 tx=0x7fdd700057f0 comp rx=0 tx=0).stop 2024-02-19T06:57:42.590 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.583+0000 7fdd8a800640 1 -- 172.21.15.46:0/1099115246 reap_dead start 2024-02-19T06:57:42.590 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.584+0000 7fdd8b200640 1 -- 172.21.15.46:0/1099115246 shutdown_connections 2024-02-19T06:57:42.590 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.584+0000 7fdd8b200640 1 -- 172.21.15.46:0/1099115246 >> 172.21.15.46:0/1099115246 conn(0x7fdd8c072490 msgr2=0x7fdd8c0728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:42.590 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.584+0000 7fdd8b200640 1 -- 172.21.15.46:0/1099115246 shutdown_connections 2024-02-19T06:57:42.590 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.584+0000 7fdd8b200640 1 -- 172.21.15.46:0/1099115246 wait complete. 2024-02-19T06:57:42.590 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.585+0000 7fdd8b200640 1 Processor -- start 2024-02-19T06:57:42.590 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.585+0000 7fdd8b200640 1 -- start start 2024-02-19T06:57:42.590 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.586+0000 7fdd8b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd8c160ae0 0x7fdd8c1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:42.590 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.586+0000 7fdd8b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd8c143b20 0x7fdd8c1f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:42.590 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.586+0000 7fdd8b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd8c153e20 0x7fdd8c1542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:42.591 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.586+0000 7fdd8b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c154810 con 0x7fdd8c153e20 2024-02-19T06:57:42.591 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.586+0000 7fdd8b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c156e60 con 0x7fdd8c143b20 2024-02-19T06:57:42.591 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.586+0000 7fdd8b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c157140 con 0x7fdd8c160ae0 2024-02-19T06:57:42.591 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.587+0000 7fdd8a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd8c153e20 0x7fdd8c1542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:42.591 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.587+0000 7fdd8a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd8c153e20 0x7fdd8c1542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33656/0 (socket says 172.21.15.46:33656) 2024-02-19T06:57:42.591 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.587+0000 7fdd8a800640 1 -- 172.21.15.46:0/2827134827 learned_addr learned my addr 172.21.15.46:0/2827134827 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:42.591 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.587+0000 7fdd89e00640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd8c160ae0 0x7fdd8c1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:42.591 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.587+0000 7fdd83e00640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd8c143b20 0x7fdd8c1f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:42.591 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.587+0000 7fdd8a800640 1 -- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd8c160ae0 msgr2=0x7fdd8c1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:42.591 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.587+0000 7fdd8a800640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd8c160ae0 0x7fdd8c1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:42.591 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.587+0000 7fdd8a800640 1 -- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd8c143b20 msgr2=0x7fdd8c1f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:42.591 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.587+0000 7fdd8a800640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd8c143b20 0x7fdd8c1f4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:42.591 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.587+0000 7fdd8a800640 1 -- 172.21.15.46:0/2827134827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c0c8510 con 0x7fdd8c153e20 2024-02-19T06:57:42.592 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.587+0000 7fdd83e00640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd8c143b20 0x7fdd8c1f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:42.592 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.587+0000 7fdd8a800640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd8c153e20 0x7fdd8c1542d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0cdef0 tx=0x7fdd8400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:42.592 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.588+0000 7fdd82000640 1 -- 172.21.15.46:0/2827134827 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84003b70 con 0x7fdd8c153e20 2024-02-19T06:57:42.592 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.588+0000 7fdd82000640 1 -- 172.21.15.46:0/2827134827 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd84003cf0 con 0x7fdd8c153e20 2024-02-19T06:57:42.592 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.588+0000 7fdd82000640 1 -- 172.21.15.46:0/2827134827 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd840052b0 con 0x7fdd8c153e20 2024-02-19T06:57:42.592 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.588+0000 7fdd8b200640 1 -- 172.21.15.46:0/2827134827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c0c87f0 con 0x7fdd8c153e20 2024-02-19T06:57:42.592 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.588+0000 7fdd8b200640 1 -- 172.21.15.46:0/2827134827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c160ec0 con 0x7fdd8c153e20 2024-02-19T06:57:42.593 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.589+0000 7fdd8b200640 1 -- 172.21.15.46:0/2827134827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c0c8d10 con 0x7fdd8c153e20 2024-02-19T06:57:42.596 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.590+0000 7fdd82000640 1 -- 172.21.15.46:0/2827134827 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7fdd84005410 con 0x7fdd8c153e20 2024-02-19T06:57:42.596 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.591+0000 7fdd82000640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdd6806b780 0x7fdd6806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:42.596 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.591+0000 7fdd82000640 1 -- 172.21.15.46:0/2827134827 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3911+0+0 (secure 0 0 0) 0x7fdd84089300 con 0x7fdd8c153e20 2024-02-19T06:57:42.596 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.591+0000 7fdd89e00640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdd6806b780 0x7fdd6806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:42.597 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.592+0000 7fdd89e00640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdd6806b780 0x7fdd6806dc40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c001270 tx=0x7fdd7c001200 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:42.597 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.595+0000 7fdd82000640 1 -- 172.21.15.46:0/2827134827 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdd8c0c8d10 con 0x7fdd8c153e20 2024-02-19T06:57:42.794 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.793+0000 7fdd8b200640 1 -- 172.21.15.46:0/2827134827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd8c0c8d10 con 0x7fdd8c153e20 2024-02-19T06:57:42.795 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.794+0000 7fdd82000640 1 -- 172.21.15.46:0/2827134827 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9937 (secure 0 0 0) 0x7fdd8c0c8d10 con 0x7fdd8c153e20 2024-02-19T06:57:42.796 INFO:teuthology.misc.health.smithi046.stdout: 2024-02-19T06:57:42.796 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":14,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:42.126329+0000","last_up_change":"2024-02-19T06:57:42.126329+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:57:42.798 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.797+0000 7fdd8b200640 1 -- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdd6806b780 msgr2=0x7fdd6806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:42.799 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.797+0000 7fdd8b200640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdd6806b780 0x7fdd6806dc40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c001270 tx=0x7fdd7c001200 comp rx=0 tx=0).stop 2024-02-19T06:57:42.799 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.797+0000 7fdd8b200640 1 -- 172.21.15.46:0/2827134827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd8c153e20 msgr2=0x7fdd8c1542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:42.799 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.797+0000 7fdd8b200640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd8c153e20 0x7fdd8c1542d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0cdef0 tx=0x7fdd8400dc00 comp rx=0 tx=0).stop 2024-02-19T06:57:42.799 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.797+0000 7fdd8b200640 1 -- 172.21.15.46:0/2827134827 shutdown_connections 2024-02-19T06:57:42.799 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.797+0000 7fdd8b200640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdd6806b780 0x7fdd6806dc40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:42.799 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.797+0000 7fdd8b200640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd8c153e20 0x7fdd8c1542d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:42.799 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.797+0000 7fdd8b200640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd8c143b20 0x7fdd8c1f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:42.799 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.797+0000 7fdd8b200640 1 --2- 172.21.15.46:0/2827134827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd8c160ae0 0x7fdd8c1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:42.799 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.797+0000 7fdd8b200640 1 -- 172.21.15.46:0/2827134827 >> 172.21.15.46:0/2827134827 conn(0x7fdd8c072490 msgr2=0x7fdd8c0b6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:42.799 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.797+0000 7fdd8b200640 1 -- 172.21.15.46:0/2827134827 shutdown_connections 2024-02-19T06:57:42.799 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:42.797+0000 7fdd8b200640 1 -- 172.21.15.46:0/2827134827 wait complete. 2024-02-19T06:57:42.812 DEBUG:teuthology.misc:6 of 8 OSDs are up 2024-02-19T06:57:49.619 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-19T06:57:49.815 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.814+0000 7f25a4800640 1 Processor -- start 2024-02-19T06:57:49.815 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.814+0000 7f25a4800640 1 -- start start 2024-02-19T06:57:49.818 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.815+0000 7f25a4800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f259c06e310 0x7f259c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:49.818 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.815+0000 7f25a4800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c0ce5f0 0x7f259c0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:49.818 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.815+0000 7f25a4800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c0cf3b0 con 0x7f259c1435c0 2024-02-19T06:57:49.818 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.816+0000 7f25a4800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c15bce0 con 0x7f259c06e310 2024-02-19T06:57:49.818 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.816+0000 7f25a4800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c06ec30 con 0x7f259c0ce5f0 2024-02-19T06:57:49.818 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.816+0000 7f25a2800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f259c1435c0 0x7f259c143a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54264/0 (socket says 172.21.15.46:54264) 2024-02-19T06:57:49.818 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.816+0000 7f25a2800640 1 -- 172.21.15.46:0/896471076 learned_addr learned my addr 172.21.15.46:0/896471076 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:57:49.818 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.816+0000 7f25a1e00640 1 --2- 172.21.15.46:0/896471076 >> v2:172.21.15.142:3300/0 conn(0x7f259c06e310 0x7f259c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:49.818 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.816+0000 7f25a1400640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c0ce5f0 0x7f259c0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:49.818 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.816+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128881759 0 0) 0x7f259c0cf3b0 con 0x7f259c1435c0 2024-02-19T06:57:49.818 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.816+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2584003520 con 0x7f259c1435c0 2024-02-19T06:57:49.820 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 750790386 0 0) 0x7f2584003520 con 0x7f259c1435c0 2024-02-19T06:57:49.820 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c0ce5f0 msgr2=0x7f259c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:49.820 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c0ce5f0 0x7f259c0ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:49.820 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 >> v2:172.21.15.142:3300/0 conn(0x7f259c06e310 msgr2=0x7f259c06e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:49.820 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 --2- 172.21.15.46:0/896471076 >> v2:172.21.15.142:3300/0 conn(0x7f259c06e310 0x7f259c06e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c0cf0d0 con 0x7f259c1435c0 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f25980019f0 con 0x7f259c1435c0 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 >> v1:172.21.15.46:6789/0 conn(0x7f259c1435c0 legacy=0x7f259c143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2584003970 0x7f2584003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c0ce5f0 0x7f25840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2584004d00 0x7f2584005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c15bce0 con 0x7f2584004d00 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c06ec30 con 0x7f2584003970 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258400db90 con 0x7f259c0ce5f0 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.817+0000 7f25a2800640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2584004d00 0x7f2584005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.818+0000 7f25a1e00640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2584003970 0x7f2584003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.818+0000 7f25a1400640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c0ce5f0 0x7f25840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.818+0000 7f25a2800640 1 -- 172.21.15.46:0/896471076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c0ce5f0 msgr2=0x7f25840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:49.821 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.818+0000 7f25a2800640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c0ce5f0 0x7f25840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:49.822 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.818+0000 7f25a2800640 1 -- 172.21.15.46:0/896471076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2584003970 msgr2=0x7f2584003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:49.822 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.818+0000 7f25a2800640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2584003970 0x7f2584003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:49.822 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.818+0000 7f25a2800640 1 -- 172.21.15.46:0/896471076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2584003520 con 0x7f2584004d00 2024-02-19T06:57:49.822 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.818+0000 7f25a1400640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c0ce5f0 0x7f25840047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:57:49.822 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.818+0000 7f25a1e00640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2584003970 0x7f2584003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:57:49.822 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.819+0000 7f25a2800640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2584004d00 0x7f2584005180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f259800a7c0 tx=0x7f25840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec26f9ec354bd4b server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:49.823 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.819+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2598034630 con 0x7f2584004d00 2024-02-19T06:57:49.823 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.819+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259802f070 con 0x7f2584004d00 2024-02-19T06:57:49.823 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.819+0000 7f25a0a00640 1 -- 172.21.15.46:0/896471076 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980349f0 con 0x7f2584004d00 2024-02-19T06:57:49.823 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.820+0000 7f25a4800640 1 -- 172.21.15.46:0/896471076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2584004d00 msgr2=0x7f2584005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:49.823 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.820+0000 7f25a4800640 1 --2- 172.21.15.46:0/896471076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2584004d00 0x7f2584005180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f259800a7c0 tx=0x7f25840057f0 comp rx=0 tx=0).stop 2024-02-19T06:57:49.823 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.820+0000 7f25a2800640 1 -- 172.21.15.46:0/896471076 reap_dead start 2024-02-19T06:57:49.823 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.820+0000 7f25a4800640 1 -- 172.21.15.46:0/896471076 shutdown_connections 2024-02-19T06:57:49.823 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.820+0000 7f25a4800640 1 -- 172.21.15.46:0/896471076 >> 172.21.15.46:0/896471076 conn(0x7f259c067030 msgr2=0x7f259c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:49.823 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.820+0000 7f25a4800640 1 -- 172.21.15.46:0/896471076 shutdown_connections 2024-02-19T06:57:49.824 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.820+0000 7f25a4800640 1 -- 172.21.15.46:0/896471076 wait complete. 2024-02-19T06:57:49.824 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.822+0000 7f25a4800640 1 Processor -- start 2024-02-19T06:57:49.825 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.822+0000 7f25a4800640 1 -- start start 2024-02-19T06:57:49.825 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.823+0000 7f25a4800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f259c132020 0x7f259c1e1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:49.825 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.823+0000 7f25a4800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c132400 0x7f259c1e2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:49.825 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.823+0000 7f25a4800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c1f6a20 0x7f259c1f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:49.825 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.823+0000 7f25a4800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c157c90 con 0x7f259c132400 2024-02-19T06:57:49.825 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.823+0000 7f25a4800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c12fd20 con 0x7f259c132020 2024-02-19T06:57:49.825 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.823+0000 7f25a4800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c1e2a40 con 0x7f259c1f6a20 2024-02-19T06:57:49.825 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.824+0000 7f25a1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c132400 0x7f259c1e2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:49.825 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.824+0000 7f25a2800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c1f6a20 0x7f259c1f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:49.825 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.824+0000 7f25a1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f259c132020 0x7f259c1e1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:49.826 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.824+0000 7f25a1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c132400 0x7f259c1e2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37576/0 (socket says 172.21.15.46:37576) 2024-02-19T06:57:49.826 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.824+0000 7f25a1400640 1 -- 172.21.15.46:0/1105740036 learned_addr learned my addr 172.21.15.46:0/1105740036 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:49.827 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.824+0000 7f25a1400640 1 -- 172.21.15.46:0/1105740036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c1f6a20 msgr2=0x7f259c1f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:49.827 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.824+0000 7f25a1400640 1 --2- 172.21.15.46:0/1105740036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c1f6a20 0x7f259c1f6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:49.827 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.824+0000 7f25a1400640 1 -- 172.21.15.46:0/1105740036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f259c132020 msgr2=0x7f259c1e1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:49.827 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.824+0000 7f25a1400640 1 --2- 172.21.15.46:0/1105740036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f259c132020 0x7f259c1e1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:49.827 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.824+0000 7f25a1400640 1 -- 172.21.15.46:0/1105740036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c1e8740 con 0x7f259c132400 2024-02-19T06:57:49.827 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.824+0000 7f25a1400640 1 --2- 172.21.15.46:0/1105740036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c132400 0x7f259c1e2500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f258c0116d0 tx=0x7f258c011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:49.827 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.825+0000 7f2596000640 1 -- 172.21.15.46:0/1105740036 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c00f9c0 con 0x7f259c132400 2024-02-19T06:57:49.827 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.825+0000 7f2596000640 1 -- 172.21.15.46:0/1105740036 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c00fb20 con 0x7f259c132400 2024-02-19T06:57:49.827 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.825+0000 7f2596000640 1 -- 172.21.15.46:0/1105740036 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c00fed0 con 0x7f259c132400 2024-02-19T06:57:49.827 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.825+0000 7f25a4800640 1 -- 172.21.15.46:0/1105740036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259c12ffe0 con 0x7f259c132400 2024-02-19T06:57:49.827 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.825+0000 7f25a4800640 1 -- 172.21.15.46:0/1105740036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259c1305a0 con 0x7f259c132400 2024-02-19T06:57:49.828 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.826+0000 7f25a4800640 1 -- 172.21.15.46:0/1105740036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259c04eee0 con 0x7f259c132400 2024-02-19T06:57:49.828 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.827+0000 7f2596000640 1 -- 172.21.15.46:0/1105740036 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f258c015460 con 0x7f259c132400 2024-02-19T06:57:49.829 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.828+0000 7f2596000640 1 --2- 172.21.15.46:0/1105740036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f258006b840 0x7f258006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:49.829 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.828+0000 7f2596000640 1 -- 172.21.15.46:0/1105740036 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f258c08a620 con 0x7f259c132400 2024-02-19T06:57:49.830 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.829+0000 7f25a1e00640 1 --2- 172.21.15.46:0/1105740036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f258006b840 0x7f258006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:49.831 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.830+0000 7f25a1e00640 1 --2- 172.21.15.46:0/1105740036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f258006b840 0x7f258006dd00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2590006f80 tx=0x7f2590008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:49.835 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:49.834+0000 7f2596000640 1 -- 172.21.15.46:0/1105740036 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f258c055440 con 0x7f259c132400 2024-02-19T06:57:50.034 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.032+0000 7f25a4800640 1 -- 172.21.15.46:0/1105740036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f259c0ceb70 con 0x7f259c132400 2024-02-19T06:57:50.035 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.034+0000 7f2596000640 1 -- 172.21.15.46:0/1105740036 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12884 (secure 0 0 0) 0x7f258c058b00 con 0x7f259c132400 2024-02-19T06:57:50.036 INFO:teuthology.misc.health.smithi046.stdout: 2024-02-19T06:57:50.036 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":18,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:46.242911+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:57:50.038 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.036+0000 7f25a4800640 1 -- 172.21.15.46:0/1105740036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f258006b840 msgr2=0x7f258006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.038 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.036+0000 7f25a4800640 1 --2- 172.21.15.46:0/1105740036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f258006b840 0x7f258006dd00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2590006f80 tx=0x7f2590008040 comp rx=0 tx=0).stop 2024-02-19T06:57:50.038 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.036+0000 7f25a4800640 1 -- 172.21.15.46:0/1105740036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c132400 msgr2=0x7f259c1e2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.038 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.036+0000 7f25a4800640 1 --2- 172.21.15.46:0/1105740036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c132400 0x7f259c1e2500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f258c0116d0 tx=0x7f258c011b90 comp rx=0 tx=0).stop 2024-02-19T06:57:50.038 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.036+0000 7f25a4800640 1 -- 172.21.15.46:0/1105740036 shutdown_connections 2024-02-19T06:57:50.039 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.036+0000 7f25a4800640 1 --2- 172.21.15.46:0/1105740036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f258006b840 0x7f258006dd00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.039 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.036+0000 7f25a4800640 1 --2- 172.21.15.46:0/1105740036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f259c1f6a20 0x7f259c1f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.039 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.036+0000 7f25a4800640 1 --2- 172.21.15.46:0/1105740036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c132400 0x7f259c1e2500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.039 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.036+0000 7f25a4800640 1 --2- 172.21.15.46:0/1105740036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f259c132020 0x7f259c1e1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.039 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.036+0000 7f25a4800640 1 -- 172.21.15.46:0/1105740036 >> 172.21.15.46:0/1105740036 conn(0x7f259c067030 msgr2=0x7f259c0af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:50.039 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.037+0000 7f25a4800640 1 -- 172.21.15.46:0/1105740036 shutdown_connections 2024-02-19T06:57:50.039 INFO:teuthology.misc.health.smithi046.stderr:2024-02-19T06:57:50.037+0000 7f25a4800640 1 -- 172.21.15.46:0/1105740036 wait complete. 2024-02-19T06:57:50.053 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-02-19T06:57:50.054 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-19T06:57:50.054 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-19T06:57:50.054 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-19T06:57:50.061 INFO:tasks.ceph.mds.a:Started 2024-02-19T06:57:50.062 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-19T06:57:50.062 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-19T06:57:50.068 INFO:tasks.ceph.mds.c:Started 2024-02-19T06:57:50.068 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-19T06:57:50.069 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-19T06:57:50.077 INFO:tasks.ceph.mds.b:Started 2024-02-19T06:57:50.077 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-19T06:57:50.077 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-19T06:57:50.085 INFO:tasks.ceph.mds.d:Started 2024-02-19T06:57:50.085 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-02-19T06:57:50.088 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:57:50.215 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-02-19T06:57:50.216 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2024-02-19T06:57:50.239 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-02-19T06:57:50.240 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2024-02-19T06:57:50.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.267+0000 7f8eb2c00640 1 Processor -- start 2024-02-19T06:57:50.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.267+0000 7f8eb2c00640 1 -- start start 2024-02-19T06:57:50.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.268+0000 7f8eb2c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8eac15dbd0 0x7f8eac0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:50.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.268+0000 7f8eb2c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eac0cf770 con 0x7f8eac162230 2024-02-19T06:57:50.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.268+0000 7f8eb2c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eac0cf4e0 con 0x7f8eac15d7f0 2024-02-19T06:57:50.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.268+0000 7f8eb2c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac0d28d0 con 0x7f8eac15dbd0 2024-02-19T06:57:50.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.268+0000 7f8eb0e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8eac162230 0x7f8eac0cedd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54274/0 (socket says 172.21.15.46:54274) 2024-02-19T06:57:50.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.268+0000 7f8eb0e00640 1 -- 172.21.15.46:0/2912870814 learned_addr learned my addr 172.21.15.46:0/2912870814 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:57:50.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.268+0000 7f8eb2200640 1 --2- 172.21.15.46:0/2912870814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8eac15dbd0 0x7f8eac0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:50.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.269+0000 7f8eabe00640 1 -- 172.21.15.46:0/2912870814 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110240037 0 0) 0x7f8eac0cf770 con 0x7f8eac162230 2024-02-19T06:57:50.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.269+0000 7f8eabe00640 1 -- 172.21.15.46:0/2912870814 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e94003520 con 0x7f8eac162230 2024-02-19T06:57:50.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.269+0000 7f8eabe00640 1 -- 172.21.15.46:0/2912870814 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864385556 0 0) 0x7f8eac0cf4e0 con 0x7f8eac15d7f0 2024-02-19T06:57:50.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.269+0000 7f8eabe00640 1 -- 172.21.15.46:0/2912870814 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eac0cf770 con 0x7f8eac15d7f0 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.269+0000 7f8eb2200640 1 -- 172.21.15.46:0/2912870814 >> v1:172.21.15.142:6789/0 conn(0x7f8eac15d7f0 legacy=0x7f8eac0d21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.269+0000 7f8eb2200640 1 -- 172.21.15.46:0/2912870814 >> v1:172.21.15.46:6789/0 conn(0x7f8eac162230 legacy=0x7f8eac0cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.269+0000 7f8eb2200640 1 -- 172.21.15.46:0/2912870814 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac0d1400 con 0x7f8eac15dbd0 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.270+0000 7f8eb2200640 1 --2- 172.21.15.46:0/2912870814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8eac15dbd0 0x7f8eac0d34f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009dc0 tx=0x7f8ea402be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=473f46bef97f7fe4 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.270+0000 7f8eabe00640 1 -- 172.21.15.46:0/2912870814 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea402cbb0 con 0x7f8eac15dbd0 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.270+0000 7f8eabe00640 1 -- 172.21.15.46:0/2912870814 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea402cd10 con 0x7f8eac15dbd0 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.270+0000 7f8eabe00640 1 -- 172.21.15.46:0/2912870814 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4034660 con 0x7f8eac15dbd0 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.271+0000 7f8eb2c00640 1 -- 172.21.15.46:0/2912870814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8eac15dbd0 msgr2=0x7f8eac0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.271+0000 7f8eb2c00640 1 --2- 172.21.15.46:0/2912870814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8eac15dbd0 0x7f8eac0d34f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009dc0 tx=0x7f8ea402be00 comp rx=0 tx=0).stop 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.271+0000 7f8eb2c00640 1 -- 172.21.15.46:0/2912870814 shutdown_connections 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.271+0000 7f8eb2c00640 1 --2- 172.21.15.46:0/2912870814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8eac15dbd0 0x7f8eac0d34f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.271+0000 7f8eb2c00640 1 -- 172.21.15.46:0/2912870814 >> 172.21.15.46:0/2912870814 conn(0x7f8eac09ca70 msgr2=0x7f8eac08afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.271+0000 7f8eb2c00640 1 -- 172.21.15.46:0/2912870814 shutdown_connections 2024-02-19T06:57:50.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.271+0000 7f8eb2c00640 1 -- 172.21.15.46:0/2912870814 wait complete. 2024-02-19T06:57:50.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.272+0000 7f8eb2c00640 1 Processor -- start 2024-02-19T06:57:50.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.273+0000 7f8eb2c00640 1 -- start start 2024-02-19T06:57:50.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.273+0000 7f8eb2c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8eac15d7f0 0x7f8eac15a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:50.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.273+0000 7f8eb2c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8eac15dbd0 0x7f8eac0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:50.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.273+0000 7f8eb2c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8eac162230 0x7f8eac0ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:50.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.273+0000 7f8eb2c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac0c7ab0 con 0x7f8eac162230 2024-02-19T06:57:50.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.273+0000 7f8eb2c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac1f44a0 con 0x7f8eac15d7f0 2024-02-19T06:57:50.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.273+0000 7f8eb2c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac0cd4f0 con 0x7f8eac15dbd0 2024-02-19T06:57:50.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.274+0000 7f8eb2200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8eac162230 0x7f8eac0ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:50.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.274+0000 7f8eb2200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8eac162230 0x7f8eac0ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37618/0 (socket says 172.21.15.46:37618) 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.274+0000 7f8eb2200640 1 -- 172.21.15.46:0/1268945675 learned_addr learned my addr 172.21.15.46:0/1268945675 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.274+0000 7f8eb0e00640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8eac15dbd0 0x7f8eac0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.274+0000 7f8eb1800640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8eac15d7f0 0x7f8eac15a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.274+0000 7f8eb2200640 1 -- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8eac15dbd0 msgr2=0x7f8eac0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.274+0000 7f8eb2200640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8eac15dbd0 0x7f8eac0ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.274+0000 7f8eb2200640 1 -- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8eac15d7f0 msgr2=0x7f8eac15a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.274+0000 7f8eb2200640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8eac15d7f0 0x7f8eac15a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.274+0000 7f8eb2200640 1 -- 172.21.15.46:0/1268945675 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4009a70 con 0x7f8eac162230 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.275+0000 7f8eb2200640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8eac162230 0x7f8eac0ce930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009ee0 tx=0x7f8ea4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.275+0000 7f8ea9600640 1 -- 172.21.15.46:0/1268945675 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4040650 con 0x7f8eac162230 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.275+0000 7f8ea9600640 1 -- 172.21.15.46:0/1268945675 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40407b0 con 0x7f8eac162230 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.275+0000 7f8ea9600640 1 -- 172.21.15.46:0/1268945675 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4040b40 con 0x7f8eac162230 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.275+0000 7f8eb2c00640 1 -- 172.21.15.46:0/1268945675 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac1f41c0 con 0x7f8eac162230 2024-02-19T06:57:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.275+0000 7f8eb2c00640 1 -- 172.21.15.46:0/1268945675 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac0cbd60 con 0x7f8eac162230 2024-02-19T06:57:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.276+0000 7f8eb2c00640 1 -- 172.21.15.46:0/1268945675 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac04eee0 con 0x7f8eac162230 2024-02-19T06:57:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.277+0000 7f8ea9600640 1 -- 172.21.15.46:0/1268945675 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8ea4040ca0 con 0x7f8eac162230 2024-02-19T06:57:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.278+0000 7f8ea9600640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e9006b810 0x7f8e9006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.278+0000 7f8ea9600640 1 -- 172.21.15.46:0/1268945675 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8ea40ac9e0 con 0x7f8eac162230 2024-02-19T06:57:50.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.278+0000 7f8eb1800640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e9006b810 0x7f8e9006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:50.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.279+0000 7f8eb1800640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e9006b810 0x7f8e9006dcd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0001840 tx=0x7f8ea0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:50.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.282+0000 7f8ea9600640 1 -- 172.21.15.46:0/1268945675 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ea4077910 con 0x7f8eac162230 2024-02-19T06:57:50.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.473+0000 7f8eb2c00640 1 -- 172.21.15.46:0/1268945675 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8eac0b3310 con 0x7f8eac162230 2024-02-19T06:57:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.475+0000 7f8ea9600640 1 -- 172.21.15.46:0/1268945675 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12884 (secure 0 0 0) 0x7f8ea4009450 con 0x7f8eac162230 2024-02-19T06:57:50.477 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:57:50.477 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:46.242911+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:57:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.477+0000 7f8eb2c00640 1 -- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e9006b810 msgr2=0x7f8e9006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.477+0000 7f8eb2c00640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e9006b810 0x7f8e9006dcd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0001840 tx=0x7f8ea0009040 comp rx=0 tx=0).stop 2024-02-19T06:57:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.477+0000 7f8eb2c00640 1 -- 172.21.15.46:0/1268945675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8eac162230 msgr2=0x7f8eac0ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.477+0000 7f8eb2c00640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8eac162230 0x7f8eac0ce930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009ee0 tx=0x7f8ea4004a40 comp rx=0 tx=0).stop 2024-02-19T06:57:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.477+0000 7f8eb2c00640 1 -- 172.21.15.46:0/1268945675 shutdown_connections 2024-02-19T06:57:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.477+0000 7f8eb2c00640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e9006b810 0x7f8e9006dcd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.477+0000 7f8eb2c00640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8eac162230 0x7f8eac0ce930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.477+0000 7f8eb2c00640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8eac15dbd0 0x7f8eac0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.477+0000 7f8eb2c00640 1 --2- 172.21.15.46:0/1268945675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8eac15d7f0 0x7f8eac15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.477+0000 7f8eb2c00640 1 -- 172.21.15.46:0/1268945675 >> 172.21.15.46:0/1268945675 conn(0x7f8eac09ca70 msgr2=0x7f8eac160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.477+0000 7f8eb2c00640 1 -- 172.21.15.46:0/1268945675 shutdown_connections 2024-02-19T06:57:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.477+0000 7f8eb2c00640 1 -- 172.21.15.46:0/1268945675 wait complete. 2024-02-19T06:57:50.497 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:57:50.497 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:57:50.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.714+0000 7f20f9400640 1 Processor -- start 2024-02-19T06:57:50.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.714+0000 7f20f9400640 1 -- start start 2024-02-19T06:57:50.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.716+0000 7f20f9400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f20f4155b20 0x7f20f40cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:50.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.716+0000 7f20f9400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f40cfa70 0x7f20f40b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:50.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.716+0000 7f20f9400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f40cfed0 con 0x7f20f40b2a20 2024-02-19T06:57:50.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.716+0000 7f20f9400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f40b2e50 con 0x7f20f4155b20 2024-02-19T06:57:50.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.716+0000 7f20f9400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f415be60 con 0x7f20f40cfa70 2024-02-19T06:57:50.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.716+0000 7f20f3e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f20f4155b20 0x7f20f40cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:50.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.716+0000 7f20f3e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f20f4155b20 0x7f20f40cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37632/0 (socket says 172.21.15.46:37632) 2024-02-19T06:57:50.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.716+0000 7f20f3e00640 1 -- 172.21.15.46:0/2639661256 learned_addr learned my addr 172.21.15.46:0/2639661256 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:50.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.716+0000 7f20f8a00640 1 --1- 172.21.15.46:0/2639661256 >> v1:172.21.15.46:6789/0 conn(0x7f20f40b2a20 0x7f20f415f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54286/0 (socket says 172.21.15.46:54286) 2024-02-19T06:57:50.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.716+0000 7f20f3400640 1 --2- 172.21.15.46:0/2639661256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f40cfa70 0x7f20f40b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:50.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.717+0000 7f20f3e00640 1 -- 172.21.15.46:0/2639661256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f40cfa70 msgr2=0x7f20f40b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:50.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.717+0000 7f20f3e00640 1 --2- 172.21.15.46:0/2639661256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f40cfa70 0x7f20f40b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.717+0000 7f20f3e00640 1 -- 172.21.15.46:0/2639661256 >> v1:172.21.15.46:6789/0 conn(0x7f20f40b2a20 legacy=0x7f20f415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.717+0000 7f20f3e00640 1 -- 172.21.15.46:0/2639661256 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f415c140 con 0x7f20f4155b20 2024-02-19T06:57:50.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.717+0000 7f20f2a00640 1 -- 172.21.15.46:0/2639661256 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142891449 0 0) 0x7f20f40cfed0 con 0x7f20f40b2a20 2024-02-19T06:57:50.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.718+0000 7f20f3e00640 1 --2- 172.21.15.46:0/2639661256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f4155b20 0x7f20f40cf530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009870 tx=0x7f20e402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c4fa37cb2055 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:50.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.718+0000 7f20f2a00640 1 -- 172.21.15.46:0/2639661256 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4030840 con 0x7f20f4155b20 2024-02-19T06:57:50.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.718+0000 7f20f2a00640 1 -- 172.21.15.46:0/2639661256 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e40309a0 con 0x7f20f4155b20 2024-02-19T06:57:50.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.718+0000 7f20f2a00640 1 -- 172.21.15.46:0/2639661256 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4030d30 con 0x7f20f4155b20 2024-02-19T06:57:50.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.719+0000 7f20f9400640 1 -- 172.21.15.46:0/2639661256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f4155b20 msgr2=0x7f20f40cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.719+0000 7f20f9400640 1 --2- 172.21.15.46:0/2639661256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f4155b20 0x7f20f40cf530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009870 tx=0x7f20e402b980 comp rx=0 tx=0).stop 2024-02-19T06:57:50.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.719+0000 7f20f9400640 1 -- 172.21.15.46:0/2639661256 shutdown_connections 2024-02-19T06:57:50.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.719+0000 7f20f9400640 1 --2- 172.21.15.46:0/2639661256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f40cfa70 0x7f20f40b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.719+0000 7f20f9400640 1 --2- 172.21.15.46:0/2639661256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f4155b20 0x7f20f40cf530 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.719+0000 7f20f9400640 1 -- 172.21.15.46:0/2639661256 >> 172.21.15.46:0/2639661256 conn(0x7f20f406ad60 msgr2=0x7f20f406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:50.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.719+0000 7f20f9400640 1 -- 172.21.15.46:0/2639661256 shutdown_connections 2024-02-19T06:57:50.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.719+0000 7f20f9400640 1 -- 172.21.15.46:0/2639661256 wait complete. 2024-02-19T06:57:50.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.721+0000 7f20f9400640 1 Processor -- start 2024-02-19T06:57:50.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.721+0000 7f20f9400640 1 -- start start 2024-02-19T06:57:50.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.722+0000 7f20f9400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40b2a20 0x7f20f4154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:50.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.722+0000 7f20f9400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f40cfa70 0x7f20f41f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:50.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f9400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20f4155b20 0x7f20f415f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:50.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f9400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f4153a30 con 0x7f20f40b2a20 2024-02-19T06:57:50.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f9400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f4153ff0 con 0x7f20f4155b20 2024-02-19T06:57:50.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f9400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f41f2fd0 con 0x7f20f40cfa70 2024-02-19T06:57:50.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40b2a20 0x7f20f4154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:50.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40b2a20 0x7f20f4154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37644/0 (socket says 172.21.15.46:37644) 2024-02-19T06:57:50.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f3e00640 1 -- 172.21.15.46:0/2774536329 learned_addr learned my addr 172.21.15.46:0/2774536329 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:50.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f8a00640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20f4155b20 0x7f20f415f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:50.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f3e00640 1 -- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f40cfa70 msgr2=0x7f20f41f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f3400640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f40cfa70 0x7f20f41f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:50.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f3e00640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f40cfa70 0x7f20f41f2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f3e00640 1 -- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20f4155b20 msgr2=0x7f20f415f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f3e00640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20f4155b20 0x7f20f415f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f3e00640 1 -- 172.21.15.46:0/2774536329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e40094d0 con 0x7f20f40b2a20 2024-02-19T06:57:50.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.723+0000 7f20f8a00640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20f4155b20 0x7f20f415f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:50.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.724+0000 7f20f3e00640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40b2a20 0x7f20f4154480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f20e402b9c0 tx=0x7f20e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:50.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.724+0000 7f20ebe00640 1 -- 172.21.15.46:0/2774536329 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4039c90 con 0x7f20f40b2a20 2024-02-19T06:57:50.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.724+0000 7f20ebe00640 1 -- 172.21.15.46:0/2774536329 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e4039df0 con 0x7f20f40b2a20 2024-02-19T06:57:50.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.724+0000 7f20ebe00640 1 -- 172.21.15.46:0/2774536329 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40446c0 con 0x7f20f40b2a20 2024-02-19T06:57:50.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.724+0000 7f20f9400640 1 -- 172.21.15.46:0/2774536329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f40adf50 con 0x7f20f40b2a20 2024-02-19T06:57:50.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.724+0000 7f20f9400640 1 -- 172.21.15.46:0/2774536329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f4153c80 con 0x7f20f40b2a20 2024-02-19T06:57:50.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.725+0000 7f20f9400640 1 -- 172.21.15.46:0/2774536329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f404eee0 con 0x7f20f40b2a20 2024-02-19T06:57:50.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.726+0000 7f20ebe00640 1 -- 172.21.15.46:0/2774536329 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f20e404d3b0 con 0x7f20f40b2a20 2024-02-19T06:57:50.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.727+0000 7f20ebe00640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f20d406b810 0x7f20d406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:50.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.727+0000 7f20ebe00640 1 -- 172.21.15.46:0/2774536329 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f20e403e070 con 0x7f20f40b2a20 2024-02-19T06:57:50.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.728+0000 7f20f3400640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f20d406b810 0x7f20d406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:50.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.729+0000 7f20f3400640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f20d406b810 0x7f20d406dcd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f20f40ad960 tx=0x7f20e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:50.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.733+0000 7f20ebe00640 1 -- 172.21.15.46:0/2774536329 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20e40776f0 con 0x7f20f40b2a20 2024-02-19T06:57:50.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.932+0000 7f20f9400640 1 -- 172.21.15.46:0/2774536329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20f406e330 con 0x7f20f40b2a20 2024-02-19T06:57:50.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.933+0000 7f20ebe00640 1 -- 172.21.15.46:0/2774536329 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20e407adb0 con 0x7f20f40b2a20 2024-02-19T06:57:50.934 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:57:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.935+0000 7f20f9400640 1 -- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f20d406b810 msgr2=0x7f20d406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.935+0000 7f20f9400640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f20d406b810 0x7f20d406dcd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f20f40ad960 tx=0x7f20e0008040 comp rx=0 tx=0).stop 2024-02-19T06:57:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.935+0000 7f20f9400640 1 -- 172.21.15.46:0/2774536329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40b2a20 msgr2=0x7f20f4154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.935+0000 7f20f9400640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40b2a20 0x7f20f4154480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f20e402b9c0 tx=0x7f20e4004730 comp rx=0 tx=0).stop 2024-02-19T06:57:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.936+0000 7f20f9400640 1 -- 172.21.15.46:0/2774536329 shutdown_connections 2024-02-19T06:57:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.936+0000 7f20f9400640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f20d406b810 0x7f20d406dcd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.936+0000 7f20f9400640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20f4155b20 0x7f20f415f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.936+0000 7f20f9400640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f40cfa70 0x7f20f41f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.936+0000 7f20f9400640 1 --2- 172.21.15.46:0/2774536329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40b2a20 0x7f20f4154480 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.936+0000 7f20f9400640 1 -- 172.21.15.46:0/2774536329 >> 172.21.15.46:0/2774536329 conn(0x7f20f406ad60 msgr2=0x7f20f415ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.936+0000 7f20f9400640 1 -- 172.21.15.46:0/2774536329 shutdown_connections 2024-02-19T06:57:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:50.936+0000 7f20f9400640 1 -- 172.21.15.46:0/2774536329 wait complete. 2024-02-19T06:57:50.957 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T06:57:51.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.180+0000 7fe92de00640 1 Processor -- start 2024-02-19T06:57:51.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.181+0000 7fe92de00640 1 -- start start 2024-02-19T06:57:51.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.182+0000 7fe92de00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe92815d7f0 0x7fe9280d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:51.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.182+0000 7fe92de00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe92815dbd0 0x7fe9280d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:51.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.182+0000 7fe92de00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280cf770 con 0x7fe928162230 2024-02-19T06:57:51.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.182+0000 7fe92de00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9280cf4e0 con 0x7fe92815d7f0 2024-02-19T06:57:51.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.182+0000 7fe92de00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280d1400 con 0x7fe92815dbd0 2024-02-19T06:57:51.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.183+0000 7fe92ca00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe92815d7f0 0x7fe9280d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:51.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.183+0000 7fe92ca00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe92815d7f0 0x7fe9280d21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37654/0 (socket says 172.21.15.46:37654) 2024-02-19T06:57:51.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.183+0000 7fe92ca00640 1 -- 172.21.15.46:0/305344169 learned_addr learned my addr 172.21.15.46:0/305344169 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:51.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.183+0000 7fe92d400640 1 --2- 172.21.15.46:0/305344169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe92815dbd0 0x7fe9280d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:51.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.183+0000 7fe92ca00640 1 -- 172.21.15.46:0/305344169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe92815dbd0 msgr2=0x7fe9280d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:51.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.183+0000 7fe92ca00640 1 --2- 172.21.15.46:0/305344169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe92815dbd0 0x7fe9280d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.183+0000 7fe92ca00640 1 -- 172.21.15.46:0/305344169 >> v1:172.21.15.46:6789/0 conn(0x7fe928162230 legacy=0x7fe9280cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:51.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.183+0000 7fe92ca00640 1 -- 172.21.15.46:0/305344169 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280d16e0 con 0x7fe92815d7f0 2024-02-19T06:57:51.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.183+0000 7fe92d400640 1 --2- 172.21.15.46:0/305344169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe92815dbd0 0x7fe9280d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:51.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.184+0000 7fe92ca00640 1 --2- 172.21.15.46:0/305344169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe92815d7f0 0x7fe9280d21c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009870 tx=0x7fe91c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa712f684ffe00bc server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:51.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.184+0000 7fe927400640 1 -- 172.21.15.46:0/305344169 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c031640 con 0x7fe92815d7f0 2024-02-19T06:57:51.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.185+0000 7fe927400640 1 -- 172.21.15.46:0/305344169 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c0317a0 con 0x7fe92815d7f0 2024-02-19T06:57:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.185+0000 7fe927400640 1 -- 172.21.15.46:0/305344169 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c031b30 con 0x7fe92815d7f0 2024-02-19T06:57:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.185+0000 7fe92de00640 1 -- 172.21.15.46:0/305344169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe92815d7f0 msgr2=0x7fe9280d21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.185+0000 7fe92de00640 1 --2- 172.21.15.46:0/305344169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe92815d7f0 0x7fe9280d21c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009870 tx=0x7fe91c02b8f0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.185+0000 7fe92de00640 1 -- 172.21.15.46:0/305344169 shutdown_connections 2024-02-19T06:57:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.185+0000 7fe92de00640 1 --2- 172.21.15.46:0/305344169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe92815dbd0 0x7fe9280d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.185+0000 7fe92de00640 1 --2- 172.21.15.46:0/305344169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe92815d7f0 0x7fe9280d21c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.185+0000 7fe92de00640 1 -- 172.21.15.46:0/305344169 >> 172.21.15.46:0/305344169 conn(0x7fe92809ca70 msgr2=0x7fe92808afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.185+0000 7fe92de00640 1 -- 172.21.15.46:0/305344169 shutdown_connections 2024-02-19T06:57:51.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.185+0000 7fe92de00640 1 -- 172.21.15.46:0/305344169 wait complete. 2024-02-19T06:57:51.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.187+0000 7fe92de00640 1 Processor -- start 2024-02-19T06:57:51.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.187+0000 7fe92de00640 1 -- start start 2024-02-19T06:57:51.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.188+0000 7fe92de00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe92815d7f0 0x7fe9281f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:51.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.188+0000 7fe92de00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe92815dbd0 0x7fe9280c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:51.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.188+0000 7fe92de00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe928162230 0x7fe9281602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:51.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.188+0000 7fe92de00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280b3180 con 0x7fe92815dbd0 2024-02-19T06:57:51.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.188+0000 7fe92de00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280ca210 con 0x7fe928162230 2024-02-19T06:57:51.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.188+0000 7fe92de00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92815e5c0 con 0x7fe92815d7f0 2024-02-19T06:57:51.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.188+0000 7fe927e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe92815dbd0 0x7fe9280c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:51.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.189+0000 7fe927e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe92815dbd0 0x7fe9280c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37660/0 (socket says 172.21.15.46:37660) 2024-02-19T06:57:51.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.189+0000 7fe927e00640 1 -- 172.21.15.46:0/3000403546 learned_addr learned my addr 172.21.15.46:0/3000403546 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:51.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.189+0000 7fe92ca00640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe92815d7f0 0x7fe9281f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:51.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.189+0000 7fe92d400640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe928162230 0x7fe9281602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:51.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.189+0000 7fe927e00640 1 -- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe92815d7f0 msgr2=0x7fe9281f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:51.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.189+0000 7fe927e00640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe92815d7f0 0x7fe9281f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.189+0000 7fe927e00640 1 -- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe928162230 msgr2=0x7fe9281602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.189+0000 7fe927e00640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe928162230 0x7fe9281602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.189+0000 7fe927e00640 1 -- 172.21.15.46:0/3000403546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c0094d0 con 0x7fe92815dbd0 2024-02-19T06:57:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.189+0000 7fe92d400640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe928162230 0x7fe9281602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.189+0000 7fe927e00640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe92815dbd0 0x7fe9280c9cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe91400c3c0 tx=0x7fe91400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.189+0000 7fe924c00640 1 -- 172.21.15.46:0/3000403546 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9140052d0 con 0x7fe92815dbd0 2024-02-19T06:57:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.190+0000 7fe924c00640 1 -- 172.21.15.46:0/3000403546 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe914005450 con 0x7fe92815dbd0 2024-02-19T06:57:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.190+0000 7fe924c00640 1 -- 172.21.15.46:0/3000403546 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914007260 con 0x7fe92815dbd0 2024-02-19T06:57:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.190+0000 7fe92de00640 1 -- 172.21.15.46:0/3000403546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9280d2880 con 0x7fe92815dbd0 2024-02-19T06:57:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.190+0000 7fe92de00640 1 -- 172.21.15.46:0/3000403546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92815eb80 con 0x7fe92815dbd0 2024-02-19T06:57:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.191+0000 7fe92de00640 1 -- 172.21.15.46:0/3000403546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92804eee0 con 0x7fe92815dbd0 2024-02-19T06:57:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.192+0000 7fe924c00640 1 -- 172.21.15.46:0/3000403546 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe9140073c0 con 0x7fe92815dbd0 2024-02-19T06:57:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.193+0000 7fe924c00640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe90806b840 0x7fe90806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.193+0000 7fe924c00640 1 -- 172.21.15.46:0/3000403546 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe914089220 con 0x7fe92815dbd0 2024-02-19T06:57:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.193+0000 7fe92ca00640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe90806b840 0x7fe90806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.194+0000 7fe92ca00640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe90806b840 0x7fe90806dd00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe91c036000 tx=0x7fe91c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:51.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.199+0000 7fe924c00640 1 -- 172.21.15.46:0/3000403546 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe914053f80 con 0x7fe92815dbd0 2024-02-19T06:57:51.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.442+0000 7fe92de00640 1 -- 172.21.15.46:0/3000403546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe92815d310 con 0x7fe92815dbd0 2024-02-19T06:57:51.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.443+0000 7fe924c00640 1 -- 172.21.15.46:0/3000403546 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7fe914057640 con 0x7fe92815dbd0 2024-02-19T06:57:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:57:51.445 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/380368509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":380368509},{"type":"v1","addr":"172.21.15.46:6834","nonce":380368509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/957808004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":957808004},{"type":"v1","addr":"172.21.15.46:6835","nonce":957808004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1288321773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1288321773},{"type":"v1","addr":"172.21.15.142:6837","nonce":1288321773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2651895852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2651895852},{"type":"v1","addr":"172.21.15.142:6836","nonce":2651895852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-02-19T06:57:51.445 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 3 2024-02-19T06:57:51.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.446+0000 7fe92de00640 1 -- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe90806b840 msgr2=0x7fe90806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:51.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.446+0000 7fe92de00640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe90806b840 0x7fe90806dd00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe91c036000 tx=0x7fe91c03c040 comp rx=0 tx=0).stop 2024-02-19T06:57:51.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.446+0000 7fe92de00640 1 -- 172.21.15.46:0/3000403546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe92815dbd0 msgr2=0x7fe9280c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:51.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.446+0000 7fe92de00640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe92815dbd0 0x7fe9280c9cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe91400c3c0 tx=0x7fe91400c880 comp rx=0 tx=0).stop 2024-02-19T06:57:51.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.446+0000 7fe92de00640 1 -- 172.21.15.46:0/3000403546 shutdown_connections 2024-02-19T06:57:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.446+0000 7fe92de00640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe90806b840 0x7fe90806dd00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.446+0000 7fe92de00640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe928162230 0x7fe9281602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.446+0000 7fe92de00640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe92815dbd0 0x7fe9280c9cd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.446+0000 7fe92de00640 1 --2- 172.21.15.46:0/3000403546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe92815d7f0 0x7fe9281f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.446+0000 7fe92de00640 1 -- 172.21.15.46:0/3000403546 >> 172.21.15.46:0/3000403546 conn(0x7fe92809ca70 msgr2=0x7fe9280cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:51.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.446+0000 7fe92de00640 1 -- 172.21.15.46:0/3000403546 shutdown_connections 2024-02-19T06:57:51.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.446+0000 7fe92de00640 1 -- 172.21.15.46:0/3000403546 wait complete. 2024-02-19T06:57:51.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:57:51.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.689+0000 7f0b0b200640 1 Processor -- start 2024-02-19T06:57:51.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.689+0000 7f0b0b200640 1 -- start start 2024-02-19T06:57:51.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.690+0000 7f0b0b200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0b040d0310 0x7f0b040d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:51.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.691+0000 7f0b0b200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0b040b2590 0x7f0b040b5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:51.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.691+0000 7f0b0b200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b040d0c30 con 0x7f0b040b2ae0 2024-02-19T06:57:51.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.691+0000 7f0b0b200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b04162820 con 0x7f0b040d0310 2024-02-19T06:57:51.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.691+0000 7f0b0b200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b04161ba0 con 0x7f0b040b2590 2024-02-19T06:57:51.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.691+0000 7f0b03e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0b040d0310 0x7f0b040d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:51.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.691+0000 7f0b03e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0b040d0310 0x7f0b040d06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37672/0 (socket says 172.21.15.46:37672) 2024-02-19T06:57:51.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.691+0000 7f0b03e00640 1 -- 172.21.15.46:0/4148658741 learned_addr learned my addr 172.21.15.46:0/4148658741 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:51.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.691+0000 7f0b03400640 1 --2- 172.21.15.46:0/4148658741 >> v2:172.21.15.142:3300/0 conn(0x7f0b040b2590 0x7f0b040b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:51.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.691+0000 7f0b03e00640 1 -- 172.21.15.46:0/4148658741 >> v2:172.21.15.142:3300/0 conn(0x7f0b040b2590 msgr2=0x7f0b040b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:51.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.691+0000 7f0b03e00640 1 --2- 172.21.15.46:0/4148658741 >> v2:172.21.15.142:3300/0 conn(0x7f0b040b2590 0x7f0b040b5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.691+0000 7f0b03e00640 1 -- 172.21.15.46:0/4148658741 >> v1:172.21.15.142:6789/0 conn(0x7f0b040b2ae0 legacy=0x7f0b040b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:51.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.691+0000 7f0b03e00640 1 -- 172.21.15.46:0/4148658741 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b04161e80 con 0x7f0b040d0310 2024-02-19T06:57:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.693+0000 7f0b03e00640 1 --2- 172.21.15.46:0/4148658741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b040d0310 0x7f0b040d06f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0b04074ae0 tx=0x7f0af402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e3444c9da79e0a server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.693+0000 7f0b02a00640 1 -- 172.21.15.46:0/4148658741 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4031870 con 0x7f0b040d0310 2024-02-19T06:57:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.693+0000 7f0b02a00640 1 -- 172.21.15.46:0/4148658741 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af40319d0 con 0x7f0b040d0310 2024-02-19T06:57:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.693+0000 7f0b02a00640 1 -- 172.21.15.46:0/4148658741 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4031d60 con 0x7f0b040d0310 2024-02-19T06:57:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.693+0000 7f0b0b200640 1 -- 172.21.15.46:0/4148658741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b040d0310 msgr2=0x7f0b040d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.693+0000 7f0b0b200640 1 --2- 172.21.15.46:0/4148658741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b040d0310 0x7f0b040d06f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0b04074ae0 tx=0x7f0af402b910 comp rx=0 tx=0).stop 2024-02-19T06:57:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.694+0000 7f0b0b200640 1 -- 172.21.15.46:0/4148658741 shutdown_connections 2024-02-19T06:57:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.694+0000 7f0b0b200640 1 --2- 172.21.15.46:0/4148658741 >> v2:172.21.15.142:3300/0 conn(0x7f0b040b2590 0x7f0b040b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.694+0000 7f0b0b200640 1 --2- 172.21.15.46:0/4148658741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b040d0310 0x7f0b040d06f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.694+0000 7f0b0b200640 1 -- 172.21.15.46:0/4148658741 >> 172.21.15.46:0/4148658741 conn(0x7f0b0406be20 msgr2=0x7f0b0406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.694+0000 7f0b0b200640 1 -- 172.21.15.46:0/4148658741 shutdown_connections 2024-02-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.694+0000 7f0b0b200640 1 -- 172.21.15.46:0/4148658741 wait complete. 2024-02-19T06:57:51.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.695+0000 7f0b0b200640 1 Processor -- start 2024-02-19T06:57:51.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.696+0000 7f0b0b200640 1 -- start start 2024-02-19T06:57:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b0b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b040b2590 0x7f0b041556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b0b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b040b2ae0 0x7f0b041f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b0b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b040d0310 0x7f0b041f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b0b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040ccdc0 con 0x7f0b040b2ae0 2024-02-19T06:57:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b0b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040cd0a0 con 0x7f0b040d0310 2024-02-19T06:57:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b0b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040cd380 con 0x7f0b040b2590 2024-02-19T06:57:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b03400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b040b2ae0 0x7f0b041f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b03400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b040b2ae0 0x7f0b041f76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37684/0 (socket says 172.21.15.46:37684) 2024-02-19T06:57:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b03400640 1 -- 172.21.15.46:0/1391837015 learned_addr learned my addr 172.21.15.46:0/1391837015 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b03e00640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b040b2590 0x7f0b041556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b09200640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b040d0310 0x7f0b041f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b03400640 1 -- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b040b2590 msgr2=0x7f0b041556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b03400640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b040b2590 0x7f0b041556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b03400640 1 -- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b040d0310 msgr2=0x7f0b041f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b03400640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b040d0310 0x7f0b041f7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b03400640 1 -- 172.21.15.46:0/1391837015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af40094d0 con 0x7f0b040b2ae0 2024-02-19T06:57:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.697+0000 7f0b09200640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b040d0310 0x7f0b041f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.698+0000 7f0b03400640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b040b2ae0 0x7f0b041f76a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0af000cd70 tx=0x7f0af000a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.698+0000 7f0afbe00640 1 -- 172.21.15.46:0/1391837015 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0003b90 con 0x7f0b040b2ae0 2024-02-19T06:57:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.698+0000 7f0afbe00640 1 -- 172.21.15.46:0/1391837015 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af0003cf0 con 0x7f0b040b2ae0 2024-02-19T06:57:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.698+0000 7f0afbe00640 1 -- 172.21.15.46:0/1391837015 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0003ea0 con 0x7f0b040b2ae0 2024-02-19T06:57:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.698+0000 7f0b0b200640 1 -- 172.21.15.46:0/1391837015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b040cd660 con 0x7f0b040b2ae0 2024-02-19T06:57:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.698+0000 7f0b0b200640 1 -- 172.21.15.46:0/1391837015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b04155bf0 con 0x7f0b040b2ae0 2024-02-19T06:57:51.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.699+0000 7f0b0b200640 1 -- 172.21.15.46:0/1391837015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b040682b0 con 0x7f0b040b2ae0 2024-02-19T06:57:51.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.700+0000 7f0afbe00640 1 -- 172.21.15.46:0/1391837015 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0af0004240 con 0x7f0b040b2ae0 2024-02-19T06:57:51.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.701+0000 7f0afbe00640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0ae406b840 0x7f0ae406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:51.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.701+0000 7f0afbe00640 1 -- 172.21.15.46:0/1391837015 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0af008a680 con 0x7f0b040b2ae0 2024-02-19T06:57:51.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.702+0000 7f0b03e00640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0ae406b840 0x7f0ae406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:51.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.703+0000 7f0b03e00640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0ae406b840 0x7f0ae406dd00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0af4036000 tx=0x7f0af403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:51.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.706+0000 7f0afbe00640 1 -- 172.21.15.46:0/1391837015 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0af00553e0 con 0x7f0b040b2ae0 2024-02-19T06:57:51.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.907+0000 7f0b0b200640 1 -- 172.21.15.46:0/1391837015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b040b22e0 con 0x7f0b040b2ae0 2024-02-19T06:57:51.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.909+0000 7f0afbe00640 1 -- 172.21.15.46:0/1391837015 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12884 (secure 0 0 0) 0x7f0af001d020 con 0x7f0b040b2ae0 2024-02-19T06:57:51.911 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:57:51.912 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:46.242911+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:57:51.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.912+0000 7f0b0b200640 1 -- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0ae406b840 msgr2=0x7f0ae406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:51.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.912+0000 7f0b0b200640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0ae406b840 0x7f0ae406dd00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0af4036000 tx=0x7f0af403c040 comp rx=0 tx=0).stop 2024-02-19T06:57:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.912+0000 7f0b0b200640 1 -- 172.21.15.46:0/1391837015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b040b2ae0 msgr2=0x7f0b041f76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.912+0000 7f0b0b200640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b040b2ae0 0x7f0b041f76a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0af000cd70 tx=0x7f0af000a610 comp rx=0 tx=0).stop 2024-02-19T06:57:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.912+0000 7f0b0b200640 1 -- 172.21.15.46:0/1391837015 shutdown_connections 2024-02-19T06:57:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.912+0000 7f0b0b200640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0ae406b840 0x7f0ae406dd00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.912+0000 7f0b0b200640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b040d0310 0x7f0b041f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.912+0000 7f0b0b200640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b040b2ae0 0x7f0b041f76a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.912+0000 7f0b0b200640 1 --2- 172.21.15.46:0/1391837015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b040b2590 0x7f0b041556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.912+0000 7f0b0b200640 1 -- 172.21.15.46:0/1391837015 >> 172.21.15.46:0/1391837015 conn(0x7f0b0406be20 msgr2=0x7f0b0415c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.912+0000 7f0b0b200640 1 -- 172.21.15.46:0/1391837015 shutdown_connections 2024-02-19T06:57:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:51.912+0000 7f0b0b200640 1 -- 172.21.15.46:0/1391837015 wait complete. 2024-02-19T06:57:51.932 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:57:51.932 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:57:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.148+0000 7f3e87c00640 1 Processor -- start 2024-02-19T06:57:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.148+0000 7f3e87c00640 1 -- start start 2024-02-19T06:57:52.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.149+0000 7f3e87c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3e8015dde0 0x7f3e8006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:52.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.149+0000 7f3e87c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e800b3e70 0x7f3e800b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:52.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.150+0000 7f3e87c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e800b49f0 con 0x7f3e800b2a10 2024-02-19T06:57:52.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.150+0000 7f3e87c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e800cd340 con 0x7f3e8015dde0 2024-02-19T06:57:52.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.150+0000 7f3e87c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800b4430 con 0x7f3e800b3e70 2024-02-19T06:57:52.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.150+0000 7f3e85200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3e8015dde0 0x7f3e8006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:52.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.150+0000 7f3e85200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3e8015dde0 0x7f3e8006dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:55610/0 (socket says 172.21.15.46:55610) 2024-02-19T06:57:52.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.150+0000 7f3e7fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e800b3e70 0x7f3e800b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:52.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.150+0000 7f3e85200640 1 -- 172.21.15.46:0/2718490974 learned_addr learned my addr 172.21.15.46:0/2718490974 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:52.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.151+0000 7f3e85200640 1 -- 172.21.15.46:0/2718490974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e800b3e70 msgr2=0x7f3e800b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:52.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.151+0000 7f3e85200640 1 --2- 172.21.15.46:0/2718490974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e800b3e70 0x7f3e800b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.151+0000 7f3e85200640 1 -- 172.21.15.46:0/2718490974 >> v1:172.21.15.142:6789/0 conn(0x7f3e800b2a10 legacy=0x7f3e800cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:52.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.151+0000 7f3e85200640 1 -- 172.21.15.46:0/2718490974 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e800b4710 con 0x7f3e8015dde0 2024-02-19T06:57:52.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.153+0000 7f3e85200640 1 --2- 172.21.15.46:0/2718490974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e8015dde0 0x7f3e8006dd30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009870 tx=0x7f3e7002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4275fdd59700eafc server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:52.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.153+0000 7f3e7f400640 1 -- 172.21.15.46:0/2718490974 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70030840 con 0x7f3e8015dde0 2024-02-19T06:57:52.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.153+0000 7f3e7f400640 1 -- 172.21.15.46:0/2718490974 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e700309a0 con 0x7f3e8015dde0 2024-02-19T06:57:52.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.153+0000 7f3e7f400640 1 -- 172.21.15.46:0/2718490974 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70030d30 con 0x7f3e8015dde0 2024-02-19T06:57:52.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.154+0000 7f3e87c00640 1 -- 172.21.15.46:0/2718490974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e8015dde0 msgr2=0x7f3e8006dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.154+0000 7f3e87c00640 1 --2- 172.21.15.46:0/2718490974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e8015dde0 0x7f3e8006dd30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009870 tx=0x7f3e7002b980 comp rx=0 tx=0).stop 2024-02-19T06:57:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.154+0000 7f3e87c00640 1 -- 172.21.15.46:0/2718490974 shutdown_connections 2024-02-19T06:57:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.154+0000 7f3e87c00640 1 --2- 172.21.15.46:0/2718490974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e800b3e70 0x7f3e800b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.154+0000 7f3e87c00640 1 --2- 172.21.15.46:0/2718490974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e8015dde0 0x7f3e8006dd30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.154+0000 7f3e87c00640 1 -- 172.21.15.46:0/2718490974 >> 172.21.15.46:0/2718490974 conn(0x7f3e80066fc0 msgr2=0x7f3e8006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.154+0000 7f3e87c00640 1 -- 172.21.15.46:0/2718490974 shutdown_connections 2024-02-19T06:57:52.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.154+0000 7f3e87c00640 1 -- 172.21.15.46:0/2718490974 wait complete. 2024-02-19T06:57:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.156+0000 7f3e87c00640 1 Processor -- start 2024-02-19T06:57:52.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.156+0000 7f3e87c00640 1 -- start start 2024-02-19T06:57:52.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.157+0000 7f3e87c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e800b2a10 0x7f3e80150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:52.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.157+0000 7f3e87c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e800b3e70 0x7f3e8015b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:52.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.157+0000 7f3e87c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e80159400 0x7f3e801efec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:52.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.157+0000 7f3e87c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8015c1f0 con 0x7f3e800b2a10 2024-02-19T06:57:52.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.157+0000 7f3e87c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e80154b00 con 0x7f3e80159400 2024-02-19T06:57:52.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.157+0000 7f3e87c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8015b950 con 0x7f3e800b3e70 2024-02-19T06:57:52.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.157+0000 7f3e85200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e800b2a10 0x7f3e80150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:52.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.157+0000 7f3e85200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e800b2a10 0x7f3e80150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37690/0 (socket says 172.21.15.46:37690) 2024-02-19T06:57:52.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.157+0000 7f3e85200640 1 -- 172.21.15.46:0/4190371369 learned_addr learned my addr 172.21.15.46:0/4190371369 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:52.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.157+0000 7f3e7fe00640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e800b3e70 0x7f3e8015b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:52.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e85c00640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e80159400 0x7f3e801efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:52.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e85200640 1 -- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e800b3e70 msgr2=0x7f3e8015b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e85200640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e800b3e70 0x7f3e8015b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e85200640 1 -- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e80159400 msgr2=0x7f3e801efec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e85200640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e80159400 0x7f3e801efec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e85200640 1 -- 172.21.15.46:0/4190371369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700094d0 con 0x7f3e800b2a10 2024-02-19T06:57:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e7fe00640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e800b3e70 0x7f3e8015b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e85c00640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e80159400 0x7f3e801efec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e85200640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e800b2a10 0x7f3e80150200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3e7002bf10 tx=0x7f3e70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e7cc00640 1 -- 172.21.15.46:0/4190371369 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70047070 con 0x7f3e800b2a10 2024-02-19T06:57:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e7cc00640 1 -- 172.21.15.46:0/4190371369 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e70039a10 con 0x7f3e800b2a10 2024-02-19T06:57:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e87c00640 1 -- 172.21.15.46:0/4190371369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8015bc30 con 0x7f3e800b2a10 2024-02-19T06:57:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e7cc00640 1 -- 172.21.15.46:0/4190371369 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70039dc0 con 0x7f3e800b2a10 2024-02-19T06:57:52.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.158+0000 7f3e87c00640 1 -- 172.21.15.46:0/4190371369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e80150740 con 0x7f3e800b2a10 2024-02-19T06:57:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.159+0000 7f3e87c00640 1 -- 172.21.15.46:0/4190371369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e80067ba0 con 0x7f3e800b2a10 2024-02-19T06:57:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.160+0000 7f3e7cc00640 1 -- 172.21.15.46:0/4190371369 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3e7004c410 con 0x7f3e800b2a10 2024-02-19T06:57:52.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.161+0000 7f3e7cc00640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3e6006b810 0x7f3e6006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.161+0000 7f3e7cc00640 1 -- 172.21.15.46:0/4190371369 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3e7003e070 con 0x7f3e800b2a10 2024-02-19T06:57:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.162+0000 7f3e7fe00640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3e6006b810 0x7f3e6006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:52.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.163+0000 7f3e7fe00640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3e6006b810 0x7f3e6006dcd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e801539a0 tx=0x7f3e6c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:52.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.166+0000 7f3e7cc00640 1 -- 172.21.15.46:0/4190371369 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e70077310 con 0x7f3e800b2a10 2024-02-19T06:57:52.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.365+0000 7f3e87c00640 1 -- 172.21.15.46:0/4190371369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e801548b0 con 0x7f3e800b2a10 2024-02-19T06:57:52.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.366+0000 7f3e7cc00640 1 -- 172.21.15.46:0/4190371369 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e7007a9d0 con 0x7f3e800b2a10 2024-02-19T06:57:52.368 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:57:52.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.368+0000 7f3e87c00640 1 -- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3e6006b810 msgr2=0x7f3e6006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:52.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.368+0000 7f3e87c00640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3e6006b810 0x7f3e6006dcd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e801539a0 tx=0x7f3e6c008040 comp rx=0 tx=0).stop 2024-02-19T06:57:52.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.368+0000 7f3e87c00640 1 -- 172.21.15.46:0/4190371369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e800b2a10 msgr2=0x7f3e80150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:52.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.368+0000 7f3e87c00640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e800b2a10 0x7f3e80150200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3e7002bf10 tx=0x7f3e70004730 comp rx=0 tx=0).stop 2024-02-19T06:57:52.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.369+0000 7f3e87c00640 1 -- 172.21.15.46:0/4190371369 shutdown_connections 2024-02-19T06:57:52.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.369+0000 7f3e87c00640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3e6006b810 0x7f3e6006dcd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.369+0000 7f3e87c00640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e80159400 0x7f3e801efec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.369+0000 7f3e87c00640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e800b3e70 0x7f3e8015b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.369+0000 7f3e87c00640 1 --2- 172.21.15.46:0/4190371369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e800b2a10 0x7f3e80150200 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.369+0000 7f3e87c00640 1 -- 172.21.15.46:0/4190371369 >> 172.21.15.46:0/4190371369 conn(0x7f3e80066fc0 msgr2=0x7f3e800afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:52.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.369+0000 7f3e87c00640 1 -- 172.21.15.46:0/4190371369 shutdown_connections 2024-02-19T06:57:52.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.369+0000 7f3e87c00640 1 -- 172.21.15.46:0/4190371369 wait complete. 2024-02-19T06:57:52.390 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-19T06:57:52.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.609+0000 7fc29ae00640 1 Processor -- start 2024-02-19T06:57:52.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.609+0000 7fc29ae00640 1 -- start start 2024-02-19T06:57:52.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.611+0000 7fc29ae00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc2940acb80 0x7fc29415ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:52.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.611+0000 7fc29ae00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2940b2540 0x7fc2940b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:52.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.611+0000 7fc29ae00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2940ad000 con 0x7fc2940ae3f0 2024-02-19T06:57:52.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.611+0000 7fc29ae00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2940adee0 con 0x7fc2940acb80 2024-02-19T06:57:52.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.611+0000 7fc29ae00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29415efc0 con 0x7fc2940b2540 2024-02-19T06:57:52.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.611+0000 7fc293400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc2940acb80 0x7fc29415ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:52.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.611+0000 7fc293e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc2940ae3f0 0x7fc2940ae7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54302/0 (socket says 172.21.15.46:54302) 2024-02-19T06:57:52.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.612+0000 7fc293e00640 1 -- 172.21.15.46:0/2103797557 learned_addr learned my addr 172.21.15.46:0/2103797557 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:57:52.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.612+0000 7fc298e00640 1 --2- 172.21.15.46:0/2103797557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2940b2540 0x7fc2940b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:52.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.612+0000 7fc293400640 1 -- 172.21.15.46:0/2103797557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2940b2540 msgr2=0x7fc2940b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:52.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.612+0000 7fc293400640 1 --2- 172.21.15.46:0/2103797557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2940b2540 0x7fc2940b29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.612+0000 7fc293400640 1 -- 172.21.15.46:0/2103797557 >> v1:172.21.15.46:6789/0 conn(0x7fc2940ae3f0 legacy=0x7fc2940ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:52.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.612+0000 7fc293400640 1 -- 172.21.15.46:0/2103797557 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2940ad260 con 0x7fc2940acb80 2024-02-19T06:57:52.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.612+0000 7fc292a00640 1 -- 172.21.15.46:0/2103797557 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241037166 0 0) 0x7fc2940ad000 con 0x7fc2940ae3f0 2024-02-19T06:57:52.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.613+0000 7fc293400640 1 --2- 172.21.15.46:0/2103797557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2940acb80 0x7fc29415ea80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0097a0 tx=0x7fc27c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965c2afaa0a501af server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:52.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.613+0000 7fc292a00640 1 -- 172.21.15.46:0/2103797557 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c031830 con 0x7fc2940acb80 2024-02-19T06:57:52.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.614+0000 7fc292a00640 1 -- 172.21.15.46:0/2103797557 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c031990 con 0x7fc2940acb80 2024-02-19T06:57:52.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.614+0000 7fc292a00640 1 -- 172.21.15.46:0/2103797557 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c031d20 con 0x7fc2940acb80 2024-02-19T06:57:52.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.614+0000 7fc29ae00640 1 -- 172.21.15.46:0/2103797557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2940acb80 msgr2=0x7fc29415ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:52.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.614+0000 7fc29ae00640 1 --2- 172.21.15.46:0/2103797557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2940acb80 0x7fc29415ea80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0097a0 tx=0x7fc27c02b8d0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.614+0000 7fc29ae00640 1 -- 172.21.15.46:0/2103797557 shutdown_connections 2024-02-19T06:57:52.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.614+0000 7fc29ae00640 1 --2- 172.21.15.46:0/2103797557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2940b2540 0x7fc2940b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.614+0000 7fc29ae00640 1 --2- 172.21.15.46:0/2103797557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2940acb80 0x7fc29415ea80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.614+0000 7fc29ae00640 1 -- 172.21.15.46:0/2103797557 >> 172.21.15.46:0/2103797557 conn(0x7fc294066f70 msgr2=0x7fc29406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:52.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.614+0000 7fc29ae00640 1 -- 172.21.15.46:0/2103797557 shutdown_connections 2024-02-19T06:57:52.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.614+0000 7fc29ae00640 1 -- 172.21.15.46:0/2103797557 wait complete. 2024-02-19T06:57:52.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.616+0000 7fc29ae00640 1 Processor -- start 2024-02-19T06:57:52.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.616+0000 7fc29ae00640 1 -- start start 2024-02-19T06:57:52.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.617+0000 7fc29ae00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2940acb80 0x7fc2941510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:52.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.617+0000 7fc29ae00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2940ae3f0 0x7fc2941f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:52.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.617+0000 7fc29ae00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2940b2540 0x7fc29415c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:52.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.617+0000 7fc29ae00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc294151680 con 0x7fc2940acb80 2024-02-19T06:57:52.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.617+0000 7fc29ae00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2941f7650 con 0x7fc2940ae3f0 2024-02-19T06:57:52.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.617+0000 7fc29ae00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc294158d00 con 0x7fc2940b2540 2024-02-19T06:57:52.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.618+0000 7fc293e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2940acb80 0x7fc2941510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.618+0000 7fc293e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2940acb80 0x7fc2941510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37706/0 (socket says 172.21.15.46:37706) 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.618+0000 7fc293e00640 1 -- 172.21.15.46:0/1194063083 learned_addr learned my addr 172.21.15.46:0/1194063083 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.618+0000 7fc293400640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2940ae3f0 0x7fc2941f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.618+0000 7fc298e00640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2940b2540 0x7fc29415c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.618+0000 7fc293e00640 1 -- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2940b2540 msgr2=0x7fc29415c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.618+0000 7fc293e00640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2940b2540 0x7fc29415c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.618+0000 7fc293e00640 1 -- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2940ae3f0 msgr2=0x7fc2941f7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.618+0000 7fc293e00640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2940ae3f0 0x7fc2941f7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.618+0000 7fc293e00640 1 -- 172.21.15.46:0/1194063083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c009400 con 0x7fc2940acb80 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.618+0000 7fc298e00640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2940b2540 0x7fc29415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.618+0000 7fc293400640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2940ae3f0 0x7fc2941f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.618+0000 7fc293e00640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2940acb80 0x7fc2941510a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc28400c8c0 tx=0x7fc28400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.619+0000 7fc28be00640 1 -- 172.21.15.46:0/1194063083 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28400a640 con 0x7fc2940acb80 2024-02-19T06:57:52.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.619+0000 7fc28be00640 1 -- 172.21.15.46:0/1194063083 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28400a7c0 con 0x7fc2940acb80 2024-02-19T06:57:52.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.619+0000 7fc28be00640 1 -- 172.21.15.46:0/1194063083 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28400ab70 con 0x7fc2940acb80 2024-02-19T06:57:52.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.619+0000 7fc29ae00640 1 -- 172.21.15.46:0/1194063083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc294158fe0 con 0x7fc2940acb80 2024-02-19T06:57:52.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.619+0000 7fc29ae00640 1 -- 172.21.15.46:0/1194063083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2941595a0 con 0x7fc2940acb80 2024-02-19T06:57:52.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.620+0000 7fc29ae00640 1 -- 172.21.15.46:0/1194063083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc294159790 con 0x7fc2940acb80 2024-02-19T06:57:52.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.621+0000 7fc28be00640 1 -- 172.21.15.46:0/1194063083 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc28400acd0 con 0x7fc2940acb80 2024-02-19T06:57:52.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.622+0000 7fc28be00640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc27006b810 0x7fc27006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:52.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.622+0000 7fc28be00640 1 -- 172.21.15.46:0/1194063083 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc284089560 con 0x7fc2940acb80 2024-02-19T06:57:52.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.622+0000 7fc293400640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc27006b810 0x7fc27006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:52.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.624+0000 7fc293400640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc27006b810 0x7fc27006dcd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc27c036000 tx=0x7fc27c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:52.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.626+0000 7fc28be00640 1 -- 172.21.15.46:0/1194063083 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc284054230 con 0x7fc2940acb80 2024-02-19T06:57:52.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.830+0000 7fc29ae00640 1 -- 172.21.15.46:0/1194063083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc294067ba0 con 0x7fc2940acb80 2024-02-19T06:57:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.831+0000 7fc28be00640 1 -- 172.21.15.46:0/1194063083 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc284018090 con 0x7fc2940acb80 2024-02-19T06:57:52.833 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:57:52.834 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-02-19T06:57:52.834 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:57:52.834 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2024-02-19T06:57:52.834 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2024-02-19T06:57:52.834 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:57:52.834 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-02-19T06:57:52.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.833+0000 7fc29ae00640 1 -- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc27006b810 msgr2=0x7fc27006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:52.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.833+0000 7fc29ae00640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc27006b810 0x7fc27006dcd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc27c036000 tx=0x7fc27c008030 comp rx=0 tx=0).stop 2024-02-19T06:57:52.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.833+0000 7fc29ae00640 1 -- 172.21.15.46:0/1194063083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2940acb80 msgr2=0x7fc2941510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.833+0000 7fc29ae00640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2940acb80 0x7fc2941510a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc28400c8c0 tx=0x7fc28400cd80 comp rx=0 tx=0).stop 2024-02-19T06:57:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.834+0000 7fc29ae00640 1 -- 172.21.15.46:0/1194063083 shutdown_connections 2024-02-19T06:57:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.834+0000 7fc29ae00640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc27006b810 0x7fc27006dcd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.834+0000 7fc29ae00640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2940b2540 0x7fc29415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.834+0000 7fc29ae00640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2940ae3f0 0x7fc2941f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.834+0000 7fc29ae00640 1 --2- 172.21.15.46:0/1194063083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2940acb80 0x7fc2941510a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.834+0000 7fc29ae00640 1 -- 172.21.15.46:0/1194063083 >> 172.21.15.46:0/1194063083 conn(0x7fc294066f70 msgr2=0x7fc29406de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.834+0000 7fc29ae00640 1 -- 172.21.15.46:0/1194063083 shutdown_connections 2024-02-19T06:57:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:52.834+0000 7fc29ae00640 1 -- 172.21.15.46:0/1194063083 wait complete. 2024-02-19T06:57:52.856 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-19T06:57:52.856 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-19T06:57:53.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.078+0000 7f98c6e00640 1 Processor -- start 2024-02-19T06:57:53.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.078+0000 7f98c6e00640 1 -- start start 2024-02-19T06:57:53.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.079+0000 7f98c6e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98c00cc840 0x7f98c00b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:53.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.080+0000 7f98c6e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c0098db0 con 0x7f98c00cf520 2024-02-19T06:57:53.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.080+0000 7f98c6e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c015bad0 con 0x7f98c0072990 2024-02-19T06:57:53.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.080+0000 7f98c6e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c00b36e0 con 0x7f98c00cc840 2024-02-19T06:57:53.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.080+0000 7f98c5a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f98c00cf520 0x7f98c00cf900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54306/0 (socket says 172.21.15.46:54306) 2024-02-19T06:57:53.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.080+0000 7f98c5a00640 1 -- 172.21.15.46:0/2811021889 learned_addr learned my addr 172.21.15.46:0/2811021889 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:57:53.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.080+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255378597 0 0) 0x7f98b4001110 con 0x7f98c00cf520 2024-02-19T06:57:53.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.080+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98a8003520 con 0x7f98c00cf520 2024-02-19T06:57:53.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.080+0000 7f98c5000640 1 --2- 172.21.15.46:0/2811021889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98c00cc840 0x7f98c00b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:53.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 183874486 0 0) 0x7f98a8003520 con 0x7f98c00cf520 2024-02-19T06:57:53.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98c00cc840 msgr2=0x7f98c00b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:53.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98bfe00640 1 --2- 172.21.15.46:0/2811021889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98c00cc840 0x7f98c00b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:53.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 >> v1:172.21.15.142:6789/0 conn(0x7f98c0072990 legacy=0x7f98c00ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:53.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c00731c0 con 0x7f98c00cf520 2024-02-19T06:57:53.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f98b4001800 con 0x7f98c00cf520 2024-02-19T06:57:53.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 >> v1:172.21.15.46:6789/0 conn(0x7f98c00cf520 legacy=0x7f98c00cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:53.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98bfe00640 1 --2- 172.21.15.46:0/2811021889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a80039a0 0x7f98a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:53.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98bfe00640 1 --2- 172.21.15.46:0/2811021889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a80047c0 0x7f98a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:53.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98bfe00640 1 --2- 172.21.15.46:0/2811021889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98c00cc840 0x7f98a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:53.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c00b36e0 con 0x7f98a80047c0 2024-02-19T06:57:53.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a80054e0 con 0x7f98a80039a0 2024-02-19T06:57:53.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a800bec0 con 0x7f98c00cc840 2024-02-19T06:57:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98c5000640 1 --2- 172.21.15.46:0/2811021889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a80047c0 0x7f98a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98c5a00640 1 --2- 172.21.15.46:0/2811021889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a80039a0 0x7f98a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98c6400640 1 --2- 172.21.15.46:0/2811021889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98c00cc840 0x7f98a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.081+0000 7f98c5000640 1 -- 172.21.15.46:0/2811021889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98c00cc840 msgr2=0x7f98a800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.082+0000 7f98c5000640 1 --2- 172.21.15.46:0/2811021889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98c00cc840 0x7f98a800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.082+0000 7f98c5000640 1 -- 172.21.15.46:0/2811021889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a80039a0 msgr2=0x7f98a8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.082+0000 7f98c5000640 1 --2- 172.21.15.46:0/2811021889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a80039a0 0x7f98a8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.082+0000 7f98c5000640 1 -- 172.21.15.46:0/2811021889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a8003520 con 0x7f98a80047c0 2024-02-19T06:57:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.082+0000 7f98c6400640 1 --2- 172.21.15.46:0/2811021889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98c00cc840 0x7f98a800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.083+0000 7f98c5000640 1 --2- 172.21.15.46:0/2811021889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a80047c0 0x7f98a8004c40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00ba30 tx=0x7f98a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7d8f8968c24ada server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.083+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac032640 con 0x7f98a80047c0 2024-02-19T06:57:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.083+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac0327a0 con 0x7f98a80047c0 2024-02-19T06:57:53.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.083+0000 7f98bfe00640 1 -- 172.21.15.46:0/2811021889 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac032b30 con 0x7f98a80047c0 2024-02-19T06:57:53.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.083+0000 7f98c6e00640 1 -- 172.21.15.46:0/2811021889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a80047c0 msgr2=0x7f98a8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.083+0000 7f98c6e00640 1 --2- 172.21.15.46:0/2811021889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a80047c0 0x7f98a8004c40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00ba30 tx=0x7f98a80057f0 comp rx=0 tx=0).stop 2024-02-19T06:57:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.084+0000 7f98c6400640 1 -- 172.21.15.46:0/2811021889 reap_dead start 2024-02-19T06:57:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.084+0000 7f98c6e00640 1 -- 172.21.15.46:0/2811021889 shutdown_connections 2024-02-19T06:57:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.084+0000 7f98c6e00640 1 -- 172.21.15.46:0/2811021889 >> 172.21.15.46:0/2811021889 conn(0x7f98c006ad60 msgr2=0x7f98c006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.084+0000 7f98c6e00640 1 -- 172.21.15.46:0/2811021889 shutdown_connections 2024-02-19T06:57:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.084+0000 7f98c6e00640 1 -- 172.21.15.46:0/2811021889 wait complete. 2024-02-19T06:57:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.085+0000 7f98c6e00640 1 Processor -- start 2024-02-19T06:57:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.086+0000 7f98c6e00640 1 -- start start 2024-02-19T06:57:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.086+0000 7f98c6e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a80047c0 0x7f98c00c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.086+0000 7f98c6e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98c00c8d00 0x7f98c01e5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c6e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98c01e5970 0x7f98c01e3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:53.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c6e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c01e5ef0 con 0x7f98a80047c0 2024-02-19T06:57:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c6e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c01e61d0 con 0x7f98c01e5970 2024-02-19T06:57:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c6e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c01e64b0 con 0x7f98c00c8d00 2024-02-19T06:57:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c5a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a80047c0 0x7f98c00c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c5a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a80047c0 0x7f98c00c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37730/0 (socket says 172.21.15.46:37730) 2024-02-19T06:57:53.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c5a00640 1 -- 172.21.15.46:0/145754145 learned_addr learned my addr 172.21.15.46:0/145754145 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:53.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c5a00640 1 -- 172.21.15.46:0/145754145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98c00c8d00 msgr2=0x7f98c01e5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:53.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c5a00640 1 --2- 172.21.15.46:0/145754145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98c00c8d00 0x7f98c01e5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:53.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c6400640 1 --2- 172.21.15.46:0/145754145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98c01e5970 0x7f98c01e3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:53.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c5a00640 1 -- 172.21.15.46:0/145754145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98c01e5970 msgr2=0x7f98c01e3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:53.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c5a00640 1 --2- 172.21.15.46:0/145754145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98c01e5970 0x7f98c01e3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:53.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c5a00640 1 -- 172.21.15.46:0/145754145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c01e6790 con 0x7f98a80047c0 2024-02-19T06:57:53.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.087+0000 7f98c5a00640 1 --2- 172.21.15.46:0/145754145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a80047c0 0x7f98c00c87c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98b4001270 tx=0x7f98b400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:53.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.088+0000 7f98bd600640 1 -- 172.21.15.46:0/145754145 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b400c8d0 con 0x7f98a80047c0 2024-02-19T06:57:53.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.088+0000 7f98bd600640 1 -- 172.21.15.46:0/145754145 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b400ca50 con 0x7f98a80047c0 2024-02-19T06:57:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.088+0000 7f98c6e00640 1 -- 172.21.15.46:0/145754145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c01e6a70 con 0x7f98a80047c0 2024-02-19T06:57:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.088+0000 7f98bd600640 1 -- 172.21.15.46:0/145754145 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b400ce00 con 0x7f98a80047c0 2024-02-19T06:57:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.088+0000 7f98c6e00640 1 -- 172.21.15.46:0/145754145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c01e4290 con 0x7f98a80047c0 2024-02-19T06:57:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.089+0000 7f98c6e00640 1 -- 172.21.15.46:0/145754145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c01e6cb0 con 0x7f98a80047c0 2024-02-19T06:57:53.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.090+0000 7f98bd600640 1 -- 172.21.15.46:0/145754145 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f98b401d460 con 0x7f98a80047c0 2024-02-19T06:57:53.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.091+0000 7f98bd600640 1 --2- 172.21.15.46:0/145754145 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f98a006b810 0x7f98a006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:53.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.091+0000 7f98bd600640 1 -- 172.21.15.46:0/145754145 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98b4089df0 con 0x7f98a80047c0 2024-02-19T06:57:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.092+0000 7f98c5000640 1 --2- 172.21.15.46:0/145754145 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f98a006b810 0x7f98a006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:53.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.093+0000 7f98c5000640 1 --2- 172.21.15.46:0/145754145 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f98a006b810 0x7f98a006dcd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00ba00 tx=0x7f98ac032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:53.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.095+0000 7f98bd600640 1 -- 172.21.15.46:0/145754145 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f98c01e6cb0 con 0x7f98a80047c0 2024-02-19T06:57:53.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.294+0000 7f98c6e00640 1 -- 172.21.15.46:0/145754145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f98c0098db0 con 0x7f98a80047c0 2024-02-19T06:57:53.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.797+0000 7f98bd600640 1 -- 172.21.15.46:0/145754145 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f98c0098db0 con 0x7f98a80047c0 2024-02-19T06:57:53.801 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2024-02-19T06:57:53.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.800+0000 7f98c6e00640 1 -- 172.21.15.46:0/145754145 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f98a006b810 msgr2=0x7f98a006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:53.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.800+0000 7f98c6e00640 1 --2- 172.21.15.46:0/145754145 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f98a006b810 0x7f98a006dcd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00ba00 tx=0x7f98ac032000 comp rx=0 tx=0).stop 2024-02-19T06:57:53.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.800+0000 7f98c6e00640 1 -- 172.21.15.46:0/145754145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a80047c0 msgr2=0x7f98c00c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:53.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.800+0000 7f98c6e00640 1 --2- 172.21.15.46:0/145754145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a80047c0 0x7f98c00c87c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98b4001270 tx=0x7f98b400ec80 comp rx=0 tx=0).stop 2024-02-19T06:57:53.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.801+0000 7f98c6e00640 1 -- 172.21.15.46:0/145754145 shutdown_connections 2024-02-19T06:57:53.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.801+0000 7f98c6e00640 1 --2- 172.21.15.46:0/145754145 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f98a006b810 0x7f98a006dcd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:53.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.801+0000 7f98c6e00640 1 --2- 172.21.15.46:0/145754145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98c01e5970 0x7f98c01e3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:53.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.801+0000 7f98c6e00640 1 --2- 172.21.15.46:0/145754145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98c00c8d00 0x7f98c01e5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:53.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.801+0000 7f98c6e00640 1 --2- 172.21.15.46:0/145754145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a80047c0 0x7f98c00c87c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:53.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.801+0000 7f98c6e00640 1 -- 172.21.15.46:0/145754145 >> 172.21.15.46:0/145754145 conn(0x7f98c006ad60 msgr2=0x7f98c00ad850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:53.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.802+0000 7f98c6e00640 1 -- 172.21.15.46:0/145754145 shutdown_connections 2024-02-19T06:57:53.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:53.802+0000 7f98c6e00640 1 -- 172.21.15.46:0/145754145 wait complete. 2024-02-19T06:57:53.833 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-19T06:57:54.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.040+0000 7f5787200640 1 Processor -- start 2024-02-19T06:57:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.040+0000 7f5787200640 1 -- start start 2024-02-19T06:57:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.041+0000 7f5787200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5788161c20 0x7f57880b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.041+0000 7f5787200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57880b3110 0x7f57880c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.041+0000 7f5787200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f57880c2820 0x7f57880cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.041+0000 7f5787200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57880c2cb0 con 0x7f57880c2820 2024-02-19T06:57:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.041+0000 7f5787200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578806cef0 con 0x7f5788161c20 2024-02-19T06:57:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.041+0000 7f5787200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578806dd50 con 0x7f57880b3110 2024-02-19T06:57:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.042+0000 7f5786800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f57880c2820 0x7f57880cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.042+0000 7f5786800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f57880c2820 0x7f57880cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37732/0 (socket says 172.21.15.46:37732) 2024-02-19T06:57:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.042+0000 7f5786800640 1 -- 172.21.15.46:0/1242306532 learned_addr learned my addr 172.21.15.46:0/1242306532 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.042+0000 7f5785e00640 1 --2- 172.21.15.46:0/1242306532 >> v2:172.21.15.142:3300/0 conn(0x7f5788161c20 0x7f57880b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.042+0000 7f577fe00640 1 --2- 172.21.15.46:0/1242306532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57880b3110 0x7f57880c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.042+0000 7f5786800640 1 -- 172.21.15.46:0/1242306532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57880b3110 msgr2=0x7f57880c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.042+0000 7f5786800640 1 --2- 172.21.15.46:0/1242306532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57880b3110 0x7f57880c22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.042+0000 7f5786800640 1 -- 172.21.15.46:0/1242306532 >> v2:172.21.15.142:3300/0 conn(0x7f5788161c20 msgr2=0x7f57880b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.042+0000 7f5786800640 1 --2- 172.21.15.46:0/1242306532 >> v2:172.21.15.142:3300/0 conn(0x7f5788161c20 0x7f57880b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.042+0000 7f5786800640 1 -- 172.21.15.46:0/1242306532 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57880cefd0 con 0x7f57880c2820 2024-02-19T06:57:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.042+0000 7f577fe00640 1 --2- 172.21.15.46:0/1242306532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57880b3110 0x7f57880c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.044+0000 7f5786800640 1 --2- 172.21.15.46:0/1242306532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57880c2820 0x7f57880cbd00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f57880b9aa0 tx=0x7f578002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7394aade7ee674 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.044+0000 7f5785400640 1 -- 172.21.15.46:0/1242306532 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578002cb00 con 0x7f57880c2820 2024-02-19T06:57:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.044+0000 7f5785400640 1 -- 172.21.15.46:0/1242306532 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578002cc60 con 0x7f57880c2820 2024-02-19T06:57:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.044+0000 7f5785400640 1 -- 172.21.15.46:0/1242306532 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57800343f0 con 0x7f57880c2820 2024-02-19T06:57:54.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.045+0000 7f5787200640 1 -- 172.21.15.46:0/1242306532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57880c2820 msgr2=0x7f57880cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:54.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.045+0000 7f5787200640 1 --2- 172.21.15.46:0/1242306532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57880c2820 0x7f57880cbd00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f57880b9aa0 tx=0x7f578002bf60 comp rx=0 tx=0).stop 2024-02-19T06:57:54.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.045+0000 7f5787200640 1 -- 172.21.15.46:0/1242306532 shutdown_connections 2024-02-19T06:57:54.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.045+0000 7f5787200640 1 --2- 172.21.15.46:0/1242306532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57880c2820 0x7f57880cbd00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:54.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.045+0000 7f5787200640 1 --2- 172.21.15.46:0/1242306532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57880b3110 0x7f57880c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:54.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.045+0000 7f5787200640 1 --2- 172.21.15.46:0/1242306532 >> v2:172.21.15.142:3300/0 conn(0x7f5788161c20 0x7f57880b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:54.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.045+0000 7f5787200640 1 -- 172.21.15.46:0/1242306532 >> 172.21.15.46:0/1242306532 conn(0x7f578806ad60 msgr2=0x7f578806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:54.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.045+0000 7f5787200640 1 -- 172.21.15.46:0/1242306532 shutdown_connections 2024-02-19T06:57:54.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.045+0000 7f5787200640 1 -- 172.21.15.46:0/1242306532 wait complete. 2024-02-19T06:57:54.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.047+0000 7f5787200640 1 Processor -- start 2024-02-19T06:57:54.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.047+0000 7f5787200640 1 -- start start 2024-02-19T06:57:54.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.048+0000 7f5787200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57880b3110 0x7f57880c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:54.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.048+0000 7f5787200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57880c2820 0x7f57881527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:54.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.048+0000 7f5787200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5788161c20 0x7f578814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:54.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.048+0000 7f5787200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5788153820 con 0x7f5788161c20 2024-02-19T06:57:54.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.048+0000 7f5787200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5788150a40 con 0x7f57880c2820 2024-02-19T06:57:54.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.048+0000 7f5787200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5788152d30 con 0x7f57880b3110 2024-02-19T06:57:54.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.049+0000 7f5786800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5788161c20 0x7f578814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:54.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.049+0000 7f5786800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5788161c20 0x7f578814fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37748/0 (socket says 172.21.15.46:37748) 2024-02-19T06:57:54.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.049+0000 7f5786800640 1 -- 172.21.15.46:0/1285972800 learned_addr learned my addr 172.21.15.46:0/1285972800 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:54.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.049+0000 7f577fe00640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57880c2820 0x7f57881527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:54.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.049+0000 7f5785e00640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57880b3110 0x7f57880c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:54.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.049+0000 7f5786800640 1 -- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57880b3110 msgr2=0x7f57880c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:54.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.049+0000 7f5786800640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57880b3110 0x7f57880c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:54.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.049+0000 7f5786800640 1 -- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57880c2820 msgr2=0x7f57881527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:54.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.049+0000 7f5786800640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57880c2820 0x7f57881527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:54.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.049+0000 7f5786800640 1 -- 172.21.15.46:0/1285972800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780009b30 con 0x7f5788161c20 2024-02-19T06:57:54.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.050+0000 7f5786800640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5788161c20 0x7f578814fee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5780036040 tx=0x7f5780004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:54.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.050+0000 7f577e000640 1 -- 172.21.15.46:0/1285972800 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780009510 con 0x7f5788161c20 2024-02-19T06:57:54.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.050+0000 7f577e000640 1 -- 172.21.15.46:0/1285972800 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578003e450 con 0x7f5788161c20 2024-02-19T06:57:54.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.050+0000 7f577e000640 1 -- 172.21.15.46:0/1285972800 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578003e7e0 con 0x7f5788161c20 2024-02-19T06:57:54.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.050+0000 7f5787200640 1 -- 172.21.15.46:0/1285972800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5788152f80 con 0x7f5788161c20 2024-02-19T06:57:54.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.050+0000 7f5787200640 1 -- 172.21.15.46:0/1285972800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5788153540 con 0x7f5788161c20 2024-02-19T06:57:54.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.051+0000 7f5787200640 1 -- 172.21.15.46:0/1285972800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57880680c0 con 0x7f5788161c20 2024-02-19T06:57:54.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.052+0000 7f577e000640 1 -- 172.21.15.46:0/1285972800 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f578003e940 con 0x7f5788161c20 2024-02-19T06:57:54.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.054+0000 7f577e000640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f576406b810 0x7f576406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:54.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.054+0000 7f577e000640 1 -- 172.21.15.46:0/1285972800 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f57800ad3f0 con 0x7f5788161c20 2024-02-19T06:57:54.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.054+0000 7f5785e00640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f576406b810 0x7f576406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:54.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.055+0000 7f5785e00640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f576406b810 0x7f576406dcd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5778006fd0 tx=0x7f5778008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:54.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.057+0000 7f577e000640 1 -- 172.21.15.46:0/1285972800 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5780078180 con 0x7f5788161c20 2024-02-19T06:57:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.257+0000 7f5787200640 1 -- 172.21.15.46:0/1285972800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f57881507a0 con 0x7f5788161c20 2024-02-19T06:57:54.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.803+0000 7f577e000640 1 -- 172.21.15.46:0/1285972800 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f57881507a0 con 0x7f5788161c20 2024-02-19T06:57:54.806 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2024-02-19T06:57:54.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.807+0000 7f5787200640 1 -- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f576406b810 msgr2=0x7f576406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:54.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.807+0000 7f5787200640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f576406b810 0x7f576406dcd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5778006fd0 tx=0x7f5778008040 comp rx=0 tx=0).stop 2024-02-19T06:57:54.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.807+0000 7f5787200640 1 -- 172.21.15.46:0/1285972800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5788161c20 msgr2=0x7f578814fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:54.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.807+0000 7f5787200640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5788161c20 0x7f578814fee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5780036040 tx=0x7f5780004a40 comp rx=0 tx=0).stop 2024-02-19T06:57:54.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.807+0000 7f5787200640 1 -- 172.21.15.46:0/1285972800 shutdown_connections 2024-02-19T06:57:54.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.807+0000 7f5787200640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f576406b810 0x7f576406dcd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:54.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.807+0000 7f5787200640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5788161c20 0x7f578814fee0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:54.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.807+0000 7f5787200640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57880c2820 0x7f57881527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:54.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.807+0000 7f5787200640 1 --2- 172.21.15.46:0/1285972800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57880b3110 0x7f57880c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:54.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.807+0000 7f5787200640 1 -- 172.21.15.46:0/1285972800 >> 172.21.15.46:0/1285972800 conn(0x7f578806ad60 msgr2=0x7f578806b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:54.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.807+0000 7f5787200640 1 -- 172.21.15.46:0/1285972800 shutdown_connections 2024-02-19T06:57:54.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:54.807+0000 7f5787200640 1 -- 172.21.15.46:0/1285972800 wait complete. 2024-02-19T06:57:54.841 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-19T06:57:55.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.031+0000 7f2dfce00640 1 Processor -- start 2024-02-19T06:57:55.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.031+0000 7f2dfce00640 1 -- start start 2024-02-19T06:57:55.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.032+0000 7f2dfce00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df815db20 0x7f2df80cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:55.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.032+0000 7f2dfce00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2df80cdec0 0x7f2df80cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:55.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.032+0000 7f2dfce00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df8161580 con 0x7f2df80b33e0 2024-02-19T06:57:55.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.032+0000 7f2dfce00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df8162200 con 0x7f2df80cdec0 2024-02-19T06:57:55.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.032+0000 7f2dfce00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df8161860 con 0x7f2df815db20 2024-02-19T06:57:55.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.033+0000 7f2df7e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2df80b33e0 0x7f2df80b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54316/0 (socket says 172.21.15.46:54316) 2024-02-19T06:57:55.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.033+0000 7f2df7e00640 1 -- 172.21.15.46:0/3513056655 learned_addr learned my addr 172.21.15.46:0/3513056655 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:57:55.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.033+0000 7f2df7400640 1 --2- 172.21.15.46:0/3513056655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df815db20 0x7f2df80cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:55.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.033+0000 7f2defe00640 1 --2- 172.21.15.46:0/3513056655 >> v2:172.21.15.142:3300/0 conn(0x7f2df80cdec0 0x7f2df80cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:55.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.033+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585453820 0 0) 0x7f2df8161580 con 0x7f2df80b33e0 2024-02-19T06:57:55.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.033+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd8003520 con 0x7f2df80b33e0 2024-02-19T06:57:55.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.033+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2645614590 0 0) 0x7f2dd8003520 con 0x7f2df80b33e0 2024-02-19T06:57:55.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.033+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df815db20 msgr2=0x7f2df80cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:55.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.033+0000 7f2df6a00640 1 --2- 172.21.15.46:0/3513056655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df815db20 0x7f2df80cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:55.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.033+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 >> v2:172.21.15.142:3300/0 conn(0x7f2df80cdec0 msgr2=0x7f2df80cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.033+0000 7f2df6a00640 1 --2- 172.21.15.46:0/3513056655 >> v2:172.21.15.142:3300/0 conn(0x7f2df80cdec0 0x7f2df80cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.033+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df8161b40 con 0x7f2df80b33e0 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f2df00019f0 con 0x7f2df80b33e0 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 >> v1:172.21.15.46:6789/0 conn(0x7f2df80b33e0 legacy=0x7f2df80b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df6a00640 1 --2- 172.21.15.46:0/3513056655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2dd8003970 0x7f2dd8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df6a00640 1 --2- 172.21.15.46:0/3513056655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dd80047c0 0x7f2dd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df6a00640 1 --2- 172.21.15.46:0/3513056655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df815db20 0x7f2dd8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df8162200 con 0x7f2dd8003970 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df8161860 con 0x7f2dd80047c0 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd800b980 con 0x7f2df815db20 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df7400640 1 --2- 172.21.15.46:0/3513056655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2dd8003970 0x7f2dd8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2defe00640 1 --2- 172.21.15.46:0/3513056655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dd80047c0 0x7f2dd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df7e00640 1 --2- 172.21.15.46:0/3513056655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df815db20 0x7f2dd8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df7400640 1 -- 172.21.15.46:0/3513056655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df815db20 msgr2=0x7f2dd8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:55.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df7400640 1 --2- 172.21.15.46:0/3513056655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df815db20 0x7f2dd8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:55.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df7400640 1 -- 172.21.15.46:0/3513056655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dd80047c0 msgr2=0x7f2dd8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:55.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df7400640 1 --2- 172.21.15.46:0/3513056655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dd80047c0 0x7f2dd8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:55.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.034+0000 7f2df7400640 1 -- 172.21.15.46:0/3513056655 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd8003520 con 0x7f2dd8003970 2024-02-19T06:57:55.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.036+0000 7f2df7400640 1 --2- 172.21.15.46:0/3513056655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2dd8003970 0x7f2dd8003d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009af0 tx=0x7f2dd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a9ba19054d61dc server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:55.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.036+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de802c6b0 con 0x7f2dd8003970 2024-02-19T06:57:55.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.036+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de802c810 con 0x7f2dd8003970 2024-02-19T06:57:55.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.036+0000 7f2df6a00640 1 -- 172.21.15.46:0/3513056655 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de802cba0 con 0x7f2dd8003970 2024-02-19T06:57:55.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.036+0000 7f2dfce00640 1 -- 172.21.15.46:0/3513056655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2dd8003970 msgr2=0x7f2dd8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:55.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.036+0000 7f2dfce00640 1 --2- 172.21.15.46:0/3513056655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2dd8003970 0x7f2dd8003d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009af0 tx=0x7f2dd80057f0 comp rx=0 tx=0).stop 2024-02-19T06:57:55.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.036+0000 7f2df7e00640 1 -- 172.21.15.46:0/3513056655 reap_dead start 2024-02-19T06:57:55.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.036+0000 7f2dfce00640 1 -- 172.21.15.46:0/3513056655 shutdown_connections 2024-02-19T06:57:55.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.036+0000 7f2dfce00640 1 -- 172.21.15.46:0/3513056655 >> 172.21.15.46:0/3513056655 conn(0x7f2df806ad60 msgr2=0x7f2df806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:55.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.037+0000 7f2dfce00640 1 -- 172.21.15.46:0/3513056655 shutdown_connections 2024-02-19T06:57:55.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.037+0000 7f2dfce00640 1 -- 172.21.15.46:0/3513056655 wait complete. 2024-02-19T06:57:55.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.038+0000 7f2dfce00640 1 Processor -- start 2024-02-19T06:57:55.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.039+0000 7f2dfce00640 1 -- start start 2024-02-19T06:57:55.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.039+0000 7f2dfce00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df81f2ae0 0x7f2df80ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.039+0000 7f2dfce00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df81f2ec0 0x7f2df80ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.039+0000 7f2dfce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df80b00c0 0x7f2df80b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.039+0000 7f2dfce00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df81f6850 con 0x7f2df81f2ec0 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.039+0000 7f2dfce00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df81f73d0 con 0x7f2df80b00c0 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.039+0000 7f2dfce00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df81f6aa0 con 0x7f2df81f2ae0 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.040+0000 7f2defe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df81f2ec0 0x7f2df80ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.040+0000 7f2defe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df81f2ec0 0x7f2df80ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37770/0 (socket says 172.21.15.46:37770) 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.040+0000 7f2defe00640 1 -- 172.21.15.46:0/385408986 learned_addr learned my addr 172.21.15.46:0/385408986 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.040+0000 7f2df7e00640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df80b00c0 0x7f2df80b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.040+0000 7f2df7400640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df81f2ae0 0x7f2df80ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.040+0000 7f2defe00640 1 -- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df81f2ae0 msgr2=0x7f2df80ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.040+0000 7f2defe00640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df81f2ae0 0x7f2df80ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.040+0000 7f2defe00640 1 -- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df80b00c0 msgr2=0x7f2df80b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.040+0000 7f2defe00640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df80b00c0 0x7f2df80b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:55.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.040+0000 7f2defe00640 1 -- 172.21.15.46:0/385408986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df81f6d80 con 0x7f2df81f2ec0 2024-02-19T06:57:55.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.040+0000 7f2defe00640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df81f2ec0 0x7f2df80ada00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2de00116d0 tx=0x7f2de0011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:55.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.041+0000 7f2def400640 1 -- 172.21.15.46:0/385408986 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000f9c0 con 0x7f2df81f2ec0 2024-02-19T06:57:55.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.041+0000 7f2def400640 1 -- 172.21.15.46:0/385408986 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de000fb20 con 0x7f2df81f2ec0 2024-02-19T06:57:55.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.041+0000 7f2def400640 1 -- 172.21.15.46:0/385408986 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000fe90 con 0x7f2df81f2ec0 2024-02-19T06:57:55.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.041+0000 7f2dfce00640 1 -- 172.21.15.46:0/385408986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df81f7060 con 0x7f2df81f2ec0 2024-02-19T06:57:55.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.041+0000 7f2dfce00640 1 -- 172.21.15.46:0/385408986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df815e7a0 con 0x7f2df81f2ec0 2024-02-19T06:57:55.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.042+0000 7f2dfce00640 1 -- 172.21.15.46:0/385408986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df81f7540 con 0x7f2df81f2ec0 2024-02-19T06:57:55.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.043+0000 7f2def400640 1 -- 172.21.15.46:0/385408986 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2de0015460 con 0x7f2df81f2ec0 2024-02-19T06:57:55.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.044+0000 7f2def400640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2dd406b840 0x7f2dd406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:55.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.044+0000 7f2def400640 1 -- 172.21.15.46:0/385408986 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2de008a9d0 con 0x7f2df81f2ec0 2024-02-19T06:57:55.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.045+0000 7f2df7400640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2dd406b840 0x7f2dd406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:55.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.046+0000 7f2df7400640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2dd406b840 0x7f2dd406dd00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2de8036000 tx=0x7f2de8030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:55.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.050+0000 7f2def400640 1 -- 172.21.15.46:0/385408986 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2de0055440 con 0x7f2df81f2ec0 2024-02-19T06:57:55.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.289+0000 7f2dfce00640 1 -- 172.21.15.46:0/385408986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2df804eee0 con 0x7f2df81f2ec0 2024-02-19T06:57:55.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.827+0000 7f2def400640 1 -- 172.21.15.46:0/385408986 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2de0058b00 con 0x7f2df81f2ec0 2024-02-19T06:57:55.830 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 2 and data pool 3 2024-02-19T06:57:55.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.832+0000 7f2dfce00640 1 -- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2dd406b840 msgr2=0x7f2dd406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:55.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.832+0000 7f2dfce00640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2dd406b840 0x7f2dd406dd00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2de8036000 tx=0x7f2de8030000 comp rx=0 tx=0).stop 2024-02-19T06:57:55.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.832+0000 7f2dfce00640 1 -- 172.21.15.46:0/385408986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df81f2ec0 msgr2=0x7f2df80ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:55.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.832+0000 7f2dfce00640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df81f2ec0 0x7f2df80ada00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2de00116d0 tx=0x7f2de0011b90 comp rx=0 tx=0).stop 2024-02-19T06:57:55.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.832+0000 7f2dfce00640 1 -- 172.21.15.46:0/385408986 shutdown_connections 2024-02-19T06:57:55.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.832+0000 7f2dfce00640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2dd406b840 0x7f2dd406dd00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.832+0000 7f2dfce00640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df80b00c0 0x7f2df80b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.832+0000 7f2dfce00640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df81f2ec0 0x7f2df80ada00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.832+0000 7f2dfce00640 1 --2- 172.21.15.46:0/385408986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df81f2ae0 0x7f2df80ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.832+0000 7f2dfce00640 1 -- 172.21.15.46:0/385408986 >> 172.21.15.46:0/385408986 conn(0x7f2df806ad60 msgr2=0x7f2df80ac1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.833+0000 7f2dfce00640 1 -- 172.21.15.46:0/385408986 shutdown_connections 2024-02-19T06:57:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:55.833+0000 7f2dfce00640 1 -- 172.21.15.46:0/385408986 wait complete. 2024-02-19T06:57:55.870 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:57:56.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.055+0000 7f9f8c400640 1 Processor -- start 2024-02-19T06:57:56.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.056+0000 7f9f8c400640 1 -- start start 2024-02-19T06:57:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.057+0000 7f9f8c400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f84145260 0x7f9f8415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.057+0000 7f9f8c400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9f8406e500 0x7f9f84071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.057+0000 7f9f8c400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8415ce10 con 0x7f9f84071000 2024-02-19T06:57:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.057+0000 7f9f8c400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f840719c0 con 0x7f9f8406e500 2024-02-19T06:57:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.057+0000 7f9f8c400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840cbde0 con 0x7f9f84145260 2024-02-19T06:57:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.057+0000 7f9f8a400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9f8406e500 0x7f9f84071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.057+0000 7f9f8a400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9f8406e500 0x7f9f84071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37858/0 (socket says 172.21.15.46:37858) 2024-02-19T06:57:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.057+0000 7f9f8a400640 1 -- 172.21.15.46:0/1817309324 learned_addr learned my addr 172.21.15.46:0/1817309324 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.058+0000 7f9f89a00640 1 --2- 172.21.15.46:0/1817309324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f84145260 0x7f9f8415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.058+0000 7f9f8a400640 1 -- 172.21.15.46:0/1817309324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f84145260 msgr2=0x7f9f8415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:56.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.058+0000 7f9f8a400640 1 --2- 172.21.15.46:0/1817309324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f84145260 0x7f9f8415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.058+0000 7f9f8a400640 1 -- 172.21.15.46:0/1817309324 >> v1:172.21.15.142:6789/0 conn(0x7f9f84071000 legacy=0x7f9f8415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.058+0000 7f9f8a400640 1 -- 172.21.15.46:0/1817309324 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f840cc080 con 0x7f9f8406e500 2024-02-19T06:57:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.058+0000 7f9f89a00640 1 --2- 172.21.15.46:0/1817309324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f84145260 0x7f9f8415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.059+0000 7f9f8a400640 1 --2- 172.21.15.46:0/1817309324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f8406e500 0x7f9f84071480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009e50 tx=0x7f9f7c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe924dfe744a151 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.059+0000 7f9f83e00640 1 -- 172.21.15.46:0/1817309324 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c02c9f0 con 0x7f9f8406e500 2024-02-19T06:57:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.059+0000 7f9f83e00640 1 -- 172.21.15.46:0/1817309324 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c02cb50 con 0x7f9f8406e500 2024-02-19T06:57:56.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.059+0000 7f9f83e00640 1 -- 172.21.15.46:0/1817309324 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0343f0 con 0x7f9f8406e500 2024-02-19T06:57:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.060+0000 7f9f8c400640 1 -- 172.21.15.46:0/1817309324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f8406e500 msgr2=0x7f9f84071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.060+0000 7f9f8c400640 1 --2- 172.21.15.46:0/1817309324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f8406e500 0x7f9f84071480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009e50 tx=0x7f9f7c02be50 comp rx=0 tx=0).stop 2024-02-19T06:57:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.060+0000 7f9f8c400640 1 -- 172.21.15.46:0/1817309324 shutdown_connections 2024-02-19T06:57:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.060+0000 7f9f8c400640 1 --2- 172.21.15.46:0/1817309324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f8406e500 0x7f9f84071480 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.060+0000 7f9f8c400640 1 --2- 172.21.15.46:0/1817309324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f84145260 0x7f9f8415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.060+0000 7f9f8c400640 1 -- 172.21.15.46:0/1817309324 >> 172.21.15.46:0/1817309324 conn(0x7f9f84066f70 msgr2=0x7f9f8406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.060+0000 7f9f8c400640 1 -- 172.21.15.46:0/1817309324 shutdown_connections 2024-02-19T06:57:56.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.060+0000 7f9f8c400640 1 -- 172.21.15.46:0/1817309324 wait complete. 2024-02-19T06:57:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.062+0000 7f9f8c400640 1 Processor -- start 2024-02-19T06:57:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.062+0000 7f9f8c400640 1 -- start start 2024-02-19T06:57:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.063+0000 7f9f8c400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f8406e500 0x7f9f840b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.063+0000 7f9f8c400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84071000 0x7f9f8413d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.063+0000 7f9f8c400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f84145260 0x7f9f8413dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.063+0000 7f9f8c400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840aefd0 con 0x7f9f84071000 2024-02-19T06:57:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.063+0000 7f9f8c400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840af220 con 0x7f9f84145260 2024-02-19T06:57:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.063+0000 7f9f8c400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840af500 con 0x7f9f8406e500 2024-02-19T06:57:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.063+0000 7f9f89000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84071000 0x7f9f8413d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.063+0000 7f9f89000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84071000 0x7f9f8413d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37874/0 (socket says 172.21.15.46:37874) 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.063+0000 7f9f89000640 1 -- 172.21.15.46:0/47764482 learned_addr learned my addr 172.21.15.46:0/47764482 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.064+0000 7f9f89a00640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f8406e500 0x7f9f840b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.064+0000 7f9f8a400640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f84145260 0x7f9f8413dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.064+0000 7f9f89000640 1 -- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f8406e500 msgr2=0x7f9f840b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.064+0000 7f9f89000640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f8406e500 0x7f9f840b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.064+0000 7f9f89000640 1 -- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f84145260 msgr2=0x7f9f8413dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.064+0000 7f9f89000640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f84145260 0x7f9f8413dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.064+0000 7f9f89000640 1 -- 172.21.15.46:0/47764482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c009b30 con 0x7f9f84071000 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.064+0000 7f9f89a00640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f8406e500 0x7f9f840b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.064+0000 7f9f8a400640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f84145260 0x7f9f8413dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.064+0000 7f9f89000640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84071000 0x7f9f8413d670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000b3f0 tx=0x7f9f7000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.065+0000 7f9f81600640 1 -- 172.21.15.46:0/47764482 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70011830 con 0x7f9f84071000 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.065+0000 7f9f81600640 1 -- 172.21.15.46:0/47764482 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f70011990 con 0x7f9f84071000 2024-02-19T06:57:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.065+0000 7f9f8c400640 1 -- 172.21.15.46:0/47764482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f840af7e0 con 0x7f9f84071000 2024-02-19T06:57:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.065+0000 7f9f81600640 1 -- 172.21.15.46:0/47764482 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70011d40 con 0x7f9f84071000 2024-02-19T06:57:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.065+0000 7f9f8c400640 1 -- 172.21.15.46:0/47764482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f840afda0 con 0x7f9f84071000 2024-02-19T06:57:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.066+0000 7f9f8c400640 1 -- 172.21.15.46:0/47764482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f840affc0 con 0x7f9f84071000 2024-02-19T06:57:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.067+0000 7f9f81600640 1 -- 172.21.15.46:0/47764482 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9f7001a400 con 0x7f9f84071000 2024-02-19T06:57:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.068+0000 7f9f81600640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9f6406b810 0x7f9f6406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.068+0000 7f9f81600640 1 -- 172.21.15.46:0/47764482 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f7008a0c0 con 0x7f9f84071000 2024-02-19T06:57:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.068+0000 7f9f89a00640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9f6406b810 0x7f9f6406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.070+0000 7f9f89a00640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9f6406b810 0x7f9f6406dcd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9f78006fd0 tx=0x7f9f78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.072+0000 7f9f81600640 1 -- 172.21.15.46:0/47764482 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9f70054a40 con 0x7f9f84071000 2024-02-19T06:57:56.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.263+0000 7f9f8c400640 1 -- 172.21.15.46:0/47764482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f84067ba0 con 0x7f9f84071000 2024-02-19T06:57:56.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.265+0000 7f9f81600640 1 -- 172.21.15.46:0/47764482 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16618 (secure 0 0 0) 0x7f9f70058100 con 0x7f9f84071000 2024-02-19T06:57:56.268 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:57:56.268 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:55.291770+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:57:56.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.267+0000 7f9f8c400640 1 -- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9f6406b810 msgr2=0x7f9f6406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.267+0000 7f9f8c400640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9f6406b810 0x7f9f6406dcd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9f78006fd0 tx=0x7f9f78008040 comp rx=0 tx=0).stop 2024-02-19T06:57:56.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.267+0000 7f9f8c400640 1 -- 172.21.15.46:0/47764482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84071000 msgr2=0x7f9f8413d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.267+0000 7f9f8c400640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84071000 0x7f9f8413d670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000b3f0 tx=0x7f9f7000b8b0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.268+0000 7f9f8c400640 1 -- 172.21.15.46:0/47764482 shutdown_connections 2024-02-19T06:57:56.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.268+0000 7f9f8c400640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9f6406b810 0x7f9f6406dcd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.268+0000 7f9f8c400640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f84145260 0x7f9f8413dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.268+0000 7f9f8c400640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84071000 0x7f9f8413d670 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.268+0000 7f9f8c400640 1 --2- 172.21.15.46:0/47764482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f8406e500 0x7f9f840b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.268+0000 7f9f8c400640 1 -- 172.21.15.46:0/47764482 >> 172.21.15.46:0/47764482 conn(0x7f9f84066f70 msgr2=0x7f9f8415be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.268+0000 7f9f8c400640 1 -- 172.21.15.46:0/47764482 shutdown_connections 2024-02-19T06:57:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.268+0000 7f9f8c400640 1 -- 172.21.15.46:0/47764482 wait complete. 2024-02-19T06:57:56.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:57:56.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.499+0000 7f868e200640 1 Processor -- start 2024-02-19T06:57:56.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.500+0000 7f868e200640 1 -- start start 2024-02-19T06:57:56.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.501+0000 7f868e200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f868815d7f0 0x7f86880d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.501+0000 7f868e200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86880cf770 con 0x7f868815dbd0 2024-02-19T06:57:56.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.501+0000 7f868e200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86880cf4e0 con 0x7f8688162230 2024-02-19T06:57:56.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.501+0000 7f868e200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86880d1400 con 0x7f868815d7f0 2024-02-19T06:57:56.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.501+0000 7f868d800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f868815dbd0 0x7f86880d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53128/0 (socket says 172.21.15.46:53128) 2024-02-19T06:57:56.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.501+0000 7f868d800640 1 -- 172.21.15.46:0/2173710712 learned_addr learned my addr 172.21.15.46:0/2173710712 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:57:56.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.502+0000 7f868ce00640 1 --2- 172.21.15.46:0/2173710712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f868815d7f0 0x7f86880d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.502+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205548092 0 0) 0x7f86880cf770 con 0x7f868815dbd0 2024-02-19T06:57:56.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.502+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f866c003520 con 0x7f868815dbd0 2024-02-19T06:57:56.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.502+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2495271854 0 0) 0x7f866c003520 con 0x7f868815dbd0 2024-02-19T06:57:56.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.502+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f868815d7f0 msgr2=0x7f86880d21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:56.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.502+0000 7f8687400640 1 --2- 172.21.15.46:0/2173710712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f868815d7f0 0x7f86880d21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.502+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 >> v1:172.21.15.142:6789/0 conn(0x7f8688162230 legacy=0x7f86880cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.502+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86880d16e0 con 0x7f868815dbd0 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.502+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f8680001670 con 0x7f868815dbd0 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.502+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 >> v1:172.21.15.46:6789/0 conn(0x7f868815dbd0 legacy=0x7f86880d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f8687400640 1 --2- 172.21.15.46:0/2173710712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f866c0039a0 0x7f866c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f8687400640 1 --2- 172.21.15.46:0/2173710712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f868815d7f0 0x7f866c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f8687400640 1 --2- 172.21.15.46:0/2173710712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f866c004d00 0x7f866c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880d1400 con 0x7f866c0039a0 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c00bb10 con 0x7f866c004d00 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c00bcd0 con 0x7f868815d7f0 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f868ce00640 1 --2- 172.21.15.46:0/2173710712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f866c0039a0 0x7f866c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f868d800640 1 --2- 172.21.15.46:0/2173710712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f866c004d00 0x7f866c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f868ce00640 1 -- 172.21.15.46:0/2173710712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f868815d7f0 msgr2=0x7f866c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f868ce00640 1 --2- 172.21.15.46:0/2173710712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f868815d7f0 0x7f866c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f868ce00640 1 -- 172.21.15.46:0/2173710712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f866c004d00 msgr2=0x7f866c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f868ce00640 1 --2- 172.21.15.46:0/2173710712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f866c004d00 0x7f866c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f868ce00640 1 -- 172.21.15.46:0/2173710712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c003520 con 0x7f866c0039a0 2024-02-19T06:57:56.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.503+0000 7f868d800640 1 --2- 172.21.15.46:0/2173710712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f866c004d00 0x7f866c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:56.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.504+0000 7f868ce00640 1 --2- 172.21.15.46:0/2173710712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f866c0039a0 0x7f866c003dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8678009ac0 tx=0x7f866c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd28cc090e5f2af server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:56.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.505+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867802c710 con 0x7f866c0039a0 2024-02-19T06:57:56.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.505+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867802c870 con 0x7f866c0039a0 2024-02-19T06:57:56.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.505+0000 7f8687400640 1 -- 172.21.15.46:0/2173710712 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867802cc00 con 0x7f866c0039a0 2024-02-19T06:57:56.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.505+0000 7f868e200640 1 -- 172.21.15.46:0/2173710712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f866c0039a0 msgr2=0x7f866c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.505+0000 7f868e200640 1 --2- 172.21.15.46:0/2173710712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f866c0039a0 0x7f866c003dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8678009ac0 tx=0x7f866c0057f0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.505+0000 7f868d800640 1 -- 172.21.15.46:0/2173710712 reap_dead start 2024-02-19T06:57:56.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.505+0000 7f868e200640 1 -- 172.21.15.46:0/2173710712 shutdown_connections 2024-02-19T06:57:56.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.505+0000 7f868e200640 1 -- 172.21.15.46:0/2173710712 >> 172.21.15.46:0/2173710712 conn(0x7f868809ca70 msgr2=0x7f868808afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:56.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.506+0000 7f868e200640 1 -- 172.21.15.46:0/2173710712 shutdown_connections 2024-02-19T06:57:56.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.506+0000 7f868e200640 1 -- 172.21.15.46:0/2173710712 wait complete. 2024-02-19T06:57:56.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.507+0000 7f868e200640 1 Processor -- start 2024-02-19T06:57:56.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.507+0000 7f868e200640 1 -- start start 2024-02-19T06:57:56.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.508+0000 7f868e200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f866c0039a0 0x7f86881579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.508+0000 7f868e200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f868815e1b0 0x7f868815e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.508+0000 7f868e200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86880ccc80 0x7f86880cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.508+0000 7f868e200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880cd640 con 0x7f868815e1b0 2024-02-19T06:57:56.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.508+0000 7f868e200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880b1060 con 0x7f86880ccc80 2024-02-19T06:57:56.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.508+0000 7f868e200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86880b0450 con 0x7f866c0039a0 2024-02-19T06:57:56.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.509+0000 7f8687e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f868815e1b0 0x7f868815e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.509+0000 7f8687e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f868815e1b0 0x7f868815e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37898/0 (socket says 172.21.15.46:37898) 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.509+0000 7f8687e00640 1 -- 172.21.15.46:0/4080100656 learned_addr learned my addr 172.21.15.46:0/4080100656 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.509+0000 7f868ce00640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f866c0039a0 0x7f86881579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.509+0000 7f868d800640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86880ccc80 0x7f86880cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.509+0000 7f8687e00640 1 -- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f866c0039a0 msgr2=0x7f86881579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.509+0000 7f8687e00640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f866c0039a0 0x7f86881579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.509+0000 7f8687e00640 1 -- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86880ccc80 msgr2=0x7f86880cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.509+0000 7f8687e00640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86880ccc80 0x7f86880cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.509+0000 7f8687e00640 1 -- 172.21.15.46:0/4080100656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86880b0730 con 0x7f868815e1b0 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.509+0000 7f8687e00640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f868815e1b0 0x7f868815e630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f867400c840 tx=0x7f867400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.510+0000 7f8684c00640 1 -- 172.21.15.46:0/4080100656 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674003b70 con 0x7f868815e1b0 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.510+0000 7f8684c00640 1 -- 172.21.15.46:0/4080100656 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674003cf0 con 0x7f868815e1b0 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.510+0000 7f8684c00640 1 -- 172.21.15.46:0/4080100656 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867400aa90 con 0x7f868815e1b0 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.510+0000 7f868e200640 1 -- 172.21.15.46:0/4080100656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86880b0a10 con 0x7f868815e1b0 2024-02-19T06:57:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.510+0000 7f868e200640 1 -- 172.21.15.46:0/4080100656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8688157f10 con 0x7f868815e1b0 2024-02-19T06:57:56.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.511+0000 7f868e200640 1 -- 172.21.15.46:0/4080100656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86881580d0 con 0x7f868815e1b0 2024-02-19T06:57:56.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.512+0000 7f8684c00640 1 -- 172.21.15.46:0/4080100656 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f867400abf0 con 0x7f868815e1b0 2024-02-19T06:57:56.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.513+0000 7f8684c00640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f866806b840 0x7f866806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.513+0000 7f8684c00640 1 -- 172.21.15.46:0/4080100656 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f867408a100 con 0x7f868815e1b0 2024-02-19T06:57:56.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.513+0000 7f868ce00640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f866806b840 0x7f866806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.515+0000 7f868ce00640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f866806b840 0x7f866806dd00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8678036000 tx=0x7f8678030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.518+0000 7f8684c00640 1 -- 172.21.15.46:0/4080100656 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8674054b00 con 0x7f868815e1b0 2024-02-19T06:57:56.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.722+0000 7f868e200640 1 -- 172.21.15.46:0/4080100656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f868804eee0 con 0x7f868815e1b0 2024-02-19T06:57:56.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.725+0000 7f8684c00640 1 -- 172.21.15.46:0/4080100656 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16618 (secure 0 0 0) 0x7f8674003e60 con 0x7f868815e1b0 2024-02-19T06:57:56.728 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:57:56.728 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:55.291770+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:57:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.728+0000 7f868e200640 1 -- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f866806b840 msgr2=0x7f866806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.728+0000 7f868e200640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f866806b840 0x7f866806dd00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8678036000 tx=0x7f8678030000 comp rx=0 tx=0).stop 2024-02-19T06:57:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.728+0000 7f868e200640 1 -- 172.21.15.46:0/4080100656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f868815e1b0 msgr2=0x7f868815e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.728+0000 7f868e200640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f868815e1b0 0x7f868815e630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f867400c840 tx=0x7f867400cd00 comp rx=0 tx=0).stop 2024-02-19T06:57:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.728+0000 7f868e200640 1 -- 172.21.15.46:0/4080100656 shutdown_connections 2024-02-19T06:57:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.728+0000 7f868e200640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f866806b840 0x7f866806dd00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.728+0000 7f868e200640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86880ccc80 0x7f86880cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.728+0000 7f868e200640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f868815e1b0 0x7f868815e630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.728+0000 7f868e200640 1 --2- 172.21.15.46:0/4080100656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f866c0039a0 0x7f86881579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.728+0000 7f868e200640 1 -- 172.21.15.46:0/4080100656 >> 172.21.15.46:0/4080100656 conn(0x7f868809ca70 msgr2=0x7f86880d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.729+0000 7f868e200640 1 -- 172.21.15.46:0/4080100656 shutdown_connections 2024-02-19T06:57:56.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.729+0000 7f868e200640 1 -- 172.21.15.46:0/4080100656 wait complete. 2024-02-19T06:57:56.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-19T06:57:56.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.976+0000 7f29d9600640 1 Processor -- start 2024-02-19T06:57:56.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.976+0000 7f29d9600640 1 -- start start 2024-02-19T06:57:56.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.978+0000 7f29d9600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29d40cf3d0 0x7f29d40cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.978+0000 7f29d9600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d406d680 0x7f29d406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.978+0000 7f29d9600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d4071e80 con 0x7f29d4145050 2024-02-19T06:57:56.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.978+0000 7f29d9600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d4071020 con 0x7f29d40cf3d0 2024-02-19T06:57:56.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.978+0000 7f29d9600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d40aef70 con 0x7f29d406d680 2024-02-19T06:57:56.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.978+0000 7f29d2a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f29d4145050 0x7f29d40cc7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53130/0 (socket says 172.21.15.46:53130) 2024-02-19T06:57:56.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.978+0000 7f29d2a00640 1 -- 172.21.15.46:0/2294821857 learned_addr learned my addr 172.21.15.46:0/2294821857 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:57:56.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.978+0000 7f29d3400640 1 --2- 172.21.15.46:0/2294821857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d406d680 0x7f29d406daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.978+0000 7f29cbe00640 1 --2- 172.21.15.46:0/2294821857 >> v2:172.21.15.142:3300/0 conn(0x7f29d40cf3d0 0x7f29d40cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.978+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867020697 0 0) 0x7f29d4071e80 con 0x7f29d4145050 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.978+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b8003520 con 0x7f29d4145050 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1947774228 0 0) 0x7f29b8003520 con 0x7f29d4145050 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d406d680 msgr2=0x7f29d406daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 --2- 172.21.15.46:0/2294821857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d406d680 0x7f29d406daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 >> v2:172.21.15.142:3300/0 conn(0x7f29d40cf3d0 msgr2=0x7f29d40cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 --2- 172.21.15.46:0/2294821857 >> v2:172.21.15.142:3300/0 conn(0x7f29d40cf3d0 0x7f29d40cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40cfd70 con 0x7f29d4145050 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f29c4001690 con 0x7f29d4145050 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 >> v1:172.21.15.46:6789/0 conn(0x7f29d4145050 legacy=0x7f29d40cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 --2- 172.21.15.46:0/2294821857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29b8003970 0x7f29b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 --2- 172.21.15.46:0/2294821857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80047c0 0x7f29b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 --2- 172.21.15.46:0/2294821857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d406d680 0x7f29b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d4071020 con 0x7f29b80047c0 2024-02-19T06:57:56.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d40aef70 con 0x7f29b8003970 2024-02-19T06:57:56.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b800b980 con 0x7f29d406d680 2024-02-19T06:57:56.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.979+0000 7f29cbe00640 1 --2- 172.21.15.46:0/2294821857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80047c0 0x7f29b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.980+0000 7f29d2a00640 1 --2- 172.21.15.46:0/2294821857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29b8003970 0x7f29b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.980+0000 7f29d3400640 1 --2- 172.21.15.46:0/2294821857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d406d680 0x7f29b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.980+0000 7f29cbe00640 1 -- 172.21.15.46:0/2294821857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d406d680 msgr2=0x7f29b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:56.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.980+0000 7f29cbe00640 1 --2- 172.21.15.46:0/2294821857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d406d680 0x7f29b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.980+0000 7f29cbe00640 1 -- 172.21.15.46:0/2294821857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29b8003970 msgr2=0x7f29b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:56.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.980+0000 7f29cbe00640 1 --2- 172.21.15.46:0/2294821857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29b8003970 0x7f29b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.980+0000 7f29cbe00640 1 -- 172.21.15.46:0/2294821857 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b8003520 con 0x7f29b80047c0 2024-02-19T06:57:56.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.980+0000 7f29d2a00640 1 --2- 172.21.15.46:0/2294821857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29b8003970 0x7f29b8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:57:56.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.981+0000 7f29cbe00640 1 --2- 172.21.15.46:0/2294821857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80047c0 0x7f29b8004c40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009ac0 tx=0x7f29b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bcec0a6167fd9f server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:56.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.982+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc02c710 con 0x7f29b80047c0 2024-02-19T06:57:56.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.982+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc02c870 con 0x7f29b80047c0 2024-02-19T06:57:56.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.982+0000 7f29d2000640 1 -- 172.21.15.46:0/2294821857 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc02cc00 con 0x7f29b80047c0 2024-02-19T06:57:56.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.982+0000 7f29d9600640 1 -- 172.21.15.46:0/2294821857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80047c0 msgr2=0x7f29b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.982+0000 7f29d9600640 1 --2- 172.21.15.46:0/2294821857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b80047c0 0x7f29b8004c40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009ac0 tx=0x7f29b80057f0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.982+0000 7f29d3400640 1 -- 172.21.15.46:0/2294821857 reap_dead start 2024-02-19T06:57:56.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.982+0000 7f29d9600640 1 -- 172.21.15.46:0/2294821857 shutdown_connections 2024-02-19T06:57:56.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.982+0000 7f29d9600640 1 -- 172.21.15.46:0/2294821857 >> 172.21.15.46:0/2294821857 conn(0x7f29d4066fc0 msgr2=0x7f29d406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:56.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.982+0000 7f29d9600640 1 -- 172.21.15.46:0/2294821857 shutdown_connections 2024-02-19T06:57:56.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.982+0000 7f29d9600640 1 -- 172.21.15.46:0/2294821857 wait complete. 2024-02-19T06:57:56.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.984+0000 7f29d9600640 1 Processor -- start 2024-02-19T06:57:56.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.984+0000 7f29d9600640 1 -- start start 2024-02-19T06:57:56.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.985+0000 7f29d9600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d415b440 0x7f29d40b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.985+0000 7f29d9600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29d40adfe0 0x7f29d415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.985+0000 7f29d9600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29d415d380 0x7f29d40b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.985+0000 7f29d9600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d415d800 con 0x7f29d415d380 2024-02-19T06:57:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.985+0000 7f29d9600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d40ad450 con 0x7f29d40adfe0 2024-02-19T06:57:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.985+0000 7f29d9600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d40ad730 con 0x7f29d415b440 2024-02-19T06:57:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.986+0000 7f29d3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29d415d380 0x7f29d40b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.986+0000 7f29d3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29d415d380 0x7f29d40b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37926/0 (socket says 172.21.15.46:37926) 2024-02-19T06:57:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.986+0000 7f29d3400640 1 -- 172.21.15.46:0/2946075914 learned_addr learned my addr 172.21.15.46:0/2946075914 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.986+0000 7f29d2a00640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d415b440 0x7f29d40b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.986+0000 7f29cbe00640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29d40adfe0 0x7f29d415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.986+0000 7f29d3400640 1 -- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d415b440 msgr2=0x7f29d40b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.986+0000 7f29d3400640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d415b440 0x7f29d40b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.986+0000 7f29d3400640 1 -- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29d40adfe0 msgr2=0x7f29d415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:56.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.986+0000 7f29d3400640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29d40adfe0 0x7f29d415ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.986+0000 7f29d3400640 1 -- 172.21.15.46:0/2946075914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40ada10 con 0x7f29d415d380 2024-02-19T06:57:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.986+0000 7f29d2a00640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d415b440 0x7f29d40b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:57:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.986+0000 7f29d3400640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29d415d380 0x7f29d40b25d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29d4070e90 tx=0x7f29cc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.987+0000 7f29caa00640 1 -- 172.21.15.46:0/2946075914 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00e070 con 0x7f29d415d380 2024-02-19T06:57:56.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.987+0000 7f29caa00640 1 -- 172.21.15.46:0/2946075914 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc011e10 con 0x7f29d415d380 2024-02-19T06:57:56.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.987+0000 7f29caa00640 1 -- 172.21.15.46:0/2946075914 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc003990 con 0x7f29d415d380 2024-02-19T06:57:56.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.987+0000 7f29d9600640 1 -- 172.21.15.46:0/2946075914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d40c5dc0 con 0x7f29d415d380 2024-02-19T06:57:56.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.987+0000 7f29d9600640 1 -- 172.21.15.46:0/2946075914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d40b4330 con 0x7f29d415d380 2024-02-19T06:57:56.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.988+0000 7f29d9600640 1 -- 172.21.15.46:0/2946075914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d40c5fb0 con 0x7f29d415d380 2024-02-19T06:57:56.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.989+0000 7f29caa00640 1 -- 172.21.15.46:0/2946075914 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f29cc003af0 con 0x7f29d415d380 2024-02-19T06:57:56.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.990+0000 7f29caa00640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f29b006b840 0x7f29b006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:56.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.990+0000 7f29caa00640 1 -- 172.21.15.46:0/2946075914 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29cc08a7a0 con 0x7f29d415d380 2024-02-19T06:57:56.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.991+0000 7f29d2a00640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f29b006b840 0x7f29b006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.992+0000 7f29d2a00640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f29b006b840 0x7f29b006dd00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f29c4001eb0 tx=0x7f29c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:56.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:56.995+0000 7f29caa00640 1 -- 172.21.15.46:0/2946075914 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f29cc0551b0 con 0x7f29d415d380 2024-02-19T06:57:57.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.240+0000 7f29d9600640 1 -- 172.21.15.46:0/2946075914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f29d4067ba0 con 0x7f29d415d380 2024-02-19T06:57:57.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.862+0000 7f29caa00640 1 -- 172.21.15.46:0/2946075914 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f29cc058870 con 0x7f29d415d380 2024-02-19T06:57:57.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.866+0000 7f29d9600640 1 -- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f29b006b840 msgr2=0x7f29b006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:57.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.866+0000 7f29d9600640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f29b006b840 0x7f29b006dd00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f29c4001eb0 tx=0x7f29c4009040 comp rx=0 tx=0).stop 2024-02-19T06:57:57.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.866+0000 7f29d9600640 1 -- 172.21.15.46:0/2946075914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29d415d380 msgr2=0x7f29d40b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:57.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.866+0000 7f29d9600640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29d415d380 0x7f29d40b25d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29d4070e90 tx=0x7f29cc0115a0 comp rx=0 tx=0).stop 2024-02-19T06:57:57.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.866+0000 7f29d9600640 1 -- 172.21.15.46:0/2946075914 shutdown_connections 2024-02-19T06:57:57.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.866+0000 7f29d9600640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f29b006b840 0x7f29b006dd00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:57.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.866+0000 7f29d9600640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29d415d380 0x7f29d40b25d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:57.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.866+0000 7f29d9600640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29d40adfe0 0x7f29d415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:57.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.866+0000 7f29d9600640 1 --2- 172.21.15.46:0/2946075914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29d415b440 0x7f29d40b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:57.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.866+0000 7f29d9600640 1 -- 172.21.15.46:0/2946075914 >> 172.21.15.46:0/2946075914 conn(0x7f29d4066fc0 msgr2=0x7f29d4144380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:57.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.866+0000 7f29d9600640 1 -- 172.21.15.46:0/2946075914 shutdown_connections 2024-02-19T06:57:57.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:57.867+0000 7f29d9600640 1 -- 172.21.15.46:0/2946075914 wait complete. 2024-02-19T06:57:57.893 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-19T06:57:57.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-19T06:57:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.113+0000 7f8c5a400640 1 Processor -- start 2024-02-19T06:57:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.114+0000 7f8c5a400640 1 -- start start 2024-02-19T06:57:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.115+0000 7f8c5a400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c54145050 0x7f8c540cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.115+0000 7f8c5a400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c540ccce0 0x7f8c540cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.115+0000 7f8c5a400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c54071e80 con 0x7f8c540cf910 2024-02-19T06:57:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.115+0000 7f8c5a400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c540cfda0 con 0x7f8c540ccce0 2024-02-19T06:57:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.115+0000 7f8c5a400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c54071020 con 0x7f8c54145050 2024-02-19T06:57:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.116+0000 7f8c52a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c540ccce0 0x7f8c540cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.116+0000 7f8c52a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c540ccce0 0x7f8c540cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37942/0 (socket says 172.21.15.46:37942) 2024-02-19T06:57:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.116+0000 7f8c52a00640 1 -- 172.21.15.46:0/746207968 learned_addr learned my addr 172.21.15.46:0/746207968 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.116+0000 7f8c53400640 1 --2- 172.21.15.46:0/746207968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c54145050 0x7f8c540cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.116+0000 7f8c52a00640 1 -- 172.21.15.46:0/746207968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c54145050 msgr2=0x7f8c540cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.116+0000 7f8c52a00640 1 --2- 172.21.15.46:0/746207968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c54145050 0x7f8c540cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.116+0000 7f8c52a00640 1 -- 172.21.15.46:0/746207968 >> v1:172.21.15.46:6789/0 conn(0x7f8c540cf910 legacy=0x7f8c5415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.116+0000 7f8c52000640 1 -- 172.21.15.46:0/746207968 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256026791 0 0) 0x7f8c54071e80 con 0x7f8c540cf910 2024-02-19T06:57:58.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.116+0000 7f8c52a00640 1 -- 172.21.15.46:0/746207968 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c540aef70 con 0x7f8c540ccce0 2024-02-19T06:57:58.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.117+0000 7f8c52a00640 1 --2- 172.21.15.46:0/746207968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c540ccce0 0x7f8c540cf3d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009870 tx=0x7f8c3c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e12be76c8e6f1a server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:58.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.118+0000 7f8c52000640 1 -- 172.21.15.46:0/746207968 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c030840 con 0x7f8c540ccce0 2024-02-19T06:57:58.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.118+0000 7f8c52000640 1 -- 172.21.15.46:0/746207968 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c0309a0 con 0x7f8c540ccce0 2024-02-19T06:57:58.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.118+0000 7f8c52000640 1 -- 172.21.15.46:0/746207968 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c030d30 con 0x7f8c540ccce0 2024-02-19T06:57:58.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.118+0000 7f8c5a400640 1 -- 172.21.15.46:0/746207968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c540ccce0 msgr2=0x7f8c540cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:58.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.118+0000 7f8c5a400640 1 --2- 172.21.15.46:0/746207968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c540ccce0 0x7f8c540cf3d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009870 tx=0x7f8c3c02b980 comp rx=0 tx=0).stop 2024-02-19T06:57:58.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.118+0000 7f8c5a400640 1 -- 172.21.15.46:0/746207968 shutdown_connections 2024-02-19T06:57:58.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.118+0000 7f8c5a400640 1 --2- 172.21.15.46:0/746207968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c540ccce0 0x7f8c540cf3d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:58.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.118+0000 7f8c5a400640 1 --2- 172.21.15.46:0/746207968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c54145050 0x7f8c540cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:58.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.118+0000 7f8c5a400640 1 -- 172.21.15.46:0/746207968 >> 172.21.15.46:0/746207968 conn(0x7f8c54066fc0 msgr2=0x7f8c5406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:58.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.118+0000 7f8c5a400640 1 -- 172.21.15.46:0/746207968 shutdown_connections 2024-02-19T06:57:58.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.119+0000 7f8c5a400640 1 -- 172.21.15.46:0/746207968 wait complete. 2024-02-19T06:57:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.120+0000 7f8c5a400640 1 Processor -- start 2024-02-19T06:57:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.121+0000 7f8c5a400640 1 -- start start 2024-02-19T06:57:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.121+0000 7f8c5a400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c540ccce0 0x7f8c5415afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.121+0000 7f8c5a400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c540cf910 0x7f8c5413a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c5a400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c54145050 0x7f8c5415de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c5a400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5415cea0 con 0x7f8c540cf910 2024-02-19T06:57:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c5a400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5415d0b0 con 0x7f8c540ccce0 2024-02-19T06:57:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c5a400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5415d390 con 0x7f8c54145050 2024-02-19T06:57:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c52a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c540cf910 0x7f8c5413a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c52a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c540cf910 0x7f8c5413a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37958/0 (socket says 172.21.15.46:37958) 2024-02-19T06:57:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c52a00640 1 -- 172.21.15.46:0/1757339737 learned_addr learned my addr 172.21.15.46:0/1757339737 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:58.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c53400640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c540ccce0 0x7f8c5415afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:58.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c52a00640 1 -- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c54145050 msgr2=0x7f8c5415de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:58.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c53e00640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c54145050 0x7f8c5415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:58.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c52a00640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c54145050 0x7f8c5415de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:58.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c52a00640 1 -- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c540ccce0 msgr2=0x7f8c5415afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:58.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c52a00640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c540ccce0 0x7f8c5415afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c52a00640 1 -- 172.21.15.46:0/1757339737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0094d0 con 0x7f8c540cf910 2024-02-19T06:57:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c53400640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c540ccce0 0x7f8c5415afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.122+0000 7f8c53e00640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c54145050 0x7f8c5415de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:57:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.123+0000 7f8c52a00640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c540cf910 0x7f8c5413a1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c000c00 tx=0x7f8c3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.123+0000 7f8c4b400640 1 -- 172.21.15.46:0/1757339737 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c039c90 con 0x7f8c540cf910 2024-02-19T06:57:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.123+0000 7f8c4b400640 1 -- 172.21.15.46:0/1757339737 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c039df0 con 0x7f8c540cf910 2024-02-19T06:57:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.123+0000 7f8c4b400640 1 -- 172.21.15.46:0/1757339737 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c043640 con 0x7f8c540cf910 2024-02-19T06:57:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.123+0000 7f8c5a400640 1 -- 172.21.15.46:0/1757339737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5415d670 con 0x7f8c540cf910 2024-02-19T06:57:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.123+0000 7f8c5a400640 1 -- 172.21.15.46:0/1757339737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5415b520 con 0x7f8c540cf910 2024-02-19T06:57:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.124+0000 7f8c5a400640 1 -- 172.21.15.46:0/1757339737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c54067ba0 con 0x7f8c540cf910 2024-02-19T06:57:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.125+0000 7f8c4b400640 1 -- 172.21.15.46:0/1757339737 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8c3c0437a0 con 0x7f8c540cf910 2024-02-19T06:57:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.126+0000 7f8c4b400640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8c3006b810 0x7f8c3006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.126+0000 7f8c4b400640 1 -- 172.21.15.46:0/1757339737 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c3c03e070 con 0x7f8c540cf910 2024-02-19T06:57:58.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.127+0000 7f8c53400640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8c3006b810 0x7f8c3006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:58.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.128+0000 7f8c53400640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8c3006b810 0x7f8c3006dcd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8c44006fd0 tx=0x7f8c44008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:58.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.131+0000 7f8c4b400640 1 -- 172.21.15.46:0/1757339737 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c3c077d00 con 0x7f8c540cf910 2024-02-19T06:57:58.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.370+0000 7f8c5a400640 1 -- 172.21.15.46:0/1757339737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8c540d02f0 con 0x7f8c540cf910 2024-02-19T06:57:58.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.880+0000 7f8c4b400640 1 -- 172.21.15.46:0/1757339737 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8c3c07b3c0 con 0x7f8c540cf910 2024-02-19T06:57:58.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.884+0000 7f8c5a400640 1 -- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8c3006b810 msgr2=0x7f8c3006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:58.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.884+0000 7f8c5a400640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8c3006b810 0x7f8c3006dcd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8c44006fd0 tx=0x7f8c44008040 comp rx=0 tx=0).stop 2024-02-19T06:57:58.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.884+0000 7f8c5a400640 1 -- 172.21.15.46:0/1757339737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c540cf910 msgr2=0x7f8c5413a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:58.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.884+0000 7f8c5a400640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c540cf910 0x7f8c5413a1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c000c00 tx=0x7f8c3c004730 comp rx=0 tx=0).stop 2024-02-19T06:57:58.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.884+0000 7f8c5a400640 1 -- 172.21.15.46:0/1757339737 shutdown_connections 2024-02-19T06:57:58.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.884+0000 7f8c5a400640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8c3006b810 0x7f8c3006dcd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:58.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.884+0000 7f8c5a400640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c54145050 0x7f8c5415de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:58.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.884+0000 7f8c5a400640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c540cf910 0x7f8c5413a1a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:58.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.884+0000 7f8c5a400640 1 --2- 172.21.15.46:0/1757339737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c540ccce0 0x7f8c5415afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:58.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.884+0000 7f8c5a400640 1 -- 172.21.15.46:0/1757339737 >> 172.21.15.46:0/1757339737 conn(0x7f8c54066fc0 msgr2=0x7f8c54144260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:58.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.884+0000 7f8c5a400640 1 -- 172.21.15.46:0/1757339737 shutdown_connections 2024-02-19T06:57:58.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:58.884+0000 7f8c5a400640 1 -- 172.21.15.46:0/1757339737 wait complete. 2024-02-19T06:57:58.908 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-19T06:57:58.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T06:57:59.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.132+0000 7f205e600640 1 Processor -- start 2024-02-19T06:57:59.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.132+0000 7f205e600640 1 -- start start 2024-02-19T06:57:59.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.134+0000 7f205e600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f205815f120 0x7f20580b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:59.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.134+0000 7f205e600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f20580b0e50 0x7f205809a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:59.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.134+0000 7f205e600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205809acb0 con 0x7f2058099a30 2024-02-19T06:57:59.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.134+0000 7f205e600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20580b2cb0 con 0x7f20580b0e50 2024-02-19T06:57:59.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.134+0000 7f205e600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20580cccf0 con 0x7f205815f120 2024-02-19T06:57:59.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.134+0000 7f2057e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2058099a30 0x7f20580cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53148/0 (socket says 172.21.15.46:53148) 2024-02-19T06:57:59.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.134+0000 7f2057e00640 1 -- 172.21.15.46:0/2150240120 learned_addr learned my addr 172.21.15.46:0/2150240120 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:57:59.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.134+0000 7f2056a00640 1 --2- 172.21.15.46:0/2150240120 >> v2:172.21.15.142:3300/0 conn(0x7f20580b0e50 0x7f205809a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:59.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.135+0000 7f2057400640 1 --2- 172.21.15.46:0/2150240120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f205815f120 0x7f20580b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:59.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.135+0000 7f2056000640 1 -- 172.21.15.46:0/2150240120 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560591639 0 0) 0x7f205809acb0 con 0x7f2058099a30 2024-02-19T06:57:59.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.135+0000 7f2056000640 1 -- 172.21.15.46:0/2150240120 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f203c003520 con 0x7f2058099a30 2024-02-19T06:57:59.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.135+0000 7f2056000640 1 -- 172.21.15.46:0/2150240120 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2873514626 0 0) 0x7f203c003520 con 0x7f2058099a30 2024-02-19T06:57:59.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.135+0000 7f2056a00640 1 -- 172.21.15.46:0/2150240120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f205815f120 msgr2=0x7f20580b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:59.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.135+0000 7f2056a00640 1 --2- 172.21.15.46:0/2150240120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f205815f120 0x7f20580b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.135+0000 7f2056a00640 1 -- 172.21.15.46:0/2150240120 >> v1:172.21.15.46:6789/0 conn(0x7f2058099a30 legacy=0x7f20580cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:59.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.135+0000 7f2056a00640 1 -- 172.21.15.46:0/2150240120 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20580ccfd0 con 0x7f20580b0e50 2024-02-19T06:57:59.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.137+0000 7f2056a00640 1 --2- 172.21.15.46:0/2150240120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20580b0e50 0x7f205809a770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20440097a0 tx=0x7f204402b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbdf4755900e2d1d server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:59.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.137+0000 7f2056000640 1 -- 172.21.15.46:0/2150240120 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20500019f0 con 0x7f20580b0e50 2024-02-19T06:57:59.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.137+0000 7f2056000640 1 -- 172.21.15.46:0/2150240120 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204402e050 con 0x7f20580b0e50 2024-02-19T06:57:59.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.137+0000 7f2056000640 1 -- 172.21.15.46:0/2150240120 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044030730 con 0x7f20580b0e50 2024-02-19T06:57:59.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.138+0000 7f205e600640 1 -- 172.21.15.46:0/2150240120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20580b0e50 msgr2=0x7f205809a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:59.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.138+0000 7f205e600640 1 --2- 172.21.15.46:0/2150240120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20580b0e50 0x7f205809a770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20440097a0 tx=0x7f204402b790 comp rx=0 tx=0).stop 2024-02-19T06:57:59.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.138+0000 7f205e600640 1 -- 172.21.15.46:0/2150240120 shutdown_connections 2024-02-19T06:57:59.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.138+0000 7f205e600640 1 --2- 172.21.15.46:0/2150240120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20580b0e50 0x7f205809a770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.138+0000 7f205e600640 1 --2- 172.21.15.46:0/2150240120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f205815f120 0x7f20580b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.138+0000 7f205e600640 1 -- 172.21.15.46:0/2150240120 >> 172.21.15.46:0/2150240120 conn(0x7f20580b3150 msgr2=0x7f20580b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:59.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.138+0000 7f205e600640 1 -- 172.21.15.46:0/2150240120 shutdown_connections 2024-02-19T06:57:59.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.138+0000 7f205e600640 1 -- 172.21.15.46:0/2150240120 wait complete. 2024-02-19T06:57:59.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.140+0000 7f205e600640 1 Processor -- start 2024-02-19T06:57:59.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.140+0000 7f205e600640 1 -- start start 2024-02-19T06:57:59.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.141+0000 7f205e600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2058099a30 0x7f2058150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:59.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.141+0000 7f205e600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20580b0e50 0x7f2058159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:59.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.141+0000 7f205e600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f205815f120 0x7f205815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:59.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.141+0000 7f205e600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20580c5190 con 0x7f205815f120 2024-02-19T06:57:59.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.141+0000 7f205e600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20580c7680 con 0x7f2058099a30 2024-02-19T06:57:59.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.141+0000 7f205e600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20580c53e0 con 0x7f20580b0e50 2024-02-19T06:57:59.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.141+0000 7f2057e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f205815f120 0x7f205815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:59.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.142+0000 7f2057e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f205815f120 0x7f205815a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37970/0 (socket says 172.21.15.46:37970) 2024-02-19T06:57:59.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.142+0000 7f2057e00640 1 -- 172.21.15.46:0/195018156 learned_addr learned my addr 172.21.15.46:0/195018156 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:59.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.142+0000 7f2057400640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2058099a30 0x7f2058150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:59.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.142+0000 7f2056a00640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20580b0e50 0x7f2058159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:59.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.142+0000 7f2057e00640 1 -- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20580b0e50 msgr2=0x7f2058159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:59.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.142+0000 7f2057e00640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20580b0e50 0x7f2058159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.142+0000 7f2057e00640 1 -- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2058099a30 msgr2=0x7f2058150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:59.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.142+0000 7f2057e00640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2058099a30 0x7f2058150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.142+0000 7f2057e00640 1 -- 172.21.15.46:0/195018156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2044009400 con 0x7f205815f120 2024-02-19T06:57:59.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.142+0000 7f2057e00640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f205815f120 0x7f205815a040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2050001830 tx=0x7f205000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:59.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.143+0000 7f204f400640 1 -- 172.21.15.46:0/195018156 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2050012400 con 0x7f205815f120 2024-02-19T06:57:59.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.143+0000 7f204f400640 1 -- 172.21.15.46:0/195018156 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2050012560 con 0x7f205815f120 2024-02-19T06:57:59.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.143+0000 7f204f400640 1 -- 172.21.15.46:0/195018156 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2050012910 con 0x7f205815f120 2024-02-19T06:57:59.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.143+0000 7f205e600640 1 -- 172.21.15.46:0/195018156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20580c56c0 con 0x7f205815f120 2024-02-19T06:57:59.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.143+0000 7f205e600640 1 -- 172.21.15.46:0/195018156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2058150fc0 con 0x7f205815f120 2024-02-19T06:57:59.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.144+0000 7f205e600640 1 -- 172.21.15.46:0/195018156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20580c5be0 con 0x7f205815f120 2024-02-19T06:57:59.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.145+0000 7f204f400640 1 -- 172.21.15.46:0/195018156 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2050012a70 con 0x7f205815f120 2024-02-19T06:57:59.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.146+0000 7f204f400640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f203806b810 0x7f203806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:59.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.146+0000 7f204f400640 1 -- 172.21.15.46:0/195018156 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f205008a9a0 con 0x7f205815f120 2024-02-19T06:57:59.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.147+0000 7f2057400640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f203806b810 0x7f203806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:59.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.148+0000 7f2057400640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f203806b810 0x7f203806dcd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2048009aa0 tx=0x7f2048009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:59.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.151+0000 7f204f400640 1 -- 172.21.15.46:0/195018156 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20580c5be0 con 0x7f205815f120 2024-02-19T06:57:59.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.387+0000 7f205e600640 1 -- 172.21.15.46:0/195018156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20580c5be0 con 0x7f205815f120 2024-02-19T06:57:59.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.389+0000 7f204f400640 1 -- 172.21.15.46:0/195018156 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f20580c5be0 con 0x7f205815f120 2024-02-19T06:57:59.391 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:57:59.392 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/380368509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":380368509},{"type":"v1","addr":"172.21.15.46:6834","nonce":380368509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/957808004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":957808004},{"type":"v1","addr":"172.21.15.46:6835","nonce":957808004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1288321773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1288321773},{"type":"v1","addr":"172.21.15.142:6837","nonce":1288321773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:57:55.292605+0000","modified":"2024-02-19T06:57:58.373002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2651895852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2651895852},{"type":"v1","addr":"172.21.15.142:6836","nonce":2651895852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-19T06:57:59.392 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-02-19T06:57:59.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.392+0000 7f205e600640 1 -- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f203806b810 msgr2=0x7f203806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:59.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.392+0000 7f205e600640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f203806b810 0x7f203806dcd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2048009aa0 tx=0x7f2048009190 comp rx=0 tx=0).stop 2024-02-19T06:57:59.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.392+0000 7f205e600640 1 -- 172.21.15.46:0/195018156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f205815f120 msgr2=0x7f205815a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:59.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.392+0000 7f205e600640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f205815f120 0x7f205815a040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2050001830 tx=0x7f205000a430 comp rx=0 tx=0).stop 2024-02-19T06:57:59.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.392+0000 7f205e600640 1 -- 172.21.15.46:0/195018156 shutdown_connections 2024-02-19T06:57:59.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.392+0000 7f205e600640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f203806b810 0x7f203806dcd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.392+0000 7f205e600640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f205815f120 0x7f205815a040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.392+0000 7f205e600640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20580b0e50 0x7f2058159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.392+0000 7f205e600640 1 --2- 172.21.15.46:0/195018156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2058099a30 0x7f2058150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.392+0000 7f205e600640 1 -- 172.21.15.46:0/195018156 >> 172.21.15.46:0/195018156 conn(0x7f20580b3150 msgr2=0x7f205806fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:59.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.392+0000 7f205e600640 1 -- 172.21.15.46:0/195018156 shutdown_connections 2024-02-19T06:57:59.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.392+0000 7f205e600640 1 -- 172.21.15.46:0/195018156 wait complete. 2024-02-19T06:57:59.413 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:57:59.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.633+0000 7f74dfe00640 1 Processor -- start 2024-02-19T06:57:59.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.634+0000 7f74dfe00640 1 -- start start 2024-02-19T06:57:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.635+0000 7f74dfe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e0162230 0x7f74e00cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.635+0000 7f74dfe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74e015dbd0 0x7f74e00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.635+0000 7f74dfe00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e00cf770 con 0x7f74e015d7f0 2024-02-19T06:57:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.635+0000 7f74dfe00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e00d28d0 con 0x7f74e015dbd0 2024-02-19T06:57:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.635+0000 7f74dfe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e00d1400 con 0x7f74e0162230 2024-02-19T06:57:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.635+0000 7f74dea00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f74e015d7f0 0x7f74e00d21c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53158/0 (socket says 172.21.15.46:53158) 2024-02-19T06:57:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.636+0000 7f74dea00640 1 -- 172.21.15.46:0/1071800746 learned_addr learned my addr 172.21.15.46:0/1071800746 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:57:59.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.636+0000 7f74df400640 1 --2- 172.21.15.46:0/1071800746 >> v2:172.21.15.46:3300/0 conn(0x7f74e015dbd0 0x7f74e00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.636+0000 7f74de000640 1 --2- 172.21.15.46:0/1071800746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e0162230 0x7f74e00cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.636+0000 7f74dd600640 1 -- 172.21.15.46:0/1071800746 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696532561 0 0) 0x7f74e00cf770 con 0x7f74e015d7f0 2024-02-19T06:57:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.636+0000 7f74dd600640 1 -- 172.21.15.46:0/1071800746 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74c4003520 con 0x7f74e015d7f0 2024-02-19T06:57:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.636+0000 7f74df400640 1 -- 172.21.15.46:0/1071800746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e0162230 msgr2=0x7f74e00cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:57:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.636+0000 7f74df400640 1 --2- 172.21.15.46:0/1071800746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e0162230 0x7f74e00cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.636+0000 7f74df400640 1 -- 172.21.15.46:0/1071800746 >> v1:172.21.15.46:6789/0 conn(0x7f74e015d7f0 legacy=0x7f74e00d21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.636+0000 7f74df400640 1 -- 172.21.15.46:0/1071800746 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e00d16e0 con 0x7f74e015dbd0 2024-02-19T06:57:59.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.636+0000 7f74de000640 1 --2- 172.21.15.46:0/1071800746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e0162230 0x7f74e00cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:57:59.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.638+0000 7f74df400640 1 --2- 172.21.15.46:0/1071800746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e015dbd0 0x7f74e00d34f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009d90 tx=0x7f74d802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a4b500823f4d3c server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:59.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.638+0000 7f74dd600640 1 -- 172.21.15.46:0/1071800746 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d802cbc0 con 0x7f74e015dbd0 2024-02-19T06:57:59.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.638+0000 7f74dd600640 1 -- 172.21.15.46:0/1071800746 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d802cd20 con 0x7f74e015dbd0 2024-02-19T06:57:59.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.638+0000 7f74dd600640 1 -- 172.21.15.46:0/1071800746 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8034660 con 0x7f74e015dbd0 2024-02-19T06:57:59.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.639+0000 7f74dfe00640 1 -- 172.21.15.46:0/1071800746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e015dbd0 msgr2=0x7f74e00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:59.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.639+0000 7f74dfe00640 1 --2- 172.21.15.46:0/1071800746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e015dbd0 0x7f74e00d34f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009d90 tx=0x7f74d802be10 comp rx=0 tx=0).stop 2024-02-19T06:57:59.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.639+0000 7f74dfe00640 1 -- 172.21.15.46:0/1071800746 shutdown_connections 2024-02-19T06:57:59.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.639+0000 7f74dfe00640 1 --2- 172.21.15.46:0/1071800746 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e015dbd0 0x7f74e00d34f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.639+0000 7f74dfe00640 1 --2- 172.21.15.46:0/1071800746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e0162230 0x7f74e00cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.639+0000 7f74dfe00640 1 -- 172.21.15.46:0/1071800746 >> 172.21.15.46:0/1071800746 conn(0x7f74e009ca70 msgr2=0x7f74e008afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:59.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.639+0000 7f74dfe00640 1 -- 172.21.15.46:0/1071800746 shutdown_connections 2024-02-19T06:57:59.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.639+0000 7f74dfe00640 1 -- 172.21.15.46:0/1071800746 wait complete. 2024-02-19T06:57:59.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.641+0000 7f74dfe00640 1 Processor -- start 2024-02-19T06:57:59.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.641+0000 7f74dfe00640 1 -- start start 2024-02-19T06:57:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.642+0000 7f74dfe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74e015d7f0 0x7f74e014f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.642+0000 7f74dfe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e015dbd0 0x7f74e00b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.642+0000 7f74dfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e0162230 0x7f74e00b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.642+0000 7f74dfe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e015edd0 con 0x7f74e0162230 2024-02-19T06:57:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.642+0000 7f74dfe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e015f1f0 con 0x7f74e015d7f0 2024-02-19T06:57:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.642+0000 7f74dfe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e014fa20 con 0x7f74e015dbd0 2024-02-19T06:57:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.642+0000 7f74df400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e0162230 0x7f74e00b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.642+0000 7f74df400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e0162230 0x7f74e00b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37990/0 (socket says 172.21.15.46:37990) 2024-02-19T06:57:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.642+0000 7f74df400640 1 -- 172.21.15.46:0/2549788484 learned_addr learned my addr 172.21.15.46:0/2549788484 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:57:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.642+0000 7f74dea00640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74e015d7f0 0x7f74e014f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.643+0000 7f74de000640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e015dbd0 0x7f74e00b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.643+0000 7f74df400640 1 -- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e015dbd0 msgr2=0x7f74e00b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:59.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.643+0000 7f74df400640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e015dbd0 0x7f74e00b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.643+0000 7f74df400640 1 -- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74e015d7f0 msgr2=0x7f74e014f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:59.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.643+0000 7f74df400640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74e015d7f0 0x7f74e014f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.643+0000 7f74df400640 1 -- 172.21.15.46:0/2549788484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d8009a70 con 0x7f74e0162230 2024-02-19T06:57:59.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.643+0000 7f74df400640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e0162230 0x7f74e00b29e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009d90 tx=0x7f74d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:59.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.643+0000 7f74d6a00640 1 -- 172.21.15.46:0/2549788484 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8040650 con 0x7f74e0162230 2024-02-19T06:57:59.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.643+0000 7f74d6a00640 1 -- 172.21.15.46:0/2549788484 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d802ce90 con 0x7f74e0162230 2024-02-19T06:57:59.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.643+0000 7f74d6a00640 1 -- 172.21.15.46:0/2549788484 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80409f0 con 0x7f74e0162230 2024-02-19T06:57:59.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.643+0000 7f74dfe00640 1 -- 172.21.15.46:0/2549788484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e015e150 con 0x7f74e0162230 2024-02-19T06:57:59.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.644+0000 7f74dfe00640 1 -- 172.21.15.46:0/2549788484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e015e710 con 0x7f74e0162230 2024-02-19T06:57:59.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.645+0000 7f74dfe00640 1 -- 172.21.15.46:0/2549788484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e015ef10 con 0x7f74e0162230 2024-02-19T06:57:59.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.646+0000 7f74d6a00640 1 -- 172.21.15.46:0/2549788484 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f74d8040b50 con 0x7f74e0162230 2024-02-19T06:57:59.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.647+0000 7f74d6a00640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f74bc06b840 0x7f74bc06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:57:59.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.647+0000 7f74d6a00640 1 -- 172.21.15.46:0/2549788484 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74d80acd70 con 0x7f74e0162230 2024-02-19T06:57:59.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.648+0000 7f74dea00640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f74bc06b840 0x7f74bc06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:57:59.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.649+0000 7f74dea00640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f74bc06b840 0x7f74bc06dd00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74d0005880 tx=0x7f74d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:57:59.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.652+0000 7f74d6a00640 1 -- 172.21.15.46:0/2549788484 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f74d8077780 con 0x7f74e0162230 2024-02-19T06:57:59.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.849+0000 7f74dfe00640 1 -- 172.21.15.46:0/2549788484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74e004eee0 con 0x7f74e0162230 2024-02-19T06:57:59.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.852+0000 7f74d6a00640 1 -- 172.21.15.46:0/2549788484 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f74d8009450 con 0x7f74e0162230 2024-02-19T06:57:59.855 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:57:59.855 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:56.828629+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:57:59.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.855+0000 7f74dfe00640 1 -- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f74bc06b840 msgr2=0x7f74bc06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:59.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.855+0000 7f74dfe00640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f74bc06b840 0x7f74bc06dd00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74d0005880 tx=0x7f74d0009040 comp rx=0 tx=0).stop 2024-02-19T06:57:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.855+0000 7f74dfe00640 1 -- 172.21.15.46:0/2549788484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e0162230 msgr2=0x7f74e00b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:57:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.855+0000 7f74dfe00640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e0162230 0x7f74e00b29e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009d90 tx=0x7f74d8004a40 comp rx=0 tx=0).stop 2024-02-19T06:57:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.855+0000 7f74dfe00640 1 -- 172.21.15.46:0/2549788484 shutdown_connections 2024-02-19T06:57:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.855+0000 7f74dfe00640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f74bc06b840 0x7f74bc06dd00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.855+0000 7f74dfe00640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e0162230 0x7f74e00b29e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.855+0000 7f74dfe00640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e015dbd0 0x7f74e00b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.855+0000 7f74dfe00640 1 --2- 172.21.15.46:0/2549788484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74e015d7f0 0x7f74e014f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:57:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.855+0000 7f74dfe00640 1 -- 172.21.15.46:0/2549788484 >> 172.21.15.46:0/2549788484 conn(0x7f74e009ca70 msgr2=0x7f74e006d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:57:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.855+0000 7f74dfe00640 1 -- 172.21.15.46:0/2549788484 shutdown_connections 2024-02-19T06:57:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:57:59.855+0000 7f74dfe00640 1 -- 172.21.15.46:0/2549788484 wait complete. 2024-02-19T06:57:59.877 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-19T06:57:59.877 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-19T06:58:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.098+0000 7f84cd800640 1 Processor -- start 2024-02-19T06:58:00.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.098+0000 7f84cd800640 1 -- start start 2024-02-19T06:58:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.099+0000 7f84cd800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f84c815b540 0x7f84c80cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.100+0000 7f84cd800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84c80cb150 0x7f84c80cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.100+0000 7f84cd800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c80cb5f0 con 0x7f84c815fd50 2024-02-19T06:58:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.100+0000 7f84cd800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c815f270 con 0x7f84c815b540 2024-02-19T06:58:00.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.100+0000 7f84cd800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c815f550 con 0x7f84c80cb150 2024-02-19T06:58:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.100+0000 7f84c7e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f84c815b540 0x7f84c80cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.100+0000 7f84cce00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f84c815fd50 0x7f84c80c99a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53170/0 (socket says 172.21.15.46:53170) 2024-02-19T06:58:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.100+0000 7f84cce00640 1 -- 172.21.15.46:0/35723783 learned_addr learned my addr 172.21.15.46:0/35723783 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.100+0000 7f84c7400640 1 --2- 172.21.15.46:0/35723783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84c80cb150 0x7f84c80cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.100+0000 7f84c7e00640 1 -- 172.21.15.46:0/35723783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84c80cb150 msgr2=0x7f84c80cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.100+0000 7f84c7e00640 1 --2- 172.21.15.46:0/35723783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84c80cb150 0x7f84c80cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.100+0000 7f84c7e00640 1 -- 172.21.15.46:0/35723783 >> v1:172.21.15.46:6789/0 conn(0x7f84c815fd50 legacy=0x7f84c80c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.100+0000 7f84c7e00640 1 -- 172.21.15.46:0/35723783 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c815f830 con 0x7f84c815b540 2024-02-19T06:58:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.100+0000 7f84c6a00640 1 -- 172.21.15.46:0/35723783 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251725396 0 0) 0x7f84c80cb5f0 con 0x7f84c815fd50 2024-02-19T06:58:00.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.101+0000 7f84c7400640 1 --2- 172.21.15.46:0/35723783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84c80cb150 0x7f84c80cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:00.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.102+0000 7f84c7e00640 1 --2- 172.21.15.46:0/35723783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84c815b540 0x7f84c80cac10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f84b80097a0 tx=0x7f84b802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acaeb9ef53ac5af server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:00.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.102+0000 7f84c6a00640 1 -- 172.21.15.46:0/35723783 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b802d040 con 0x7f84c815b540 2024-02-19T06:58:00.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.102+0000 7f84c6a00640 1 -- 172.21.15.46:0/35723783 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b8031810 con 0x7f84c815b540 2024-02-19T06:58:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.102+0000 7f84c6a00640 1 -- 172.21.15.46:0/35723783 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8031ba0 con 0x7f84c815b540 2024-02-19T06:58:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.102+0000 7f84cd800640 1 -- 172.21.15.46:0/35723783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84c815b540 msgr2=0x7f84c80cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.102+0000 7f84cd800640 1 --2- 172.21.15.46:0/35723783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84c815b540 0x7f84c80cac10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f84b80097a0 tx=0x7f84b802b8b0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.103+0000 7f84cd800640 1 -- 172.21.15.46:0/35723783 shutdown_connections 2024-02-19T06:58:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.103+0000 7f84cd800640 1 --2- 172.21.15.46:0/35723783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84c80cb150 0x7f84c80cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.103+0000 7f84cd800640 1 --2- 172.21.15.46:0/35723783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84c815b540 0x7f84c80cac10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.103+0000 7f84cd800640 1 -- 172.21.15.46:0/35723783 >> 172.21.15.46:0/35723783 conn(0x7f84c806afa0 msgr2=0x7f84c806b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.103+0000 7f84cd800640 1 -- 172.21.15.46:0/35723783 shutdown_connections 2024-02-19T06:58:00.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.103+0000 7f84cd800640 1 -- 172.21.15.46:0/35723783 wait complete. 2024-02-19T06:58:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.104+0000 7f84cd800640 1 Processor -- start 2024-02-19T06:58:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.105+0000 7f84cd800640 1 -- start start 2024-02-19T06:58:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.105+0000 7f84cd800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84c80cb150 0x7f84c81ee890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84cd800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84c815b540 0x7f84c80c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84cd800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84c815fd50 0x7f84c80c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84cd800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80c4530 con 0x7f84c815fd50 2024-02-19T06:58:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84cd800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80c3920 con 0x7f84c80cb150 2024-02-19T06:58:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84cd800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80c3c00 con 0x7f84c815b540 2024-02-19T06:58:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84cce00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84c815fd50 0x7f84c80c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84cce00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84c815fd50 0x7f84c80c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38004/0 (socket says 172.21.15.46:38004) 2024-02-19T06:58:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84cce00640 1 -- 172.21.15.46:0/3834791273 learned_addr learned my addr 172.21.15.46:0/3834791273 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84c7e00640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84c80cb150 0x7f84c81ee890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84c7400640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84c815b540 0x7f84c80c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:00.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84cce00640 1 -- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84c815b540 msgr2=0x7f84c80c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:00.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84cce00640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84c815b540 0x7f84c80c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84cce00640 1 -- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84c80cb150 msgr2=0x7f84c81ee890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:00.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84cce00640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84c80cb150 0x7f84c81ee890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.106+0000 7f84cce00640 1 -- 172.21.15.46:0/3834791273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b8009400 con 0x7f84c815fd50 2024-02-19T06:58:00.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.107+0000 7f84cce00640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84c815fd50 0x7f84c80c32f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f84c000c700 tx=0x7f84c000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:00.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.107+0000 7f84bfe00640 1 -- 172.21.15.46:0/3834791273 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c000ce10 con 0x7f84c815fd50 2024-02-19T06:58:00.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.107+0000 7f84bfe00640 1 -- 172.21.15.46:0/3834791273 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c000a640 con 0x7f84c815fd50 2024-02-19T06:58:00.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.107+0000 7f84bfe00640 1 -- 172.21.15.46:0/3834791273 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c000aa30 con 0x7f84c815fd50 2024-02-19T06:58:00.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.107+0000 7f84cd800640 1 -- 172.21.15.46:0/3834791273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c80c3ee0 con 0x7f84c815fd50 2024-02-19T06:58:00.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.107+0000 7f84cd800640 1 -- 172.21.15.46:0/3834791273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c81f15d0 con 0x7f84c815fd50 2024-02-19T06:58:00.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.108+0000 7f84cd800640 1 -- 172.21.15.46:0/3834791273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c804eee0 con 0x7f84c815fd50 2024-02-19T06:58:00.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.109+0000 7f84bfe00640 1 -- 172.21.15.46:0/3834791273 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f84c000ab90 con 0x7f84c815fd50 2024-02-19T06:58:00.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.110+0000 7f84bfe00640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f84a806b810 0x7f84a806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:00.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.110+0000 7f84bfe00640 1 -- 172.21.15.46:0/3834791273 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84c00898f0 con 0x7f84c815fd50 2024-02-19T06:58:00.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.111+0000 7f84c7e00640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f84a806b810 0x7f84a806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:00.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.112+0000 7f84c7e00640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f84a806b810 0x7f84a806dcd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84b8036000 tx=0x7f84b803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:00.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.115+0000 7f84bfe00640 1 -- 172.21.15.46:0/3834791273 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f84c00543b0 con 0x7f84c815fd50 2024-02-19T06:58:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.314+0000 7f84cd800640 1 -- 172.21.15.46:0/3834791273 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84c80b25b0 con 0x7f84a806b810 2024-02-19T06:58:00.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.339+0000 7f84bfe00640 1 -- 172.21.15.46:0/3834791273 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264499 (secure 0 0 0) 0x7f84c80b25b0 con 0x7f84a806b810 2024-02-19T06:58:00.349 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-02-19T06:58:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.347+0000 7f84cd800640 1 -- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f84a806b810 msgr2=0x7f84a806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.347+0000 7f84cd800640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f84a806b810 0x7f84a806dcd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84b8036000 tx=0x7f84b803c040 comp rx=0 tx=0).stop 2024-02-19T06:58:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.347+0000 7f84cd800640 1 -- 172.21.15.46:0/3834791273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84c815fd50 msgr2=0x7f84c80c32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:00.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.347+0000 7f84cd800640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84c815fd50 0x7f84c80c32f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f84c000c700 tx=0x7f84c000cbc0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.347+0000 7f84cd800640 1 -- 172.21.15.46:0/3834791273 shutdown_connections 2024-02-19T06:58:00.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.347+0000 7f84cd800640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f84a806b810 0x7f84a806dcd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.347+0000 7f84cd800640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84c815fd50 0x7f84c80c32f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.347+0000 7f84cd800640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84c815b540 0x7f84c80c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.347+0000 7f84cd800640 1 --2- 172.21.15.46:0/3834791273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84c80cb150 0x7f84c81ee890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.347+0000 7f84cd800640 1 -- 172.21.15.46:0/3834791273 >> 172.21.15.46:0/3834791273 conn(0x7f84c806afa0 msgr2=0x7f84c80ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:00.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.347+0000 7f84cd800640 1 -- 172.21.15.46:0/3834791273 shutdown_connections 2024-02-19T06:58:00.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.347+0000 7f84cd800640 1 -- 172.21.15.46:0/3834791273 wait complete. 2024-02-19T06:58:00.369 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-02-19T06:57:59.668786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235764,"kb_used_data":2940,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738956,"statfs":{"total":773094113280,"available":772852690944,"internally_reserved":0,"allocated":3010560,"data_stored":1804264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.868542"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843569+0000","last_change":"2024-02-19T06:57:55.881582+0000","last_active":"2024-02-19T06:57:56.843569+0000","last_peered":"2024-02-19T06:57:56.843569+0000","last_clean":"2024-02-19T06:57:56.843569+0000","last_became_active":"2024-02-19T06:57:55.880789+0000","last_became_peered":"2024-02-19T06:57:55.880789+0000","last_unstale":"2024-02-19T06:57:56.843569+0000","last_undegraded":"2024-02-19T06:57:56.843569+0000","last_fullsized":"2024-02-19T06:57:56.843569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:24:57.181299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838514+0000","last_change":"2024-02-19T06:57:55.875781+0000","last_active":"2024-02-19T06:57:56.838514+0000","last_peered":"2024-02-19T06:57:56.838514+0000","last_clean":"2024-02-19T06:57:56.838514+0000","last_became_active":"2024-02-19T06:57:55.875457+0000","last_became_peered":"2024-02-19T06:57:55.875457+0000","last_unstale":"2024-02-19T06:57:56.838514+0000","last_undegraded":"2024-02-19T06:57:56.838514+0000","last_fullsized":"2024-02-19T06:57:56.838514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296432+0000","last_change":"2024-02-19T06:57:55.879795+0000","last_active":"2024-02-19T06:57:57.296432+0000","last_peered":"2024-02-19T06:57:57.296432+0000","last_clean":"2024-02-19T06:57:57.296432+0000","last_became_active":"2024-02-19T06:57:55.879476+0000","last_became_peered":"2024-02-19T06:57:55.879476+0000","last_unstale":"2024-02-19T06:57:57.296432+0000","last_undegraded":"2024-02-19T06:57:57.296432+0000","last_fullsized":"2024-02-19T06:57:57.296432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:26:02.934116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297501+0000","last_change":"2024-02-19T06:57:55.863246+0000","last_active":"2024-02-19T06:57:57.297501+0000","last_peered":"2024-02-19T06:57:57.297501+0000","last_clean":"2024-02-19T06:57:57.297501+0000","last_became_active":"2024-02-19T06:57:55.862759+0000","last_became_peered":"2024-02-19T06:57:55.862759+0000","last_unstale":"2024-02-19T06:57:57.297501+0000","last_undegraded":"2024-02-19T06:57:57.297501+0000","last_fullsized":"2024-02-19T06:57:57.297501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:02:01.947104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841155+0000","last_change":"2024-02-19T06:57:55.857896+0000","last_active":"2024-02-19T06:57:56.841155+0000","last_peered":"2024-02-19T06:57:56.841155+0000","last_clean":"2024-02-19T06:57:56.841155+0000","last_became_active":"2024-02-19T06:57:55.857608+0000","last_became_peered":"2024-02-19T06:57:55.857608+0000","last_unstale":"2024-02-19T06:57:56.841155+0000","last_undegraded":"2024-02-19T06:57:56.841155+0000","last_fullsized":"2024-02-19T06:57:56.841155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:24:14.106586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296899+0000","last_change":"2024-02-19T06:57:55.867450+0000","last_active":"2024-02-19T06:57:57.296899+0000","last_peered":"2024-02-19T06:57:57.296899+0000","last_clean":"2024-02-19T06:57:57.296899+0000","last_became_active":"2024-02-19T06:57:55.867181+0000","last_became_peered":"2024-02-19T06:57:55.867181+0000","last_unstale":"2024-02-19T06:57:57.296899+0000","last_undegraded":"2024-02-19T06:57:57.296899+0000","last_fullsized":"2024-02-19T06:57:57.296899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.840561+0000","last_change":"2024-02-19T06:57:55.870845+0000","last_active":"2024-02-19T06:57:56.840561+0000","last_peered":"2024-02-19T06:57:56.840561+0000","last_clean":"2024-02-19T06:57:56.840561+0000","last_became_active":"2024-02-19T06:57:55.870532+0000","last_became_peered":"2024-02-19T06:57:55.870532+0000","last_unstale":"2024-02-19T06:57:56.840561+0000","last_undegraded":"2024-02-19T06:57:56.840561+0000","last_fullsized":"2024-02-19T06:57:56.840561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:32:16.779230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297147+0000","last_change":"2024-02-19T06:57:55.869272+0000","last_active":"2024-02-19T06:57:57.297147+0000","last_peered":"2024-02-19T06:57:57.297147+0000","last_clean":"2024-02-19T06:57:57.297147+0000","last_became_active":"2024-02-19T06:57:55.867903+0000","last_became_peered":"2024-02-19T06:57:55.867903+0000","last_unstale":"2024-02-19T06:57:57.297147+0000","last_undegraded":"2024-02-19T06:57:57.297147+0000","last_fullsized":"2024-02-19T06:57:57.297147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:33:37.227028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843541+0000","last_change":"2024-02-19T06:57:55.869047+0000","last_active":"2024-02-19T06:57:56.843541+0000","last_peered":"2024-02-19T06:57:56.843541+0000","last_clean":"2024-02-19T06:57:56.843541+0000","last_became_active":"2024-02-19T06:57:55.868781+0000","last_became_peered":"2024-02-19T06:57:55.868781+0000","last_unstale":"2024-02-19T06:57:56.843541+0000","last_undegraded":"2024-02-19T06:57:56.843541+0000","last_fullsized":"2024-02-19T06:57:56.843541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:47:51.163933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299489+0000","last_change":"2024-02-19T06:57:55.878539+0000","last_active":"2024-02-19T06:57:57.299489+0000","last_peered":"2024-02-19T06:57:57.299489+0000","last_clean":"2024-02-19T06:57:57.299489+0000","last_became_active":"2024-02-19T06:57:55.877859+0000","last_became_peered":"2024-02-19T06:57:55.877859+0000","last_unstale":"2024-02-19T06:57:57.299489+0000","last_undegraded":"2024-02-19T06:57:57.299489+0000","last_fullsized":"2024-02-19T06:57:57.299489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299028+0000","last_change":"2024-02-19T06:57:55.876129+0000","last_active":"2024-02-19T06:57:57.299028+0000","last_peered":"2024-02-19T06:57:57.299028+0000","last_clean":"2024-02-19T06:57:57.299028+0000","last_became_active":"2024-02-19T06:57:55.875481+0000","last_became_peered":"2024-02-19T06:57:55.875481+0000","last_unstale":"2024-02-19T06:57:57.299028+0000","last_undegraded":"2024-02-19T06:57:57.299028+0000","last_fullsized":"2024-02-19T06:57:57.299028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842411+0000","last_change":"2024-02-19T06:57:55.879728+0000","last_active":"2024-02-19T06:57:56.842411+0000","last_peered":"2024-02-19T06:57:56.842411+0000","last_clean":"2024-02-19T06:57:56.842411+0000","last_became_active":"2024-02-19T06:57:55.878922+0000","last_became_peered":"2024-02-19T06:57:55.878922+0000","last_unstale":"2024-02-19T06:57:56.842411+0000","last_undegraded":"2024-02-19T06:57:56.842411+0000","last_fullsized":"2024-02-19T06:57:56.842411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:42:35.923860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298289+0000","last_change":"2024-02-19T06:57:55.863333+0000","last_active":"2024-02-19T06:57:57.298289+0000","last_peered":"2024-02-19T06:57:57.298289+0000","last_clean":"2024-02-19T06:57:57.298289+0000","last_became_active":"2024-02-19T06:57:55.863137+0000","last_became_peered":"2024-02-19T06:57:55.863137+0000","last_unstale":"2024-02-19T06:57:57.298289+0000","last_undegraded":"2024-02-19T06:57:57.298289+0000","last_fullsized":"2024-02-19T06:57:57.298289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:16:45.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296260+0000","last_change":"2024-02-19T06:57:55.870376+0000","last_active":"2024-02-19T06:57:57.296260+0000","last_peered":"2024-02-19T06:57:57.296260+0000","last_clean":"2024-02-19T06:57:57.296260+0000","last_became_active":"2024-02-19T06:57:55.865453+0000","last_became_peered":"2024-02-19T06:57:55.865453+0000","last_unstale":"2024-02-19T06:57:57.296260+0000","last_undegraded":"2024-02-19T06:57:57.296260+0000","last_fullsized":"2024-02-19T06:57:57.296260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:10:54.622454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838056+0000","last_change":"2024-02-19T06:57:55.866944+0000","last_active":"2024-02-19T06:57:56.838056+0000","last_peered":"2024-02-19T06:57:56.838056+0000","last_clean":"2024-02-19T06:57:56.838056+0000","last_became_active":"2024-02-19T06:57:55.866168+0000","last_became_peered":"2024-02-19T06:57:55.866168+0000","last_unstale":"2024-02-19T06:57:56.838056+0000","last_undegraded":"2024-02-19T06:57:56.838056+0000","last_fullsized":"2024-02-19T06:57:56.838056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:33:37.227028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296615+0000","last_change":"2024-02-19T06:57:55.866999+0000","last_active":"2024-02-19T06:57:57.296615+0000","last_peered":"2024-02-19T06:57:57.296615+0000","last_clean":"2024-02-19T06:57:57.296615+0000","last_became_active":"2024-02-19T06:57:55.866721+0000","last_became_peered":"2024-02-19T06:57:55.866721+0000","last_unstale":"2024-02-19T06:57:57.296615+0000","last_undegraded":"2024-02-19T06:57:57.296615+0000","last_fullsized":"2024-02-19T06:57:57.296615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299188+0000","last_change":"2024-02-19T06:57:55.855201+0000","last_active":"2024-02-19T06:57:57.299188+0000","last_peered":"2024-02-19T06:57:57.299188+0000","last_clean":"2024-02-19T06:57:57.299188+0000","last_became_active":"2024-02-19T06:57:55.854955+0000","last_became_peered":"2024-02-19T06:57:55.854955+0000","last_unstale":"2024-02-19T06:57:57.299188+0000","last_undegraded":"2024-02-19T06:57:57.299188+0000","last_fullsized":"2024-02-19T06:57:57.299188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:44:06.998192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298443+0000","last_change":"2024-02-19T06:57:55.876606+0000","last_active":"2024-02-19T06:57:57.298443+0000","last_peered":"2024-02-19T06:57:57.298443+0000","last_clean":"2024-02-19T06:57:57.298443+0000","last_became_active":"2024-02-19T06:57:55.876334+0000","last_became_peered":"2024-02-19T06:57:55.876334+0000","last_unstale":"2024-02-19T06:57:57.298443+0000","last_undegraded":"2024-02-19T06:57:57.298443+0000","last_fullsized":"2024-02-19T06:57:57.298443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:34:02.546590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843210+0000","last_change":"2024-02-19T06:57:55.861233+0000","last_active":"2024-02-19T06:57:56.843210+0000","last_peered":"2024-02-19T06:57:56.843210+0000","last_clean":"2024-02-19T06:57:56.843210+0000","last_became_active":"2024-02-19T06:57:55.860849+0000","last_became_peered":"2024-02-19T06:57:55.860849+0000","last_unstale":"2024-02-19T06:57:56.843210+0000","last_undegraded":"2024-02-19T06:57:56.843210+0000","last_fullsized":"2024-02-19T06:57:56.843210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:58:02.081784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298883+0000","last_change":"2024-02-19T06:57:55.879542+0000","last_active":"2024-02-19T06:57:57.298883+0000","last_peered":"2024-02-19T06:57:57.298883+0000","last_clean":"2024-02-19T06:57:57.298883+0000","last_became_active":"2024-02-19T06:57:55.876325+0000","last_became_peered":"2024-02-19T06:57:55.876325+0000","last_unstale":"2024-02-19T06:57:57.298883+0000","last_undegraded":"2024-02-19T06:57:57.298883+0000","last_fullsized":"2024-02-19T06:57:57.298883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:19:13.712235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296072+0000","last_change":"2024-02-19T06:57:55.882287+0000","last_active":"2024-02-19T06:57:57.296072+0000","last_peered":"2024-02-19T06:57:57.296072+0000","last_clean":"2024-02-19T06:57:57.296072+0000","last_became_active":"2024-02-19T06:57:55.881847+0000","last_became_peered":"2024-02-19T06:57:55.881847+0000","last_unstale":"2024-02-19T06:57:57.296072+0000","last_undegraded":"2024-02-19T06:57:57.296072+0000","last_fullsized":"2024-02-19T06:57:57.296072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:26:43.190851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297087+0000","last_change":"2024-02-19T06:57:55.855047+0000","last_active":"2024-02-19T06:57:57.297087+0000","last_peered":"2024-02-19T06:57:57.297087+0000","last_clean":"2024-02-19T06:57:57.297087+0000","last_became_active":"2024-02-19T06:57:55.854699+0000","last_became_peered":"2024-02-19T06:57:55.854699+0000","last_unstale":"2024-02-19T06:57:57.297087+0000","last_undegraded":"2024-02-19T06:57:57.297087+0000","last_fullsized":"2024-02-19T06:57:57.297087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:16:45.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297920+0000","last_change":"2024-02-19T06:57:55.869732+0000","last_active":"2024-02-19T06:57:57.297920+0000","last_peered":"2024-02-19T06:57:57.297920+0000","last_clean":"2024-02-19T06:57:57.297920+0000","last_became_active":"2024-02-19T06:57:55.869159+0000","last_became_peered":"2024-02-19T06:57:55.869159+0000","last_unstale":"2024-02-19T06:57:57.297920+0000","last_undegraded":"2024-02-19T06:57:57.297920+0000","last_fullsized":"2024-02-19T06:57:57.297920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296891+0000","last_change":"2024-02-19T06:57:55.863170+0000","last_active":"2024-02-19T06:57:57.296891+0000","last_peered":"2024-02-19T06:57:57.296891+0000","last_clean":"2024-02-19T06:57:57.296891+0000","last_became_active":"2024-02-19T06:57:55.862285+0000","last_became_peered":"2024-02-19T06:57:55.862285+0000","last_unstale":"2024-02-19T06:57:57.296891+0000","last_undegraded":"2024-02-19T06:57:57.296891+0000","last_fullsized":"2024-02-19T06:57:57.296891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299100+0000","last_change":"2024-02-19T06:57:55.869627+0000","last_active":"2024-02-19T06:57:57.299100+0000","last_peered":"2024-02-19T06:57:57.299100+0000","last_clean":"2024-02-19T06:57:57.299100+0000","last_became_active":"2024-02-19T06:57:55.869305+0000","last_became_peered":"2024-02-19T06:57:55.869305+0000","last_unstale":"2024-02-19T06:57:57.299100+0000","last_undegraded":"2024-02-19T06:57:57.299100+0000","last_fullsized":"2024-02-19T06:57:57.299100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:02:01.947104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299832+0000","last_change":"2024-02-19T06:57:55.872539+0000","last_active":"2024-02-19T06:57:57.299832+0000","last_peered":"2024-02-19T06:57:57.299832+0000","last_clean":"2024-02-19T06:57:57.299832+0000","last_became_active":"2024-02-19T06:57:55.871775+0000","last_became_peered":"2024-02-19T06:57:55.871775+0000","last_unstale":"2024-02-19T06:57:57.299832+0000","last_undegraded":"2024-02-19T06:57:57.299832+0000","last_fullsized":"2024-02-19T06:57:57.299832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838731+0000","last_change":"2024-02-19T06:57:55.864536+0000","last_active":"2024-02-19T06:57:56.838731+0000","last_peered":"2024-02-19T06:57:56.838731+0000","last_clean":"2024-02-19T06:57:56.838731+0000","last_became_active":"2024-02-19T06:57:55.864079+0000","last_became_peered":"2024-02-19T06:57:55.864079+0000","last_unstale":"2024-02-19T06:57:56.838731+0000","last_undegraded":"2024-02-19T06:57:56.838731+0000","last_fullsized":"2024-02-19T06:57:56.838731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296866+0000","last_change":"2024-02-19T06:57:55.868409+0000","last_active":"2024-02-19T06:57:57.296866+0000","last_peered":"2024-02-19T06:57:57.296866+0000","last_clean":"2024-02-19T06:57:57.296866+0000","last_became_active":"2024-02-19T06:57:55.868136+0000","last_became_peered":"2024-02-19T06:57:55.868136+0000","last_unstale":"2024-02-19T06:57:57.296866+0000","last_undegraded":"2024-02-19T06:57:57.296866+0000","last_fullsized":"2024-02-19T06:57:57.296866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:36:55.635583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296486+0000","last_change":"2024-02-19T06:57:55.883330+0000","last_active":"2024-02-19T06:57:57.296486+0000","last_peered":"2024-02-19T06:57:57.296486+0000","last_clean":"2024-02-19T06:57:57.296486+0000","last_became_active":"2024-02-19T06:57:55.881827+0000","last_became_peered":"2024-02-19T06:57:55.881827+0000","last_unstale":"2024-02-19T06:57:57.296486+0000","last_undegraded":"2024-02-19T06:57:57.296486+0000","last_fullsized":"2024-02-19T06:57:57.296486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:30:53.058177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297284+0000","last_change":"2024-02-19T06:57:55.869285+0000","last_active":"2024-02-19T06:57:57.297284+0000","last_peered":"2024-02-19T06:57:57.297284+0000","last_clean":"2024-02-19T06:57:57.297284+0000","last_became_active":"2024-02-19T06:57:55.868584+0000","last_became_peered":"2024-02-19T06:57:55.868584+0000","last_unstale":"2024-02-19T06:57:57.297284+0000","last_undegraded":"2024-02-19T06:57:57.297284+0000","last_fullsized":"2024-02-19T06:57:57.297284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:19:34.393218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297058+0000","last_change":"2024-02-19T06:57:55.859224+0000","last_active":"2024-02-19T06:57:57.297058+0000","last_peered":"2024-02-19T06:57:57.297058+0000","last_clean":"2024-02-19T06:57:57.297058+0000","last_became_active":"2024-02-19T06:57:55.858917+0000","last_became_peered":"2024-02-19T06:57:55.858917+0000","last_unstale":"2024-02-19T06:57:57.297058+0000","last_undegraded":"2024-02-19T06:57:57.297058+0000","last_fullsized":"2024-02-19T06:57:57.297058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T06:59:02.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297505+0000","last_change":"2024-02-19T06:57:55.874779+0000","last_active":"2024-02-19T06:57:57.297505+0000","last_peered":"2024-02-19T06:57:57.297505+0000","last_clean":"2024-02-19T06:57:57.297505+0000","last_became_active":"2024-02-19T06:57:55.868999+0000","last_became_peered":"2024-02-19T06:57:55.868999+0000","last_unstale":"2024-02-19T06:57:57.297505+0000","last_undegraded":"2024-02-19T06:57:57.297505+0000","last_fullsized":"2024-02-19T06:57:57.297505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:36:55.635583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.840892+0000","last_change":"2024-02-19T06:57:55.848789+0000","last_active":"2024-02-19T06:57:56.840892+0000","last_peered":"2024-02-19T06:57:56.840892+0000","last_clean":"2024-02-19T06:57:56.840892+0000","last_became_active":"2024-02-19T06:57:55.848272+0000","last_became_peered":"2024-02-19T06:57:55.848272+0000","last_unstale":"2024-02-19T06:57:56.840892+0000","last_undegraded":"2024-02-19T06:57:56.840892+0000","last_fullsized":"2024-02-19T06:57:56.840892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:31:25.479236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298851+0000","last_change":"2024-02-19T06:57:54.848533+0000","last_active":"2024-02-19T06:57:57.298851+0000","last_peered":"2024-02-19T06:57:57.298851+0000","last_clean":"2024-02-19T06:57:57.298851+0000","last_became_active":"2024-02-19T06:57:54.847588+0000","last_became_peered":"2024-02-19T06:57:54.847588+0000","last_unstale":"2024-02-19T06:57:57.298851+0000","last_undegraded":"2024-02-19T06:57:57.298851+0000","last_fullsized":"2024-02-19T06:57:57.298851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:48:35.345147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296871+0000","last_change":"2024-02-19T06:57:55.873153+0000","last_active":"2024-02-19T06:57:57.296871+0000","last_peered":"2024-02-19T06:57:57.296871+0000","last_clean":"2024-02-19T06:57:57.296871+0000","last_became_active":"2024-02-19T06:57:55.872845+0000","last_became_peered":"2024-02-19T06:57:55.872845+0000","last_unstale":"2024-02-19T06:57:57.296871+0000","last_undegraded":"2024-02-19T06:57:57.296871+0000","last_fullsized":"2024-02-19T06:57:57.296871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:38:12.022068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298413+0000","last_change":"2024-02-19T06:57:54.845309+0000","last_active":"2024-02-19T06:57:57.298413+0000","last_peered":"2024-02-19T06:57:57.298413+0000","last_clean":"2024-02-19T06:57:57.298413+0000","last_became_active":"2024-02-19T06:57:54.845046+0000","last_became_peered":"2024-02-19T06:57:54.845046+0000","last_unstale":"2024-02-19T06:57:57.298413+0000","last_undegraded":"2024-02-19T06:57:57.298413+0000","last_fullsized":"2024-02-19T06:57:57.298413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:04:53.869596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298172+0000","last_change":"2024-02-19T06:57:54.853227+0000","last_active":"2024-02-19T06:57:57.298172+0000","last_peered":"2024-02-19T06:57:57.298172+0000","last_clean":"2024-02-19T06:57:57.298172+0000","last_became_active":"2024-02-19T06:57:54.852992+0000","last_became_peered":"2024-02-19T06:57:54.852992+0000","last_unstale":"2024-02-19T06:57:57.298172+0000","last_undegraded":"2024-02-19T06:57:57.298172+0000","last_fullsized":"2024-02-19T06:57:57.298172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:28:51.362957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297490+0000","last_change":"2024-02-19T06:57:55.867102+0000","last_active":"2024-02-19T06:57:57.297490+0000","last_peered":"2024-02-19T06:57:57.297490+0000","last_clean":"2024-02-19T06:57:57.297490+0000","last_became_active":"2024-02-19T06:57:55.866831+0000","last_became_peered":"2024-02-19T06:57:55.866831+0000","last_unstale":"2024-02-19T06:57:57.297490+0000","last_undegraded":"2024-02-19T06:57:57.297490+0000","last_fullsized":"2024-02-19T06:57:57.297490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298008+0000","last_change":"2024-02-19T06:57:54.836938+0000","last_active":"2024-02-19T06:57:57.298008+0000","last_peered":"2024-02-19T06:57:57.298008+0000","last_clean":"2024-02-19T06:57:57.298008+0000","last_became_active":"2024-02-19T06:57:54.836538+0000","last_became_peered":"2024-02-19T06:57:54.836538+0000","last_unstale":"2024-02-19T06:57:57.298008+0000","last_undegraded":"2024-02-19T06:57:57.298008+0000","last_fullsized":"2024-02-19T06:57:57.298008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:44:55.409988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838441+0000","last_change":"2024-02-19T06:57:55.857240+0000","last_active":"2024-02-19T06:57:56.838441+0000","last_peered":"2024-02-19T06:57:56.838441+0000","last_clean":"2024-02-19T06:57:56.838441+0000","last_became_active":"2024-02-19T06:57:55.856505+0000","last_became_peered":"2024-02-19T06:57:55.856505+0000","last_unstale":"2024-02-19T06:57:56.838441+0000","last_undegraded":"2024-02-19T06:57:56.838441+0000","last_fullsized":"2024-02-19T06:57:56.838441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299283+0000","last_change":"2024-02-19T06:57:54.849649+0000","last_active":"2024-02-19T06:57:57.299283+0000","last_peered":"2024-02-19T06:57:57.299283+0000","last_clean":"2024-02-19T06:57:57.299283+0000","last_became_active":"2024-02-19T06:57:54.848543+0000","last_became_peered":"2024-02-19T06:57:54.848543+0000","last_unstale":"2024-02-19T06:57:57.299283+0000","last_undegraded":"2024-02-19T06:57:57.299283+0000","last_fullsized":"2024-02-19T06:57:57.299283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:59:11.619972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299748+0000","last_change":"2024-02-19T06:57:55.856202+0000","last_active":"2024-02-19T06:57:57.299748+0000","last_peered":"2024-02-19T06:57:57.299748+0000","last_clean":"2024-02-19T06:57:57.299748+0000","last_became_active":"2024-02-19T06:57:55.855896+0000","last_became_peered":"2024-02-19T06:57:55.855896+0000","last_unstale":"2024-02-19T06:57:57.299748+0000","last_undegraded":"2024-02-19T06:57:57.299748+0000","last_fullsized":"2024-02-19T06:57:57.299748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:58:48.198207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298578+0000","last_change":"2024-02-19T06:57:54.849568+0000","last_active":"2024-02-19T06:57:57.298578+0000","last_peered":"2024-02-19T06:57:57.298578+0000","last_clean":"2024-02-19T06:57:57.298578+0000","last_became_active":"2024-02-19T06:57:54.849259+0000","last_became_peered":"2024-02-19T06:57:54.849259+0000","last_unstale":"2024-02-19T06:57:57.298578+0000","last_undegraded":"2024-02-19T06:57:57.298578+0000","last_fullsized":"2024-02-19T06:57:57.298578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:59:11.619972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296283+0000","last_change":"2024-02-19T06:57:55.879987+0000","last_active":"2024-02-19T06:57:57.296283+0000","last_peered":"2024-02-19T06:57:57.296283+0000","last_clean":"2024-02-19T06:57:57.296283+0000","last_became_active":"2024-02-19T06:57:55.874213+0000","last_became_peered":"2024-02-19T06:57:55.874213+0000","last_unstale":"2024-02-19T06:57:57.296283+0000","last_undegraded":"2024-02-19T06:57:57.296283+0000","last_fullsized":"2024-02-19T06:57:57.296283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:13:00.717755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838753+0000","last_change":"2024-02-19T06:57:54.842446+0000","last_active":"2024-02-19T06:57:56.838753+0000","last_peered":"2024-02-19T06:57:56.838753+0000","last_clean":"2024-02-19T06:57:56.838753+0000","last_became_active":"2024-02-19T06:57:54.842159+0000","last_became_peered":"2024-02-19T06:57:54.842159+0000","last_unstale":"2024-02-19T06:57:56.838753+0000","last_undegraded":"2024-02-19T06:57:56.838753+0000","last_fullsized":"2024-02-19T06:57:56.838753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:59:42.541017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842413+0000","last_change":"2024-02-19T06:57:55.861662+0000","last_active":"2024-02-19T06:57:56.842413+0000","last_peered":"2024-02-19T06:57:56.842413+0000","last_clean":"2024-02-19T06:57:56.842413+0000","last_became_active":"2024-02-19T06:57:55.861272+0000","last_became_peered":"2024-02-19T06:57:55.861272+0000","last_unstale":"2024-02-19T06:57:56.842413+0000","last_undegraded":"2024-02-19T06:57:56.842413+0000","last_fullsized":"2024-02-19T06:57:56.842413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:34:02.546590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298720+0000","last_change":"2024-02-19T06:57:54.848390+0000","last_active":"2024-02-19T06:57:57.298720+0000","last_peered":"2024-02-19T06:57:57.298720+0000","last_clean":"2024-02-19T06:57:57.298720+0000","last_became_active":"2024-02-19T06:57:54.848036+0000","last_became_peered":"2024-02-19T06:57:54.848036+0000","last_unstale":"2024-02-19T06:57:57.298720+0000","last_undegraded":"2024-02-19T06:57:57.298720+0000","last_fullsized":"2024-02-19T06:57:57.298720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:44:55.409988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841529+0000","last_change":"2024-02-19T06:57:55.865916+0000","last_active":"2024-02-19T06:57:56.841529+0000","last_peered":"2024-02-19T06:57:56.841529+0000","last_clean":"2024-02-19T06:57:56.841529+0000","last_became_active":"2024-02-19T06:57:55.865239+0000","last_became_peered":"2024-02-19T06:57:55.865239+0000","last_unstale":"2024-02-19T06:57:56.841529+0000","last_undegraded":"2024-02-19T06:57:56.841529+0000","last_fullsized":"2024-02-19T06:57:56.841529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:22:32.626274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297160+0000","last_change":"2024-02-19T06:57:54.845625+0000","last_active":"2024-02-19T06:57:57.297160+0000","last_peered":"2024-02-19T06:57:57.297160+0000","last_clean":"2024-02-19T06:57:57.297160+0000","last_became_active":"2024-02-19T06:57:54.845135+0000","last_became_peered":"2024-02-19T06:57:54.845135+0000","last_unstale":"2024-02-19T06:57:57.297160+0000","last_undegraded":"2024-02-19T06:57:57.297160+0000","last_fullsized":"2024-02-19T06:57:57.297160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:31:12.486420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296648+0000","last_change":"2024-02-19T06:57:55.879354+0000","last_active":"2024-02-19T06:57:57.296648+0000","last_peered":"2024-02-19T06:57:57.296648+0000","last_clean":"2024-02-19T06:57:57.296648+0000","last_became_active":"2024-02-19T06:57:55.878992+0000","last_became_peered":"2024-02-19T06:57:55.878992+0000","last_unstale":"2024-02-19T06:57:57.296648+0000","last_undegraded":"2024-02-19T06:57:57.296648+0000","last_fullsized":"2024-02-19T06:57:57.296648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:02:58.620182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297355+0000","last_change":"2024-02-19T06:57:54.846040+0000","last_active":"2024-02-19T06:57:57.297355+0000","last_peered":"2024-02-19T06:57:57.297355+0000","last_clean":"2024-02-19T06:57:57.297355+0000","last_became_active":"2024-02-19T06:57:54.845607+0000","last_became_peered":"2024-02-19T06:57:54.845607+0000","last_unstale":"2024-02-19T06:57:57.297355+0000","last_undegraded":"2024-02-19T06:57:57.297355+0000","last_fullsized":"2024-02-19T06:57:57.297355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:04:53.869596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841142+0000","last_change":"2024-02-19T06:57:55.873658+0000","last_active":"2024-02-19T06:57:56.841142+0000","last_peered":"2024-02-19T06:57:56.841142+0000","last_clean":"2024-02-19T06:57:56.841142+0000","last_became_active":"2024-02-19T06:57:55.868108+0000","last_became_peered":"2024-02-19T06:57:55.868108+0000","last_unstale":"2024-02-19T06:57:56.841142+0000","last_undegraded":"2024-02-19T06:57:56.841142+0000","last_fullsized":"2024-02-19T06:57:56.841142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:51:32.064277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297967+0000","last_change":"2024-02-19T06:57:54.847587+0000","last_active":"2024-02-19T06:57:57.297967+0000","last_peered":"2024-02-19T06:57:57.297967+0000","last_clean":"2024-02-19T06:57:57.297967+0000","last_became_active":"2024-02-19T06:57:54.844899+0000","last_became_peered":"2024-02-19T06:57:54.844899+0000","last_unstale":"2024-02-19T06:57:57.297967+0000","last_undegraded":"2024-02-19T06:57:57.297967+0000","last_fullsized":"2024-02-19T06:57:57.297967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:51:03.784955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297605+0000","last_change":"2024-02-19T06:57:55.868933+0000","last_active":"2024-02-19T06:57:57.297605+0000","last_peered":"2024-02-19T06:57:57.297605+0000","last_clean":"2024-02-19T06:57:57.297605+0000","last_became_active":"2024-02-19T06:57:55.868592+0000","last_became_peered":"2024-02-19T06:57:55.868592+0000","last_unstale":"2024-02-19T06:57:57.297605+0000","last_undegraded":"2024-02-19T06:57:57.297605+0000","last_fullsized":"2024-02-19T06:57:57.297605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:33:37.227028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297451+0000","last_change":"2024-02-19T06:57:54.831858+0000","last_active":"2024-02-19T06:57:57.297451+0000","last_peered":"2024-02-19T06:57:57.297451+0000","last_clean":"2024-02-19T06:57:57.297451+0000","last_became_active":"2024-02-19T06:57:54.831512+0000","last_became_peered":"2024-02-19T06:57:54.831512+0000","last_unstale":"2024-02-19T06:57:57.297451+0000","last_undegraded":"2024-02-19T06:57:57.297451+0000","last_fullsized":"2024-02-19T06:57:57.297451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:48:18.433112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.839899+0000","last_change":"2024-02-19T06:57:55.872697+0000","last_active":"2024-02-19T06:57:56.839899+0000","last_peered":"2024-02-19T06:57:56.839899+0000","last_clean":"2024-02-19T06:57:56.839899+0000","last_became_active":"2024-02-19T06:57:55.872411+0000","last_became_peered":"2024-02-19T06:57:55.872411+0000","last_unstale":"2024-02-19T06:57:56.839899+0000","last_undegraded":"2024-02-19T06:57:56.839899+0000","last_fullsized":"2024-02-19T06:57:56.839899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:44:33.781212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842124+0000","last_change":"2024-02-19T06:57:54.844428+0000","last_active":"2024-02-19T06:57:56.842124+0000","last_peered":"2024-02-19T06:57:56.842124+0000","last_clean":"2024-02-19T06:57:56.842124+0000","last_became_active":"2024-02-19T06:57:54.844078+0000","last_became_peered":"2024-02-19T06:57:54.844078+0000","last_unstale":"2024-02-19T06:57:56.842124+0000","last_undegraded":"2024-02-19T06:57:56.842124+0000","last_fullsized":"2024-02-19T06:57:56.842124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:48:12.144495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843194+0000","last_change":"2024-02-19T06:57:55.869556+0000","last_active":"2024-02-19T06:57:56.843194+0000","last_peered":"2024-02-19T06:57:56.843194+0000","last_clean":"2024-02-19T06:57:56.843194+0000","last_became_active":"2024-02-19T06:57:55.869252+0000","last_became_peered":"2024-02-19T06:57:55.869252+0000","last_unstale":"2024-02-19T06:57:56.843194+0000","last_undegraded":"2024-02-19T06:57:56.843194+0000","last_fullsized":"2024-02-19T06:57:56.843194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:34:32.534931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298549+0000","last_change":"2024-02-19T06:57:54.848350+0000","last_active":"2024-02-19T06:57:57.298549+0000","last_peered":"2024-02-19T06:57:57.298549+0000","last_clean":"2024-02-19T06:57:57.298549+0000","last_became_active":"2024-02-19T06:57:54.848006+0000","last_became_peered":"2024-02-19T06:57:54.848006+0000","last_unstale":"2024-02-19T06:57:57.298549+0000","last_undegraded":"2024-02-19T06:57:57.298549+0000","last_fullsized":"2024-02-19T06:57:57.298549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:51:48.627075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843747+0000","last_change":"2024-02-19T06:57:55.872749+0000","last_active":"2024-02-19T06:57:56.843747+0000","last_peered":"2024-02-19T06:57:56.843747+0000","last_clean":"2024-02-19T06:57:56.843747+0000","last_became_active":"2024-02-19T06:57:55.872475+0000","last_became_peered":"2024-02-19T06:57:55.872475+0000","last_unstale":"2024-02-19T06:57:56.843747+0000","last_undegraded":"2024-02-19T06:57:56.843747+0000","last_fullsized":"2024-02-19T06:57:56.843747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:48:48.733251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.839076+0000","last_change":"2024-02-19T06:57:54.835766+0000","last_active":"2024-02-19T06:57:56.839076+0000","last_peered":"2024-02-19T06:57:56.839076+0000","last_clean":"2024-02-19T06:57:56.839076+0000","last_became_active":"2024-02-19T06:57:54.835407+0000","last_became_peered":"2024-02-19T06:57:54.835407+0000","last_unstale":"2024-02-19T06:57:56.839076+0000","last_undegraded":"2024-02-19T06:57:56.839076+0000","last_fullsized":"2024-02-19T06:57:56.839076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:09:02.273345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297872+0000","last_change":"2024-02-19T06:57:55.875676+0000","last_active":"2024-02-19T06:57:57.297872+0000","last_peered":"2024-02-19T06:57:57.297872+0000","last_clean":"2024-02-19T06:57:57.297872+0000","last_became_active":"2024-02-19T06:57:55.874703+0000","last_became_peered":"2024-02-19T06:57:55.874703+0000","last_unstale":"2024-02-19T06:57:57.297872+0000","last_undegraded":"2024-02-19T06:57:57.297872+0000","last_fullsized":"2024-02-19T06:57:57.297872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:07:14.896235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298413+0000","last_change":"2024-02-19T06:57:54.842701+0000","last_active":"2024-02-19T06:57:57.298413+0000","last_peered":"2024-02-19T06:57:57.298413+0000","last_clean":"2024-02-19T06:57:57.298413+0000","last_became_active":"2024-02-19T06:57:54.842305+0000","last_became_peered":"2024-02-19T06:57:54.842305+0000","last_unstale":"2024-02-19T06:57:57.298413+0000","last_undegraded":"2024-02-19T06:57:57.298413+0000","last_fullsized":"2024-02-19T06:57:57.298413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:31:12.486420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842830+0000","last_change":"2024-02-19T06:57:55.865803+0000","last_active":"2024-02-19T06:57:56.842830+0000","last_peered":"2024-02-19T06:57:56.842830+0000","last_clean":"2024-02-19T06:57:56.842830+0000","last_became_active":"2024-02-19T06:57:55.865239+0000","last_became_peered":"2024-02-19T06:57:55.865239+0000","last_unstale":"2024-02-19T06:57:56.842830+0000","last_undegraded":"2024-02-19T06:57:56.842830+0000","last_fullsized":"2024-02-19T06:57:56.842830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:14:32.464297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841305+0000","last_change":"2024-02-19T06:57:45.353063+0000","last_active":"2024-02-19T06:57:56.841305+0000","last_peered":"2024-02-19T06:57:56.841305+0000","last_clean":"2024-02-19T06:57:56.841305+0000","last_became_active":"2024-02-19T06:57:45.350602+0000","last_became_peered":"2024-02-19T06:57:45.350602+0000","last_unstale":"2024-02-19T06:57:56.841305+0000","last_undegraded":"2024-02-19T06:57:56.841305+0000","last_fullsized":"2024-02-19T06:57:56.841305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_clean_scrub_stamp":"2024-02-19T06:57:44.230095+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:04:42.513180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297047+0000","last_change":"2024-02-19T06:57:54.839055+0000","last_active":"2024-02-19T06:57:57.297047+0000","last_peered":"2024-02-19T06:57:57.297047+0000","last_clean":"2024-02-19T06:57:57.297047+0000","last_became_active":"2024-02-19T06:57:54.838769+0000","last_became_peered":"2024-02-19T06:57:54.838769+0000","last_unstale":"2024-02-19T06:57:57.297047+0000","last_undegraded":"2024-02-19T06:57:57.297047+0000","last_fullsized":"2024-02-19T06:57:57.297047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:48:35.345147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.295995+0000","last_change":"2024-02-19T06:57:55.864141+0000","last_active":"2024-02-19T06:57:57.295995+0000","last_peered":"2024-02-19T06:57:57.295995+0000","last_clean":"2024-02-19T06:57:57.295995+0000","last_became_active":"2024-02-19T06:57:55.863841+0000","last_became_peered":"2024-02-19T06:57:55.863841+0000","last_unstale":"2024-02-19T06:57:57.295995+0000","last_undegraded":"2024-02-19T06:57:57.295995+0000","last_fullsized":"2024-02-19T06:57:57.295995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:18:12.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841663+0000","last_change":"2024-02-19T06:57:54.830847+0000","last_active":"2024-02-19T06:57:56.841663+0000","last_peered":"2024-02-19T06:57:56.841663+0000","last_clean":"2024-02-19T06:57:56.841663+0000","last_became_active":"2024-02-19T06:57:54.830511+0000","last_became_peered":"2024-02-19T06:57:54.830511+0000","last_unstale":"2024-02-19T06:57:56.841663+0000","last_undegraded":"2024-02-19T06:57:56.841663+0000","last_fullsized":"2024-02-19T06:57:56.841663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T06:59:01.746042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.295829+0000","last_change":"2024-02-19T06:57:55.870925+0000","last_active":"2024-02-19T06:57:57.295829+0000","last_peered":"2024-02-19T06:57:57.295829+0000","last_clean":"2024-02-19T06:57:57.295829+0000","last_became_active":"2024-02-19T06:57:55.870616+0000","last_became_peered":"2024-02-19T06:57:55.870616+0000","last_unstale":"2024-02-19T06:57:57.295829+0000","last_undegraded":"2024-02-19T06:57:57.295829+0000","last_fullsized":"2024-02-19T06:57:57.295829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:43:48.726828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297970+0000","last_change":"2024-02-19T06:57:54.848662+0000","last_active":"2024-02-19T06:57:57.297970+0000","last_peered":"2024-02-19T06:57:57.297970+0000","last_clean":"2024-02-19T06:57:57.297970+0000","last_became_active":"2024-02-19T06:57:54.848378+0000","last_became_peered":"2024-02-19T06:57:54.848378+0000","last_unstale":"2024-02-19T06:57:57.297970+0000","last_undegraded":"2024-02-19T06:57:57.297970+0000","last_fullsized":"2024-02-19T06:57:57.297970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:48:40.438231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.837477+0000","last_change":"2024-02-19T06:57:55.848725+0000","last_active":"2024-02-19T06:57:56.837477+0000","last_peered":"2024-02-19T06:57:56.837477+0000","last_clean":"2024-02-19T06:57:56.837477+0000","last_became_active":"2024-02-19T06:57:55.846707+0000","last_became_peered":"2024-02-19T06:57:55.846707+0000","last_unstale":"2024-02-19T06:57:56.837477+0000","last_undegraded":"2024-02-19T06:57:56.837477+0000","last_fullsized":"2024-02-19T06:57:56.837477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:36:55.635583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297591+0000","last_change":"2024-02-19T06:57:54.836285+0000","last_active":"2024-02-19T06:57:57.297591+0000","last_peered":"2024-02-19T06:57:57.297591+0000","last_clean":"2024-02-19T06:57:57.297591+0000","last_became_active":"2024-02-19T06:57:54.831238+0000","last_became_peered":"2024-02-19T06:57:54.831238+0000","last_unstale":"2024-02-19T06:57:57.297591+0000","last_undegraded":"2024-02-19T06:57:57.297591+0000","last_fullsized":"2024-02-19T06:57:57.297591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:51:03.784955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841596+0000","last_change":"2024-02-19T06:57:55.884751+0000","last_active":"2024-02-19T06:57:56.841596+0000","last_peered":"2024-02-19T06:57:56.841596+0000","last_clean":"2024-02-19T06:57:56.841596+0000","last_became_active":"2024-02-19T06:57:55.884444+0000","last_became_peered":"2024-02-19T06:57:55.884444+0000","last_unstale":"2024-02-19T06:57:56.841596+0000","last_undegraded":"2024-02-19T06:57:56.841596+0000","last_fullsized":"2024-02-19T06:57:56.841596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T06:59:02.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838502+0000","last_change":"2024-02-19T06:57:54.849999+0000","last_active":"2024-02-19T06:57:56.838502+0000","last_peered":"2024-02-19T06:57:56.838502+0000","last_clean":"2024-02-19T06:57:56.838502+0000","last_became_active":"2024-02-19T06:57:54.849632+0000","last_became_peered":"2024-02-19T06:57:54.849632+0000","last_unstale":"2024-02-19T06:57:56.838502+0000","last_undegraded":"2024-02-19T06:57:56.838502+0000","last_fullsized":"2024-02-19T06:57:56.838502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:59:11.619972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298324+0000","last_change":"2024-02-19T06:57:55.864794+0000","last_active":"2024-02-19T06:57:57.298324+0000","last_peered":"2024-02-19T06:57:57.298324+0000","last_clean":"2024-02-19T06:57:57.298324+0000","last_became_active":"2024-02-19T06:57:55.864493+0000","last_became_peered":"2024-02-19T06:57:55.864493+0000","last_unstale":"2024-02-19T06:57:57.298324+0000","last_undegraded":"2024-02-19T06:57:57.298324+0000","last_fullsized":"2024-02-19T06:57:57.298324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:13:32.804426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843295+0000","last_change":"2024-02-19T06:57:54.844059+0000","last_active":"2024-02-19T06:57:56.843295+0000","last_peered":"2024-02-19T06:57:56.843295+0000","last_clean":"2024-02-19T06:57:56.843295+0000","last_became_active":"2024-02-19T06:57:54.843728+0000","last_became_peered":"2024-02-19T06:57:54.843728+0000","last_unstale":"2024-02-19T06:57:56.843295+0000","last_undegraded":"2024-02-19T06:57:56.843295+0000","last_fullsized":"2024-02-19T06:57:56.843295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:29:04.812047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838149+0000","last_change":"2024-02-19T06:57:55.850256+0000","last_active":"2024-02-19T06:57:56.838149+0000","last_peered":"2024-02-19T06:57:56.838149+0000","last_clean":"2024-02-19T06:57:56.838149+0000","last_became_active":"2024-02-19T06:57:55.846503+0000","last_became_peered":"2024-02-19T06:57:55.846503+0000","last_unstale":"2024-02-19T06:57:56.838149+0000","last_undegraded":"2024-02-19T06:57:56.838149+0000","last_fullsized":"2024-02-19T06:57:56.838149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:19:13.712235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838870+0000","last_change":"2024-02-19T06:57:54.845587+0000","last_active":"2024-02-19T06:57:56.838870+0000","last_peered":"2024-02-19T06:57:56.838870+0000","last_clean":"2024-02-19T06:57:56.838870+0000","last_became_active":"2024-02-19T06:57:54.844017+0000","last_became_peered":"2024-02-19T06:57:54.844017+0000","last_unstale":"2024-02-19T06:57:56.838870+0000","last_undegraded":"2024-02-19T06:57:56.838870+0000","last_fullsized":"2024-02-19T06:57:56.838870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:11:06.185390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299468+0000","last_change":"2024-02-19T06:57:55.873485+0000","last_active":"2024-02-19T06:57:57.299468+0000","last_peered":"2024-02-19T06:57:57.299468+0000","last_clean":"2024-02-19T06:57:57.299468+0000","last_became_active":"2024-02-19T06:57:55.873179+0000","last_became_peered":"2024-02-19T06:57:55.873179+0000","last_unstale":"2024-02-19T06:57:57.299468+0000","last_undegraded":"2024-02-19T06:57:57.299468+0000","last_fullsized":"2024-02-19T06:57:57.299468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:45:59.994639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299321+0000","last_change":"2024-02-19T06:57:54.849235+0000","last_active":"2024-02-19T06:57:57.299321+0000","last_peered":"2024-02-19T06:57:57.299321+0000","last_clean":"2024-02-19T06:57:57.299321+0000","last_became_active":"2024-02-19T06:57:54.848969+0000","last_became_peered":"2024-02-19T06:57:54.848969+0000","last_unstale":"2024-02-19T06:57:57.299321+0000","last_undegraded":"2024-02-19T06:57:57.299321+0000","last_fullsized":"2024-02-19T06:57:57.299321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:59:42.541017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297324+0000","last_change":"2024-02-19T06:57:55.878312+0000","last_active":"2024-02-19T06:57:57.297324+0000","last_peered":"2024-02-19T06:57:57.297324+0000","last_clean":"2024-02-19T06:57:57.297324+0000","last_became_active":"2024-02-19T06:57:55.872331+0000","last_became_peered":"2024-02-19T06:57:55.872331+0000","last_unstale":"2024-02-19T06:57:57.297324+0000","last_undegraded":"2024-02-19T06:57:57.297324+0000","last_fullsized":"2024-02-19T06:57:57.297324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:16:19.287368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841162+0000","last_change":"2024-02-19T06:57:54.851412+0000","last_active":"2024-02-19T06:57:56.841162+0000","last_peered":"2024-02-19T06:57:56.841162+0000","last_clean":"2024-02-19T06:57:56.841162+0000","last_became_active":"2024-02-19T06:57:54.849764+0000","last_became_peered":"2024-02-19T06:57:54.849764+0000","last_unstale":"2024-02-19T06:57:56.841162+0000","last_undegraded":"2024-02-19T06:57:56.841162+0000","last_fullsized":"2024-02-19T06:57:56.841162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:31:24.467437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.840874+0000","last_change":"2024-02-19T06:57:55.859782+0000","last_active":"2024-02-19T06:57:56.840874+0000","last_peered":"2024-02-19T06:57:56.840874+0000","last_clean":"2024-02-19T06:57:56.840874+0000","last_became_active":"2024-02-19T06:57:55.859506+0000","last_became_peered":"2024-02-19T06:57:55.859506+0000","last_unstale":"2024-02-19T06:57:56.840874+0000","last_undegraded":"2024-02-19T06:57:56.840874+0000","last_fullsized":"2024-02-19T06:57:56.840874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:14:51.291554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838183+0000","last_change":"2024-02-19T06:57:54.833195+0000","last_active":"2024-02-19T06:57:56.838183+0000","last_peered":"2024-02-19T06:57:56.838183+0000","last_clean":"2024-02-19T06:57:56.838183+0000","last_became_active":"2024-02-19T06:57:54.832921+0000","last_became_peered":"2024-02-19T06:57:54.832921+0000","last_unstale":"2024-02-19T06:57:56.838183+0000","last_undegraded":"2024-02-19T06:57:56.838183+0000","last_fullsized":"2024-02-19T06:57:56.838183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:51:03.784955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297856+0000","last_change":"2024-02-19T06:57:55.863807+0000","last_active":"2024-02-19T06:57:57.297856+0000","last_peered":"2024-02-19T06:57:57.297856+0000","last_clean":"2024-02-19T06:57:57.297856+0000","last_became_active":"2024-02-19T06:57:55.862327+0000","last_became_peered":"2024-02-19T06:57:55.862327+0000","last_unstale":"2024-02-19T06:57:57.297856+0000","last_undegraded":"2024-02-19T06:57:57.297856+0000","last_fullsized":"2024-02-19T06:57:57.297856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.837924+0000","last_change":"2024-02-19T06:57:54.847191+0000","last_active":"2024-02-19T06:57:56.837924+0000","last_peered":"2024-02-19T06:57:56.837924+0000","last_clean":"2024-02-19T06:57:56.837924+0000","last_became_active":"2024-02-19T06:57:54.846893+0000","last_became_peered":"2024-02-19T06:57:54.846893+0000","last_unstale":"2024-02-19T06:57:56.837924+0000","last_undegraded":"2024-02-19T06:57:56.837924+0000","last_fullsized":"2024-02-19T06:57:56.837924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:44:55.409988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298592+0000","last_change":"2024-02-19T06:57:55.882338+0000","last_active":"2024-02-19T06:57:57.298592+0000","last_peered":"2024-02-19T06:57:57.298592+0000","last_clean":"2024-02-19T06:57:57.298592+0000","last_became_active":"2024-02-19T06:57:55.881014+0000","last_became_peered":"2024-02-19T06:57:55.881014+0000","last_unstale":"2024-02-19T06:57:57.298592+0000","last_undegraded":"2024-02-19T06:57:57.298592+0000","last_fullsized":"2024-02-19T06:57:57.298592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:19:34.393218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841316+0000","last_change":"2024-02-19T06:57:54.845977+0000","last_active":"2024-02-19T06:57:56.841316+0000","last_peered":"2024-02-19T06:57:56.841316+0000","last_clean":"2024-02-19T06:57:56.841316+0000","last_became_active":"2024-02-19T06:57:54.845651+0000","last_became_peered":"2024-02-19T06:57:54.845651+0000","last_unstale":"2024-02-19T06:57:56.841316+0000","last_undegraded":"2024-02-19T06:57:56.841316+0000","last_fullsized":"2024-02-19T06:57:56.841316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:42:34.912061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297311+0000","last_change":"2024-02-19T06:57:55.870900+0000","last_active":"2024-02-19T06:57:57.297311+0000","last_peered":"2024-02-19T06:57:57.297311+0000","last_clean":"2024-02-19T06:57:57.297311+0000","last_became_active":"2024-02-19T06:57:55.870632+0000","last_became_peered":"2024-02-19T06:57:55.870632+0000","last_unstale":"2024-02-19T06:57:57.297311+0000","last_undegraded":"2024-02-19T06:57:57.297311+0000","last_fullsized":"2024-02-19T06:57:57.297311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:18:12.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298148+0000","last_change":"2024-02-19T06:57:55.863948+0000","last_active":"2024-02-19T06:57:57.298148+0000","last_peered":"2024-02-19T06:57:57.298148+0000","last_clean":"2024-02-19T06:57:57.298148+0000","last_became_active":"2024-02-19T06:57:55.863663+0000","last_became_peered":"2024-02-19T06:57:55.863663+0000","last_unstale":"2024-02-19T06:57:57.298148+0000","last_undegraded":"2024-02-19T06:57:57.298148+0000","last_fullsized":"2024-02-19T06:57:57.298148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:06:41.609470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841684+0000","last_change":"2024-02-19T06:57:54.841874+0000","last_active":"2024-02-19T06:57:56.841684+0000","last_peered":"2024-02-19T06:57:56.841684+0000","last_clean":"2024-02-19T06:57:56.841684+0000","last_became_active":"2024-02-19T06:57:54.841500+0000","last_became_peered":"2024-02-19T06:57:54.841500+0000","last_unstale":"2024-02-19T06:57:56.841684+0000","last_undegraded":"2024-02-19T06:57:56.841684+0000","last_fullsized":"2024-02-19T06:57:56.841684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:34:01.534791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297567+0000","last_change":"2024-02-19T06:57:55.864005+0000","last_active":"2024-02-19T06:57:57.297567+0000","last_peered":"2024-02-19T06:57:57.297567+0000","last_clean":"2024-02-19T06:57:57.297567+0000","last_became_active":"2024-02-19T06:57:55.863634+0000","last_became_peered":"2024-02-19T06:57:55.863634+0000","last_unstale":"2024-02-19T06:57:57.297567+0000","last_undegraded":"2024-02-19T06:57:57.297567+0000","last_fullsized":"2024-02-19T06:57:57.297567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:45:59.994639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842721+0000","last_change":"2024-02-19T06:57:54.845418+0000","last_active":"2024-02-19T06:57:56.842721+0000","last_peered":"2024-02-19T06:57:56.842721+0000","last_clean":"2024-02-19T06:57:56.842721+0000","last_became_active":"2024-02-19T06:57:54.845134+0000","last_became_peered":"2024-02-19T06:57:54.845134+0000","last_unstale":"2024-02-19T06:57:56.842721+0000","last_undegraded":"2024-02-19T06:57:56.842721+0000","last_fullsized":"2024-02-19T06:57:56.842721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:37:22.505873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.295990+0000","last_change":"2024-02-19T06:57:55.880160+0000","last_active":"2024-02-19T06:57:57.295990+0000","last_peered":"2024-02-19T06:57:57.295990+0000","last_clean":"2024-02-19T06:57:57.295990+0000","last_became_active":"2024-02-19T06:57:55.879826+0000","last_became_peered":"2024-02-19T06:57:55.879826+0000","last_unstale":"2024-02-19T06:57:57.295990+0000","last_undegraded":"2024-02-19T06:57:57.295990+0000","last_fullsized":"2024-02-19T06:57:57.295990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:31:58.448215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297341+0000","last_change":"2024-02-19T06:57:54.848100+0000","last_active":"2024-02-19T06:57:57.297341+0000","last_peered":"2024-02-19T06:57:57.297341+0000","last_clean":"2024-02-19T06:57:57.297341+0000","last_became_active":"2024-02-19T06:57:54.847632+0000","last_became_peered":"2024-02-19T06:57:54.847632+0000","last_unstale":"2024-02-19T06:57:57.297341+0000","last_undegraded":"2024-02-19T06:57:57.297341+0000","last_fullsized":"2024-02-19T06:57:57.297341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:04:53.869596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297229+0000","last_change":"2024-02-19T06:57:55.873869+0000","last_active":"2024-02-19T06:57:57.297229+0000","last_peered":"2024-02-19T06:57:57.297229+0000","last_clean":"2024-02-19T06:57:57.297229+0000","last_became_active":"2024-02-19T06:57:55.873711+0000","last_became_peered":"2024-02-19T06:57:55.873711+0000","last_unstale":"2024-02-19T06:57:57.297229+0000","last_undegraded":"2024-02-19T06:57:57.297229+0000","last_fullsized":"2024-02-19T06:57:57.297229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:19:13.712235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296492+0000","last_change":"2024-02-19T06:57:54.846614+0000","last_active":"2024-02-19T06:57:57.296492+0000","last_peered":"2024-02-19T06:57:57.296492+0000","last_clean":"2024-02-19T06:57:57.296492+0000","last_became_active":"2024-02-19T06:57:54.846293+0000","last_became_peered":"2024-02-19T06:57:54.846293+0000","last_unstale":"2024-02-19T06:57:57.296492+0000","last_undegraded":"2024-02-19T06:57:57.296492+0000","last_fullsized":"2024-02-19T06:57:57.296492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:14:50.279754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":79738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7969999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.865}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6719999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":78216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.855}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7649999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":669076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":78252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7290000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8939999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":78126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":78286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6850000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5670000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":669132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T06:58:00.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-19T06:58:00.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.631+0000 7fc48f200640 1 Processor -- start 2024-02-19T06:58:00.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.631+0000 7fc48f200640 1 -- start start 2024-02-19T06:58:00.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.633+0000 7fc48f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc49015b540 0x7fc4900cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:00.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.633+0000 7fc48f200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc4900cb150 0x7fc4900cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:00.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.633+0000 7fc48f200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4900cb5f0 con 0x7fc49015fd50 2024-02-19T06:58:00.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.633+0000 7fc48f200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49015f270 con 0x7fc4900cb150 2024-02-19T06:58:00.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.633+0000 7fc48f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49015f550 con 0x7fc49015b540 2024-02-19T06:58:00.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.633+0000 7fc48e800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc49015fd50 0x7fc4900c99a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53174/0 (socket says 172.21.15.46:53174) 2024-02-19T06:58:00.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.633+0000 7fc48e800640 1 -- 172.21.15.46:0/417874859 learned_addr learned my addr 172.21.15.46:0/417874859 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:00.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.633+0000 7fc487e00640 1 --2- 172.21.15.46:0/417874859 >> v2:172.21.15.142:3300/0 conn(0x7fc4900cb150 0x7fc4900cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:00.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.634+0000 7fc48de00640 1 --2- 172.21.15.46:0/417874859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc49015b540 0x7fc4900cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:00.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.634+0000 7fc48d400640 1 -- 172.21.15.46:0/417874859 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72288338 0 0) 0x7fc4900cb5f0 con 0x7fc49015fd50 2024-02-19T06:58:00.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.634+0000 7fc48d400640 1 -- 172.21.15.46:0/417874859 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc474003520 con 0x7fc49015fd50 2024-02-19T06:58:00.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.634+0000 7fc487e00640 1 -- 172.21.15.46:0/417874859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc49015b540 msgr2=0x7fc4900cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:00.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.634+0000 7fc487e00640 1 --2- 172.21.15.46:0/417874859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc49015b540 0x7fc4900cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.634+0000 7fc487e00640 1 -- 172.21.15.46:0/417874859 >> v1:172.21.15.46:6789/0 conn(0x7fc49015fd50 legacy=0x7fc4900c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:00.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.634+0000 7fc487e00640 1 -- 172.21.15.46:0/417874859 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49015f830 con 0x7fc4900cb150 2024-02-19T06:58:00.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.636+0000 7fc487e00640 1 --2- 172.21.15.46:0/417874859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4900cb150 0x7fc4900cf740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc4780097a0 tx=0x7fc47802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c356ba3f58636c11 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:00.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.636+0000 7fc48d400640 1 -- 172.21.15.46:0/417874859 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47802d040 con 0x7fc4900cb150 2024-02-19T06:58:00.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.636+0000 7fc48d400640 1 -- 172.21.15.46:0/417874859 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc478031810 con 0x7fc4900cb150 2024-02-19T06:58:00.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.636+0000 7fc48d400640 1 -- 172.21.15.46:0/417874859 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc478031ba0 con 0x7fc4900cb150 2024-02-19T06:58:00.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.637+0000 7fc48f200640 1 -- 172.21.15.46:0/417874859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4900cb150 msgr2=0x7fc4900cf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:00.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.637+0000 7fc48f200640 1 --2- 172.21.15.46:0/417874859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4900cb150 0x7fc4900cf740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc4780097a0 tx=0x7fc47802b8b0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.637+0000 7fc48f200640 1 -- 172.21.15.46:0/417874859 shutdown_connections 2024-02-19T06:58:00.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.637+0000 7fc48f200640 1 --2- 172.21.15.46:0/417874859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4900cb150 0x7fc4900cf740 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.637+0000 7fc48f200640 1 --2- 172.21.15.46:0/417874859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc49015b540 0x7fc4900cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.637+0000 7fc48f200640 1 -- 172.21.15.46:0/417874859 >> 172.21.15.46:0/417874859 conn(0x7fc49006afa0 msgr2=0x7fc49006b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:00.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.637+0000 7fc48f200640 1 -- 172.21.15.46:0/417874859 shutdown_connections 2024-02-19T06:58:00.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.637+0000 7fc48f200640 1 -- 172.21.15.46:0/417874859 wait complete. 2024-02-19T06:58:00.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.639+0000 7fc48f200640 1 Processor -- start 2024-02-19T06:58:00.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.639+0000 7fc48f200640 1 -- start start 2024-02-19T06:58:00.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc48f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4900cb150 0x7fc4901f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:00.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc48f200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc49015b540 0x7fc49014b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:00.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc48f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49015fd50 0x7fc49006e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:00.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc48f200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49015d320 con 0x7fc49015b540 2024-02-19T06:58:00.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc48f200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49015ce40 con 0x7fc49015fd50 2024-02-19T06:58:00.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc48f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900ad0e0 con 0x7fc4900cb150 2024-02-19T06:58:00.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc487e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc49015b540 0x7fc49014b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:00.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc487e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc49015b540 0x7fc49014b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38012/0 (socket says 172.21.15.46:38012) 2024-02-19T06:58:00.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc487e00640 1 -- 172.21.15.46:0/392263295 learned_addr learned my addr 172.21.15.46:0/392263295 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc48de00640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4900cb150 0x7fc4901f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc48e800640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49015fd50 0x7fc49006e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc487e00640 1 -- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4900cb150 msgr2=0x7fc4901f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc487e00640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4900cb150 0x7fc4901f3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc487e00640 1 -- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49015fd50 msgr2=0x7fc49006e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc487e00640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49015fd50 0x7fc49006e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc487e00640 1 -- 172.21.15.46:0/392263295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc478009400 con 0x7fc49015b540 2024-02-19T06:58:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.640+0000 7fc48de00640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4900cb150 0x7fc4901f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.641+0000 7fc487e00640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc49015b540 0x7fc49014b9b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4780098c0 tx=0x7fc4780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.641+0000 7fc486000640 1 -- 172.21.15.46:0/392263295 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47803ad60 con 0x7fc49015b540 2024-02-19T06:58:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.641+0000 7fc486000640 1 -- 172.21.15.46:0/392263295 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc478044400 con 0x7fc49015b540 2024-02-19T06:58:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.641+0000 7fc486000640 1 -- 172.21.15.46:0/392263295 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780445b0 con 0x7fc49015b540 2024-02-19T06:58:00.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.641+0000 7fc48f200640 1 -- 172.21.15.46:0/392263295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49014bef0 con 0x7fc49015b540 2024-02-19T06:58:00.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.641+0000 7fc48f200640 1 -- 172.21.15.46:0/392263295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4900acb20 con 0x7fc49015b540 2024-02-19T06:58:00.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.643+0000 7fc48f200640 1 -- 172.21.15.46:0/392263295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49015cc80 con 0x7fc49015b540 2024-02-19T06:58:00.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.643+0000 7fc486000640 1 -- 172.21.15.46:0/392263295 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc47804d440 con 0x7fc49015b540 2024-02-19T06:58:00.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.644+0000 7fc486000640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc46c06b840 0x7fc46c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:00.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.644+0000 7fc486000640 1 -- 172.21.15.46:0/392263295 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4780ac310 con 0x7fc49015b540 2024-02-19T06:58:00.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.645+0000 7fc48de00640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc46c06b840 0x7fc46c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:00.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.646+0000 7fc48de00640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc46c06b840 0x7fc46c06dd00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc480009ac0 tx=0x7fc480008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:00.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.649+0000 7fc486000640 1 -- 172.21.15.46:0/392263295 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc478076ee0 con 0x7fc49015b540 2024-02-19T06:58:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.847+0000 7fc48f200640 1 -- 172.21.15.46:0/392263295 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4900b21e0 con 0x7fc46c06b840 2024-02-19T06:58:00.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.864+0000 7fc486000640 1 -- 172.21.15.46:0/392263295 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264499 (secure 0 0 0) 0x7fc4900b21e0 con 0x7fc46c06b840 2024-02-19T06:58:00.871 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:00.873 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-02-19T06:58:00.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.870+0000 7fc48f200640 1 -- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc46c06b840 msgr2=0x7fc46c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:00.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.870+0000 7fc48f200640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc46c06b840 0x7fc46c06dd00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc480009ac0 tx=0x7fc480008040 comp rx=0 tx=0).stop 2024-02-19T06:58:00.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.870+0000 7fc48f200640 1 -- 172.21.15.46:0/392263295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc49015b540 msgr2=0x7fc49014b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:00.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.870+0000 7fc48f200640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc49015b540 0x7fc49014b9b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4780098c0 tx=0x7fc4780046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.870+0000 7fc48f200640 1 -- 172.21.15.46:0/392263295 shutdown_connections 2024-02-19T06:58:00.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.870+0000 7fc48f200640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc46c06b840 0x7fc46c06dd00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.870+0000 7fc48f200640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49015fd50 0x7fc49006e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.870+0000 7fc48f200640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc49015b540 0x7fc49014b9b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.870+0000 7fc48f200640 1 --2- 172.21.15.46:0/392263295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4900cb150 0x7fc4901f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:00.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.870+0000 7fc48f200640 1 -- 172.21.15.46:0/392263295 >> 172.21.15.46:0/392263295 conn(0x7fc49006afa0 msgr2=0x7fc4901570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:00.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.870+0000 7fc48f200640 1 -- 172.21.15.46:0/392263295 shutdown_connections 2024-02-19T06:58:00.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:00.870+0000 7fc48f200640 1 -- 172.21.15.46:0/392263295 wait complete. 2024-02-19T06:58:00.892 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-02-19T06:57:59.668786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235764,"kb_used_data":2940,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738956,"statfs":{"total":773094113280,"available":772852690944,"internally_reserved":0,"allocated":3010560,"data_stored":1804264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.868542"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843569+0000","last_change":"2024-02-19T06:57:55.881582+0000","last_active":"2024-02-19T06:57:56.843569+0000","last_peered":"2024-02-19T06:57:56.843569+0000","last_clean":"2024-02-19T06:57:56.843569+0000","last_became_active":"2024-02-19T06:57:55.880789+0000","last_became_peered":"2024-02-19T06:57:55.880789+0000","last_unstale":"2024-02-19T06:57:56.843569+0000","last_undegraded":"2024-02-19T06:57:56.843569+0000","last_fullsized":"2024-02-19T06:57:56.843569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:24:57.181299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838514+0000","last_change":"2024-02-19T06:57:55.875781+0000","last_active":"2024-02-19T06:57:56.838514+0000","last_peered":"2024-02-19T06:57:56.838514+0000","last_clean":"2024-02-19T06:57:56.838514+0000","last_became_active":"2024-02-19T06:57:55.875457+0000","last_became_peered":"2024-02-19T06:57:55.875457+0000","last_unstale":"2024-02-19T06:57:56.838514+0000","last_undegraded":"2024-02-19T06:57:56.838514+0000","last_fullsized":"2024-02-19T06:57:56.838514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296432+0000","last_change":"2024-02-19T06:57:55.879795+0000","last_active":"2024-02-19T06:57:57.296432+0000","last_peered":"2024-02-19T06:57:57.296432+0000","last_clean":"2024-02-19T06:57:57.296432+0000","last_became_active":"2024-02-19T06:57:55.879476+0000","last_became_peered":"2024-02-19T06:57:55.879476+0000","last_unstale":"2024-02-19T06:57:57.296432+0000","last_undegraded":"2024-02-19T06:57:57.296432+0000","last_fullsized":"2024-02-19T06:57:57.296432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:26:02.934116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297501+0000","last_change":"2024-02-19T06:57:55.863246+0000","last_active":"2024-02-19T06:57:57.297501+0000","last_peered":"2024-02-19T06:57:57.297501+0000","last_clean":"2024-02-19T06:57:57.297501+0000","last_became_active":"2024-02-19T06:57:55.862759+0000","last_became_peered":"2024-02-19T06:57:55.862759+0000","last_unstale":"2024-02-19T06:57:57.297501+0000","last_undegraded":"2024-02-19T06:57:57.297501+0000","last_fullsized":"2024-02-19T06:57:57.297501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:02:01.947104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841155+0000","last_change":"2024-02-19T06:57:55.857896+0000","last_active":"2024-02-19T06:57:56.841155+0000","last_peered":"2024-02-19T06:57:56.841155+0000","last_clean":"2024-02-19T06:57:56.841155+0000","last_became_active":"2024-02-19T06:57:55.857608+0000","last_became_peered":"2024-02-19T06:57:55.857608+0000","last_unstale":"2024-02-19T06:57:56.841155+0000","last_undegraded":"2024-02-19T06:57:56.841155+0000","last_fullsized":"2024-02-19T06:57:56.841155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:24:14.106586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296899+0000","last_change":"2024-02-19T06:57:55.867450+0000","last_active":"2024-02-19T06:57:57.296899+0000","last_peered":"2024-02-19T06:57:57.296899+0000","last_clean":"2024-02-19T06:57:57.296899+0000","last_became_active":"2024-02-19T06:57:55.867181+0000","last_became_peered":"2024-02-19T06:57:55.867181+0000","last_unstale":"2024-02-19T06:57:57.296899+0000","last_undegraded":"2024-02-19T06:57:57.296899+0000","last_fullsized":"2024-02-19T06:57:57.296899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.840561+0000","last_change":"2024-02-19T06:57:55.870845+0000","last_active":"2024-02-19T06:57:56.840561+0000","last_peered":"2024-02-19T06:57:56.840561+0000","last_clean":"2024-02-19T06:57:56.840561+0000","last_became_active":"2024-02-19T06:57:55.870532+0000","last_became_peered":"2024-02-19T06:57:55.870532+0000","last_unstale":"2024-02-19T06:57:56.840561+0000","last_undegraded":"2024-02-19T06:57:56.840561+0000","last_fullsized":"2024-02-19T06:57:56.840561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:32:16.779230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297147+0000","last_change":"2024-02-19T06:57:55.869272+0000","last_active":"2024-02-19T06:57:57.297147+0000","last_peered":"2024-02-19T06:57:57.297147+0000","last_clean":"2024-02-19T06:57:57.297147+0000","last_became_active":"2024-02-19T06:57:55.867903+0000","last_became_peered":"2024-02-19T06:57:55.867903+0000","last_unstale":"2024-02-19T06:57:57.297147+0000","last_undegraded":"2024-02-19T06:57:57.297147+0000","last_fullsized":"2024-02-19T06:57:57.297147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:33:37.227028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843541+0000","last_change":"2024-02-19T06:57:55.869047+0000","last_active":"2024-02-19T06:57:56.843541+0000","last_peered":"2024-02-19T06:57:56.843541+0000","last_clean":"2024-02-19T06:57:56.843541+0000","last_became_active":"2024-02-19T06:57:55.868781+0000","last_became_peered":"2024-02-19T06:57:55.868781+0000","last_unstale":"2024-02-19T06:57:56.843541+0000","last_undegraded":"2024-02-19T06:57:56.843541+0000","last_fullsized":"2024-02-19T06:57:56.843541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:47:51.163933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299489+0000","last_change":"2024-02-19T06:57:55.878539+0000","last_active":"2024-02-19T06:57:57.299489+0000","last_peered":"2024-02-19T06:57:57.299489+0000","last_clean":"2024-02-19T06:57:57.299489+0000","last_became_active":"2024-02-19T06:57:55.877859+0000","last_became_peered":"2024-02-19T06:57:55.877859+0000","last_unstale":"2024-02-19T06:57:57.299489+0000","last_undegraded":"2024-02-19T06:57:57.299489+0000","last_fullsized":"2024-02-19T06:57:57.299489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299028+0000","last_change":"2024-02-19T06:57:55.876129+0000","last_active":"2024-02-19T06:57:57.299028+0000","last_peered":"2024-02-19T06:57:57.299028+0000","last_clean":"2024-02-19T06:57:57.299028+0000","last_became_active":"2024-02-19T06:57:55.875481+0000","last_became_peered":"2024-02-19T06:57:55.875481+0000","last_unstale":"2024-02-19T06:57:57.299028+0000","last_undegraded":"2024-02-19T06:57:57.299028+0000","last_fullsized":"2024-02-19T06:57:57.299028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842411+0000","last_change":"2024-02-19T06:57:55.879728+0000","last_active":"2024-02-19T06:57:56.842411+0000","last_peered":"2024-02-19T06:57:56.842411+0000","last_clean":"2024-02-19T06:57:56.842411+0000","last_became_active":"2024-02-19T06:57:55.878922+0000","last_became_peered":"2024-02-19T06:57:55.878922+0000","last_unstale":"2024-02-19T06:57:56.842411+0000","last_undegraded":"2024-02-19T06:57:56.842411+0000","last_fullsized":"2024-02-19T06:57:56.842411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:42:35.923860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298289+0000","last_change":"2024-02-19T06:57:55.863333+0000","last_active":"2024-02-19T06:57:57.298289+0000","last_peered":"2024-02-19T06:57:57.298289+0000","last_clean":"2024-02-19T06:57:57.298289+0000","last_became_active":"2024-02-19T06:57:55.863137+0000","last_became_peered":"2024-02-19T06:57:55.863137+0000","last_unstale":"2024-02-19T06:57:57.298289+0000","last_undegraded":"2024-02-19T06:57:57.298289+0000","last_fullsized":"2024-02-19T06:57:57.298289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:16:45.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296260+0000","last_change":"2024-02-19T06:57:55.870376+0000","last_active":"2024-02-19T06:57:57.296260+0000","last_peered":"2024-02-19T06:57:57.296260+0000","last_clean":"2024-02-19T06:57:57.296260+0000","last_became_active":"2024-02-19T06:57:55.865453+0000","last_became_peered":"2024-02-19T06:57:55.865453+0000","last_unstale":"2024-02-19T06:57:57.296260+0000","last_undegraded":"2024-02-19T06:57:57.296260+0000","last_fullsized":"2024-02-19T06:57:57.296260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:10:54.622454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838056+0000","last_change":"2024-02-19T06:57:55.866944+0000","last_active":"2024-02-19T06:57:56.838056+0000","last_peered":"2024-02-19T06:57:56.838056+0000","last_clean":"2024-02-19T06:57:56.838056+0000","last_became_active":"2024-02-19T06:57:55.866168+0000","last_became_peered":"2024-02-19T06:57:55.866168+0000","last_unstale":"2024-02-19T06:57:56.838056+0000","last_undegraded":"2024-02-19T06:57:56.838056+0000","last_fullsized":"2024-02-19T06:57:56.838056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:33:37.227028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296615+0000","last_change":"2024-02-19T06:57:55.866999+0000","last_active":"2024-02-19T06:57:57.296615+0000","last_peered":"2024-02-19T06:57:57.296615+0000","last_clean":"2024-02-19T06:57:57.296615+0000","last_became_active":"2024-02-19T06:57:55.866721+0000","last_became_peered":"2024-02-19T06:57:55.866721+0000","last_unstale":"2024-02-19T06:57:57.296615+0000","last_undegraded":"2024-02-19T06:57:57.296615+0000","last_fullsized":"2024-02-19T06:57:57.296615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299188+0000","last_change":"2024-02-19T06:57:55.855201+0000","last_active":"2024-02-19T06:57:57.299188+0000","last_peered":"2024-02-19T06:57:57.299188+0000","last_clean":"2024-02-19T06:57:57.299188+0000","last_became_active":"2024-02-19T06:57:55.854955+0000","last_became_peered":"2024-02-19T06:57:55.854955+0000","last_unstale":"2024-02-19T06:57:57.299188+0000","last_undegraded":"2024-02-19T06:57:57.299188+0000","last_fullsized":"2024-02-19T06:57:57.299188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:44:06.998192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298443+0000","last_change":"2024-02-19T06:57:55.876606+0000","last_active":"2024-02-19T06:57:57.298443+0000","last_peered":"2024-02-19T06:57:57.298443+0000","last_clean":"2024-02-19T06:57:57.298443+0000","last_became_active":"2024-02-19T06:57:55.876334+0000","last_became_peered":"2024-02-19T06:57:55.876334+0000","last_unstale":"2024-02-19T06:57:57.298443+0000","last_undegraded":"2024-02-19T06:57:57.298443+0000","last_fullsized":"2024-02-19T06:57:57.298443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:34:02.546590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843210+0000","last_change":"2024-02-19T06:57:55.861233+0000","last_active":"2024-02-19T06:57:56.843210+0000","last_peered":"2024-02-19T06:57:56.843210+0000","last_clean":"2024-02-19T06:57:56.843210+0000","last_became_active":"2024-02-19T06:57:55.860849+0000","last_became_peered":"2024-02-19T06:57:55.860849+0000","last_unstale":"2024-02-19T06:57:56.843210+0000","last_undegraded":"2024-02-19T06:57:56.843210+0000","last_fullsized":"2024-02-19T06:57:56.843210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:58:02.081784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298883+0000","last_change":"2024-02-19T06:57:55.879542+0000","last_active":"2024-02-19T06:57:57.298883+0000","last_peered":"2024-02-19T06:57:57.298883+0000","last_clean":"2024-02-19T06:57:57.298883+0000","last_became_active":"2024-02-19T06:57:55.876325+0000","last_became_peered":"2024-02-19T06:57:55.876325+0000","last_unstale":"2024-02-19T06:57:57.298883+0000","last_undegraded":"2024-02-19T06:57:57.298883+0000","last_fullsized":"2024-02-19T06:57:57.298883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:19:13.712235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296072+0000","last_change":"2024-02-19T06:57:55.882287+0000","last_active":"2024-02-19T06:57:57.296072+0000","last_peered":"2024-02-19T06:57:57.296072+0000","last_clean":"2024-02-19T06:57:57.296072+0000","last_became_active":"2024-02-19T06:57:55.881847+0000","last_became_peered":"2024-02-19T06:57:55.881847+0000","last_unstale":"2024-02-19T06:57:57.296072+0000","last_undegraded":"2024-02-19T06:57:57.296072+0000","last_fullsized":"2024-02-19T06:57:57.296072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:26:43.190851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297087+0000","last_change":"2024-02-19T06:57:55.855047+0000","last_active":"2024-02-19T06:57:57.297087+0000","last_peered":"2024-02-19T06:57:57.297087+0000","last_clean":"2024-02-19T06:57:57.297087+0000","last_became_active":"2024-02-19T06:57:55.854699+0000","last_became_peered":"2024-02-19T06:57:55.854699+0000","last_unstale":"2024-02-19T06:57:57.297087+0000","last_undegraded":"2024-02-19T06:57:57.297087+0000","last_fullsized":"2024-02-19T06:57:57.297087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:16:45.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297920+0000","last_change":"2024-02-19T06:57:55.869732+0000","last_active":"2024-02-19T06:57:57.297920+0000","last_peered":"2024-02-19T06:57:57.297920+0000","last_clean":"2024-02-19T06:57:57.297920+0000","last_became_active":"2024-02-19T06:57:55.869159+0000","last_became_peered":"2024-02-19T06:57:55.869159+0000","last_unstale":"2024-02-19T06:57:57.297920+0000","last_undegraded":"2024-02-19T06:57:57.297920+0000","last_fullsized":"2024-02-19T06:57:57.297920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296891+0000","last_change":"2024-02-19T06:57:55.863170+0000","last_active":"2024-02-19T06:57:57.296891+0000","last_peered":"2024-02-19T06:57:57.296891+0000","last_clean":"2024-02-19T06:57:57.296891+0000","last_became_active":"2024-02-19T06:57:55.862285+0000","last_became_peered":"2024-02-19T06:57:55.862285+0000","last_unstale":"2024-02-19T06:57:57.296891+0000","last_undegraded":"2024-02-19T06:57:57.296891+0000","last_fullsized":"2024-02-19T06:57:57.296891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299100+0000","last_change":"2024-02-19T06:57:55.869627+0000","last_active":"2024-02-19T06:57:57.299100+0000","last_peered":"2024-02-19T06:57:57.299100+0000","last_clean":"2024-02-19T06:57:57.299100+0000","last_became_active":"2024-02-19T06:57:55.869305+0000","last_became_peered":"2024-02-19T06:57:55.869305+0000","last_unstale":"2024-02-19T06:57:57.299100+0000","last_undegraded":"2024-02-19T06:57:57.299100+0000","last_fullsized":"2024-02-19T06:57:57.299100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:02:01.947104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299832+0000","last_change":"2024-02-19T06:57:55.872539+0000","last_active":"2024-02-19T06:57:57.299832+0000","last_peered":"2024-02-19T06:57:57.299832+0000","last_clean":"2024-02-19T06:57:57.299832+0000","last_became_active":"2024-02-19T06:57:55.871775+0000","last_became_peered":"2024-02-19T06:57:55.871775+0000","last_unstale":"2024-02-19T06:57:57.299832+0000","last_undegraded":"2024-02-19T06:57:57.299832+0000","last_fullsized":"2024-02-19T06:57:57.299832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838731+0000","last_change":"2024-02-19T06:57:55.864536+0000","last_active":"2024-02-19T06:57:56.838731+0000","last_peered":"2024-02-19T06:57:56.838731+0000","last_clean":"2024-02-19T06:57:56.838731+0000","last_became_active":"2024-02-19T06:57:55.864079+0000","last_became_peered":"2024-02-19T06:57:55.864079+0000","last_unstale":"2024-02-19T06:57:56.838731+0000","last_undegraded":"2024-02-19T06:57:56.838731+0000","last_fullsized":"2024-02-19T06:57:56.838731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296866+0000","last_change":"2024-02-19T06:57:55.868409+0000","last_active":"2024-02-19T06:57:57.296866+0000","last_peered":"2024-02-19T06:57:57.296866+0000","last_clean":"2024-02-19T06:57:57.296866+0000","last_became_active":"2024-02-19T06:57:55.868136+0000","last_became_peered":"2024-02-19T06:57:55.868136+0000","last_unstale":"2024-02-19T06:57:57.296866+0000","last_undegraded":"2024-02-19T06:57:57.296866+0000","last_fullsized":"2024-02-19T06:57:57.296866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:36:55.635583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296486+0000","last_change":"2024-02-19T06:57:55.883330+0000","last_active":"2024-02-19T06:57:57.296486+0000","last_peered":"2024-02-19T06:57:57.296486+0000","last_clean":"2024-02-19T06:57:57.296486+0000","last_became_active":"2024-02-19T06:57:55.881827+0000","last_became_peered":"2024-02-19T06:57:55.881827+0000","last_unstale":"2024-02-19T06:57:57.296486+0000","last_undegraded":"2024-02-19T06:57:57.296486+0000","last_fullsized":"2024-02-19T06:57:57.296486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:30:53.058177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297284+0000","last_change":"2024-02-19T06:57:55.869285+0000","last_active":"2024-02-19T06:57:57.297284+0000","last_peered":"2024-02-19T06:57:57.297284+0000","last_clean":"2024-02-19T06:57:57.297284+0000","last_became_active":"2024-02-19T06:57:55.868584+0000","last_became_peered":"2024-02-19T06:57:55.868584+0000","last_unstale":"2024-02-19T06:57:57.297284+0000","last_undegraded":"2024-02-19T06:57:57.297284+0000","last_fullsized":"2024-02-19T06:57:57.297284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:19:34.393218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297058+0000","last_change":"2024-02-19T06:57:55.859224+0000","last_active":"2024-02-19T06:57:57.297058+0000","last_peered":"2024-02-19T06:57:57.297058+0000","last_clean":"2024-02-19T06:57:57.297058+0000","last_became_active":"2024-02-19T06:57:55.858917+0000","last_became_peered":"2024-02-19T06:57:55.858917+0000","last_unstale":"2024-02-19T06:57:57.297058+0000","last_undegraded":"2024-02-19T06:57:57.297058+0000","last_fullsized":"2024-02-19T06:57:57.297058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T06:59:02.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297505+0000","last_change":"2024-02-19T06:57:55.874779+0000","last_active":"2024-02-19T06:57:57.297505+0000","last_peered":"2024-02-19T06:57:57.297505+0000","last_clean":"2024-02-19T06:57:57.297505+0000","last_became_active":"2024-02-19T06:57:55.868999+0000","last_became_peered":"2024-02-19T06:57:55.868999+0000","last_unstale":"2024-02-19T06:57:57.297505+0000","last_undegraded":"2024-02-19T06:57:57.297505+0000","last_fullsized":"2024-02-19T06:57:57.297505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:36:55.635583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.840892+0000","last_change":"2024-02-19T06:57:55.848789+0000","last_active":"2024-02-19T06:57:56.840892+0000","last_peered":"2024-02-19T06:57:56.840892+0000","last_clean":"2024-02-19T06:57:56.840892+0000","last_became_active":"2024-02-19T06:57:55.848272+0000","last_became_peered":"2024-02-19T06:57:55.848272+0000","last_unstale":"2024-02-19T06:57:56.840892+0000","last_undegraded":"2024-02-19T06:57:56.840892+0000","last_fullsized":"2024-02-19T06:57:56.840892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:31:25.479236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298851+0000","last_change":"2024-02-19T06:57:54.848533+0000","last_active":"2024-02-19T06:57:57.298851+0000","last_peered":"2024-02-19T06:57:57.298851+0000","last_clean":"2024-02-19T06:57:57.298851+0000","last_became_active":"2024-02-19T06:57:54.847588+0000","last_became_peered":"2024-02-19T06:57:54.847588+0000","last_unstale":"2024-02-19T06:57:57.298851+0000","last_undegraded":"2024-02-19T06:57:57.298851+0000","last_fullsized":"2024-02-19T06:57:57.298851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:48:35.345147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296871+0000","last_change":"2024-02-19T06:57:55.873153+0000","last_active":"2024-02-19T06:57:57.296871+0000","last_peered":"2024-02-19T06:57:57.296871+0000","last_clean":"2024-02-19T06:57:57.296871+0000","last_became_active":"2024-02-19T06:57:55.872845+0000","last_became_peered":"2024-02-19T06:57:55.872845+0000","last_unstale":"2024-02-19T06:57:57.296871+0000","last_undegraded":"2024-02-19T06:57:57.296871+0000","last_fullsized":"2024-02-19T06:57:57.296871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:38:12.022068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298413+0000","last_change":"2024-02-19T06:57:54.845309+0000","last_active":"2024-02-19T06:57:57.298413+0000","last_peered":"2024-02-19T06:57:57.298413+0000","last_clean":"2024-02-19T06:57:57.298413+0000","last_became_active":"2024-02-19T06:57:54.845046+0000","last_became_peered":"2024-02-19T06:57:54.845046+0000","last_unstale":"2024-02-19T06:57:57.298413+0000","last_undegraded":"2024-02-19T06:57:57.298413+0000","last_fullsized":"2024-02-19T06:57:57.298413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:04:53.869596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298172+0000","last_change":"2024-02-19T06:57:54.853227+0000","last_active":"2024-02-19T06:57:57.298172+0000","last_peered":"2024-02-19T06:57:57.298172+0000","last_clean":"2024-02-19T06:57:57.298172+0000","last_became_active":"2024-02-19T06:57:54.852992+0000","last_became_peered":"2024-02-19T06:57:54.852992+0000","last_unstale":"2024-02-19T06:57:57.298172+0000","last_undegraded":"2024-02-19T06:57:57.298172+0000","last_fullsized":"2024-02-19T06:57:57.298172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:28:51.362957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297490+0000","last_change":"2024-02-19T06:57:55.867102+0000","last_active":"2024-02-19T06:57:57.297490+0000","last_peered":"2024-02-19T06:57:57.297490+0000","last_clean":"2024-02-19T06:57:57.297490+0000","last_became_active":"2024-02-19T06:57:55.866831+0000","last_became_peered":"2024-02-19T06:57:55.866831+0000","last_unstale":"2024-02-19T06:57:57.297490+0000","last_undegraded":"2024-02-19T06:57:57.297490+0000","last_fullsized":"2024-02-19T06:57:57.297490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298008+0000","last_change":"2024-02-19T06:57:54.836938+0000","last_active":"2024-02-19T06:57:57.298008+0000","last_peered":"2024-02-19T06:57:57.298008+0000","last_clean":"2024-02-19T06:57:57.298008+0000","last_became_active":"2024-02-19T06:57:54.836538+0000","last_became_peered":"2024-02-19T06:57:54.836538+0000","last_unstale":"2024-02-19T06:57:57.298008+0000","last_undegraded":"2024-02-19T06:57:57.298008+0000","last_fullsized":"2024-02-19T06:57:57.298008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:44:55.409988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838441+0000","last_change":"2024-02-19T06:57:55.857240+0000","last_active":"2024-02-19T06:57:56.838441+0000","last_peered":"2024-02-19T06:57:56.838441+0000","last_clean":"2024-02-19T06:57:56.838441+0000","last_became_active":"2024-02-19T06:57:55.856505+0000","last_became_peered":"2024-02-19T06:57:55.856505+0000","last_unstale":"2024-02-19T06:57:56.838441+0000","last_undegraded":"2024-02-19T06:57:56.838441+0000","last_fullsized":"2024-02-19T06:57:56.838441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299283+0000","last_change":"2024-02-19T06:57:54.849649+0000","last_active":"2024-02-19T06:57:57.299283+0000","last_peered":"2024-02-19T06:57:57.299283+0000","last_clean":"2024-02-19T06:57:57.299283+0000","last_became_active":"2024-02-19T06:57:54.848543+0000","last_became_peered":"2024-02-19T06:57:54.848543+0000","last_unstale":"2024-02-19T06:57:57.299283+0000","last_undegraded":"2024-02-19T06:57:57.299283+0000","last_fullsized":"2024-02-19T06:57:57.299283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:59:11.619972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299748+0000","last_change":"2024-02-19T06:57:55.856202+0000","last_active":"2024-02-19T06:57:57.299748+0000","last_peered":"2024-02-19T06:57:57.299748+0000","last_clean":"2024-02-19T06:57:57.299748+0000","last_became_active":"2024-02-19T06:57:55.855896+0000","last_became_peered":"2024-02-19T06:57:55.855896+0000","last_unstale":"2024-02-19T06:57:57.299748+0000","last_undegraded":"2024-02-19T06:57:57.299748+0000","last_fullsized":"2024-02-19T06:57:57.299748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:58:48.198207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298578+0000","last_change":"2024-02-19T06:57:54.849568+0000","last_active":"2024-02-19T06:57:57.298578+0000","last_peered":"2024-02-19T06:57:57.298578+0000","last_clean":"2024-02-19T06:57:57.298578+0000","last_became_active":"2024-02-19T06:57:54.849259+0000","last_became_peered":"2024-02-19T06:57:54.849259+0000","last_unstale":"2024-02-19T06:57:57.298578+0000","last_undegraded":"2024-02-19T06:57:57.298578+0000","last_fullsized":"2024-02-19T06:57:57.298578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:59:11.619972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296283+0000","last_change":"2024-02-19T06:57:55.879987+0000","last_active":"2024-02-19T06:57:57.296283+0000","last_peered":"2024-02-19T06:57:57.296283+0000","last_clean":"2024-02-19T06:57:57.296283+0000","last_became_active":"2024-02-19T06:57:55.874213+0000","last_became_peered":"2024-02-19T06:57:55.874213+0000","last_unstale":"2024-02-19T06:57:57.296283+0000","last_undegraded":"2024-02-19T06:57:57.296283+0000","last_fullsized":"2024-02-19T06:57:57.296283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:13:00.717755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838753+0000","last_change":"2024-02-19T06:57:54.842446+0000","last_active":"2024-02-19T06:57:56.838753+0000","last_peered":"2024-02-19T06:57:56.838753+0000","last_clean":"2024-02-19T06:57:56.838753+0000","last_became_active":"2024-02-19T06:57:54.842159+0000","last_became_peered":"2024-02-19T06:57:54.842159+0000","last_unstale":"2024-02-19T06:57:56.838753+0000","last_undegraded":"2024-02-19T06:57:56.838753+0000","last_fullsized":"2024-02-19T06:57:56.838753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:59:42.541017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842413+0000","last_change":"2024-02-19T06:57:55.861662+0000","last_active":"2024-02-19T06:57:56.842413+0000","last_peered":"2024-02-19T06:57:56.842413+0000","last_clean":"2024-02-19T06:57:56.842413+0000","last_became_active":"2024-02-19T06:57:55.861272+0000","last_became_peered":"2024-02-19T06:57:55.861272+0000","last_unstale":"2024-02-19T06:57:56.842413+0000","last_undegraded":"2024-02-19T06:57:56.842413+0000","last_fullsized":"2024-02-19T06:57:56.842413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:34:02.546590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298720+0000","last_change":"2024-02-19T06:57:54.848390+0000","last_active":"2024-02-19T06:57:57.298720+0000","last_peered":"2024-02-19T06:57:57.298720+0000","last_clean":"2024-02-19T06:57:57.298720+0000","last_became_active":"2024-02-19T06:57:54.848036+0000","last_became_peered":"2024-02-19T06:57:54.848036+0000","last_unstale":"2024-02-19T06:57:57.298720+0000","last_undegraded":"2024-02-19T06:57:57.298720+0000","last_fullsized":"2024-02-19T06:57:57.298720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:44:55.409988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841529+0000","last_change":"2024-02-19T06:57:55.865916+0000","last_active":"2024-02-19T06:57:56.841529+0000","last_peered":"2024-02-19T06:57:56.841529+0000","last_clean":"2024-02-19T06:57:56.841529+0000","last_became_active":"2024-02-19T06:57:55.865239+0000","last_became_peered":"2024-02-19T06:57:55.865239+0000","last_unstale":"2024-02-19T06:57:56.841529+0000","last_undegraded":"2024-02-19T06:57:56.841529+0000","last_fullsized":"2024-02-19T06:57:56.841529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:22:32.626274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297160+0000","last_change":"2024-02-19T06:57:54.845625+0000","last_active":"2024-02-19T06:57:57.297160+0000","last_peered":"2024-02-19T06:57:57.297160+0000","last_clean":"2024-02-19T06:57:57.297160+0000","last_became_active":"2024-02-19T06:57:54.845135+0000","last_became_peered":"2024-02-19T06:57:54.845135+0000","last_unstale":"2024-02-19T06:57:57.297160+0000","last_undegraded":"2024-02-19T06:57:57.297160+0000","last_fullsized":"2024-02-19T06:57:57.297160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:31:12.486420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296648+0000","last_change":"2024-02-19T06:57:55.879354+0000","last_active":"2024-02-19T06:57:57.296648+0000","last_peered":"2024-02-19T06:57:57.296648+0000","last_clean":"2024-02-19T06:57:57.296648+0000","last_became_active":"2024-02-19T06:57:55.878992+0000","last_became_peered":"2024-02-19T06:57:55.878992+0000","last_unstale":"2024-02-19T06:57:57.296648+0000","last_undegraded":"2024-02-19T06:57:57.296648+0000","last_fullsized":"2024-02-19T06:57:57.296648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:02:58.620182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297355+0000","last_change":"2024-02-19T06:57:54.846040+0000","last_active":"2024-02-19T06:57:57.297355+0000","last_peered":"2024-02-19T06:57:57.297355+0000","last_clean":"2024-02-19T06:57:57.297355+0000","last_became_active":"2024-02-19T06:57:54.845607+0000","last_became_peered":"2024-02-19T06:57:54.845607+0000","last_unstale":"2024-02-19T06:57:57.297355+0000","last_undegraded":"2024-02-19T06:57:57.297355+0000","last_fullsized":"2024-02-19T06:57:57.297355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:04:53.869596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841142+0000","last_change":"2024-02-19T06:57:55.873658+0000","last_active":"2024-02-19T06:57:56.841142+0000","last_peered":"2024-02-19T06:57:56.841142+0000","last_clean":"2024-02-19T06:57:56.841142+0000","last_became_active":"2024-02-19T06:57:55.868108+0000","last_became_peered":"2024-02-19T06:57:55.868108+0000","last_unstale":"2024-02-19T06:57:56.841142+0000","last_undegraded":"2024-02-19T06:57:56.841142+0000","last_fullsized":"2024-02-19T06:57:56.841142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:51:32.064277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297967+0000","last_change":"2024-02-19T06:57:54.847587+0000","last_active":"2024-02-19T06:57:57.297967+0000","last_peered":"2024-02-19T06:57:57.297967+0000","last_clean":"2024-02-19T06:57:57.297967+0000","last_became_active":"2024-02-19T06:57:54.844899+0000","last_became_peered":"2024-02-19T06:57:54.844899+0000","last_unstale":"2024-02-19T06:57:57.297967+0000","last_undegraded":"2024-02-19T06:57:57.297967+0000","last_fullsized":"2024-02-19T06:57:57.297967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:51:03.784955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297605+0000","last_change":"2024-02-19T06:57:55.868933+0000","last_active":"2024-02-19T06:57:57.297605+0000","last_peered":"2024-02-19T06:57:57.297605+0000","last_clean":"2024-02-19T06:57:57.297605+0000","last_became_active":"2024-02-19T06:57:55.868592+0000","last_became_peered":"2024-02-19T06:57:55.868592+0000","last_unstale":"2024-02-19T06:57:57.297605+0000","last_undegraded":"2024-02-19T06:57:57.297605+0000","last_fullsized":"2024-02-19T06:57:57.297605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:33:37.227028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297451+0000","last_change":"2024-02-19T06:57:54.831858+0000","last_active":"2024-02-19T06:57:57.297451+0000","last_peered":"2024-02-19T06:57:57.297451+0000","last_clean":"2024-02-19T06:57:57.297451+0000","last_became_active":"2024-02-19T06:57:54.831512+0000","last_became_peered":"2024-02-19T06:57:54.831512+0000","last_unstale":"2024-02-19T06:57:57.297451+0000","last_undegraded":"2024-02-19T06:57:57.297451+0000","last_fullsized":"2024-02-19T06:57:57.297451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:48:18.433112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.839899+0000","last_change":"2024-02-19T06:57:55.872697+0000","last_active":"2024-02-19T06:57:56.839899+0000","last_peered":"2024-02-19T06:57:56.839899+0000","last_clean":"2024-02-19T06:57:56.839899+0000","last_became_active":"2024-02-19T06:57:55.872411+0000","last_became_peered":"2024-02-19T06:57:55.872411+0000","last_unstale":"2024-02-19T06:57:56.839899+0000","last_undegraded":"2024-02-19T06:57:56.839899+0000","last_fullsized":"2024-02-19T06:57:56.839899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:44:33.781212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842124+0000","last_change":"2024-02-19T06:57:54.844428+0000","last_active":"2024-02-19T06:57:56.842124+0000","last_peered":"2024-02-19T06:57:56.842124+0000","last_clean":"2024-02-19T06:57:56.842124+0000","last_became_active":"2024-02-19T06:57:54.844078+0000","last_became_peered":"2024-02-19T06:57:54.844078+0000","last_unstale":"2024-02-19T06:57:56.842124+0000","last_undegraded":"2024-02-19T06:57:56.842124+0000","last_fullsized":"2024-02-19T06:57:56.842124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:48:12.144495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843194+0000","last_change":"2024-02-19T06:57:55.869556+0000","last_active":"2024-02-19T06:57:56.843194+0000","last_peered":"2024-02-19T06:57:56.843194+0000","last_clean":"2024-02-19T06:57:56.843194+0000","last_became_active":"2024-02-19T06:57:55.869252+0000","last_became_peered":"2024-02-19T06:57:55.869252+0000","last_unstale":"2024-02-19T06:57:56.843194+0000","last_undegraded":"2024-02-19T06:57:56.843194+0000","last_fullsized":"2024-02-19T06:57:56.843194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:34:32.534931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298549+0000","last_change":"2024-02-19T06:57:54.848350+0000","last_active":"2024-02-19T06:57:57.298549+0000","last_peered":"2024-02-19T06:57:57.298549+0000","last_clean":"2024-02-19T06:57:57.298549+0000","last_became_active":"2024-02-19T06:57:54.848006+0000","last_became_peered":"2024-02-19T06:57:54.848006+0000","last_unstale":"2024-02-19T06:57:57.298549+0000","last_undegraded":"2024-02-19T06:57:57.298549+0000","last_fullsized":"2024-02-19T06:57:57.298549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:51:48.627075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843747+0000","last_change":"2024-02-19T06:57:55.872749+0000","last_active":"2024-02-19T06:57:56.843747+0000","last_peered":"2024-02-19T06:57:56.843747+0000","last_clean":"2024-02-19T06:57:56.843747+0000","last_became_active":"2024-02-19T06:57:55.872475+0000","last_became_peered":"2024-02-19T06:57:55.872475+0000","last_unstale":"2024-02-19T06:57:56.843747+0000","last_undegraded":"2024-02-19T06:57:56.843747+0000","last_fullsized":"2024-02-19T06:57:56.843747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:48:48.733251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.839076+0000","last_change":"2024-02-19T06:57:54.835766+0000","last_active":"2024-02-19T06:57:56.839076+0000","last_peered":"2024-02-19T06:57:56.839076+0000","last_clean":"2024-02-19T06:57:56.839076+0000","last_became_active":"2024-02-19T06:57:54.835407+0000","last_became_peered":"2024-02-19T06:57:54.835407+0000","last_unstale":"2024-02-19T06:57:56.839076+0000","last_undegraded":"2024-02-19T06:57:56.839076+0000","last_fullsized":"2024-02-19T06:57:56.839076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:09:02.273345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297872+0000","last_change":"2024-02-19T06:57:55.875676+0000","last_active":"2024-02-19T06:57:57.297872+0000","last_peered":"2024-02-19T06:57:57.297872+0000","last_clean":"2024-02-19T06:57:57.297872+0000","last_became_active":"2024-02-19T06:57:55.874703+0000","last_became_peered":"2024-02-19T06:57:55.874703+0000","last_unstale":"2024-02-19T06:57:57.297872+0000","last_undegraded":"2024-02-19T06:57:57.297872+0000","last_fullsized":"2024-02-19T06:57:57.297872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:07:14.896235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298413+0000","last_change":"2024-02-19T06:57:54.842701+0000","last_active":"2024-02-19T06:57:57.298413+0000","last_peered":"2024-02-19T06:57:57.298413+0000","last_clean":"2024-02-19T06:57:57.298413+0000","last_became_active":"2024-02-19T06:57:54.842305+0000","last_became_peered":"2024-02-19T06:57:54.842305+0000","last_unstale":"2024-02-19T06:57:57.298413+0000","last_undegraded":"2024-02-19T06:57:57.298413+0000","last_fullsized":"2024-02-19T06:57:57.298413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:31:12.486420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842830+0000","last_change":"2024-02-19T06:57:55.865803+0000","last_active":"2024-02-19T06:57:56.842830+0000","last_peered":"2024-02-19T06:57:56.842830+0000","last_clean":"2024-02-19T06:57:56.842830+0000","last_became_active":"2024-02-19T06:57:55.865239+0000","last_became_peered":"2024-02-19T06:57:55.865239+0000","last_unstale":"2024-02-19T06:57:56.842830+0000","last_undegraded":"2024-02-19T06:57:56.842830+0000","last_fullsized":"2024-02-19T06:57:56.842830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:14:32.464297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841305+0000","last_change":"2024-02-19T06:57:45.353063+0000","last_active":"2024-02-19T06:57:56.841305+0000","last_peered":"2024-02-19T06:57:56.841305+0000","last_clean":"2024-02-19T06:57:56.841305+0000","last_became_active":"2024-02-19T06:57:45.350602+0000","last_became_peered":"2024-02-19T06:57:45.350602+0000","last_unstale":"2024-02-19T06:57:56.841305+0000","last_undegraded":"2024-02-19T06:57:56.841305+0000","last_fullsized":"2024-02-19T06:57:56.841305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_clean_scrub_stamp":"2024-02-19T06:57:44.230095+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:04:42.513180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297047+0000","last_change":"2024-02-19T06:57:54.839055+0000","last_active":"2024-02-19T06:57:57.297047+0000","last_peered":"2024-02-19T06:57:57.297047+0000","last_clean":"2024-02-19T06:57:57.297047+0000","last_became_active":"2024-02-19T06:57:54.838769+0000","last_became_peered":"2024-02-19T06:57:54.838769+0000","last_unstale":"2024-02-19T06:57:57.297047+0000","last_undegraded":"2024-02-19T06:57:57.297047+0000","last_fullsized":"2024-02-19T06:57:57.297047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:48:35.345147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.295995+0000","last_change":"2024-02-19T06:57:55.864141+0000","last_active":"2024-02-19T06:57:57.295995+0000","last_peered":"2024-02-19T06:57:57.295995+0000","last_clean":"2024-02-19T06:57:57.295995+0000","last_became_active":"2024-02-19T06:57:55.863841+0000","last_became_peered":"2024-02-19T06:57:55.863841+0000","last_unstale":"2024-02-19T06:57:57.295995+0000","last_undegraded":"2024-02-19T06:57:57.295995+0000","last_fullsized":"2024-02-19T06:57:57.295995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:18:12.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841663+0000","last_change":"2024-02-19T06:57:54.830847+0000","last_active":"2024-02-19T06:57:56.841663+0000","last_peered":"2024-02-19T06:57:56.841663+0000","last_clean":"2024-02-19T06:57:56.841663+0000","last_became_active":"2024-02-19T06:57:54.830511+0000","last_became_peered":"2024-02-19T06:57:54.830511+0000","last_unstale":"2024-02-19T06:57:56.841663+0000","last_undegraded":"2024-02-19T06:57:56.841663+0000","last_fullsized":"2024-02-19T06:57:56.841663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T06:59:01.746042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.295829+0000","last_change":"2024-02-19T06:57:55.870925+0000","last_active":"2024-02-19T06:57:57.295829+0000","last_peered":"2024-02-19T06:57:57.295829+0000","last_clean":"2024-02-19T06:57:57.295829+0000","last_became_active":"2024-02-19T06:57:55.870616+0000","last_became_peered":"2024-02-19T06:57:55.870616+0000","last_unstale":"2024-02-19T06:57:57.295829+0000","last_undegraded":"2024-02-19T06:57:57.295829+0000","last_fullsized":"2024-02-19T06:57:57.295829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:43:48.726828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297970+0000","last_change":"2024-02-19T06:57:54.848662+0000","last_active":"2024-02-19T06:57:57.297970+0000","last_peered":"2024-02-19T06:57:57.297970+0000","last_clean":"2024-02-19T06:57:57.297970+0000","last_became_active":"2024-02-19T06:57:54.848378+0000","last_became_peered":"2024-02-19T06:57:54.848378+0000","last_unstale":"2024-02-19T06:57:57.297970+0000","last_undegraded":"2024-02-19T06:57:57.297970+0000","last_fullsized":"2024-02-19T06:57:57.297970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:48:40.438231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.837477+0000","last_change":"2024-02-19T06:57:55.848725+0000","last_active":"2024-02-19T06:57:56.837477+0000","last_peered":"2024-02-19T06:57:56.837477+0000","last_clean":"2024-02-19T06:57:56.837477+0000","last_became_active":"2024-02-19T06:57:55.846707+0000","last_became_peered":"2024-02-19T06:57:55.846707+0000","last_unstale":"2024-02-19T06:57:56.837477+0000","last_undegraded":"2024-02-19T06:57:56.837477+0000","last_fullsized":"2024-02-19T06:57:56.837477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:36:55.635583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297591+0000","last_change":"2024-02-19T06:57:54.836285+0000","last_active":"2024-02-19T06:57:57.297591+0000","last_peered":"2024-02-19T06:57:57.297591+0000","last_clean":"2024-02-19T06:57:57.297591+0000","last_became_active":"2024-02-19T06:57:54.831238+0000","last_became_peered":"2024-02-19T06:57:54.831238+0000","last_unstale":"2024-02-19T06:57:57.297591+0000","last_undegraded":"2024-02-19T06:57:57.297591+0000","last_fullsized":"2024-02-19T06:57:57.297591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:51:03.784955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841596+0000","last_change":"2024-02-19T06:57:55.884751+0000","last_active":"2024-02-19T06:57:56.841596+0000","last_peered":"2024-02-19T06:57:56.841596+0000","last_clean":"2024-02-19T06:57:56.841596+0000","last_became_active":"2024-02-19T06:57:55.884444+0000","last_became_peered":"2024-02-19T06:57:55.884444+0000","last_unstale":"2024-02-19T06:57:56.841596+0000","last_undegraded":"2024-02-19T06:57:56.841596+0000","last_fullsized":"2024-02-19T06:57:56.841596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T06:59:02.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838502+0000","last_change":"2024-02-19T06:57:54.849999+0000","last_active":"2024-02-19T06:57:56.838502+0000","last_peered":"2024-02-19T06:57:56.838502+0000","last_clean":"2024-02-19T06:57:56.838502+0000","last_became_active":"2024-02-19T06:57:54.849632+0000","last_became_peered":"2024-02-19T06:57:54.849632+0000","last_unstale":"2024-02-19T06:57:56.838502+0000","last_undegraded":"2024-02-19T06:57:56.838502+0000","last_fullsized":"2024-02-19T06:57:56.838502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:59:11.619972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298324+0000","last_change":"2024-02-19T06:57:55.864794+0000","last_active":"2024-02-19T06:57:57.298324+0000","last_peered":"2024-02-19T06:57:57.298324+0000","last_clean":"2024-02-19T06:57:57.298324+0000","last_became_active":"2024-02-19T06:57:55.864493+0000","last_became_peered":"2024-02-19T06:57:55.864493+0000","last_unstale":"2024-02-19T06:57:57.298324+0000","last_undegraded":"2024-02-19T06:57:57.298324+0000","last_fullsized":"2024-02-19T06:57:57.298324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:13:32.804426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843295+0000","last_change":"2024-02-19T06:57:54.844059+0000","last_active":"2024-02-19T06:57:56.843295+0000","last_peered":"2024-02-19T06:57:56.843295+0000","last_clean":"2024-02-19T06:57:56.843295+0000","last_became_active":"2024-02-19T06:57:54.843728+0000","last_became_peered":"2024-02-19T06:57:54.843728+0000","last_unstale":"2024-02-19T06:57:56.843295+0000","last_undegraded":"2024-02-19T06:57:56.843295+0000","last_fullsized":"2024-02-19T06:57:56.843295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:29:04.812047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838149+0000","last_change":"2024-02-19T06:57:55.850256+0000","last_active":"2024-02-19T06:57:56.838149+0000","last_peered":"2024-02-19T06:57:56.838149+0000","last_clean":"2024-02-19T06:57:56.838149+0000","last_became_active":"2024-02-19T06:57:55.846503+0000","last_became_peered":"2024-02-19T06:57:55.846503+0000","last_unstale":"2024-02-19T06:57:56.838149+0000","last_undegraded":"2024-02-19T06:57:56.838149+0000","last_fullsized":"2024-02-19T06:57:56.838149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:19:13.712235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838870+0000","last_change":"2024-02-19T06:57:54.845587+0000","last_active":"2024-02-19T06:57:56.838870+0000","last_peered":"2024-02-19T06:57:56.838870+0000","last_clean":"2024-02-19T06:57:56.838870+0000","last_became_active":"2024-02-19T06:57:54.844017+0000","last_became_peered":"2024-02-19T06:57:54.844017+0000","last_unstale":"2024-02-19T06:57:56.838870+0000","last_undegraded":"2024-02-19T06:57:56.838870+0000","last_fullsized":"2024-02-19T06:57:56.838870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:11:06.185390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299468+0000","last_change":"2024-02-19T06:57:55.873485+0000","last_active":"2024-02-19T06:57:57.299468+0000","last_peered":"2024-02-19T06:57:57.299468+0000","last_clean":"2024-02-19T06:57:57.299468+0000","last_became_active":"2024-02-19T06:57:55.873179+0000","last_became_peered":"2024-02-19T06:57:55.873179+0000","last_unstale":"2024-02-19T06:57:57.299468+0000","last_undegraded":"2024-02-19T06:57:57.299468+0000","last_fullsized":"2024-02-19T06:57:57.299468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:45:59.994639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299321+0000","last_change":"2024-02-19T06:57:54.849235+0000","last_active":"2024-02-19T06:57:57.299321+0000","last_peered":"2024-02-19T06:57:57.299321+0000","last_clean":"2024-02-19T06:57:57.299321+0000","last_became_active":"2024-02-19T06:57:54.848969+0000","last_became_peered":"2024-02-19T06:57:54.848969+0000","last_unstale":"2024-02-19T06:57:57.299321+0000","last_undegraded":"2024-02-19T06:57:57.299321+0000","last_fullsized":"2024-02-19T06:57:57.299321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:59:42.541017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297324+0000","last_change":"2024-02-19T06:57:55.878312+0000","last_active":"2024-02-19T06:57:57.297324+0000","last_peered":"2024-02-19T06:57:57.297324+0000","last_clean":"2024-02-19T06:57:57.297324+0000","last_became_active":"2024-02-19T06:57:55.872331+0000","last_became_peered":"2024-02-19T06:57:55.872331+0000","last_unstale":"2024-02-19T06:57:57.297324+0000","last_undegraded":"2024-02-19T06:57:57.297324+0000","last_fullsized":"2024-02-19T06:57:57.297324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:16:19.287368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841162+0000","last_change":"2024-02-19T06:57:54.851412+0000","last_active":"2024-02-19T06:57:56.841162+0000","last_peered":"2024-02-19T06:57:56.841162+0000","last_clean":"2024-02-19T06:57:56.841162+0000","last_became_active":"2024-02-19T06:57:54.849764+0000","last_became_peered":"2024-02-19T06:57:54.849764+0000","last_unstale":"2024-02-19T06:57:56.841162+0000","last_undegraded":"2024-02-19T06:57:56.841162+0000","last_fullsized":"2024-02-19T06:57:56.841162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:31:24.467437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.840874+0000","last_change":"2024-02-19T06:57:55.859782+0000","last_active":"2024-02-19T06:57:56.840874+0000","last_peered":"2024-02-19T06:57:56.840874+0000","last_clean":"2024-02-19T06:57:56.840874+0000","last_became_active":"2024-02-19T06:57:55.859506+0000","last_became_peered":"2024-02-19T06:57:55.859506+0000","last_unstale":"2024-02-19T06:57:56.840874+0000","last_undegraded":"2024-02-19T06:57:56.840874+0000","last_fullsized":"2024-02-19T06:57:56.840874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:14:51.291554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838183+0000","last_change":"2024-02-19T06:57:54.833195+0000","last_active":"2024-02-19T06:57:56.838183+0000","last_peered":"2024-02-19T06:57:56.838183+0000","last_clean":"2024-02-19T06:57:56.838183+0000","last_became_active":"2024-02-19T06:57:54.832921+0000","last_became_peered":"2024-02-19T06:57:54.832921+0000","last_unstale":"2024-02-19T06:57:56.838183+0000","last_undegraded":"2024-02-19T06:57:56.838183+0000","last_fullsized":"2024-02-19T06:57:56.838183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:51:03.784955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297856+0000","last_change":"2024-02-19T06:57:55.863807+0000","last_active":"2024-02-19T06:57:57.297856+0000","last_peered":"2024-02-19T06:57:57.297856+0000","last_clean":"2024-02-19T06:57:57.297856+0000","last_became_active":"2024-02-19T06:57:55.862327+0000","last_became_peered":"2024-02-19T06:57:55.862327+0000","last_unstale":"2024-02-19T06:57:57.297856+0000","last_undegraded":"2024-02-19T06:57:57.297856+0000","last_fullsized":"2024-02-19T06:57:57.297856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.837924+0000","last_change":"2024-02-19T06:57:54.847191+0000","last_active":"2024-02-19T06:57:56.837924+0000","last_peered":"2024-02-19T06:57:56.837924+0000","last_clean":"2024-02-19T06:57:56.837924+0000","last_became_active":"2024-02-19T06:57:54.846893+0000","last_became_peered":"2024-02-19T06:57:54.846893+0000","last_unstale":"2024-02-19T06:57:56.837924+0000","last_undegraded":"2024-02-19T06:57:56.837924+0000","last_fullsized":"2024-02-19T06:57:56.837924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:44:55.409988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298592+0000","last_change":"2024-02-19T06:57:55.882338+0000","last_active":"2024-02-19T06:57:57.298592+0000","last_peered":"2024-02-19T06:57:57.298592+0000","last_clean":"2024-02-19T06:57:57.298592+0000","last_became_active":"2024-02-19T06:57:55.881014+0000","last_became_peered":"2024-02-19T06:57:55.881014+0000","last_unstale":"2024-02-19T06:57:57.298592+0000","last_undegraded":"2024-02-19T06:57:57.298592+0000","last_fullsized":"2024-02-19T06:57:57.298592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:19:34.393218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841316+0000","last_change":"2024-02-19T06:57:54.845977+0000","last_active":"2024-02-19T06:57:56.841316+0000","last_peered":"2024-02-19T06:57:56.841316+0000","last_clean":"2024-02-19T06:57:56.841316+0000","last_became_active":"2024-02-19T06:57:54.845651+0000","last_became_peered":"2024-02-19T06:57:54.845651+0000","last_unstale":"2024-02-19T06:57:56.841316+0000","last_undegraded":"2024-02-19T06:57:56.841316+0000","last_fullsized":"2024-02-19T06:57:56.841316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:42:34.912061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297311+0000","last_change":"2024-02-19T06:57:55.870900+0000","last_active":"2024-02-19T06:57:57.297311+0000","last_peered":"2024-02-19T06:57:57.297311+0000","last_clean":"2024-02-19T06:57:57.297311+0000","last_became_active":"2024-02-19T06:57:55.870632+0000","last_became_peered":"2024-02-19T06:57:55.870632+0000","last_unstale":"2024-02-19T06:57:57.297311+0000","last_undegraded":"2024-02-19T06:57:57.297311+0000","last_fullsized":"2024-02-19T06:57:57.297311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:18:12.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298148+0000","last_change":"2024-02-19T06:57:55.863948+0000","last_active":"2024-02-19T06:57:57.298148+0000","last_peered":"2024-02-19T06:57:57.298148+0000","last_clean":"2024-02-19T06:57:57.298148+0000","last_became_active":"2024-02-19T06:57:55.863663+0000","last_became_peered":"2024-02-19T06:57:55.863663+0000","last_unstale":"2024-02-19T06:57:57.298148+0000","last_undegraded":"2024-02-19T06:57:57.298148+0000","last_fullsized":"2024-02-19T06:57:57.298148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:06:41.609470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841684+0000","last_change":"2024-02-19T06:57:54.841874+0000","last_active":"2024-02-19T06:57:56.841684+0000","last_peered":"2024-02-19T06:57:56.841684+0000","last_clean":"2024-02-19T06:57:56.841684+0000","last_became_active":"2024-02-19T06:57:54.841500+0000","last_became_peered":"2024-02-19T06:57:54.841500+0000","last_unstale":"2024-02-19T06:57:56.841684+0000","last_undegraded":"2024-02-19T06:57:56.841684+0000","last_fullsized":"2024-02-19T06:57:56.841684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:34:01.534791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297567+0000","last_change":"2024-02-19T06:57:55.864005+0000","last_active":"2024-02-19T06:57:57.297567+0000","last_peered":"2024-02-19T06:57:57.297567+0000","last_clean":"2024-02-19T06:57:57.297567+0000","last_became_active":"2024-02-19T06:57:55.863634+0000","last_became_peered":"2024-02-19T06:57:55.863634+0000","last_unstale":"2024-02-19T06:57:57.297567+0000","last_undegraded":"2024-02-19T06:57:57.297567+0000","last_fullsized":"2024-02-19T06:57:57.297567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:45:59.994639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842721+0000","last_change":"2024-02-19T06:57:54.845418+0000","last_active":"2024-02-19T06:57:56.842721+0000","last_peered":"2024-02-19T06:57:56.842721+0000","last_clean":"2024-02-19T06:57:56.842721+0000","last_became_active":"2024-02-19T06:57:54.845134+0000","last_became_peered":"2024-02-19T06:57:54.845134+0000","last_unstale":"2024-02-19T06:57:56.842721+0000","last_undegraded":"2024-02-19T06:57:56.842721+0000","last_fullsized":"2024-02-19T06:57:56.842721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:37:22.505873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.295990+0000","last_change":"2024-02-19T06:57:55.880160+0000","last_active":"2024-02-19T06:57:57.295990+0000","last_peered":"2024-02-19T06:57:57.295990+0000","last_clean":"2024-02-19T06:57:57.295990+0000","last_became_active":"2024-02-19T06:57:55.879826+0000","last_became_peered":"2024-02-19T06:57:55.879826+0000","last_unstale":"2024-02-19T06:57:57.295990+0000","last_undegraded":"2024-02-19T06:57:57.295990+0000","last_fullsized":"2024-02-19T06:57:57.295990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:31:58.448215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297341+0000","last_change":"2024-02-19T06:57:54.848100+0000","last_active":"2024-02-19T06:57:57.297341+0000","last_peered":"2024-02-19T06:57:57.297341+0000","last_clean":"2024-02-19T06:57:57.297341+0000","last_became_active":"2024-02-19T06:57:54.847632+0000","last_became_peered":"2024-02-19T06:57:54.847632+0000","last_unstale":"2024-02-19T06:57:57.297341+0000","last_undegraded":"2024-02-19T06:57:57.297341+0000","last_fullsized":"2024-02-19T06:57:57.297341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:04:53.869596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297229+0000","last_change":"2024-02-19T06:57:55.873869+0000","last_active":"2024-02-19T06:57:57.297229+0000","last_peered":"2024-02-19T06:57:57.297229+0000","last_clean":"2024-02-19T06:57:57.297229+0000","last_became_active":"2024-02-19T06:57:55.873711+0000","last_became_peered":"2024-02-19T06:57:55.873711+0000","last_unstale":"2024-02-19T06:57:57.297229+0000","last_undegraded":"2024-02-19T06:57:57.297229+0000","last_fullsized":"2024-02-19T06:57:57.297229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:19:13.712235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296492+0000","last_change":"2024-02-19T06:57:54.846614+0000","last_active":"2024-02-19T06:57:57.296492+0000","last_peered":"2024-02-19T06:57:57.296492+0000","last_clean":"2024-02-19T06:57:57.296492+0000","last_became_active":"2024-02-19T06:57:54.846293+0000","last_became_peered":"2024-02-19T06:57:54.846293+0000","last_unstale":"2024-02-19T06:57:57.296492+0000","last_undegraded":"2024-02-19T06:57:57.296492+0000","last_fullsized":"2024-02-19T06:57:57.296492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:14:50.279754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":79738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7969999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.865}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6719999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":78216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.855}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7649999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":669076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":78252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7290000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8939999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":78126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":78286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6850000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5670000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":669132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T06:58:00.897 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-19T06:58:00.897 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-19T06:58:00.898 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-19T06:58:00.898 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-19T06:58:00.898 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-19T06:58:01.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.158+0000 7fbd8d400640 1 Processor -- start 2024-02-19T06:58:01.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.159+0000 7fbd8d400640 1 -- start start 2024-02-19T06:58:01.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.160+0000 7fbd8d400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd8815b540 0x7fbd880cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.160+0000 7fbd8d400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd880cb150 0x7fbd880cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.160+0000 7fbd8d400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd8815fd50 0x7fbd880cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.160+0000 7fbd8d400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd880cb5f0 con 0x7fbd8815fd50 2024-02-19T06:58:01.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.160+0000 7fbd8d400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8815f270 con 0x7fbd880cb150 2024-02-19T06:58:01.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.160+0000 7fbd8d400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8815f550 con 0x7fbd8815b540 2024-02-19T06:58:01.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.160+0000 7fbd8ca00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd8815fd50 0x7fbd880cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.160+0000 7fbd8ca00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd8815fd50 0x7fbd880cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38028/0 (socket says 172.21.15.46:38028) 2024-02-19T06:58:01.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.160+0000 7fbd8ca00640 1 -- 172.21.15.46:0/2928035659 learned_addr learned my addr 172.21.15.46:0/2928035659 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:01.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.161+0000 7fbd87e00640 1 --2- 172.21.15.46:0/2928035659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd8815b540 0x7fbd880cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.161+0000 7fbd7fe00640 1 --2- 172.21.15.46:0/2928035659 >> v2:172.21.15.142:3300/0 conn(0x7fbd880cb150 0x7fbd880cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.161+0000 7fbd8ca00640 1 -- 172.21.15.46:0/2928035659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd8815b540 msgr2=0x7fbd880cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:01.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.161+0000 7fbd8ca00640 1 --2- 172.21.15.46:0/2928035659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd8815b540 0x7fbd880cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.161+0000 7fbd8ca00640 1 -- 172.21.15.46:0/2928035659 >> v2:172.21.15.142:3300/0 conn(0x7fbd880cb150 msgr2=0x7fbd880cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:01.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.161+0000 7fbd8ca00640 1 --2- 172.21.15.46:0/2928035659 >> v2:172.21.15.142:3300/0 conn(0x7fbd880cb150 0x7fbd880cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.161+0000 7fbd8ca00640 1 -- 172.21.15.46:0/2928035659 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8815f830 con 0x7fbd8815fd50 2024-02-19T06:58:01.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.162+0000 7fbd8ca00640 1 --2- 172.21.15.46:0/2928035659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8815fd50 0x7fbd880cfc80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbd880cce30 tx=0x7fbd8002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa203673a935fcd server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:01.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.162+0000 7fbd87400640 1 -- 172.21.15.46:0/2928035659 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8002ca70 con 0x7fbd8815fd50 2024-02-19T06:58:01.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.162+0000 7fbd87400640 1 -- 172.21.15.46:0/2928035659 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8002cbd0 con 0x7fbd8815fd50 2024-02-19T06:58:01.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.162+0000 7fbd87400640 1 -- 172.21.15.46:0/2928035659 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd800343f0 con 0x7fbd8815fd50 2024-02-19T06:58:01.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.163+0000 7fbd8d400640 1 -- 172.21.15.46:0/2928035659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8815fd50 msgr2=0x7fbd880cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:01.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.163+0000 7fbd8d400640 1 --2- 172.21.15.46:0/2928035659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8815fd50 0x7fbd880cfc80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbd880cce30 tx=0x7fbd8002bed0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.163+0000 7fbd8d400640 1 -- 172.21.15.46:0/2928035659 shutdown_connections 2024-02-19T06:58:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.163+0000 7fbd8d400640 1 --2- 172.21.15.46:0/2928035659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8815fd50 0x7fbd880cfc80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.163+0000 7fbd8d400640 1 --2- 172.21.15.46:0/2928035659 >> v2:172.21.15.142:3300/0 conn(0x7fbd880cb150 0x7fbd880cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.163+0000 7fbd8d400640 1 --2- 172.21.15.46:0/2928035659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd8815b540 0x7fbd880cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.163+0000 7fbd8d400640 1 -- 172.21.15.46:0/2928035659 >> 172.21.15.46:0/2928035659 conn(0x7fbd8806afa0 msgr2=0x7fbd8806b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.163+0000 7fbd8d400640 1 -- 172.21.15.46:0/2928035659 shutdown_connections 2024-02-19T06:58:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.163+0000 7fbd8d400640 1 -- 172.21.15.46:0/2928035659 wait complete. 2024-02-19T06:58:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.165+0000 7fbd8d400640 1 Processor -- start 2024-02-19T06:58:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.165+0000 7fbd8d400640 1 -- start start 2024-02-19T06:58:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.166+0000 7fbd8d400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd880cb150 0x7fbd880ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.166+0000 7fbd8d400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd8815b540 0x7fbd881f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.166+0000 7fbd8d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8815fd50 0x7fbd880ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.166+0000 7fbd8d400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd880c7aa0 con 0x7fbd8815fd50 2024-02-19T06:58:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.166+0000 7fbd8d400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd881f61d0 con 0x7fbd880cb150 2024-02-19T06:58:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.166+0000 7fbd8d400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd880ac6e0 con 0x7fbd8815b540 2024-02-19T06:58:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.166+0000 7fbd8ca00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8815fd50 0x7fbd880ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.166+0000 7fbd8ca00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8815fd50 0x7fbd880ac1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38038/0 (socket says 172.21.15.46:38038) 2024-02-19T06:58:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.166+0000 7fbd8ca00640 1 -- 172.21.15.46:0/2588969572 learned_addr learned my addr 172.21.15.46:0/2588969572 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.167+0000 7fbd7fe00640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd8815b540 0x7fbd881f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.167+0000 7fbd87e00640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd880cb150 0x7fbd880ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.167+0000 7fbd8ca00640 1 -- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd8815b540 msgr2=0x7fbd881f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.167+0000 7fbd8ca00640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd8815b540 0x7fbd881f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.167+0000 7fbd8ca00640 1 -- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd880cb150 msgr2=0x7fbd880ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.167+0000 7fbd8ca00640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd880cb150 0x7fbd880ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.167+0000 7fbd8ca00640 1 -- 172.21.15.46:0/2588969572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd80009b30 con 0x7fbd8815fd50 2024-02-19T06:58:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.167+0000 7fbd8ca00640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8815fd50 0x7fbd880ac1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd8002c4e0 tx=0x7fbd80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.167+0000 7fbd84c00640 1 -- 172.21.15.46:0/2588969572 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80009510 con 0x7fbd8815fd50 2024-02-19T06:58:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.168+0000 7fbd84c00640 1 -- 172.21.15.46:0/2588969572 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8003e450 con 0x7fbd8815fd50 2024-02-19T06:58:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.168+0000 7fbd84c00640 1 -- 172.21.15.46:0/2588969572 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8003e7e0 con 0x7fbd8815fd50 2024-02-19T06:58:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.168+0000 7fbd8d400640 1 -- 172.21.15.46:0/2588969572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd880ac960 con 0x7fbd8815fd50 2024-02-19T06:58:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.168+0000 7fbd8d400640 1 -- 172.21.15.46:0/2588969572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd880acf20 con 0x7fbd8815fd50 2024-02-19T06:58:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.169+0000 7fbd8d400640 1 -- 172.21.15.46:0/2588969572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd880c7800 con 0x7fbd8815fd50 2024-02-19T06:58:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.170+0000 7fbd84c00640 1 -- 172.21.15.46:0/2588969572 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbd8003e940 con 0x7fbd8815fd50 2024-02-19T06:58:01.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.171+0000 7fbd84c00640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbd6406b840 0x7fbd6406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.171+0000 7fbd84c00640 1 -- 172.21.15.46:0/2588969572 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd800acf50 con 0x7fbd8815fd50 2024-02-19T06:58:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.172+0000 7fbd87e00640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbd6406b840 0x7fbd6406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.173+0000 7fbd87e00640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbd6406b840 0x7fbd6406dd00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbd78006fd0 tx=0x7fbd78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:01.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.176+0000 7fbd84c00640 1 -- 172.21.15.46:0/2588969572 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbd880c7800 con 0x7fbd8815fd50 2024-02-19T06:58:01.241 INFO:tasks.ceph.mds.b.smithi142.stderr:2024-02-19T06:58:01.239+0000 7fd5f3400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-19T06:58:01.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.425+0000 7fbd8d400640 1 -- 172.21.15.46:0/2588969572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fbd880c7be0 con 0x7fbd8815fd50 2024-02-19T06:58:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.431+0000 7fbd84c00640 1 -- 172.21.15.46:0/2588969572 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171800 (secure 0 0 0) 0x7fbd880c7be0 con 0x7fbd8815fd50 2024-02-19T06:58:01.436 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:01.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.435+0000 7fbd8d400640 1 -- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbd6406b840 msgr2=0x7fbd6406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:01.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.435+0000 7fbd8d400640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbd6406b840 0x7fbd6406dd00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbd78006fd0 tx=0x7fbd78008040 comp rx=0 tx=0).stop 2024-02-19T06:58:01.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.435+0000 7fbd8d400640 1 -- 172.21.15.46:0/2588969572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8815fd50 msgr2=0x7fbd880ac1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:01.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.435+0000 7fbd8d400640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8815fd50 0x7fbd880ac1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd8002c4e0 tx=0x7fbd80004a40 comp rx=0 tx=0).stop 2024-02-19T06:58:01.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.435+0000 7fbd8d400640 1 -- 172.21.15.46:0/2588969572 shutdown_connections 2024-02-19T06:58:01.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.435+0000 7fbd8d400640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbd6406b840 0x7fbd6406dd00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.435+0000 7fbd8d400640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd8815fd50 0x7fbd880ac1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.435+0000 7fbd8d400640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd8815b540 0x7fbd881f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.435+0000 7fbd8d400640 1 --2- 172.21.15.46:0/2588969572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd880cb150 0x7fbd880ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.435+0000 7fbd8d400640 1 -- 172.21.15.46:0/2588969572 >> 172.21.15.46:0/2588969572 conn(0x7fbd8806afa0 msgr2=0x7fbd880c1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:01.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.435+0000 7fbd8d400640 1 -- 172.21.15.46:0/2588969572 shutdown_connections 2024-02-19T06:58:01.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.435+0000 7fbd8d400640 1 -- 172.21.15.46:0/2588969572 wait complete. 2024-02-19T06:58:01.455 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1628765207},{"type":"v1","addr":"172.21.15.142:6833","nonce":1628765207}]},"active_addr":"172.21.15.142:6833/1628765207","active_change":"2024-02-19T06:57:35.640220+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4114,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":161670254}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1957451408}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":288914786}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1726226375}]}]} 2024-02-19T06:58:01.458 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-19T06:58:01.458 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-19T06:58:01.458 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:01.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.674+0000 7f8628a00640 1 Processor -- start 2024-02-19T06:58:01.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.674+0000 7f8628a00640 1 -- start start 2024-02-19T06:58:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.676+0000 7f8628a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f862415f120 0x7f86240b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.676+0000 7f8628a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86240b0e50 0x7f862409a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.676+0000 7f8628a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8624099a30 0x7f8624099ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.676+0000 7f8628a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862409a400 con 0x7f8624099a30 2024-02-19T06:58:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.676+0000 7f8628a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86240b2cb0 con 0x7f86240b0e50 2024-02-19T06:58:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.676+0000 7f8628a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862409acb0 con 0x7f862415f120 2024-02-19T06:58:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.676+0000 7f8622800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8624099a30 0x7f8624099ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.676+0000 7f8622800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8624099a30 0x7f8624099ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38040/0 (socket says 172.21.15.46:38040) 2024-02-19T06:58:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.676+0000 7f8622800640 1 -- 172.21.15.46:0/3132363281 learned_addr learned my addr 172.21.15.46:0/3132363281 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.677+0000 7f8621e00640 1 --2- 172.21.15.46:0/3132363281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f862415f120 0x7f86240b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.677+0000 7f861be00640 1 --2- 172.21.15.46:0/3132363281 >> v2:172.21.15.142:3300/0 conn(0x7f86240b0e50 0x7f862409a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.677+0000 7f8622800640 1 -- 172.21.15.46:0/3132363281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f862415f120 msgr2=0x7f86240b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:01.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.677+0000 7f8622800640 1 --2- 172.21.15.46:0/3132363281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f862415f120 0x7f86240b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.677+0000 7f8622800640 1 -- 172.21.15.46:0/3132363281 >> v2:172.21.15.142:3300/0 conn(0x7f86240b0e50 msgr2=0x7f862409a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:01.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.677+0000 7f8622800640 1 --2- 172.21.15.46:0/3132363281 >> v2:172.21.15.142:3300/0 conn(0x7f86240b0e50 0x7f862409a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.677+0000 7f8622800640 1 -- 172.21.15.46:0/3132363281 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240cccf0 con 0x7f8624099a30 2024-02-19T06:58:01.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.678+0000 7f8622800640 1 --2- 172.21.15.46:0/3132363281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8624099a30 0x7f8624099ec0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8624072b40 tx=0x7f861c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90eda1287e2aaf69 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:01.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.678+0000 7f8621400640 1 -- 172.21.15.46:0/3132363281 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c02ca70 con 0x7f8624099a30 2024-02-19T06:58:01.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.678+0000 7f8621400640 1 -- 172.21.15.46:0/3132363281 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c02cbd0 con 0x7f8624099a30 2024-02-19T06:58:01.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.679+0000 7f8621400640 1 -- 172.21.15.46:0/3132363281 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c0343f0 con 0x7f8624099a30 2024-02-19T06:58:01.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.679+0000 7f8628a00640 1 -- 172.21.15.46:0/3132363281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8624099a30 msgr2=0x7f8624099ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:01.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.679+0000 7f8628a00640 1 --2- 172.21.15.46:0/3132363281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8624099a30 0x7f8624099ec0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8624072b40 tx=0x7f861c02bed0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.679+0000 7f8628a00640 1 -- 172.21.15.46:0/3132363281 shutdown_connections 2024-02-19T06:58:01.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.679+0000 7f8628a00640 1 --2- 172.21.15.46:0/3132363281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8624099a30 0x7f8624099ec0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.679+0000 7f8628a00640 1 --2- 172.21.15.46:0/3132363281 >> v2:172.21.15.142:3300/0 conn(0x7f86240b0e50 0x7f862409a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.679+0000 7f8628a00640 1 --2- 172.21.15.46:0/3132363281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f862415f120 0x7f86240b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.679+0000 7f8628a00640 1 -- 172.21.15.46:0/3132363281 >> 172.21.15.46:0/3132363281 conn(0x7f86240b3150 msgr2=0x7f86240b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:01.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.679+0000 7f8628a00640 1 -- 172.21.15.46:0/3132363281 shutdown_connections 2024-02-19T06:58:01.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.680+0000 7f8628a00640 1 -- 172.21.15.46:0/3132363281 wait complete. 2024-02-19T06:58:01.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.681+0000 7f8628a00640 1 Processor -- start 2024-02-19T06:58:01.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.682+0000 7f8628a00640 1 -- start start 2024-02-19T06:58:01.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.682+0000 7f8628a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8624099a30 0x7f862415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8628a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86240b0e50 0x7f86240b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8628a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f862415f120 0x7f862415d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8628a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862415c370 con 0x7f862415f120 2024-02-19T06:58:01.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8628a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862415cef0 con 0x7f86240b0e50 2024-02-19T06:58:01.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8628a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862415c5c0 con 0x7f8624099a30 2024-02-19T06:58:01.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8622800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f862415f120 0x7f862415d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8622800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f862415f120 0x7f862415d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38052/0 (socket says 172.21.15.46:38052) 2024-02-19T06:58:01.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8622800640 1 -- 172.21.15.46:0/3994830393 learned_addr learned my addr 172.21.15.46:0/3994830393 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:01.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f861be00640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86240b0e50 0x7f86240b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8621e00640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8624099a30 0x7f862415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8622800640 1 -- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8624099a30 msgr2=0x7f862415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:01.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8622800640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8624099a30 0x7f862415aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8622800640 1 -- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86240b0e50 msgr2=0x7f86240b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:01.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8622800640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86240b0e50 0x7f86240b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.683+0000 7f8622800640 1 -- 172.21.15.46:0/3994830393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c009b30 con 0x7f862415f120 2024-02-19T06:58:01.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.684+0000 7f8622800640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f862415f120 0x7f862415d380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f861c009e50 tx=0x7f861c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:01.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.684+0000 7f861a000640 1 -- 172.21.15.46:0/3994830393 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c009510 con 0x7f862415f120 2024-02-19T06:58:01.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.684+0000 7f861a000640 1 -- 172.21.15.46:0/3994830393 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c03e450 con 0x7f862415f120 2024-02-19T06:58:01.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.684+0000 7f861a000640 1 -- 172.21.15.46:0/3994830393 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c03e7e0 con 0x7f862415f120 2024-02-19T06:58:01.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.684+0000 7f8628a00640 1 -- 172.21.15.46:0/3994830393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862415c8a0 con 0x7f862415f120 2024-02-19T06:58:01.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.684+0000 7f8628a00640 1 -- 172.21.15.46:0/3994830393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862415afa0 con 0x7f862415f120 2024-02-19T06:58:01.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.685+0000 7f8628a00640 1 -- 172.21.15.46:0/3994830393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862415d080 con 0x7f862415f120 2024-02-19T06:58:01.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.686+0000 7f861a000640 1 -- 172.21.15.46:0/3994830393 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f861c03e940 con 0x7f862415f120 2024-02-19T06:58:01.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.687+0000 7f861a000640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f860006b840 0x7f860006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:01.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.687+0000 7f861a000640 1 -- 172.21.15.46:0/3994830393 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f861c0acd30 con 0x7f862415f120 2024-02-19T06:58:01.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.688+0000 7f8621e00640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f860006b840 0x7f860006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:01.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.689+0000 7f8621e00640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f860006b840 0x7f860006dd00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8614006fd0 tx=0x7f8614008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:01.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.692+0000 7f861a000640 1 -- 172.21.15.46:0/3994830393 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f861c0776b0 con 0x7f862415f120 2024-02-19T06:58:01.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.892+0000 7f8628a00640 1 -- 172.21.15.46:0/3994830393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8624067ba0 con 0x7f862415f120 2024-02-19T06:58:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.895+0000 7f861a000640 1 -- 172.21.15.46:0/3994830393 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f861c07ad70 con 0x7f862415f120 2024-02-19T06:58:01.898 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:01.898 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:56.828629+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.898+0000 7f8628a00640 1 -- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f860006b840 msgr2=0x7f860006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.898+0000 7f8628a00640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f860006b840 0x7f860006dd00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8614006fd0 tx=0x7f8614008040 comp rx=0 tx=0).stop 2024-02-19T06:58:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.898+0000 7f8628a00640 1 -- 172.21.15.46:0/3994830393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f862415f120 msgr2=0x7f862415d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.898+0000 7f8628a00640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f862415f120 0x7f862415d380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f861c009e50 tx=0x7f861c004a40 comp rx=0 tx=0).stop 2024-02-19T06:58:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.898+0000 7f8628a00640 1 -- 172.21.15.46:0/3994830393 shutdown_connections 2024-02-19T06:58:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.898+0000 7f8628a00640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f860006b840 0x7f860006dd00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.898+0000 7f8628a00640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f862415f120 0x7f862415d380 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.898+0000 7f8628a00640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86240b0e50 0x7f86240b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.898+0000 7f8628a00640 1 --2- 172.21.15.46:0/3994830393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8624099a30 0x7f862415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.898+0000 7f8628a00640 1 -- 172.21.15.46:0/3994830393 >> 172.21.15.46:0/3994830393 conn(0x7f86240b3150 msgr2=0x7f8624073cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.898+0000 7f8628a00640 1 -- 172.21.15.46:0/3994830393 shutdown_connections 2024-02-19T06:58:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:01.898+0000 7f8628a00640 1 -- 172.21.15.46:0/3994830393 wait complete. 2024-02-19T06:58:01.919 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-19T06:58:01.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:02.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.138+0000 7f2df6000640 1 Processor -- start 2024-02-19T06:58:02.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.139+0000 7f2df6000640 1 -- start start 2024-02-19T06:58:02.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.140+0000 7f2df6000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2df00cc3c0 0x7f2df006bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.140+0000 7f2df6000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df00b2f20 con 0x7f2df00b2790 2024-02-19T06:58:02.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.140+0000 7f2df6000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df00cfc80 con 0x7f2df015dee0 2024-02-19T06:58:02.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.141+0000 7f2df6000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df00cff60 con 0x7f2df00cc3c0 2024-02-19T06:58:02.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.141+0000 7f2defe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2df00cc3c0 0x7f2df006bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.141+0000 7f2defe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2df00cc3c0 0x7f2df006bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38068/0 (socket says 172.21.15.46:38068) 2024-02-19T06:58:02.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.141+0000 7f2defe00640 1 -- 172.21.15.46:0/3627304665 learned_addr learned my addr 172.21.15.46:0/3627304665 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.141+0000 7f2defe00640 1 -- 172.21.15.46:0/3627304665 >> v1:172.21.15.142:6789/0 conn(0x7f2df015dee0 legacy=0x7f2df00d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:02.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.141+0000 7f2defe00640 1 -- 172.21.15.46:0/3627304665 >> v1:172.21.15.46:6789/0 conn(0x7f2df00b2790 legacy=0x7f2df00cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.141+0000 7f2defe00640 1 -- 172.21.15.46:0/3627304665 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df00d0240 con 0x7f2df00cc3c0 2024-02-19T06:58:02.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.143+0000 7f2defe00640 1 --2- 172.21.15.46:0/3627304665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df00cc3c0 0x7f2df006bea0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009870 tx=0x7f2de802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbba698f27e9bfbc server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.143+0000 7f2dee000640 1 -- 172.21.15.46:0/3627304665 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8030860 con 0x7f2df00cc3c0 2024-02-19T06:58:02.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.143+0000 7f2dee000640 1 -- 172.21.15.46:0/3627304665 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de80309c0 con 0x7f2df00cc3c0 2024-02-19T06:58:02.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.143+0000 7f2dee000640 1 -- 172.21.15.46:0/3627304665 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8030d50 con 0x7f2df00cc3c0 2024-02-19T06:58:02.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.143+0000 7f2df6000640 1 -- 172.21.15.46:0/3627304665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df00cc3c0 msgr2=0x7f2df006bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.143+0000 7f2df6000640 1 --2- 172.21.15.46:0/3627304665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df00cc3c0 0x7f2df006bea0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009870 tx=0x7f2de802b9a0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.144+0000 7f2df6000640 1 -- 172.21.15.46:0/3627304665 shutdown_connections 2024-02-19T06:58:02.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.144+0000 7f2df6000640 1 --2- 172.21.15.46:0/3627304665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df00cc3c0 0x7f2df006bea0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.144+0000 7f2df6000640 1 -- 172.21.15.46:0/3627304665 >> 172.21.15.46:0/3627304665 conn(0x7f2df00b3150 msgr2=0x7f2df00b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.144+0000 7f2df6000640 1 -- 172.21.15.46:0/3627304665 shutdown_connections 2024-02-19T06:58:02.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.144+0000 7f2df6000640 1 -- 172.21.15.46:0/3627304665 wait complete. 2024-02-19T06:58:02.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.145+0000 7f2df6000640 1 Processor -- start 2024-02-19T06:58:02.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.146+0000 7f2df6000640 1 -- start start 2024-02-19T06:58:02.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.147+0000 7f2df6000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df00b2790 0x7f2df00cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.147+0000 7f2df6000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df015dee0 0x7f2df014ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.147+0000 7f2df6000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df00b4210 0x7f2df00b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.147+0000 7f2df6000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00b49d0 con 0x7f2df015dee0 2024-02-19T06:58:02.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.147+0000 7f2df6000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00b4cb0 con 0x7f2df00b4210 2024-02-19T06:58:02.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.147+0000 7f2df6000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00b4f90 con 0x7f2df00b2790 2024-02-19T06:58:02.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.147+0000 7f2deea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df015dee0 0x7f2df014ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.147+0000 7f2deea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df015dee0 0x7f2df014ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38082/0 (socket says 172.21.15.46:38082) 2024-02-19T06:58:02.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.147+0000 7f2deea00640 1 -- 172.21.15.46:0/3785567502 learned_addr learned my addr 172.21.15.46:0/3785567502 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.147+0000 7f2defe00640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df00b4210 0x7f2df00b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.147+0000 7f2def400640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df00b2790 0x7f2df00cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.148+0000 7f2deea00640 1 -- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df00b2790 msgr2=0x7f2df00cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.148+0000 7f2deea00640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df00b2790 0x7f2df00cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.148+0000 7f2deea00640 1 -- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df00b4210 msgr2=0x7f2df00b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.148+0000 7f2deea00640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df00b4210 0x7f2df00b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.148+0000 7f2deea00640 1 -- 172.21.15.46:0/3785567502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de80094d0 con 0x7f2df015dee0 2024-02-19T06:58:02.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.148+0000 7f2deea00640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df015dee0 0x7f2df014ce20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800c400 tx=0x7f2dd800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.148+0000 7f2de7400640 1 -- 172.21.15.46:0/3785567502 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80052d0 con 0x7f2df015dee0 2024-02-19T06:58:02.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.148+0000 7f2de7400640 1 -- 172.21.15.46:0/3785567502 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd8005430 con 0x7f2df015dee0 2024-02-19T06:58:02.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.148+0000 7f2de7400640 1 -- 172.21.15.46:0/3785567502 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8003830 con 0x7f2df015dee0 2024-02-19T06:58:02.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.148+0000 7f2df6000640 1 -- 172.21.15.46:0/3785567502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df00b5270 con 0x7f2df015dee0 2024-02-19T06:58:02.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.148+0000 7f2df6000640 1 -- 172.21.15.46:0/3785567502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df00b46c0 con 0x7f2df015dee0 2024-02-19T06:58:02.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.149+0000 7f2df6000640 1 -- 172.21.15.46:0/3785567502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df00b5790 con 0x7f2df015dee0 2024-02-19T06:58:02.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.150+0000 7f2de7400640 1 -- 172.21.15.46:0/3785567502 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2dd8003990 con 0x7f2df015dee0 2024-02-19T06:58:02.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.151+0000 7f2de7400640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2dcc06b840 0x7f2dcc06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.151+0000 7f2de7400640 1 -- 172.21.15.46:0/3785567502 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2dd8089700 con 0x7f2df015dee0 2024-02-19T06:58:02.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.152+0000 7f2def400640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2dcc06b840 0x7f2dcc06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.153+0000 7f2def400640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2dcc06b840 0x7f2dcc06dd00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2de0001d40 tx=0x7f2de0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.156+0000 7f2de7400640 1 -- 172.21.15.46:0/3785567502 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2df00b5790 con 0x7f2df015dee0 2024-02-19T06:58:02.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.347+0000 7f2df6000640 1 -- 172.21.15.46:0/3785567502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2df00b5790 con 0x7f2df015dee0 2024-02-19T06:58:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.349+0000 7f2de7400640 1 -- 172.21.15.46:0/3785567502 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f2df00b5790 con 0x7f2df015dee0 2024-02-19T06:58:02.352 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:02.352 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:56.828629+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.352+0000 7f2df6000640 1 -- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2dcc06b840 msgr2=0x7f2dcc06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.352+0000 7f2df6000640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2dcc06b840 0x7f2dcc06dd00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2de0001d40 tx=0x7f2de0009040 comp rx=0 tx=0).stop 2024-02-19T06:58:02.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.352+0000 7f2df6000640 1 -- 172.21.15.46:0/3785567502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df015dee0 msgr2=0x7f2df014ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.352+0000 7f2df6000640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df015dee0 0x7f2df014ce20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800c400 tx=0x7f2dd800c8c0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.352+0000 7f2df6000640 1 -- 172.21.15.46:0/3785567502 shutdown_connections 2024-02-19T06:58:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.352+0000 7f2df6000640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2dcc06b840 0x7f2dcc06dd00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.352+0000 7f2df6000640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df00b4210 0x7f2df00b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.352+0000 7f2df6000640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df015dee0 0x7f2df014ce20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.352+0000 7f2df6000640 1 --2- 172.21.15.46:0/3785567502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df00b2790 0x7f2df00cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.352+0000 7f2df6000640 1 -- 172.21.15.46:0/3785567502 >> 172.21.15.46:0/3785567502 conn(0x7f2df00b3150 msgr2=0x7f2df00709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.352+0000 7f2df6000640 1 -- 172.21.15.46:0/3785567502 shutdown_connections 2024-02-19T06:58:02.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.352+0000 7f2df6000640 1 -- 172.21.15.46:0/3785567502 wait complete. 2024-02-19T06:58:02.373 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-19T06:58:02.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-19T06:58:02.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-19T06:58:02.375 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-19T06:58:02.375 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-19T06:58:02.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-19T06:58:02.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-19T06:58:02.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-19T06:58:02.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.677+0000 7f282aa00640 1 Processor -- start 2024-02-19T06:58:02.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.677+0000 7f282aa00640 1 -- start start 2024-02-19T06:58:02.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.679+0000 7f282aa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f282415d960 0x7f282406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.679+0000 7f282aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28240d1320 0x7f28240cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.679+0000 7f282aa00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f28240d1c50 0x7f28240d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.679+0000 7f282aa00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282415dd40 con 0x7f282415d960 2024-02-19T06:58:02.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.679+0000 7f282aa00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28240ce260 con 0x7f28240d1c50 2024-02-19T06:58:02.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.679+0000 7f282aa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28240ce500 con 0x7f28240d1320 2024-02-19T06:58:02.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.681+0000 7f2823e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f282415d960 0x7f282406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.681+0000 7f2823e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f282415d960 0x7f282406bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38088/0 (socket says 172.21.15.46:38088) 2024-02-19T06:58:02.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.681+0000 7f2823e00640 1 -- 172.21.15.46:0/3530314486 learned_addr learned my addr 172.21.15.46:0/3530314486 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.681+0000 7f2823400640 1 --2- 172.21.15.46:0/3530314486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28240d1320 0x7f28240cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.681+0000 7f2828a00640 1 --2- 172.21.15.46:0/3530314486 >> v2:172.21.15.142:3300/0 conn(0x7f28240d1c50 0x7f28240d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.681+0000 7f2823e00640 1 -- 172.21.15.46:0/3530314486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28240d1320 msgr2=0x7f28240cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:02.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.681+0000 7f2823e00640 1 --2- 172.21.15.46:0/3530314486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28240d1320 0x7f28240cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.681+0000 7f2823e00640 1 -- 172.21.15.46:0/3530314486 >> v2:172.21.15.142:3300/0 conn(0x7f28240d1c50 msgr2=0x7f28240d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:02.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.681+0000 7f2823e00640 1 --2- 172.21.15.46:0/3530314486 >> v2:172.21.15.142:3300/0 conn(0x7f28240d1c50 0x7f28240d20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.681+0000 7f2823e00640 1 -- 172.21.15.46:0/3530314486 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28240d2620 con 0x7f282415d960 2024-02-19T06:58:02.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.682+0000 7f2828a00640 1 --2- 172.21.15.46:0/3530314486 >> v2:172.21.15.142:3300/0 conn(0x7f28240d1c50 0x7f28240d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:02.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.682+0000 7f90da400640 1 Processor -- start 2024-02-19T06:58:02.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.682+0000 7f90da400640 1 -- start start 2024-02-19T06:58:02.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.683+0000 7f2823e00640 1 --2- 172.21.15.46:0/3530314486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282415d960 0x7f282406bc00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f282406d980 tx=0x7f281c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94bfae2915bcbf1 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.684+0000 7f2822a00640 1 -- 172.21.15.46:0/3530314486 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c02ca70 con 0x7f282415d960 2024-02-19T06:58:02.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.684+0000 7f2822a00640 1 -- 172.21.15.46:0/3530314486 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c02cbd0 con 0x7f282415d960 2024-02-19T06:58:02.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.684+0000 7f2822a00640 1 -- 172.21.15.46:0/3530314486 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c0343f0 con 0x7f282415d960 2024-02-19T06:58:02.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.684+0000 7f90da400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90d415dc20 0x7f90d406c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.684+0000 7f90da400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f90d406c9b0 0x7f90d40d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.684+0000 7f90da400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d4161f20 con 0x7f90d415d840 2024-02-19T06:58:02.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.684+0000 7f90da400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d41624a0 con 0x7f90d406c9b0 2024-02-19T06:58:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.685+0000 7f282aa00640 1 -- 172.21.15.46:0/3530314486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282415d960 msgr2=0x7f282406bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.685+0000 7f282aa00640 1 --2- 172.21.15.46:0/3530314486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282415d960 0x7f282406bc00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f282406d980 tx=0x7f281c02bed0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.685+0000 7f282aa00640 1 -- 172.21.15.46:0/3530314486 shutdown_connections 2024-02-19T06:58:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.685+0000 7f282aa00640 1 --2- 172.21.15.46:0/3530314486 >> v2:172.21.15.142:3300/0 conn(0x7f28240d1c50 0x7f28240d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.685+0000 7f282aa00640 1 --2- 172.21.15.46:0/3530314486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28240d1320 0x7f28240cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.685+0000 7f282aa00640 1 --2- 172.21.15.46:0/3530314486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f282415d960 0x7f282406bc00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.685+0000 7f282aa00640 1 -- 172.21.15.46:0/3530314486 >> 172.21.15.46:0/3530314486 conn(0x7f282409c9e0 msgr2=0x7f282408afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.684+0000 7f90da400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d40ce280 con 0x7f90d415dc20 2024-02-19T06:58:02.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.686+0000 7f282aa00640 1 -- 172.21.15.46:0/3530314486 shutdown_connections 2024-02-19T06:58:02.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.686+0000 7f90d9a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f90d406c9b0 0x7f90d40d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.686+0000 7f90d9a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f90d406c9b0 0x7f90d40d1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38098/0 (socket says 172.21.15.46:38098) 2024-02-19T06:58:02.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.687+0000 7f90d3e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90d415dc20 0x7f90d406c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.687+0000 7f90d3e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90d415dc20 0x7f90d406c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43074/0 (socket says 172.21.15.46:43074) 2024-02-19T06:58:02.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.687+0000 7f90d3e00640 1 -- 172.21.15.46:0/4190154817 learned_addr learned my addr 172.21.15.46:0/4190154817 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.685+0000 7fbc24c00640 1 Processor -- start 2024-02-19T06:58:02.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.685+0000 7fbc24c00640 1 -- start start 2024-02-19T06:58:02.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.687+0000 7f90d9a00640 1 -- 172.21.15.46:0/4190154817 >> v2:172.21.15.142:3300/0 conn(0x7f90d415dc20 msgr2=0x7f90d406c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.687+0000 7f90d9a00640 1 --2- 172.21.15.46:0/4190154817 >> v2:172.21.15.142:3300/0 conn(0x7f90d415dc20 0x7f90d406c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.687+0000 7f90d9a00640 1 -- 172.21.15.46:0/4190154817 >> v1:172.21.15.46:6789/0 conn(0x7f90d415d840 legacy=0x7f90d4161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.687+0000 7f90d9a00640 1 -- 172.21.15.46:0/4190154817 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d40ce520 con 0x7f90d406c9b0 2024-02-19T06:58:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.687+0000 7fbc24c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbc200b27f0 0x7fbc200afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.687+0000 7fbc24c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc200cf210 0x7fbc200cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.687+0000 7fbc24c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc20166750 con 0x7fbc20161d10 2024-02-19T06:58:02.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.687+0000 7fbc24c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc201620f0 con 0x7fbc200b27f0 2024-02-19T06:58:02.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.687+0000 7fbc24c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200b00b0 con 0x7fbc200cf210 2024-02-19T06:58:02.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.686+0000 7f282aa00640 1 -- 172.21.15.46:0/3530314486 wait complete. 2024-02-19T06:58:02.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.688+0000 7fbc1e800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc200cf210 0x7fbc200cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.689+0000 7fbc1d400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbc200b27f0 0x7fbc200afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.689+0000 7fbc1de00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbc20161d10 0x7fbc200b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53204/0 (socket says 172.21.15.46:53204) 2024-02-19T06:58:02.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.689+0000 7fbc1de00640 1 -- 172.21.15.46:0/2058337556 learned_addr learned my addr 172.21.15.46:0/2058337556 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:02.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.690+0000 7f282aa00640 1 Processor -- start 2024-02-19T06:58:02.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.689+0000 7f90d9a00640 1 --2- 172.21.15.46:0/4190154817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d406c9b0 0x7f90d40d1c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0097a0 tx=0x7f90cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9209bfe0b403b9bc server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.690+0000 7f8fb1800640 1 Processor -- start 2024-02-19T06:58:02.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.690+0000 7f8fb1800640 1 -- start start 2024-02-19T06:58:02.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.690+0000 7f282aa00640 1 -- start start 2024-02-19T06:58:02.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.690+0000 7fbc1e800640 1 -- 172.21.15.46:0/2058337556 >> v2:172.21.15.46:3300/0 conn(0x7fbc200b27f0 msgr2=0x7fbc200afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:02.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.690+0000 7fbc1e800640 1 --2- 172.21.15.46:0/2058337556 >> v2:172.21.15.46:3300/0 conn(0x7fbc200b27f0 0x7fbc200afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.690+0000 7f90d3400640 1 -- 172.21.15.46:0/4190154817 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc02e070 con 0x7f90d406c9b0 2024-02-19T06:58:02.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.690+0000 7f90d3400640 1 -- 172.21.15.46:0/4190154817 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc0315a0 con 0x7f90d406c9b0 2024-02-19T06:58:02.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.690+0000 7f90d3400640 1 -- 172.21.15.46:0/4190154817 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc031930 con 0x7f90d406c9b0 2024-02-19T06:58:02.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.690+0000 7fbc1e800640 1 -- 172.21.15.46:0/2058337556 >> v1:172.21.15.46:6789/0 conn(0x7fbc20161d10 legacy=0x7fbc200b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.690+0000 7fbc1e800640 1 -- 172.21.15.46:0/2058337556 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc20165b40 con 0x7fbc200cf210 2024-02-19T06:58:02.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f90da400640 1 -- 172.21.15.46:0/4190154817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d406c9b0 msgr2=0x7f90d40d1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f90da400640 1 --2- 172.21.15.46:0/4190154817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d406c9b0 0x7f90d40d1c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0097a0 tx=0x7f90cc02b840 comp rx=0 tx=0).stop 2024-02-19T06:58:02.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f8fb1800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fac0acf20 0x7f8fac0ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f8fb1800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8fac0b3240 0x7f8fac15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f8fb1800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fac0b20e0 con 0x7f8fac15aa40 2024-02-19T06:58:02.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f8fb1800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fac154ed0 con 0x7f8fac0b3240 2024-02-19T06:58:02.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f8fb1800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac15b530 con 0x7f8fac0acf20 2024-02-19T06:58:02.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f282aa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28240d1320 0x7f2824150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f282aa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28240d1c50 0x7f28240c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f282aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28241f5a50 0x7f28240c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f282aa00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282413b110 con 0x7f28240d1c50 2024-02-19T06:58:02.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f282aa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28240c8d40 con 0x7f28240d1320 2024-02-19T06:58:02.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f282aa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282413b360 con 0x7f28241f5a50 2024-02-19T06:58:02.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f2823400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28240d1c50 0x7f28240c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f2823400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28240d1c50 0x7f28240c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38118/0 (socket says 172.21.15.46:38118) 2024-02-19T06:58:02.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.692+0000 7f2823400640 1 -- 172.21.15.46:0/2908951005 learned_addr learned my addr 172.21.15.46:0/2908951005 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f2828a00640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28241f5a50 0x7f28240c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f2823e00640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28240d1320 0x7f2824150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f90da400640 1 -- 172.21.15.46:0/4190154817 shutdown_connections 2024-02-19T06:58:02.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f90da400640 1 --2- 172.21.15.46:0/4190154817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d406c9b0 0x7f90d40d1c10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f90da400640 1 --2- 172.21.15.46:0/4190154817 >> v2:172.21.15.142:3300/0 conn(0x7f90d415dc20 0x7f90d406c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f90da400640 1 -- 172.21.15.46:0/4190154817 >> 172.21.15.46:0/4190154817 conn(0x7f90d409c9d0 msgr2=0x7f90d408afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f8faa000640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8fac15aa40 0x7f8fac0b2b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53214/0 (socket says 172.21.15.46:53214) 2024-02-19T06:58:02.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f8fab400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8fac0b3240 0x7f8fac15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f8fab400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8fac0b3240 0x7f8fac15aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38128/0 (socket says 172.21.15.46:38128) 2024-02-19T06:58:02.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f8fab400640 1 -- 172.21.15.46:0/4104873557 learned_addr learned my addr 172.21.15.46:0/4104873557 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f2823400640 1 -- 172.21.15.46:0/2908951005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28241f5a50 msgr2=0x7f28240c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f2823400640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28241f5a50 0x7f28240c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f2823400640 1 -- 172.21.15.46:0/2908951005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28240d1320 msgr2=0x7f2824150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f2823400640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28240d1320 0x7f2824150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f2823400640 1 -- 172.21.15.46:0/2908951005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c009b30 con 0x7f28240d1c50 2024-02-19T06:58:02.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7f8faaa00640 1 --2- 172.21.15.46:0/4104873557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fac0acf20 0x7f8fac0ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.693+0000 7fbc1e800640 1 --2- 172.21.15.46:0/2058337556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc200cf210 0x7fbc200cf6a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0097a0 tx=0x7fbc0c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcce3d49dcfe085f server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.694+0000 7f2823e00640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28240d1320 0x7f2824150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.694+0000 7f2823400640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28240d1c50 0x7f28240c82c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f281400d800 tx=0x7f281400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.694+0000 7f8fab400640 1 -- 172.21.15.46:0/4104873557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fac0acf20 msgr2=0x7f8fac0ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.694+0000 7f8fab400640 1 --2- 172.21.15.46:0/4104873557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fac0acf20 0x7f8fac0ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.694+0000 7f8fab400640 1 -- 172.21.15.46:0/4104873557 >> v1:172.21.15.46:6789/0 conn(0x7f8fac15aa40 legacy=0x7f8fac0b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.694+0000 7f8fab400640 1 -- 172.21.15.46:0/4104873557 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac15b810 con 0x7f8fac0b3240 2024-02-19T06:58:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.695+0000 7fbc1ca00640 1 -- 172.21.15.46:0/2058337556 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c02d040 con 0x7fbc200cf210 2024-02-19T06:58:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.695+0000 7fbc1ca00640 1 -- 172.21.15.46:0/2058337556 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0c031810 con 0x7fbc200cf210 2024-02-19T06:58:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.695+0000 7fbc1ca00640 1 -- 172.21.15.46:0/2058337556 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c031ba0 con 0x7fbc200cf210 2024-02-19T06:58:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.695+0000 7f281be00640 1 -- 172.21.15.46:0/2908951005 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28140096a0 con 0x7f28240d1c50 2024-02-19T06:58:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.695+0000 7f281be00640 1 -- 172.21.15.46:0/2908951005 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2814009800 con 0x7f28240d1c50 2024-02-19T06:58:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.695+0000 7f281be00640 1 -- 172.21.15.46:0/2908951005 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814009b90 con 0x7f28240d1c50 2024-02-19T06:58:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.694+0000 7f90da400640 1 -- 172.21.15.46:0/4190154817 shutdown_connections 2024-02-19T06:58:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.694+0000 7f90da400640 1 -- 172.21.15.46:0/4190154817 wait complete. 2024-02-19T06:58:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.696+0000 7f282aa00640 1 -- 172.21.15.46:0/2908951005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282413b640 con 0x7f28240d1c50 2024-02-19T06:58:02.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.696+0000 7f7d29400640 1 Processor -- start 2024-02-19T06:58:02.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.696+0000 7fea21c00640 1 Processor -- start 2024-02-19T06:58:02.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.696+0000 7fbc24c00640 1 -- 172.21.15.46:0/2058337556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc200cf210 msgr2=0x7fbc200cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.696+0000 7fbc24c00640 1 --2- 172.21.15.46:0/2058337556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc200cf210 0x7fbc200cf6a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0097a0 tx=0x7fbc0c02b8b0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.696+0000 7fea21c00640 1 -- start start 2024-02-19T06:58:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.696+0000 7fbc24c00640 1 -- 172.21.15.46:0/2058337556 shutdown_connections 2024-02-19T06:58:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.697+0000 7f90da400640 1 Processor -- start 2024-02-19T06:58:02.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.697+0000 7fbc24c00640 1 --2- 172.21.15.46:0/2058337556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc200cf210 0x7fbc200cf6a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.697+0000 7fbc24c00640 1 --2- 172.21.15.46:0/2058337556 >> v2:172.21.15.46:3300/0 conn(0x7fbc200b27f0 0x7fbc200afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.697+0000 7f90da400640 1 -- start start 2024-02-19T06:58:02.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.697+0000 7fbc24c00640 1 -- 172.21.15.46:0/2058337556 >> 172.21.15.46:0/2058337556 conn(0x7fbc200b4640 msgr2=0x7fbc200b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.696+0000 7f8fab400640 1 --2- 172.21.15.46:0/4104873557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fac0b3240 0x7f8fac15aec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009870 tx=0x7f8f9c02b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ad454e8c8ffed0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.697+0000 7f7d29400640 1 -- start start 2024-02-19T06:58:02.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.698+0000 7f282aa00640 1 -- 172.21.15.46:0/2908951005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282413bc00 con 0x7f28240d1c50 2024-02-19T06:58:02.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.698+0000 7f8fa9600640 1 -- 172.21.15.46:0/4104873557 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c031890 con 0x7f8fac0b3240 2024-02-19T06:58:02.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.698+0000 7fea21c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fea1c0d0650 0x7fea1c1665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.698+0000 7f90da400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d406c9b0 0x7f90d415f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.698+0000 7f8fa9600640 1 -- 172.21.15.46:0/4104873557 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0319f0 con 0x7f8fac0b3240 2024-02-19T06:58:02.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.698+0000 7f8fa9600640 1 -- 172.21.15.46:0/4104873557 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c031dc0 con 0x7f8fac0b3240 2024-02-19T06:58:02.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.698+0000 7fea21c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c06c470 con 0x7fea1c0b2c60 2024-02-19T06:58:02.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f282aa00640 1 -- 172.21.15.46:0/2908951005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28240d3290 con 0x7f28240d1c50 2024-02-19T06:58:02.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f90da400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d415d840 0x7f90d40b8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.698+0000 7fea21c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c0ce280 con 0x7fea1c0b2880 2024-02-19T06:58:02.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.698+0000 7fea21c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c0d2850 con 0x7fea1c0d0650 2024-02-19T06:58:02.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f90da400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d415dc20 0x7f90d40b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f90d9000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d406c9b0 0x7f90d415f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f90d9000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d406c9b0 0x7f90d415f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43104/0 (socket says 172.21.15.46:43104) 2024-02-19T06:58:02.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f90d9000640 1 -- 172.21.15.46:0/455858505 learned_addr learned my addr 172.21.15.46:0/455858505 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f90da400640 1 -- 172.21.15.46:0/455858505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d415e5a0 con 0x7f90d415d840 2024-02-19T06:58:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f90da400640 1 -- 172.21.15.46:0/455858505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d415e880 con 0x7f90d406c9b0 2024-02-19T06:58:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f90da400640 1 -- 172.21.15.46:0/455858505 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d415eb60 con 0x7f90d415dc20 2024-02-19T06:58:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7fea1be00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fea1c0b2880 0x7fea1c0cff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:52556/0 (socket says 172.21.15.46:52556) 2024-02-19T06:58:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7fea1be00640 1 -- 172.21.15.46:0/812791051 learned_addr learned my addr 172.21.15.46:0/812791051 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7fbc24c00640 1 -- 172.21.15.46:0/2058337556 shutdown_connections 2024-02-19T06:58:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7f90d3e00640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d415d840 0x7f90d40b8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7f90d9a00640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d415dc20 0x7f90d40b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7f994ac00640 1 Processor -- start 2024-02-19T06:58:02.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7f8fb1800640 1 -- 172.21.15.46:0/4104873557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fac0b3240 msgr2=0x7f8fac15aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7f8fb1800640 1 --2- 172.21.15.46:0/4104873557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fac0b3240 0x7f8fac15aec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009870 tx=0x7f8f9c02b930 comp rx=0 tx=0).stop 2024-02-19T06:58:02.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f7d29400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7d24162390 0x7f7d240d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f7d29400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d240d0760 0x7f7d240d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f7d29400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d240d1ee0 0x7f7d240b5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f7d29400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d240d0bf0 con 0x7f7d24162390 2024-02-19T06:58:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f7d29400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d240d36c0 con 0x7f7d240d0760 2024-02-19T06:58:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.699+0000 7f7d29400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240d2620 con 0x7f7d240d1ee0 2024-02-19T06:58:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7f7d21e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d240d0760 0x7f7d240d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7f7d23200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d240d1ee0 0x7f7d240b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7f7d21e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d240d0760 0x7f7d240d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43112/0 (socket says 172.21.15.46:43112) 2024-02-19T06:58:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7f7d21e00640 1 -- 172.21.15.46:0/2069083481 learned_addr learned my addr 172.21.15.46:0/2069083481 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7f994ac00640 1 -- start start 2024-02-19T06:58:02.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7fea1b400640 1 --2- 172.21.15.46:0/812791051 >> v2:172.21.15.46:3300/0 conn(0x7fea1c0d0650 0x7fea1c1665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f90d9000640 1 -- 172.21.15.46:0/455858505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d415dc20 msgr2=0x7f90d40b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f90d9000640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d415dc20 0x7f90d40b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f90d9000640 1 -- 172.21.15.46:0/455858505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d415d840 msgr2=0x7f90d40b8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f90d9000640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d415d840 0x7f90d40b8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f90d9000640 1 -- 172.21.15.46:0/455858505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc009400 con 0x7f90d406c9b0 2024-02-19T06:58:02.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7fbc24c00640 1 -- 172.21.15.46:0/2058337556 wait complete. 2024-02-19T06:58:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f8fb1800640 1 -- 172.21.15.46:0/4104873557 shutdown_connections 2024-02-19T06:58:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f8fb1800640 1 --2- 172.21.15.46:0/4104873557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fac0b3240 0x7f8fac15aec0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f8fb1800640 1 --2- 172.21.15.46:0/4104873557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fac0acf20 0x7f8fac0ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f8fb1800640 1 -- 172.21.15.46:0/4104873557 >> 172.21.15.46:0/4104873557 conn(0x7f8fac0b1410 msgr2=0x7f8fac06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f7d22800640 1 --2- 172.21.15.46:0/2069083481 >> v2:172.21.15.46:3300/0 conn(0x7f7d24162390 0x7f7d240d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f7d23200640 1 -- 172.21.15.46:0/2069083481 >> v2:172.21.15.142:3300/0 conn(0x7f7d240d0760 msgr2=0x7f7d240d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f7d23200640 1 --2- 172.21.15.46:0/2069083481 >> v2:172.21.15.142:3300/0 conn(0x7f7d240d0760 0x7f7d240d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f7d23200640 1 -- 172.21.15.46:0/2069083481 >> v2:172.21.15.46:3300/0 conn(0x7f7d24162390 msgr2=0x7f7d240d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f7d23200640 1 --2- 172.21.15.46:0/2069083481 >> v2:172.21.15.46:3300/0 conn(0x7f7d24162390 0x7f7d240d0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7f7d23200640 1 -- 172.21.15.46:0/2069083481 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d240d2900 con 0x7f7d240d1ee0 2024-02-19T06:58:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7fea1b400640 1 -- 172.21.15.46:0/812791051 >> v1:172.21.15.142:6789/0 conn(0x7fea1c0b2880 legacy=0x7fea1c0cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7fea1b400640 1 -- 172.21.15.46:0/812791051 >> v1:172.21.15.46:6789/0 conn(0x7fea1c0b2c60 legacy=0x7fea1c0ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.701+0000 7fea1b400640 1 -- 172.21.15.46:0/812791051 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c0d1c40 con 0x7fea1c0d0650 2024-02-19T06:58:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.700+0000 7f281be00640 1 -- 172.21.15.46:0/2908951005 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2814009cf0 con 0x7f28240d1c50 2024-02-19T06:58:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.702+0000 7f281be00640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f280406b860 0x7f280406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.702+0000 7f90d9000640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d406c9b0 0x7f90d415f640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90c000c410 tx=0x7f90c000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.702+0000 7f281be00640 1 -- 172.21.15.46:0/2908951005 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f281408a5b0 con 0x7f28240d1c50 2024-02-19T06:58:02.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7f281be00640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] conn(0x7f2804073a80 0x7f2804075ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7f2823e00640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f280406b860 0x7f280406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.702+0000 7f8fb1800640 1 -- 172.21.15.46:0/4104873557 shutdown_connections 2024-02-19T06:58:02.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7f281be00640 1 -- 172.21.15.46:0/2908951005 --> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2804076550 con 0x7f2804073a80 2024-02-19T06:58:02.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7f281be00640 1 -- 172.21.15.46:0/2908951005 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f281408ccc0 con 0x7f28240d1c50 2024-02-19T06:58:02.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7f90d0c00640 1 -- 172.21.15.46:0/455858505 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00035f0 con 0x7f90d406c9b0 2024-02-19T06:58:02.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7f90da400640 1 -- 172.21.15.46:0/455858505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d415ee40 con 0x7f90d406c9b0 2024-02-19T06:58:02.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7f90da400640 1 -- 172.21.15.46:0/455858505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d40b9480 con 0x7f90d406c9b0 2024-02-19T06:58:02.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7f90d0c00640 1 -- 172.21.15.46:0/455858505 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c0003750 con 0x7f90d406c9b0 2024-02-19T06:58:02.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7f90d0c00640 1 -- 172.21.15.46:0/455858505 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0003ae0 con 0x7f90d406c9b0 2024-02-19T06:58:02.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7f994ac00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f993c0df220 0x7f993c038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7fbc24c00640 1 Processor -- start 2024-02-19T06:58:02.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.704+0000 7f7d23200640 1 --2- 172.21.15.46:0/2069083481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d240d1ee0 0x7f7d240b5360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7d240ca940 tx=0x7f7d1002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=521a43d5ac4f3707 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.704+0000 7f9949800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f993c0df220 0x7f993c038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.704+0000 7f9949800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f993c0df220 0x7f993c038080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38178/0 (socket says 172.21.15.46:38178) 2024-02-19T06:58:02.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.704+0000 7f9949800640 1 -- 172.21.15.46:0/3445125422 learned_addr learned my addr 172.21.15.46:0/3445125422 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7fea1b400640 1 --2- 172.21.15.46:0/812791051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c0d0650 0x7fea1c1665a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fea080097a0 tx=0x7fea0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b73b11c0314e0ae server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.704+0000 7f994ac00640 1 --2- 172.21.15.46:0/3445125422 >> v2:172.21.15.142:3300/0 conn(0x7f993c053c70 0x7f993c04fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.704+0000 7fea1aa00640 1 -- 172.21.15.46:0/812791051 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08031830 con 0x7fea1c0d0650 2024-02-19T06:58:02.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.704+0000 7f7d21400640 1 -- 172.21.15.46:0/2069083481 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1002e070 con 0x7f7d240d1ee0 2024-02-19T06:58:02.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.704+0000 7f90ca000640 1 -- 172.21.15.46:0/455858505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90d4161c40 con 0x7f90d406c9b0 2024-02-19T06:58:02.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7f7d21400640 1 -- 172.21.15.46:0/2069083481 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d100315a0 con 0x7f7d240d1ee0 2024-02-19T06:58:02.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7f7d21400640 1 -- 172.21.15.46:0/2069083481 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10031930 con 0x7f7d240d1ee0 2024-02-19T06:58:02.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7f994ac00640 1 -- 172.21.15.46:0/3445125422 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993c0544c0 con 0x7f993c033ef0 2024-02-19T06:58:02.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.704+0000 7fbc24c00640 1 -- start start 2024-02-19T06:58:02.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7f994ac00640 1 -- 172.21.15.46:0/3445125422 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993c0541e0 con 0x7f993c0df220 2024-02-19T06:58:02.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7f994ac00640 1 -- 172.21.15.46:0/3445125422 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993c005f30 con 0x7f993c053c70 2024-02-19T06:58:02.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7fbc24c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc200b27f0 0x7fbc201509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7fbc24c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc200cf210 0x7fbc200992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7f9948e00640 1 --2- 172.21.15.46:0/3445125422 >> v2:172.21.15.142:3300/0 conn(0x7f993c053c70 0x7f993c04fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7fbc24c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc20161d10 0x7fbc200997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7fbc24c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc20150ef0 con 0x7fbc200cf210 2024-02-19T06:58:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7fbc24c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200ae120 con 0x7fbc200b27f0 2024-02-19T06:58:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7fbc24c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc20162ba0 con 0x7fbc20161d10 2024-02-19T06:58:02.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7f8fb1800640 1 -- 172.21.15.46:0/4104873557 wait complete. 2024-02-19T06:58:02.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7f7d29400640 1 -- 172.21.15.46:0/2069083481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d240d1ee0 msgr2=0x7f7d240b5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7f7d29400640 1 --2- 172.21.15.46:0/2069083481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d240d1ee0 0x7f7d240b5360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7d240ca940 tx=0x7f7d1002b840 comp rx=0 tx=0).stop 2024-02-19T06:58:02.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7fea1aa00640 1 -- 172.21.15.46:0/812791051 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea08031990 con 0x7fea1c0d0650 2024-02-19T06:58:02.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.705+0000 7fea1aa00640 1 -- 172.21.15.46:0/812791051 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08031d20 con 0x7fea1c0d0650 2024-02-19T06:58:02.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.703+0000 7f2828a00640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] conn(0x7f2804073a80 0x7f2804075ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f2828a00640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] conn(0x7f2804073a80 0x7f2804075ea0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f7d29400640 1 -- 172.21.15.46:0/2069083481 shutdown_connections 2024-02-19T06:58:02.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f7d29400640 1 --2- 172.21.15.46:0/2069083481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d240d1ee0 0x7f7d240b5360 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f7d29400640 1 --2- 172.21.15.46:0/2069083481 >> v2:172.21.15.142:3300/0 conn(0x7f7d240d0760 0x7f7d240d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f7d29400640 1 --2- 172.21.15.46:0/2069083481 >> v2:172.21.15.46:3300/0 conn(0x7f7d24162390 0x7f7d240d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f7d29400640 1 -- 172.21.15.46:0/2069083481 >> 172.21.15.46:0/2069083481 conn(0x7f7d2406be20 msgr2=0x7f7d2406c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f8fb1800640 1 Processor -- start 2024-02-19T06:58:02.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f7d29400640 1 -- 172.21.15.46:0/2069083481 shutdown_connections 2024-02-19T06:58:02.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f8fb1800640 1 -- start start 2024-02-19T06:58:02.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f9949800640 1 -- 172.21.15.46:0/3445125422 >> v2:172.21.15.142:3300/0 conn(0x7f993c053c70 msgr2=0x7f993c04fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:02.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7fbc1de00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc200b27f0 0x7fbc201509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f7d29400640 1 -- 172.21.15.46:0/2069083481 wait complete. 2024-02-19T06:58:02.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7fbc1d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc200cf210 0x7fbc200992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f9949800640 1 --2- 172.21.15.46:0/3445125422 >> v2:172.21.15.142:3300/0 conn(0x7f993c053c70 0x7f993c04fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f9949800640 1 -- 172.21.15.46:0/3445125422 >> v1:172.21.15.142:6789/0 conn(0x7f993c033ef0 legacy=0x7f993c006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.706+0000 7f9949800640 1 -- 172.21.15.46:0/3445125422 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c006210 con 0x7f993c0df220 2024-02-19T06:58:02.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.707+0000 7f9948e00640 1 --2- 172.21.15.46:0/3445125422 >> v2:172.21.15.142:3300/0 conn(0x7f993c053c70 0x7f993c04fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:02.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.707+0000 7fbc1d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc200cf210 0x7fbc200992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38180/0 (socket says 172.21.15.46:38180) 2024-02-19T06:58:02.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.707+0000 7fbc1d400640 1 -- 172.21.15.46:0/3455392969 learned_addr learned my addr 172.21.15.46:0/3455392969 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.707+0000 7f8fb1800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fac0acf20 0x7f8fac095c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.707+0000 7f8fb1800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fac0b3240 0x7f8fac151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7f8fb1800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fac15aa40 0x7f8fac0ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7fea21c00640 1 -- 172.21.15.46:0/812791051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c0d0650 msgr2=0x7fea1c1665a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7fea21c00640 1 --2- 172.21.15.46:0/812791051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c0d0650 0x7fea1c1665a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fea080097a0 tx=0x7fea0802b8d0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7f8fb1800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac151c60 con 0x7f8fac0acf20 2024-02-19T06:58:02.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7f8fb1800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac098eb0 con 0x7f8fac15aa40 2024-02-19T06:58:02.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7f8fb1800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac098650 con 0x7f8fac0b3240 2024-02-19T06:58:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7fbc1d400640 1 -- 172.21.15.46:0/3455392969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc20161d10 msgr2=0x7fbc200997f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-19T06:58:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7fbc1d400640 1 --2- 172.21.15.46:0/3455392969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc20161d10 0x7fbc200997f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7fbc1d400640 1 -- 172.21.15.46:0/3455392969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc200b27f0 msgr2=0x7fbc201509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7fbc1d400640 1 --2- 172.21.15.46:0/3455392969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc200b27f0 0x7fbc201509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7fbc1d400640 1 -- 172.21.15.46:0/3455392969 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c009400 con 0x7fbc200cf210 2024-02-19T06:58:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7f90d0c00640 1 -- 172.21.15.46:0/455858505 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f90c0003c40 con 0x7f90d406c9b0 2024-02-19T06:58:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7f281be00640 1 -- 172.21.15.46:0/2908951005 <== osd.0 v2:172.21.15.46:6808/3877139085 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2804076550 con 0x7f2804073a80 2024-02-19T06:58:02.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7fea21c00640 1 -- 172.21.15.46:0/812791051 shutdown_connections 2024-02-19T06:58:02.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7fea21c00640 1 --2- 172.21.15.46:0/812791051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c0d0650 0x7fea1c1665a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7fea21c00640 1 -- 172.21.15.46:0/812791051 >> 172.21.15.46:0/812791051 conn(0x7fea1c09c9d0 msgr2=0x7fea1c08afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7f2823e00640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f280406b860 0x7f280406dd20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f281c035000 tx=0x7f281c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7f8faa000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fac0b3240 0x7f8fac151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7f8faaa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fac0acf20 0x7f8fac095c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7f8fab400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fac15aa40 0x7f8fac0ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7f8faa000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fac0b3240 0x7f8fac151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:45944/0 (socket says 172.21.15.46:45944) 2024-02-19T06:58:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.708+0000 7f8faa000640 1 -- 172.21.15.46:0/1650867802 learned_addr learned my addr 172.21.15.46:0/1650867802 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.709+0000 7f7d29400640 1 Processor -- start 2024-02-19T06:58:02.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.709+0000 7fea21c00640 1 -- 172.21.15.46:0/812791051 shutdown_connections 2024-02-19T06:58:02.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.709+0000 7fea21c00640 1 -- 172.21.15.46:0/812791051 wait complete. 2024-02-19T06:58:02.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.709+0000 7f7d29400640 1 -- start start 2024-02-19T06:58:02.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.709+0000 7f90d0c00640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f90b406b860 0x7f90b406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.709+0000 7f90d0c00640 1 -- 172.21.15.46:0/455858505 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90c008a190 con 0x7f90d406c9b0 2024-02-19T06:58:02.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.709+0000 7fbc1d400640 1 --2- 172.21.15.46:0/3455392969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc200cf210 0x7fbc200992b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000d8f0 tx=0x7fbc1000ddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f90d0c00640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] conn(0x7f90b4073a80 0x7f90b4075ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f90d0c00640 1 -- 172.21.15.46:0/455858505 --> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90b4076550 con 0x7f90b4073a80 2024-02-19T06:58:02.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f90d0c00640 1 -- 172.21.15.46:0/455858505 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90c008a630 con 0x7f90d406c9b0 2024-02-19T06:58:02.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f8faa000640 1 -- 172.21.15.46:0/1650867802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fac15aa40 msgr2=0x7f8fac0ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f8faa000640 1 --2- 172.21.15.46:0/1650867802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fac15aa40 0x7f8fac0ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f8faa000640 1 -- 172.21.15.46:0/1650867802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fac0acf20 msgr2=0x7f8fac095c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f8faa000640 1 --2- 172.21.15.46:0/1650867802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fac0acf20 0x7f8fac095c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f8faa000640 1 -- 172.21.15.46:0/1650867802 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c0094d0 con 0x7f8fac0b3240 2024-02-19T06:58:02.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f8fab400640 1 --2- 172.21.15.46:0/1650867802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fac15aa40 0x7f8fac0ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:58:02.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f90d3e00640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f90b406b860 0x7f90b406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.709+0000 7f9949800640 1 --2- 172.21.15.46:0/3445125422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c0df220 0x7f993c038080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f993c00b3f0 tx=0x7f993002db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e1fb41fee8c6a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f8faa000640 1 --2- 172.21.15.46:0/1650867802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fac0b3240 0x7f8fac151720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800c3e0 tx=0x7f8f9800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f90d9a00640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] conn(0x7f90b4073a80 0x7f90b4075ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7fbc16000640 1 -- 172.21.15.46:0/3455392969 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000b6c0 con 0x7fbc200cf210 2024-02-19T06:58:02.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f7d29400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d240d0760 0x7f7d2414cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7f7d29400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d240d1ee0 0x7f7d2415c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.711+0000 7f7d29400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d24162390 0x7f7d24159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.711+0000 7f7d29400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2414d2c0 con 0x7f7d240d1ee0 2024-02-19T06:58:02.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.711+0000 7f7d29400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240cbfa0 con 0x7f7d240d0760 2024-02-19T06:58:02.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.711+0000 7f7d29400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240cc280 con 0x7f7d24162390 2024-02-19T06:58:02.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.711+0000 7f8fa2a00640 1 -- 172.21.15.46:0/1650867802 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f980074e0 con 0x7f8fac0b3240 2024-02-19T06:58:02.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.711+0000 7f8fa2a00640 1 -- 172.21.15.46:0/1650867802 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f98007640 con 0x7f8fac0b3240 2024-02-19T06:58:02.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.711+0000 7f8fa2a00640 1 -- 172.21.15.46:0/1650867802 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f980049e0 con 0x7f8fac0b3240 2024-02-19T06:58:02.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.711+0000 7f8fb1800640 1 -- 172.21.15.46:0/1650867802 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fac0aed80 con 0x7f8fac0b3240 2024-02-19T06:58:02.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.711+0000 7f8fb1800640 1 -- 172.21.15.46:0/1650867802 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fac098bd0 con 0x7f8fac0b3240 2024-02-19T06:58:02.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.711+0000 7f7d22800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d240d0760 0x7f7d2414cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.711+0000 7f7d22800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d240d0760 0x7f7d2414cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43148/0 (socket says 172.21.15.46:43148) 2024-02-19T06:58:02.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.711+0000 7f9943e00640 1 -- 172.21.15.46:0/3445125422 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993002f8e0 con 0x7f993c0df220 2024-02-19T06:58:02.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.712+0000 7f7d22800640 1 -- 172.21.15.46:0/1714154238 learned_addr learned my addr 172.21.15.46:0/1714154238 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.712+0000 7f7d23200640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d24162390 0x7f7d24159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.712+0000 7fea21c00640 1 Processor -- start 2024-02-19T06:58:02.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.712+0000 7f8fb1800640 1 -- 172.21.15.46:0/1650867802 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8fac0b2610 con 0x7f8fac0b3240 2024-02-19T06:58:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.712+0000 7f7d21e00640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d240d1ee0 0x7f7d2415c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.712+0000 7f9943e00640 1 -- 172.21.15.46:0/3445125422 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993002fa40 con 0x7f993c0df220 2024-02-19T06:58:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.712+0000 7f9943e00640 1 -- 172.21.15.46:0/3445125422 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993002f8e0 con 0x7f993c0df220 2024-02-19T06:58:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.712+0000 7f74f2000640 1 Processor -- start 2024-02-19T06:58:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.711+0000 7f90d9a00640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] conn(0x7f90b4073a80 0x7f90b4075ea0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7fbc16000640 1 -- 172.21.15.46:0/3455392969 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1000b820 con 0x7fbc200cf210 2024-02-19T06:58:02.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7fbc16000640 1 -- 172.21.15.46:0/3455392969 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000bbb0 con 0x7fbc200cf210 2024-02-19T06:58:02.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7fbc24c00640 1 -- 172.21.15.46:0/3455392969 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc20162e80 con 0x7fbc200cf210 2024-02-19T06:58:02.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.710+0000 7fbc24c00640 1 -- 172.21.15.46:0/3455392969 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc20163440 con 0x7fbc200cf210 2024-02-19T06:58:02.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.712+0000 7fbc24c00640 1 -- 172.21.15.46:0/3455392969 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbbf8001030 con 0x7fbc200cf210 2024-02-19T06:58:02.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f90d0c00640 1 -- 172.21.15.46:0/455858505 <== osd.2 v2:172.21.15.46:6800/1495872287 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f90b4076550 con 0x7f90b4073a80 2024-02-19T06:58:02.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f74f2000640 1 -- start start 2024-02-19T06:58:02.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f90d3e00640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f90b406b860 0x7f90b406dd20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f90d40b21f0 tx=0x7f90c400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f7d22800640 1 -- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d24162390 msgr2=0x7f7d24159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7fea21c00640 1 -- start start 2024-02-19T06:58:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f994ac00640 1 -- 172.21.15.46:0/3445125422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c0df220 msgr2=0x7f993c038080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f994ac00640 1 --2- 172.21.15.46:0/3445125422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c0df220 0x7f993c038080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f993c00b3f0 tx=0x7f993002db20 comp rx=0 tx=0).stop 2024-02-19T06:58:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f994ac00640 1 -- 172.21.15.46:0/3445125422 shutdown_connections 2024-02-19T06:58:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f994ac00640 1 --2- 172.21.15.46:0/3445125422 >> v2:172.21.15.142:3300/0 conn(0x7f993c053c70 0x7f993c04fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f994ac00640 1 --2- 172.21.15.46:0/3445125422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c0df220 0x7f993c038080 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f994ac00640 1 -- 172.21.15.46:0/3445125422 >> 172.21.15.46:0/3445125422 conn(0x7f993c009fb0 msgr2=0x7f993c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f7d22800640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d24162390 0x7f7d24159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f7d22800640 1 -- 172.21.15.46:0/1714154238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d240d1ee0 msgr2=0x7f7d2415c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f7d22800640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d240d1ee0 0x7f7d2415c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.713+0000 7f7d22800640 1 -- 172.21.15.46:0/1714154238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10009400 con 0x7f7d240d0760 2024-02-19T06:58:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.714+0000 7f994ac00640 1 -- 172.21.15.46:0/3445125422 shutdown_connections 2024-02-19T06:58:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.714+0000 7f994ac00640 1 -- 172.21.15.46:0/3445125422 wait complete. 2024-02-19T06:58:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.714+0000 7f7d21e00640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d240d1ee0 0x7f7d2415c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:02.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.714+0000 7f74f2000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ec15d770 0x7f74ec06cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.714+0000 7f74f2000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f74ec0d1c60 0x7f74ec0d20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.715+0000 7f7d22800640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d240d0760 0x7f7d2414cd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00cdf0 tx=0x7f7d1c00a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.715+0000 7f74f2000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ec0b2db0 con 0x7f74ec161430 2024-02-19T06:58:02.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.715+0000 7f74f2000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ec06d510 con 0x7f74ec0d1c60 2024-02-19T06:58:02.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.715+0000 7f74f2000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0d2610 con 0x7f74ec15d770 2024-02-19T06:58:02.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.715+0000 7fea21c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c0b2880 0x7fea1c0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.715+0000 7f7d1aa00640 1 -- 172.21.15.46:0/1714154238 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c003b90 con 0x7f7d240d0760 2024-02-19T06:58:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.715+0000 7f74f0c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ec15d770 0x7f74ec06cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.715+0000 7fbc16000640 1 -- 172.21.15.46:0/3455392969 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbc1000bd10 con 0x7fbc200cf210 2024-02-19T06:58:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.715+0000 7f7d29400640 1 -- 172.21.15.46:0/1714154238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d240cc560 con 0x7f7d240d0760 2024-02-19T06:58:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.715+0000 7fea21c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea1c0b2c60 0x7fea1c203540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.715+0000 7f74e3e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f74ec0d1c60 0x7f74ec0d20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.715+0000 7f74f0c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ec15d770 0x7f74ec06cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:45954/0 (socket says 172.21.15.46:45954) 2024-02-19T06:58:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.715+0000 7f74f0c00640 1 -- 172.21.15.46:0/1640829668 learned_addr learned my addr 172.21.15.46:0/1640829668 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.717+0000 7fbc16000640 1 --2- 172.21.15.46:0/3455392969 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbc0006b890 0x7fbc0006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.717+0000 7fbc16000640 1 -- 172.21.15.46:0/3455392969 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc1008afe0 con 0x7fbc200cf210 2024-02-19T06:58:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.717+0000 7fbc16000640 1 --2- 172.21.15.46:0/3455392969 >> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] conn(0x7fbc00073b10 0x7fbc00075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.717+0000 7fbc16000640 1 -- 172.21.15.46:0/3455392969 --> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc000765e0 con 0x7fbc00073b10 2024-02-19T06:58:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.717+0000 7fbc16000640 1 -- 172.21.15.46:0/3455392969 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc1008b3d0 con 0x7fbc200cf210 2024-02-19T06:58:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.717+0000 7f8fa2a00640 1 -- 172.21.15.46:0/1650867802 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8f98004b40 con 0x7f8fac0b3240 2024-02-19T06:58:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.716+0000 7f7d1aa00640 1 -- 172.21.15.46:0/1714154238 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c003d10 con 0x7f7d240d0760 2024-02-19T06:58:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.716+0000 7f7d29400640 1 -- 172.21.15.46:0/1714154238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d240ccb20 con 0x7f7d240d0760 2024-02-19T06:58:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.716+0000 7f7d1aa00640 1 -- 172.21.15.46:0/1714154238 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c004260 con 0x7f7d240d0760 2024-02-19T06:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.716+0000 7fea21c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea1c0d0650 0x7fea1c0b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.716+0000 7fea21c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0cc430 con 0x7fea1c0b2880 2024-02-19T06:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.716+0000 7fea21c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c204000 con 0x7fea1c0b2c60 2024-02-19T06:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.716+0000 7fea1b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea1c0b2c60 0x7fea1c203540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.716+0000 7fea1b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea1c0b2c60 0x7fea1c203540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43170/0 (socket says 172.21.15.46:43170) 2024-02-19T06:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.716+0000 7fea1b400640 1 -- 172.21.15.46:0/3080485302 learned_addr learned my addr 172.21.15.46:0/3080485302 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.716+0000 7fea21c00640 1 -- 172.21.15.46:0/3080485302 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c2042e0 con 0x7fea1c0d0650 2024-02-19T06:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.716+0000 7fea21200640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea1c0d0650 0x7fea1c0b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.717+0000 7fea1be00640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c0b2880 0x7fea1c0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.717+0000 7f74f0c00640 1 -- 172.21.15.46:0/1640829668 >> v2:172.21.15.142:3300/0 conn(0x7f74ec0d1c60 msgr2=0x7f74ec0d20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:02.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.717+0000 7f74f0c00640 1 --2- 172.21.15.46:0/1640829668 >> v2:172.21.15.142:3300/0 conn(0x7f74ec0d1c60 0x7f74ec0d20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.718+0000 7f7d29400640 1 -- 172.21.15.46:0/1714154238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d240d31a0 con 0x7f7d240d0760 2024-02-19T06:58:02.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.717+0000 7f74f0c00640 1 -- 172.21.15.46:0/1640829668 >> v1:172.21.15.46:6789/0 conn(0x7f74ec161430 legacy=0x7f74ec161880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.717+0000 7f74f0c00640 1 -- 172.21.15.46:0/1640829668 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec162060 con 0x7f74ec15d770 2024-02-19T06:58:02.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.718+0000 7fbc1e800640 1 --2- 172.21.15.46:0/3455392969 >> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] conn(0x7fbc00073b10 0x7fbc00075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.718+0000 7fbc1de00640 1 --2- 172.21.15.46:0/3455392969 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbc0006b890 0x7fbc0006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.718+0000 7fea21200640 1 -- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea1c0b2c60 msgr2=0x7fea1c203540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.718+0000 7fea21200640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea1c0b2c60 0x7fea1c203540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.718+0000 7fea21200640 1 -- 172.21.15.46:0/3080485302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c0b2880 msgr2=0x7fea1c0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.718+0000 7fea21200640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c0b2880 0x7fea1c0cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.718+0000 7fea21200640 1 -- 172.21.15.46:0/3080485302 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea08009400 con 0x7fea1c0d0650 2024-02-19T06:58:02.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.718+0000 7fea1be00640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea1c0b2880 0x7fea1c0cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:58:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.719+0000 7f994ac00640 1 Processor -- start 2024-02-19T06:58:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.717+0000 7f74ebe00640 1 -- 172.21.15.46:0/1640829668 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219051173 0 0) 0x7f74ec0b2db0 con 0x7f74ec161430 2024-02-19T06:58:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.720+0000 7fbc1e800640 1 --2- 172.21.15.46:0/3455392969 >> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] conn(0x7fbc00073b10 0x7fbc00075f30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f8fa2a00640 1 --2- 172.21.15.46:0/1650867802 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8f8c06b8e0 0x7f8f8c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f8fa2a00640 1 -- 172.21.15.46:0/1650867802 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f9808a450 con 0x7f8fac0b3240 2024-02-19T06:58:02.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.722+0000 7f8fa2a00640 1 --2- 172.21.15.46:0/1650867802 >> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] conn(0x7f8f8c073b60 0x7f8f8c075f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.722+0000 7f8faaa00640 1 --2- 172.21.15.46:0/1650867802 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8f8c06b8e0 0x7f8f8c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.719+0000 7fea21200640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea1c0d0650 0x7fea1c0b5130 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fea1400c750 tx=0x7fea1400cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.720+0000 7fea13e00640 1 -- 172.21.15.46:0/3080485302 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400a850 con 0x7fea1c0d0650 2024-02-19T06:58:02.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.720+0000 7fea13e00640 1 -- 172.21.15.46:0/3080485302 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1400a9b0 con 0x7fea1c0d0650 2024-02-19T06:58:02.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.722+0000 7fea13e00640 1 -- 172.21.15.46:0/3080485302 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400ada0 con 0x7fea1c0d0650 2024-02-19T06:58:02.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.719+0000 7f994ac00640 1 -- start start 2024-02-19T06:58:02.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f994ac00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f993c033ef0 0x7f993c1807b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f994ac00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f993c053c70 0x7f993c0d6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f994ac00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c0df220 0x7f993c047da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f994ac00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c0d83c0 con 0x7f993c0df220 2024-02-19T06:58:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f994ac00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c0d7530 con 0x7f993c053c70 2024-02-19T06:58:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f994ac00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c180d90 con 0x7f993c033ef0 2024-02-19T06:58:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f9949800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f993c033ef0 0x7f993c1807b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f9949800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f993c033ef0 0x7f993c1807b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:45966/0 (socket says 172.21.15.46:45966) 2024-02-19T06:58:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f9949800640 1 -- 172.21.15.46:0/40956736 learned_addr learned my addr 172.21.15.46:0/40956736 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.719+0000 7f74f0c00640 1 --2- 172.21.15.46:0/1640829668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ec15d770 0x7f74ec06cfd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f74dc009e50 tx=0x7f74dc02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3dbe995861cd1fd server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.719+0000 7f74ebe00640 1 -- 172.21.15.46:0/1640829668 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc02cb00 con 0x7f74ec15d770 2024-02-19T06:58:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f74ebe00640 1 -- 172.21.15.46:0/1640829668 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74dc02cc60 con 0x7f74ec15d770 2024-02-19T06:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f74ebe00640 1 -- 172.21.15.46:0/1640829668 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc0343f0 con 0x7f74ec15d770 2024-02-19T06:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.722+0000 7f74f2000640 1 -- 172.21.15.46:0/1640829668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ec15d770 msgr2=0x7f74ec06cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.722+0000 7f74f2000640 1 --2- 172.21.15.46:0/1640829668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ec15d770 0x7f74ec06cfd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f74dc009e50 tx=0x7f74dc02bf60 comp rx=0 tx=0).stop 2024-02-19T06:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.722+0000 7f74f2000640 1 -- 172.21.15.46:0/1640829668 shutdown_connections 2024-02-19T06:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.722+0000 7f74f2000640 1 --2- 172.21.15.46:0/1640829668 >> v2:172.21.15.142:3300/0 conn(0x7f74ec0d1c60 0x7f74ec0d20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.722+0000 7f74f2000640 1 --2- 172.21.15.46:0/1640829668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ec15d770 0x7f74ec06cfd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.722+0000 7f74f2000640 1 -- 172.21.15.46:0/1640829668 >> 172.21.15.46:0/1640829668 conn(0x7f74ec09ca00 msgr2=0x7f74ec08afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.722+0000 7fea21c00640 1 -- 172.21.15.46:0/3080485302 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c0cc6d0 con 0x7fea1c0d0650 2024-02-19T06:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.722+0000 7fea21c00640 1 -- 172.21.15.46:0/3080485302 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c0cd410 con 0x7fea1c0d0650 2024-02-19T06:58:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.721+0000 7f7d1aa00640 1 -- 172.21.15.46:0/1714154238 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7d1c0043c0 con 0x7f7d240d0760 2024-02-19T06:58:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.722+0000 7f7d1aa00640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7d0406b810 0x7f7d0406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.722+0000 7f9948e00640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f993c053c70 0x7f993c0d6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f8fa2a00640 1 -- 172.21.15.46:0/1650867802 --> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f8c076630 con 0x7f8f8c073b60 2024-02-19T06:58:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f8fa2a00640 1 -- 172.21.15.46:0/1650867802 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f9808a800 con 0x7f8fac0b3240 2024-02-19T06:58:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f74f2000640 1 -- 172.21.15.46:0/1640829668 shutdown_connections 2024-02-19T06:58:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7fbc1de00640 1 --2- 172.21.15.46:0/3455392969 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbc0006b890 0x7fbc0006dd50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbc18005c00 tx=0x7fbc18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f9949800640 1 -- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f993c053c70 msgr2=0x7f993c0d6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f9949800640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f993c053c70 0x7f993c0d6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f9949800640 1 -- 172.21.15.46:0/40956736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c0df220 msgr2=0x7f993c047da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T06:58:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f74f2000640 1 -- 172.21.15.46:0/1640829668 wait complete. 2024-02-19T06:58:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f8fab400640 1 --2- 172.21.15.46:0/1650867802 >> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] conn(0x7f8f8c073b60 0x7f8f8c075f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f7d1aa00640 1 -- 172.21.15.46:0/1714154238 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d1c012070 con 0x7f7d240d0760 2024-02-19T06:58:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7fea21c00640 1 -- 172.21.15.46:0/3080485302 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea1c0d24e0 con 0x7fea1c0d0650 2024-02-19T06:58:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f8faaa00640 1 --2- 172.21.15.46:0/1650867802 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8f8c06b8e0 0x7f8f8c06dda0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4003b80 tx=0x7f8fa40098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f7d1aa00640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] conn(0x7f7d040739b0 0x7f7d04075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f7d1aa00640 1 -- 172.21.15.46:0/1714154238 --> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d04076480 con 0x7f7d040739b0 2024-02-19T06:58:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.724+0000 7f7d1aa00640 1 -- 172.21.15.46:0/1714154238 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d1c08b3e0 con 0x7f7d240d0760 2024-02-19T06:58:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f994a200640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c0df220 0x7f993c047da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f9949800640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f993c0df220 0x7f993c047da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.723+0000 7f9949800640 1 -- 172.21.15.46:0/40956736 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99300094d0 con 0x7f993c033ef0 2024-02-19T06:58:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.724+0000 7fbc16000640 1 -- 172.21.15.46:0/3455392969 <== osd.1 v2:172.21.15.46:6815/3031745429 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbc000765e0 con 0x7fbc00073b10 2024-02-19T06:58:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.724+0000 7f9949800640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f993c033ef0 0x7f993c1807b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f99300090b0 tx=0x7f99300046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.724+0000 7f7d21e00640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7d0406b810 0x7f7d0406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.724+0000 7f7d23200640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] conn(0x7f7d040739b0 0x7f7d04075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.725+0000 7f9941600640 1 -- 172.21.15.46:0/40956736 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930003810 con 0x7f993c033ef0 2024-02-19T06:58:02.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.725+0000 7f994ac00640 1 -- 172.21.15.46:0/40956736 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c181070 con 0x7f993c033ef0 2024-02-19T06:58:02.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.725+0000 7f9941600640 1 -- 172.21.15.46:0/40956736 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9930003990 con 0x7f993c033ef0 2024-02-19T06:58:02.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.725+0000 7f994ac00640 1 -- 172.21.15.46:0/40956736 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c181630 con 0x7f993c033ef0 2024-02-19T06:58:02.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.726+0000 7f7d21e00640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7d0406b810 0x7f7d0406dcd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d2415b9c0 tx=0x7f7d14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.726+0000 7f7d23200640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] conn(0x7f7d040739b0 0x7f7d04075dd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.726+0000 7f9941600640 1 -- 172.21.15.46:0/40956736 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930003d00 con 0x7f993c033ef0 2024-02-19T06:58:02.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.726+0000 7f74f2000640 1 Processor -- start 2024-02-19T06:58:02.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.726+0000 7f74f2000640 1 -- start start 2024-02-19T06:58:02.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.727+0000 7f994ac00640 1 -- 172.21.15.46:0/40956736 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f993c0df600 con 0x7f993c033ef0 2024-02-19T06:58:02.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.727+0000 7fea13e00640 1 -- 172.21.15.46:0/3080485302 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fea14012420 con 0x7fea1c0d0650 2024-02-19T06:58:02.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.728+0000 7fea13e00640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe9fc06b810 0x7fe9fc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.728+0000 7f74f2000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec0d1c60 0x7f74ec15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.728+0000 7f74f2000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ec15d770 0x7f74ec0d3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.728+0000 7f74f2000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec161430 0x7f74ec0d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.728+0000 7f74f2000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0cc790 con 0x7f74ec0d1c60 2024-02-19T06:58:02.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.728+0000 7f74f2000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0cca70 con 0x7f74ec161430 2024-02-19T06:58:02.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.728+0000 7f74f2000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0ccd50 con 0x7f74ec15d770 2024-02-19T06:58:02.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.729+0000 7f9941600640 1 -- 172.21.15.46:0/40956736 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9930037420 con 0x7f993c033ef0 2024-02-19T06:58:02.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.728+0000 7fea13e00640 1 -- 172.21.15.46:0/3080485302 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea1408aba0 con 0x7fea1c0d0650 2024-02-19T06:58:02.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.729+0000 7fea13e00640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] conn(0x7fe9fc0739b0 0x7fe9fc075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.729+0000 7fea13e00640 1 -- 172.21.15.46:0/3080485302 --> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9fc076480 con 0x7fe9fc0739b0 2024-02-19T06:58:02.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.729+0000 7fea13e00640 1 -- 172.21.15.46:0/3080485302 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea1408af10 con 0x7fea1c0d0650 2024-02-19T06:58:02.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.729+0000 7f7d1aa00640 1 -- 172.21.15.46:0/1714154238 <== osd.4 v2:172.21.15.142:6800/4262903338 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7d04076480 con 0x7f7d040739b0 2024-02-19T06:58:02.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.729+0000 7fea1be00640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe9fc06b810 0x7fe9fc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.730+0000 7f9941600640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f992406b810 0x7f992406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.729+0000 7f8fab400640 1 --2- 172.21.15.46:0/1650867802 >> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] conn(0x7f8f8c073b60 0x7f8f8c075f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.730+0000 7f9941600640 1 -- 172.21.15.46:0/40956736 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9930033070 con 0x7f993c033ef0 2024-02-19T06:58:02.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.731+0000 7fea1b400640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] conn(0x7fe9fc0739b0 0x7fe9fc075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.731+0000 7fea1be00640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe9fc06b810 0x7fe9fc06dcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea0c005880 tx=0x7fea0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.729+0000 7f74f0c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec0d1c60 0x7f74ec15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.729+0000 7f74f0c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec0d1c60 0x7f74ec15bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38250/0 (socket says 172.21.15.46:38250) 2024-02-19T06:58:02.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.731+0000 7f9941600640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] conn(0x7f99240739b0 0x7f9924075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.729+0000 7f74f0c00640 1 -- 172.21.15.46:0/3055176609 learned_addr learned my addr 172.21.15.46:0/3055176609 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:02.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.729+0000 7f74e3e00640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ec15d770 0x7f74ec0d3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.730+0000 7f74f1600640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec161430 0x7f74ec0d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.730+0000 7f74e3e00640 1 -- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec161430 msgr2=0x7f74ec0d37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.730+0000 7f74e3e00640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec161430 0x7f74ec0d37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.730+0000 7f74e3e00640 1 -- 172.21.15.46:0/3055176609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec0d1c60 msgr2=0x7f74ec15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.731+0000 7f9941600640 1 -- 172.21.15.46:0/40956736 --> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9924076480 con 0x7f99240739b0 2024-02-19T06:58:02.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.730+0000 7f74e3e00640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec0d1c60 0x7f74ec15bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.730+0000 7f74e3e00640 1 -- 172.21.15.46:0/3055176609 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc009b30 con 0x7f74ec15d770 2024-02-19T06:58:02.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.731+0000 7f74e3e00640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ec15d770 0x7f74ec0d3270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f74d400e870 tx=0x7f74d400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.731+0000 7f9941600640 1 -- 172.21.15.46:0/40956736 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99300ad960 con 0x7f993c033ef0 2024-02-19T06:58:02.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.731+0000 7f9948e00640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f992406b810 0x7f992406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.732+0000 7f8fa2a00640 1 -- 172.21.15.46:0/1650867802 <== osd.3 v2:172.21.15.46:6824/319601708 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8f8c076630 con 0x7f8f8c073b60 2024-02-19T06:58:02.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.732+0000 7f74e9600640 1 -- 172.21.15.46:0/3055176609 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4009500 con 0x7f74ec15d770 2024-02-19T06:58:02.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.732+0000 7f74e9600640 1 -- 172.21.15.46:0/3055176609 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d400c940 con 0x7f74ec15d770 2024-02-19T06:58:02.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.732+0000 7f74e9600640 1 -- 172.21.15.46:0/3055176609 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d400ccb0 con 0x7f74ec15d770 2024-02-19T06:58:02.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.732+0000 7f74f2000640 1 -- 172.21.15.46:0/3055176609 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec0cd030 con 0x7f74ec15d770 2024-02-19T06:58:02.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.732+0000 7f994a200640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] conn(0x7f99240739b0 0x7f9924075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.733+0000 7f9948e00640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f992406b810 0x7f992406dcd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f993c0e0540 tx=0x7f993800c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.733+0000 7f994a200640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] conn(0x7f99240739b0 0x7f9924075dd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.733+0000 7f74f2000640 1 -- 172.21.15.46:0/3055176609 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec15c470 con 0x7f74ec15d770 2024-02-19T06:58:02.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.734+0000 7f74f2000640 1 -- 172.21.15.46:0/3055176609 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74ec06c7d0 con 0x7f74ec15d770 2024-02-19T06:58:02.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.735+0000 7fea1b400640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] conn(0x7fe9fc0739b0 0x7fe9fc075dd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.736+0000 7f9941600640 1 -- 172.21.15.46:0/40956736 <== osd.6 v2:172.21.15.142:6816/2395736986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9924076480 con 0x7f99240739b0 2024-02-19T06:58:02.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.737+0000 7f74e9600640 1 -- 172.21.15.46:0/3055176609 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f74d4026480 con 0x7f74ec15d770 2024-02-19T06:58:02.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.739+0000 7fea13e00640 1 -- 172.21.15.46:0/3080485302 <== osd.5 v2:172.21.15.142:6808/1219840819 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe9fc076480 con 0x7fe9fc0739b0 2024-02-19T06:58:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.739+0000 7f74e9600640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f74c806b890 0x7f74c806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.739+0000 7f74e9600640 1 -- 172.21.15.46:0/3055176609 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74d408a820 con 0x7f74ec15d770 2024-02-19T06:58:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.739+0000 7f74e9600640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] conn(0x7f74c8073ab0 0x7f74c8075ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.739+0000 7f74e9600640 1 -- 172.21.15.46:0/3055176609 --> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f74c8076580 con 0x7f74c8073ab0 2024-02-19T06:58:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.739+0000 7f74e9600640 1 -- 172.21.15.46:0/3055176609 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74d408acc0 con 0x7f74ec15d770 2024-02-19T06:58:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.740+0000 7f74f0c00640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f74c806b890 0x7f74c806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.740+0000 7f74f1600640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] conn(0x7f74c8073ab0 0x7f74c8075ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.741+0000 7f74f1600640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] conn(0x7f74c8073ab0 0x7f74c8075ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.743+0000 7f74f0c00640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f74c806b890 0x7f74c806dd50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74dc02bfa0 tx=0x7f74dc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.744+0000 7f74e9600640 1 -- 172.21.15.46:0/3055176609 <== osd.7 v2:172.21.15.142:6824/4235520298 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f74c8076580 con 0x7f74c8073ab0 2024-02-19T06:58:02.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.745+0000 7f90ca000640 1 -- 172.21.15.46:0/455858505 --> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f90d40ce7c0 con 0x7f90b4073a80 2024-02-19T06:58:02.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.746+0000 7f90d0c00640 1 -- 172.21.15.46:0/455858505 <== osd.2 v2:172.21.15.46:6800/1495872287 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f90cc031970 con 0x7f90b4073a80 2024-02-19T06:58:02.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.747+0000 7f90da400640 1 -- 172.21.15.46:0/455858505 >> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] conn(0x7f90b4073a80 msgr2=0x7f90b4075ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.747+0000 7f90da400640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] conn(0x7f90b4073a80 0x7f90b4075ea0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.748+0000 7f90da400640 1 -- 172.21.15.46:0/455858505 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f90b406b860 msgr2=0x7f90b406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.748+0000 7f90da400640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f90b406b860 0x7f90b406dd20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f90d40b21f0 tx=0x7f90c400b040 comp rx=0 tx=0).stop 2024-02-19T06:58:02.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.748+0000 7f90da400640 1 -- 172.21.15.46:0/455858505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d406c9b0 msgr2=0x7f90d415f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.748+0000 7f90da400640 1 --2- 172.21.15.46:0/455858505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d406c9b0 0x7f90d415f640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90c000c410 tx=0x7f90c000c8d0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.748+0000 7f90d9a00640 1 -- 172.21.15.46:0/455858505 reap_dead start 2024-02-19T06:58:02.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.748+0000 7f90da400640 1 -- 172.21.15.46:0/455858505 shutdown_connections 2024-02-19T06:58:02.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.748+0000 7f90da400640 1 -- 172.21.15.46:0/455858505 >> 172.21.15.46:0/455858505 conn(0x7f90d409c9d0 msgr2=0x7f90d408afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.750+0000 7f282aa00640 1 -- 172.21.15.46:0/2908951005 --> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2824068760 con 0x7f2804073a80 2024-02-19T06:58:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.750+0000 7f90da400640 1 -- 172.21.15.46:0/455858505 shutdown_connections 2024-02-19T06:58:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.751+0000 7f90da400640 1 -- 172.21.15.46:0/455858505 wait complete. 2024-02-19T06:58:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.751+0000 7f281be00640 1 -- 172.21.15.46:0/2908951005 <== osd.0 v2:172.21.15.46:6808/3877139085 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2824068760 con 0x7f2804073a80 2024-02-19T06:58:02.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.751+0000 7fbc24c00640 1 -- 172.21.15.46:0/3455392969 --> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbbf8002d30 con 0x7fbc00073b10 2024-02-19T06:58:02.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.752+0000 7f282aa00640 1 -- 172.21.15.46:0/2908951005 >> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] conn(0x7f2804073a80 msgr2=0x7f2804075ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.752+0000 7f282aa00640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] conn(0x7f2804073a80 0x7f2804075ea0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.752+0000 7fbc16000640 1 -- 172.21.15.46:0/3455392969 <== osd.1 v2:172.21.15.46:6815/3031745429 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbbf8002d30 con 0x7fbc00073b10 2024-02-19T06:58:02.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.752+0000 7f282aa00640 1 -- 172.21.15.46:0/2908951005 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f280406b860 msgr2=0x7f280406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.752+0000 7f282aa00640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f280406b860 0x7f280406dd20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f281c035000 tx=0x7f281c030000 comp rx=0 tx=0).stop 2024-02-19T06:58:02.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.752+0000 7f282aa00640 1 -- 172.21.15.46:0/2908951005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28240d1c50 msgr2=0x7f28240c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.752+0000 7f282aa00640 1 --2- 172.21.15.46:0/2908951005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28240d1c50 0x7f28240c82c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f281400d800 tx=0x7f281400dcc0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7f2828a00640 1 -- 172.21.15.46:0/2908951005 reap_dead start 2024-02-19T06:58:02.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7f282aa00640 1 -- 172.21.15.46:0/2908951005 shutdown_connections 2024-02-19T06:58:02.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7f282aa00640 1 -- 172.21.15.46:0/2908951005 >> 172.21.15.46:0/2908951005 conn(0x7f282409c9e0 msgr2=0x7f28240b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7f282aa00640 1 -- 172.21.15.46:0/2908951005 shutdown_connections 2024-02-19T06:58:02.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7fbc24c00640 1 -- 172.21.15.46:0/3455392969 >> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] conn(0x7fbc00073b10 msgr2=0x7fbc00075f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7fbc24c00640 1 --2- 172.21.15.46:0/3455392969 >> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] conn(0x7fbc00073b10 0x7fbc00075f30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7f282aa00640 1 -- 172.21.15.46:0/2908951005 wait complete. 2024-02-19T06:58:02.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7fbc24c00640 1 -- 172.21.15.46:0/3455392969 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbc0006b890 msgr2=0x7fbc0006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7fbc24c00640 1 --2- 172.21.15.46:0/3455392969 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbc0006b890 0x7fbc0006dd50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbc18005c00 tx=0x7fbc18009040 comp rx=0 tx=0).stop 2024-02-19T06:58:02.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7fbc24c00640 1 -- 172.21.15.46:0/3455392969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc200cf210 msgr2=0x7fbc200992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7fbc24c00640 1 --2- 172.21.15.46:0/3455392969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc200cf210 0x7fbc200992b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000d8f0 tx=0x7fbc1000ddb0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7fbc1e800640 1 -- 172.21.15.46:0/3455392969 reap_dead start 2024-02-19T06:58:02.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7fbc24c00640 1 -- 172.21.15.46:0/3455392969 shutdown_connections 2024-02-19T06:58:02.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.753+0000 7fbc24c00640 1 -- 172.21.15.46:0/3455392969 >> 172.21.15.46:0/3455392969 conn(0x7fbc200b4640 msgr2=0x7fbc2006cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.754+0000 7fbc24c00640 1 -- 172.21.15.46:0/3455392969 shutdown_connections 2024-02-19T06:58:02.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.754+0000 7fbc24c00640 1 -- 172.21.15.46:0/3455392969 wait complete. 2024-02-19T06:58:02.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.765+0000 7f7d29400640 1 -- 172.21.15.46:0/1714154238 --> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7d240d2ec0 con 0x7f7d040739b0 2024-02-19T06:58:02.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.766+0000 7f7d1aa00640 1 -- 172.21.15.46:0/1714154238 <== osd.4 v2:172.21.15.142:6800/4262903338 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7d10031960 con 0x7f7d040739b0 2024-02-19T06:58:02.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.766+0000 7f8fb1800640 1 -- 172.21.15.46:0/1650867802 --> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8fac04eee0 con 0x7f8f8c073b60 2024-02-19T06:58:02.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.767+0000 7f7d29400640 1 -- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] conn(0x7f7d040739b0 msgr2=0x7f7d04075dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.767+0000 7f7d29400640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] conn(0x7f7d040739b0 0x7f7d04075dd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.767+0000 7f7d29400640 1 -- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7d0406b810 msgr2=0x7f7d0406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.767+0000 7f7d29400640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7d0406b810 0x7f7d0406dcd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d2415b9c0 tx=0x7f7d14008040 comp rx=0 tx=0).stop 2024-02-19T06:58:02.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.767+0000 7f7d29400640 1 -- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d240d0760 msgr2=0x7f7d2414cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.767+0000 7f7d29400640 1 --2- 172.21.15.46:0/1714154238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d240d0760 0x7f7d2414cd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00cdf0 tx=0x7f7d1c00a660 comp rx=0 tx=0).stop 2024-02-19T06:58:02.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.767+0000 7f8fa2a00640 1 -- 172.21.15.46:0/1650867802 <== osd.3 v2:172.21.15.46:6824/319601708 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8fac04eee0 con 0x7f8f8c073b60 2024-02-19T06:58:02.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.768+0000 7f7d23200640 1 -- 172.21.15.46:0/1714154238 reap_dead start 2024-02-19T06:58:02.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.768+0000 7f7d29400640 1 -- 172.21.15.46:0/1714154238 shutdown_connections 2024-02-19T06:58:02.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.768+0000 7f7d29400640 1 -- 172.21.15.46:0/1714154238 >> 172.21.15.46:0/1714154238 conn(0x7f7d2406be20 msgr2=0x7f7d241653c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.768+0000 7f7d29400640 1 -- 172.21.15.46:0/1714154238 shutdown_connections 2024-02-19T06:58:02.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.768+0000 7f994ac00640 1 -- 172.21.15.46:0/40956736 --> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f993c005390 con 0x7f99240739b0 2024-02-19T06:58:02.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.768+0000 7f7d29400640 1 -- 172.21.15.46:0/1714154238 wait complete. 2024-02-19T06:58:02.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.768+0000 7f8f97e00640 1 -- 172.21.15.46:0/1650867802 >> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] conn(0x7f8f8c073b60 msgr2=0x7f8f8c075f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.768+0000 7f8f97e00640 1 --2- 172.21.15.46:0/1650867802 >> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] conn(0x7f8f8c073b60 0x7f8f8c075f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.769+0000 7f8f97e00640 1 -- 172.21.15.46:0/1650867802 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8f8c06b8e0 msgr2=0x7f8f8c06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.769+0000 7f8f97e00640 1 --2- 172.21.15.46:0/1650867802 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8f8c06b8e0 0x7f8f8c06dda0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4003b80 tx=0x7f8fa40098d0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.769+0000 7f8f97e00640 1 -- 172.21.15.46:0/1650867802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fac0b3240 msgr2=0x7f8fac151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.769+0000 7f8f97e00640 1 --2- 172.21.15.46:0/1650867802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fac0b3240 0x7f8fac151720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800c3e0 tx=0x7f8f9800c8a0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.769+0000 7f8fab400640 1 -- 172.21.15.46:0/1650867802 reap_dead start 2024-02-19T06:58:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.769+0000 7f8f97e00640 1 -- 172.21.15.46:0/1650867802 shutdown_connections 2024-02-19T06:58:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.769+0000 7f8f97e00640 1 -- 172.21.15.46:0/1650867802 >> 172.21.15.46:0/1650867802 conn(0x7f8fac0b1410 msgr2=0x7f8fac153b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.769+0000 7f9941600640 1 -- 172.21.15.46:0/40956736 <== osd.6 v2:172.21.15.142:6816/2395736986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f993c005390 con 0x7f99240739b0 2024-02-19T06:58:02.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.769+0000 7f8f97e00640 1 -- 172.21.15.46:0/1650867802 shutdown_connections 2024-02-19T06:58:02.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.769+0000 7f8f97e00640 1 -- 172.21.15.46:0/1650867802 wait complete. 2024-02-19T06:58:02.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.770+0000 7f9936a00640 1 -- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] conn(0x7f99240739b0 msgr2=0x7f9924075dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.770+0000 7f9936a00640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] conn(0x7f99240739b0 0x7f9924075dd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.770+0000 7f9936a00640 1 -- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f992406b810 msgr2=0x7f992406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.770+0000 7f9936a00640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f992406b810 0x7f992406dcd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f993c0e0540 tx=0x7f993800c040 comp rx=0 tx=0).stop 2024-02-19T06:58:02.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.770+0000 7f9936a00640 1 -- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f993c033ef0 msgr2=0x7f993c1807b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.771+0000 7f9936a00640 1 --2- 172.21.15.46:0/40956736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f993c033ef0 0x7f993c1807b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f99300090b0 tx=0x7f99300046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.771+0000 7f994a200640 1 -- 172.21.15.46:0/40956736 reap_dead start 2024-02-19T06:58:02.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.771+0000 7f9936a00640 1 -- 172.21.15.46:0/40956736 shutdown_connections 2024-02-19T06:58:02.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.771+0000 7f9936a00640 1 -- 172.21.15.46:0/40956736 >> 172.21.15.46:0/40956736 conn(0x7f993c009fb0 msgr2=0x7f993c035130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.772+0000 7f9936a00640 1 -- 172.21.15.46:0/40956736 shutdown_connections 2024-02-19T06:58:02.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.772+0000 7f9936a00640 1 -- 172.21.15.46:0/40956736 wait complete. 2024-02-19T06:58:02.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.774+0000 7f74f2000640 1 -- 172.21.15.46:0/3055176609 --> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f74ec06c4f0 con 0x7f74c8073ab0 2024-02-19T06:58:02.806 INFO:teuthology.orchestra.run.smithi046.stdout:60129542150 2024-02-19T06:58:02.806 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-19T06:58:02.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.776+0000 7f74e9600640 1 -- 172.21.15.46:0/3055176609 <== osd.7 v2:172.21.15.142:6824/4235520298 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f74e4001490 con 0x7f74c8073ab0 2024-02-19T06:58:02.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.776+0000 7f74f2000640 1 -- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] conn(0x7f74c8073ab0 msgr2=0x7f74c8075ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.776+0000 7f74f2000640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] conn(0x7f74c8073ab0 0x7f74c8075ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.777+0000 7fea21c00640 1 -- 172.21.15.46:0/3080485302 --> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fea1c203cd0 con 0x7fe9fc0739b0 2024-02-19T06:58:02.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.777+0000 7f74f2000640 1 -- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f74c806b890 msgr2=0x7f74c806dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.777+0000 7f74f2000640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f74c806b890 0x7f74c806dd50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74dc02bfa0 tx=0x7f74dc030000 comp rx=0 tx=0).stop 2024-02-19T06:58:02.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.777+0000 7f74f2000640 1 -- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ec15d770 msgr2=0x7f74ec0d3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.777+0000 7f74f2000640 1 --2- 172.21.15.46:0/3055176609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ec15d770 0x7f74ec0d3270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f74d400e870 tx=0x7f74d400ed30 comp rx=0 tx=0).stop 2024-02-19T06:58:02.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.777+0000 7f74f1600640 1 -- 172.21.15.46:0/3055176609 reap_dead start 2024-02-19T06:58:02.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.778+0000 7f74f2000640 1 -- 172.21.15.46:0/3055176609 shutdown_connections 2024-02-19T06:58:02.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.778+0000 7f74f2000640 1 -- 172.21.15.46:0/3055176609 >> 172.21.15.46:0/3055176609 conn(0x7f74ec09ca00 msgr2=0x7f74ec0cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.778+0000 7f74f2000640 1 -- 172.21.15.46:0/3055176609 shutdown_connections 2024-02-19T06:58:02.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.778+0000 7fea13e00640 1 -- 172.21.15.46:0/3080485302 <== osd.5 v2:172.21.15.142:6808/1219840819 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fea1c203cd0 con 0x7fe9fc0739b0 2024-02-19T06:58:02.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.778+0000 7f74f2000640 1 -- 172.21.15.46:0/3055176609 wait complete. 2024-02-19T06:58:02.809 INFO:teuthology.orchestra.run.smithi046.stdout:60129542152 2024-02-19T06:58:02.810 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-19T06:58:02.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.779+0000 7fea21c00640 1 -- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] conn(0x7fe9fc0739b0 msgr2=0x7fe9fc075dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.779+0000 7fea21c00640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] conn(0x7fe9fc0739b0 0x7fe9fc075dd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:02.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.779+0000 7fea21c00640 1 -- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe9fc06b810 msgr2=0x7fe9fc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.779+0000 7fea21c00640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe9fc06b810 0x7fe9fc06dcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea0c005880 tx=0x7fea0c009040 comp rx=0 tx=0).stop 2024-02-19T06:58:02.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.779+0000 7fea21c00640 1 -- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea1c0d0650 msgr2=0x7fea1c0b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:02.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.779+0000 7fea21c00640 1 --2- 172.21.15.46:0/3080485302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea1c0d0650 0x7fea1c0b5130 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fea1400c750 tx=0x7fea1400cc10 comp rx=0 tx=0).stop 2024-02-19T06:58:02.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.779+0000 7fea21200640 1 -- 172.21.15.46:0/3080485302 reap_dead start 2024-02-19T06:58:02.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.779+0000 7fea21c00640 1 -- 172.21.15.46:0/3080485302 shutdown_connections 2024-02-19T06:58:02.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.779+0000 7fea21c00640 1 -- 172.21.15.46:0/3080485302 >> 172.21.15.46:0/3080485302 conn(0x7fea1c09c9d0 msgr2=0x7fea1c08afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:02.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.780+0000 7fea21c00640 1 -- 172.21.15.46:0/3080485302 shutdown_connections 2024-02-19T06:58:02.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:02.780+0000 7fea21c00640 1 -- 172.21.15.46:0/3080485302 wait complete. 2024-02-19T06:58:02.812 INFO:teuthology.orchestra.run.smithi046.stdout:60129542151 2024-02-19T06:58:02.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-19T06:58:02.813 INFO:teuthology.orchestra.run.smithi046.stdout:60129542150 2024-02-19T06:58:02.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-19T06:58:02.814 INFO:teuthology.orchestra.run.smithi046.stdout:60129542150 2024-02-19T06:58:02.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-19T06:58:02.815 INFO:teuthology.orchestra.run.smithi046.stdout:64424509447 2024-02-19T06:58:02.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-19T06:58:02.816 INFO:teuthology.orchestra.run.smithi046.stdout:64424509446 2024-02-19T06:58:02.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-19T06:58:02.817 INFO:teuthology.orchestra.run.smithi046.stdout:60129542150 2024-02-19T06:58:02.818 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-19T06:58:03.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.142+0000 7f30d2e00640 1 Processor -- start 2024-02-19T06:58:03.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.142+0000 7f30d2e00640 1 -- start start 2024-02-19T06:58:03.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.145+0000 7f30d2e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f30c40df420 0x7f30c4053260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.145+0000 7f30d2e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c40068a0 con 0x7f30c404fa90 2024-02-19T06:58:03.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.145+0000 7f30d2e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c4006af0 con 0x7f30c40392d0 2024-02-19T06:58:03.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.145+0000 7f30d2e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c4007770 con 0x7f30c40df420 2024-02-19T06:58:03.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.146+0000 7f30d1a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f30c404fa90 0x7f30c404fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53222/0 (socket says 172.21.15.46:53222) 2024-02-19T06:58:03.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.146+0000 7f30d1a00640 1 -- 172.21.15.46:0/1423230267 learned_addr learned my addr 172.21.15.46:0/1423230267 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:03.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.147+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990094944 0 0) 0x7f30c40068a0 con 0x7f30c404fa90 2024-02-19T06:58:03.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.147+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30b4003520 con 0x7f30c404fa90 2024-02-19T06:58:03.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.148+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 762439257 0 0) 0x7f30b4003520 con 0x7f30c404fa90 2024-02-19T06:58:03.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.148+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 >> v2:172.21.15.46:3300/0 conn(0x7f30c40df420 msgr2=0x7f30c4053260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-19T06:58:03.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.149+0000 7f30d1000640 1 --2- 172.21.15.46:0/1423230267 >> v2:172.21.15.46:3300/0 conn(0x7f30c40df420 0x7f30c4053260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.149+0000 7f30cbe00640 1 --2- 172.21.15.46:0/1423230267 >> v2:172.21.15.46:3300/0 conn(0x7f30c40df420 0x7f30c4053260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.149+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 >> v1:172.21.15.142:6789/0 conn(0x7f30c40392d0 legacy=0x7f30c40537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:03.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.149+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4006dd0 con 0x7f30c404fa90 2024-02-19T06:58:03.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.149+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f30c0001650 con 0x7f30c404fa90 2024-02-19T06:58:03.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.149+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 >> v1:172.21.15.46:6789/0 conn(0x7f30c404fa90 legacy=0x7f30c404fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.149+0000 7f30cbe00640 1 --2- 172.21.15.46:0/1423230267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b4003760 0x7f30b4003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.149+0000 7f30cbe00640 1 --2- 172.21.15.46:0/1423230267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b40040e0 0x7f30b400b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.149+0000 7f30cbe00640 1 --2- 172.21.15.46:0/1423230267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30b400b600 0x7f30b400daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.149+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c4007770 con 0x7f30b400b600 2024-02-19T06:58:03.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.149+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b400e410 con 0x7f30b40040e0 2024-02-19T06:58:03.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.149+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b400e5d0 con 0x7f30b4003760 2024-02-19T06:58:03.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.150+0000 7f30d2400640 1 --2- 172.21.15.46:0/1423230267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30b400b600 0x7f30b400daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.151+0000 7f30d1000640 1 --2- 172.21.15.46:0/1423230267 >> v2:172.21.15.46:3300/0 conn(0x7f30c40df420 0x7f30c4053260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:03.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.151+0000 7f30d2400640 1 -- 172.21.15.46:0/1423230267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b4003760 msgr2=0x7f30b4003ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-19T06:58:03.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.151+0000 7f30d2400640 1 --2- 172.21.15.46:0/1423230267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30b4003760 0x7f30b4003ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.151+0000 7f30d2400640 1 -- 172.21.15.46:0/1423230267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b40040e0 msgr2=0x7f30b400b010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-19T06:58:03.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.151+0000 7f30d2400640 1 --2- 172.21.15.46:0/1423230267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b40040e0 0x7f30b400b010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.151+0000 7f30d2400640 1 -- 172.21.15.46:0/1423230267 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4006dd0 con 0x7f30b400b600 2024-02-19T06:58:03.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.152+0000 7f30d2400640 1 -- 172.21.15.46:0/1423230267 reap_dead start 2024-02-19T06:58:03.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.152+0000 7f30d2400640 1 --2- 172.21.15.46:0/1423230267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30b400b600 0x7f30b400daa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0692b0 tx=0x7f30b40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb068a5ce8c8a53 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.152+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0ab7d0 con 0x7f30b400b600 2024-02-19T06:58:03.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.152+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30cc0ab930 con 0x7f30b400b600 2024-02-19T06:58:03.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.153+0000 7f30cbe00640 1 -- 172.21.15.46:0/1423230267 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0abcc0 con 0x7f30b400b600 2024-02-19T06:58:03.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.153+0000 7f190fc00640 1 Processor -- start 2024-02-19T06:58:03.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.153+0000 7fe5d5600640 1 Processor -- start 2024-02-19T06:58:03.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.153+0000 7f190fc00640 1 -- start start 2024-02-19T06:58:03.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.153+0000 7f30d2e00640 1 -- 172.21.15.46:0/1423230267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30b400b600 msgr2=0x7f30b400daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.153+0000 7f30d2e00640 1 --2- 172.21.15.46:0/1423230267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30b400b600 0x7f30b400daa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0692b0 tx=0x7f30b40047e0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.153+0000 7fe5d5600640 1 -- start start 2024-02-19T06:58:03.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.154+0000 7f30d2e00640 1 -- 172.21.15.46:0/1423230267 shutdown_connections 2024-02-19T06:58:03.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.154+0000 7f30d2e00640 1 --2- 172.21.15.46:0/1423230267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30b400b600 0x7f30b400daa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.154+0000 7f30d2e00640 1 -- 172.21.15.46:0/1423230267 >> 172.21.15.46:0/1423230267 conn(0x7f30c4009fb0 msgr2=0x7f30c400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.155+0000 7f30d2e00640 1 -- 172.21.15.46:0/1423230267 shutdown_connections 2024-02-19T06:58:03.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.155+0000 7f30d2e00640 1 -- 172.21.15.46:0/1423230267 wait complete. 2024-02-19T06:58:03.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.155+0000 7fe5d5600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe5d015d960 0x7fe5d006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.155+0000 7fe5d5600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5d00d1320 0x7fe5d00cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.155+0000 7fe5d5600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe5d00d1c50 0x7fe5d00d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.155+0000 7fe5d5600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d015dd40 con 0x7fe5d00d1c50 2024-02-19T06:58:03.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.155+0000 7fe5d5600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d00ce260 con 0x7fe5d015d960 2024-02-19T06:58:03.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.155+0000 7fe5d5600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00ce500 con 0x7fe5d00d1320 2024-02-19T06:58:03.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.156+0000 7fe5cf400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe5d00d1c50 0x7fe5d00d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.156+0000 7fe5cea00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe5d015d960 0x7fe5d006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.156+0000 7fe5cea00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe5d015d960 0x7fe5d006bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43196/0 (socket says 172.21.15.46:43196) 2024-02-19T06:58:03.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.156+0000 7f190fc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f19000501a0 0x7f1900038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.156+0000 7f190fc00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19000544c0 con 0x7f19000df220 2024-02-19T06:58:03.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.156+0000 7f190fc00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19000541e0 con 0x7f190000c0a0 2024-02-19T06:58:03.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.156+0000 7f190fc00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1900005f30 con 0x7f19000501a0 2024-02-19T06:58:03.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.156+0000 7fe5cea00640 1 -- 172.21.15.46:0/3595799117 learned_addr learned my addr 172.21.15.46:0/3595799117 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:03.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.157+0000 7f190d200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f19000df220 0x7f190004fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53224/0 (socket says 172.21.15.46:53224) 2024-02-19T06:58:03.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.157+0000 7f190d200640 1 -- 172.21.15.46:0/59710259 learned_addr learned my addr 172.21.15.46:0/59710259 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:03.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.157+0000 7fe5cea00640 1 -- 172.21.15.46:0/3595799117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5d00d1320 msgr2=0x7fe5d00cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:03.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.157+0000 7fe5cea00640 1 --2- 172.21.15.46:0/3595799117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5d00d1320 0x7fe5d00cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.157+0000 7fe5cea00640 1 -- 172.21.15.46:0/3595799117 >> v2:172.21.15.46:3300/0 conn(0x7fe5d00d1c50 msgr2=0x7fe5d00d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:03.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.157+0000 7fe5cea00640 1 --2- 172.21.15.46:0/3595799117 >> v2:172.21.15.46:3300/0 conn(0x7fe5d00d1c50 0x7fe5d00d20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.157+0000 7fe5cea00640 1 -- 172.21.15.46:0/3595799117 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d00d2620 con 0x7fe5d015d960 2024-02-19T06:58:03.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.157+0000 7fe5cf400640 1 --2- 172.21.15.46:0/3595799117 >> v2:172.21.15.46:3300/0 conn(0x7fe5d00d1c50 0x7fe5d00d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:58:03.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.158+0000 7f1907e00640 1 --2- 172.21.15.46:0/59710259 >> v2:172.21.15.142:3300/0 conn(0x7f19000501a0 0x7f1900038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.158+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378021824 0 0) 0x7f19000544c0 con 0x7f19000df220 2024-02-19T06:58:03.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.158+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18f0003520 con 0x7f19000df220 2024-02-19T06:58:03.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.158+0000 7f30d2e00640 1 Processor -- start 2024-02-19T06:58:03.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2219529493 0 0) 0x7f18f0003520 con 0x7f19000df220 2024-02-19T06:58:03.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 >> v2:172.21.15.142:3300/0 conn(0x7f19000501a0 msgr2=0x7f1900038080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:03.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f1907400640 1 --2- 172.21.15.46:0/59710259 >> v2:172.21.15.142:3300/0 conn(0x7f19000501a0 0x7f1900038080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 >> v1:172.21.15.142:6789/0 conn(0x7f190000c0a0 legacy=0x7f1900006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1900006210 con 0x7f19000df220 2024-02-19T06:58:03.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f18f8001670 con 0x7f19000df220 2024-02-19T06:58:03.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 >> v1:172.21.15.46:6789/0 conn(0x7f19000df220 legacy=0x7f190004fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f1907400640 1 --2- 172.21.15.46:0/59710259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18f0003970 0x7f18f0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f1907400640 1 --2- 172.21.15.46:0/59710259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18f00042d0 0x7f18f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f1907400640 1 --2- 172.21.15.46:0/59710259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18f0004f50 0x7f18f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1900005f30 con 0x7f18f0004f50 2024-02-19T06:58:03.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f30d2e00640 1 -- start start 2024-02-19T06:58:03.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.160+0000 7f30d2e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b400b600 0x7f30c40d9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.160+0000 7f30d2e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30c40daec0 0x7f30c4048a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.160+0000 7f30d2e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c4048fb0 0x7f30c4180360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.160+0000 7f30d2e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c4049430 con 0x7f30c4048fb0 2024-02-19T06:58:03.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.160+0000 7f30d2e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c404aca0 con 0x7f30b400b600 2024-02-19T06:58:03.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.160+0000 7f30d2e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c404b220 con 0x7f30c40daec0 2024-02-19T06:58:03.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f000bec0 con 0x7f18f0003970 2024-02-19T06:58:03.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.159+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f000c050 con 0x7f18f00042d0 2024-02-19T06:58:03.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.160+0000 7f190d200640 1 --2- 172.21.15.46:0/59710259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18f0003970 0x7f18f0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.160+0000 7f190dc00640 1 --2- 172.21.15.46:0/59710259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18f0004f50 0x7f18f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.161+0000 7f1907e00640 1 --2- 172.21.15.46:0/59710259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18f00042d0 0x7f18f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.161+0000 7f30d2400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c4048fb0 0x7f30c4180360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.161+0000 7f30d2400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c4048fb0 0x7f30c4180360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38284/0 (socket says 172.21.15.46:38284) 2024-02-19T06:58:03.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.161+0000 7f30d2400640 1 -- 172.21.15.46:0/2501863365 learned_addr learned my addr 172.21.15.46:0/2501863365 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:03.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.161+0000 7f190dc00640 1 -- 172.21.15.46:0/59710259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18f00042d0 msgr2=0x7f18f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:03.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.161+0000 7f190dc00640 1 --2- 172.21.15.46:0/59710259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18f00042d0 0x7f18f00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.161+0000 7f190dc00640 1 -- 172.21.15.46:0/59710259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18f0003970 msgr2=0x7f18f0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:03.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.161+0000 7f190dc00640 1 --2- 172.21.15.46:0/59710259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18f0003970 0x7f18f0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.161+0000 7f190dc00640 1 -- 172.21.15.46:0/59710259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1900006210 con 0x7f18f0004f50 2024-02-19T06:58:03.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.161+0000 7f30d1000640 1 --2- 172.21.15.46:0/2501863365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30c40daec0 0x7f30c4048a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.162+0000 7f30d2400640 1 -- 172.21.15.46:0/2501863365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30c40daec0 msgr2=0x7f30c4048a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.162+0000 7f30d2400640 1 --2- 172.21.15.46:0/2501863365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30c40daec0 0x7f30c4048a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.162+0000 7f30d2400640 1 -- 172.21.15.46:0/2501863365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b400b600 msgr2=0x7f30c40d9f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-19T06:58:03.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.162+0000 7f30d2400640 1 --2- 172.21.15.46:0/2501863365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b400b600 0x7f30c40d9f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.162+0000 7f30d2400640 1 -- 172.21.15.46:0/2501863365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c404af40 con 0x7f30c4048fb0 2024-02-19T06:58:03.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.162+0000 7f30d2400640 1 --2- 172.21.15.46:0/2501863365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c4048fb0 0x7f30c4180360 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0692b0 tx=0x7f30cc069e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.163+0000 7f30c9600640 1 -- 172.21.15.46:0/2501863365 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0b3650 con 0x7f30c4048fb0 2024-02-19T06:58:03.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.163+0000 7f190dc00640 1 --2- 172.21.15.46:0/59710259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18f0004f50 0x7f18f000b980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1908068250 tx=0x7f18f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d725347c3abb3bc server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.163+0000 7f190dc00640 1 -- 172.21.15.46:0/59710259 reap_dead start 2024-02-19T06:58:03.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.163+0000 7f30c9600640 1 -- 172.21.15.46:0/2501863365 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30cc0b37b0 con 0x7f30c4048fb0 2024-02-19T06:58:03.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.163+0000 7f30c9600640 1 -- 172.21.15.46:0/2501863365 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0b3b20 con 0x7f30c4048fb0 2024-02-19T06:58:03.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.164+0000 7f30d2e00640 1 -- 172.21.15.46:0/2501863365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c40df930 con 0x7f30c4048fb0 2024-02-19T06:58:03.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.163+0000 7f82e5000640 1 Processor -- start 2024-02-19T06:58:03.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.164+0000 7f82e5000640 1 -- start start 2024-02-19T06:58:03.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.164+0000 7fe5cea00640 1 --2- 172.21.15.46:0/3595799117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5d015d960 0x7fe5d006bc00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00d46c0 tx=0x7fe5c002b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f830edf4c7ecf88a server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.164+0000 7fe5cd600640 1 -- 172.21.15.46:0/3595799117 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0030800 con 0x7fe5d015d960 2024-02-19T06:58:03.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.164+0000 7fe5cd600640 1 -- 172.21.15.46:0/3595799117 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c0030960 con 0x7fe5d015d960 2024-02-19T06:58:03.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.164+0000 7fe5cd600640 1 -- 172.21.15.46:0/3595799117 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0030d30 con 0x7fe5d015d960 2024-02-19T06:58:03.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.165+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080afbc0 con 0x7f18f0004f50 2024-02-19T06:58:03.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.165+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19080b3070 con 0x7f18f0004f50 2024-02-19T06:58:03.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.165+0000 7f30d2e00640 1 -- 172.21.15.46:0/2501863365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c40dfef0 con 0x7f30c4048fb0 2024-02-19T06:58:03.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.165+0000 7f1907400640 1 -- 172.21.15.46:0/59710259 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080b9400 con 0x7f18f0004f50 2024-02-19T06:58:03.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.165+0000 7f82e5000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f82e00c6cf0 0x7f82e00d3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.165+0000 7f82e5000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f82e00ce860 0x7f82e00b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.165+0000 7f82e5000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e01626c0 con 0x7f82e00cecf0 2024-02-19T06:58:03.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.165+0000 7f82e5000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e00d36a0 con 0x7f82e00ce860 2024-02-19T06:58:03.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.165+0000 7f82e5000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e00ce5b0 con 0x7f82e00c6cf0 2024-02-19T06:58:03.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.166+0000 7f82de800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f82e00cecf0 0x7f82e00b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53238/0 (socket says 172.21.15.46:53238) 2024-02-19T06:58:03.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.166+0000 7f82de800640 1 -- 172.21.15.46:0/2799748085 learned_addr learned my addr 172.21.15.46:0/2799748085 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:03.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.166+0000 7f190fc00640 1 -- 172.21.15.46:0/59710259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18f0004f50 msgr2=0x7f18f000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.166+0000 7f190fc00640 1 --2- 172.21.15.46:0/59710259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18f0004f50 0x7f18f000b980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1908068250 tx=0x7f18f00057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.166+0000 7f82dde00640 1 --2- 172.21.15.46:0/2799748085 >> v2:172.21.15.142:3300/0 conn(0x7f82e00c6cf0 0x7f82e00d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.167+0000 7f82dd400640 1 --2- 172.21.15.46:0/2799748085 >> v2:172.21.15.46:3300/0 conn(0x7f82e00ce860 0x7f82e00b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.167+0000 7f190fc00640 1 -- 172.21.15.46:0/59710259 shutdown_connections 2024-02-19T06:58:03.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.167+0000 7f190fc00640 1 --2- 172.21.15.46:0/59710259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18f0004f50 0x7f18f000b980 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.167+0000 7f82dca00640 1 -- 172.21.15.46:0/2799748085 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463308968 0 0) 0x7f82e01626c0 con 0x7f82e00cecf0 2024-02-19T06:58:03.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.167+0000 7f190fc00640 1 -- 172.21.15.46:0/59710259 >> 172.21.15.46:0/59710259 conn(0x7f1900009fb0 msgr2=0x7f190000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.167+0000 7f30d2e00640 1 -- 172.21.15.46:0/2501863365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c404f900 con 0x7f30c4048fb0 2024-02-19T06:58:03.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.167+0000 7f190fc00640 1 -- 172.21.15.46:0/59710259 shutdown_connections 2024-02-19T06:58:03.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.167+0000 7f30c9600640 1 -- 172.21.15.46:0/2501863365 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f30cc0b3c80 con 0x7f30c4048fb0 2024-02-19T06:58:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.165+0000 7fe5d5600640 1 -- 172.21.15.46:0/3595799117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5d015d960 msgr2=0x7fe5d006bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.165+0000 7fe5d5600640 1 --2- 172.21.15.46:0/3595799117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5d015d960 0x7fe5d006bc00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00d46c0 tx=0x7fe5c002b940 comp rx=0 tx=0).stop 2024-02-19T06:58:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.167+0000 7f82dde00640 1 -- 172.21.15.46:0/2799748085 >> v2:172.21.15.46:3300/0 conn(0x7f82e00ce860 msgr2=0x7f82e00b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.167+0000 7f82dde00640 1 --2- 172.21.15.46:0/2799748085 >> v2:172.21.15.46:3300/0 conn(0x7f82e00ce860 0x7f82e00b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.167+0000 7f82dde00640 1 -- 172.21.15.46:0/2799748085 >> v1:172.21.15.46:6789/0 conn(0x7f82e00cecf0 legacy=0x7f82e00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.167+0000 7f82dde00640 1 -- 172.21.15.46:0/2799748085 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e00d20c0 con 0x7f82e00c6cf0 2024-02-19T06:58:03.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.168+0000 7f190fc00640 1 -- 172.21.15.46:0/59710259 wait complete. 2024-02-19T06:58:03.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.168+0000 7fe5d5600640 1 -- 172.21.15.46:0/3595799117 shutdown_connections 2024-02-19T06:58:03.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.168+0000 7fe5d5600640 1 --2- 172.21.15.46:0/3595799117 >> v2:172.21.15.46:3300/0 conn(0x7fe5d00d1c50 0x7fe5d00d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.168+0000 7fe5d5600640 1 --2- 172.21.15.46:0/3595799117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5d00d1320 0x7fe5d00cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.168+0000 7fe5d5600640 1 --2- 172.21.15.46:0/3595799117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5d015d960 0x7fe5d006bc00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.168+0000 7fe5d5600640 1 -- 172.21.15.46:0/3595799117 >> 172.21.15.46:0/3595799117 conn(0x7fe5d009c9e0 msgr2=0x7fe5d008afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.169+0000 7f82dde00640 1 --2- 172.21.15.46:0/2799748085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e00c6cf0 0x7f82e00d3160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f82e008b560 tx=0x7f82d802bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae71ffd8c2e27e35 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.169+0000 7f30c9600640 1 --2- 172.21.15.46:0/2501863365 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f30ac06b840 0x7f30ac06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.169+0000 7f30c9600640 1 -- 172.21.15.46:0/2501863365 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30cc125aa0 con 0x7f30c4048fb0 2024-02-19T06:58:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.170+0000 7f30d1a00640 1 --2- 172.21.15.46:0/2501863365 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f30ac06b840 0x7f30ac06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.171+0000 7f82dca00640 1 -- 172.21.15.46:0/2799748085 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d802ccb0 con 0x7f82e00c6cf0 2024-02-19T06:58:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.168+0000 7fe5d5600640 1 -- 172.21.15.46:0/3595799117 shutdown_connections 2024-02-19T06:58:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.168+0000 7fe5d5600640 1 -- 172.21.15.46:0/3595799117 wait complete. 2024-02-19T06:58:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.171+0000 7f82dca00640 1 -- 172.21.15.46:0/2799748085 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d802ce10 con 0x7f82e00c6cf0 2024-02-19T06:58:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.171+0000 7fe5d5600640 1 Processor -- start 2024-02-19T06:58:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.171+0000 7f30d1a00640 1 --2- 172.21.15.46:0/2501863365 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f30ac06b840 0x7f30ac06dd00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f30c0007a00 tx=0x7f30c00014f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.171+0000 7f190fc00640 1 Processor -- start 2024-02-19T06:58:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.171+0000 7fe5d5600640 1 -- start start 2024-02-19T06:58:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.172+0000 7f190fc00640 1 -- start start 2024-02-19T06:58:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.172+0000 7f82e5000640 1 -- 172.21.15.46:0/2799748085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e00c6cf0 msgr2=0x7f82e00d3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.172+0000 7f82dca00640 1 -- 172.21.15.46:0/2799748085 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d802ccb0 con 0x7f82e00c6cf0 2024-02-19T06:58:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.172+0000 7f82e5000640 1 --2- 172.21.15.46:0/2799748085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e00c6cf0 0x7f82e00d3160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f82e008b560 tx=0x7f82d802bf00 comp rx=0 tx=0).stop 2024-02-19T06:58:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.173+0000 7fe5d5600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5d00d1320 0x7fe5d015fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7fe5d5600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5d00d1c50 0x7fe5d01ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7f190fc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18f0004f50 0x7f19000d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7fe5d5600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5d015d960 0x7fe5d00b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7f190fc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19000ddc20 0x7f19000d40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7f190fc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19000df900 0x7f19000d4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7fe5d5600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0160260 con 0x7fe5d015d960 2024-02-19T06:58:03.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7fe5cea00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5d00d1320 0x7fe5d015fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7fe5d5600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00ca970 con 0x7fe5d00d1c50 2024-02-19T06:58:03.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7fe5d5600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0160cf0 con 0x7fe5d00d1320 2024-02-19T06:58:03.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7f190fc00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000d11c0 con 0x7f19000df900 2024-02-19T06:58:03.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7f190fc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000dfea0 con 0x7f19000ddc20 2024-02-19T06:58:03.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7f190fc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19000e0180 con 0x7f18f0004f50 2024-02-19T06:58:03.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7fe5ce000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5d00d1c50 0x7fe5d01ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.175+0000 7f82e5000640 1 -- 172.21.15.46:0/2799748085 shutdown_connections 2024-02-19T06:58:03.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.175+0000 7f82e5000640 1 --2- 172.21.15.46:0/2799748085 >> v2:172.21.15.46:3300/0 conn(0x7f82e00ce860 0x7f82e00b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7fe5cea00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5d00d1320 0x7fe5d015fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:46014/0 (socket says 172.21.15.46:46014) 2024-02-19T06:58:03.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.174+0000 7fe5cea00640 1 -- 172.21.15.46:0/32901915 learned_addr learned my addr 172.21.15.46:0/32901915 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:03.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.175+0000 7f82e5000640 1 --2- 172.21.15.46:0/2799748085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e00c6cf0 0x7f82e00d3160 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.175+0000 7f82e5000640 1 -- 172.21.15.46:0/2799748085 >> 172.21.15.46:0/2799748085 conn(0x7f82e008afc0 msgr2=0x7f82e00d3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.175+0000 7f82e5000640 1 -- 172.21.15.46:0/2799748085 shutdown_connections 2024-02-19T06:58:03.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.175+0000 7f82e5000640 1 -- 172.21.15.46:0/2799748085 wait complete. 2024-02-19T06:58:03.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.176+0000 7fe5ce000640 1 -- 172.21.15.46:0/32901915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5d00d1320 msgr2=0x7fe5d015fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.176+0000 7fe5ce000640 1 --2- 172.21.15.46:0/32901915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5d00d1320 0x7fe5d015fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.176+0000 7fe5ce000640 1 -- 172.21.15.46:0/32901915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5d015d960 msgr2=0x7fe5d00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.176+0000 7fe5ce000640 1 --2- 172.21.15.46:0/32901915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5d015d960 0x7fe5d00b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.176+0000 7fe5ce000640 1 -- 172.21.15.46:0/32901915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c8009a70 con 0x7fe5d00d1c50 2024-02-19T06:58:03.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.175+0000 7f9360000640 1 Processor -- start 2024-02-19T06:58:03.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.175+0000 7f9360000640 1 -- start start 2024-02-19T06:58:03.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.175+0000 7f1907e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19000ddc20 0x7f19000d40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.175+0000 7f1907e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19000ddc20 0x7f19000d40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43246/0 (socket says 172.21.15.46:43246) 2024-02-19T06:58:03.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.175+0000 7f1907e00640 1 -- 172.21.15.46:0/4249512030 learned_addr learned my addr 172.21.15.46:0/4249512030 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:03.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.176+0000 7f190d200640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18f0004f50 0x7f19000d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.176+0000 7f1907e00640 1 -- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18f0004f50 msgr2=0x7f19000d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.176+0000 7f1907e00640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18f0004f50 0x7f19000d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.176+0000 7f1907e00640 1 -- 172.21.15.46:0/4249512030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19000df900 msgr2=0x7f19000d4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.176+0000 7f1907e00640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19000df900 0x7f19000d4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.176+0000 7f1907e00640 1 -- 172.21.15.46:0/4249512030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19000e0460 con 0x7f19000ddc20 2024-02-19T06:58:03.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.177+0000 7f190d200640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18f0004f50 0x7f19000d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:03.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.177+0000 7f1907e00640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19000ddc20 0x7f19000d40c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18fc011960 tx=0x7f18fc011e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.177+0000 7f9360000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93580c6cf0 0x7f93580d3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.177+0000 7f9360000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93580cecc0 0x7f93580b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.177+0000 7f9360000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93581626c0 con 0x7f93580ce860 2024-02-19T06:58:03.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.177+0000 7f9360000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93580d36a0 con 0x7f93580cecc0 2024-02-19T06:58:03.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.177+0000 7f9360000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93580ce5b0 con 0x7f93580c6cf0 2024-02-19T06:58:03.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.178+0000 7f1904c00640 1 -- 172.21.15.46:0/4249512030 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc00fa10 con 0x7f19000ddc20 2024-02-19T06:58:03.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.178+0000 7f1904c00640 1 -- 172.21.15.46:0/4249512030 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18fc00fb70 con 0x7f19000ddc20 2024-02-19T06:58:03.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.178+0000 7f1904c00640 1 -- 172.21.15.46:0/4249512030 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc014440 con 0x7f19000ddc20 2024-02-19T06:58:03.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.178+0000 7f190fc00640 1 -- 172.21.15.46:0/4249512030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19000e0740 con 0x7f19000ddc20 2024-02-19T06:58:03.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.178+0000 7f190fc00640 1 -- 172.21.15.46:0/4249512030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19000e19d0 con 0x7f19000ddc20 2024-02-19T06:58:03.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.178+0000 7fe5ce000640 1 --2- 172.21.15.46:0/32901915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5d00d1c50 0x7fe5d01ff9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00b410 tx=0x7fe5bc00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.178+0000 7f935e000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93580cecc0 0x7f93580b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.178+0000 7f82e5000640 1 Processor -- start 2024-02-19T06:58:03.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.178+0000 7f935e000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93580cecc0 0x7f93580b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38330/0 (socket says 172.21.15.46:38330) 2024-02-19T06:58:03.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.178+0000 7f935e000640 1 -- 172.21.15.46:0/3848933233 learned_addr learned my addr 172.21.15.46:0/3848933233 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:03.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.179+0000 7f82e5000640 1 -- start start 2024-02-19T06:58:03.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.179+0000 7f935e000640 1 -- 172.21.15.46:0/3848933233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93580c6cf0 msgr2=0x7f93580d3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:03.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.179+0000 7f935d600640 1 --2- 172.21.15.46:0/3848933233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93580c6cf0 0x7f93580d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.179+0000 7fe5c6a00640 1 -- 172.21.15.46:0/32901915 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc011830 con 0x7fe5d00d1c50 2024-02-19T06:58:03.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.179+0000 7fe5c6a00640 1 -- 172.21.15.46:0/32901915 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc011990 con 0x7fe5d00d1c50 2024-02-19T06:58:03.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.179+0000 7fe5c6a00640 1 -- 172.21.15.46:0/32901915 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc011d40 con 0x7fe5d00d1c50 2024-02-19T06:58:03.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.179+0000 7f935e000640 1 --2- 172.21.15.46:0/3848933233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93580c6cf0 0x7f93580d3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.179+0000 7f935e000640 1 -- 172.21.15.46:0/3848933233 >> v1:172.21.15.46:6789/0 conn(0x7f93580ce860 legacy=0x7f93580b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:03.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.179+0000 7f935e000640 1 -- 172.21.15.46:0/3848933233 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93580d20c0 con 0x7f93580cecc0 2024-02-19T06:58:03.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.179+0000 7f935d600640 1 --2- 172.21.15.46:0/3848933233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93580c6cf0 0x7f93580d3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:03.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.179+0000 7fe5d5600640 1 -- 172.21.15.46:0/32901915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c00094d0 con 0x7fe5d00d1c50 2024-02-19T06:58:03.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.180+0000 7fe5d5600640 1 -- 172.21.15.46:0/32901915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d0160730 con 0x7fe5d00d1c50 2024-02-19T06:58:03.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.180+0000 7fb118800640 1 Processor -- start 2024-02-19T06:58:03.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.180+0000 7f82e5000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82e00c6cf0 0x7f82e00cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.180+0000 7f82e5000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82e00ce860 0x7f82e014f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.180+0000 7f82e5000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e00cecf0 0x7f82e014fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.180+0000 7f82e5000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e01503b0 con 0x7f82e00c6cf0 2024-02-19T06:58:03.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.180+0000 7f8e6cc00640 1 Processor -- start 2024-02-19T06:58:03.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.180+0000 7f18d1400640 1 Processor -- start 2024-02-19T06:58:03.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.180+0000 7f82e5000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00b76f0 con 0x7f82e00cecf0 2024-02-19T06:58:03.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.180+0000 7f82e5000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00b8750 con 0x7f82e00ce860 2024-02-19T06:58:03.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.180+0000 7f190fc00640 1 -- 172.21.15.46:0/4249512030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19000e0c60 con 0x7f19000ddc20 2024-02-19T06:58:03.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.181+0000 7f82de800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e00cecf0 0x7f82e014fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.181+0000 7fb118800640 1 -- start start 2024-02-19T06:58:03.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.181+0000 7f18d1400640 1 -- start start 2024-02-19T06:58:03.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.181+0000 7f82de800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e00cecf0 0x7f82e014fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43252/0 (socket says 172.21.15.46:43252) 2024-02-19T06:58:03.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.181+0000 7f82de800640 1 -- 172.21.15.46:0/2786833225 learned_addr learned my addr 172.21.15.46:0/2786833225 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:03.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.181+0000 7fe5bbe00640 1 -- 172.21.15.46:0/32901915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a4005290 con 0x7fe5d00d1c50 2024-02-19T06:58:03.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.182+0000 7f82de800640 1 -- 172.21.15.46:0/2786833225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82e00ce860 msgr2=0x7f82e014f930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-19T06:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.182+0000 7f82de800640 1 --2- 172.21.15.46:0/2786833225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82e00ce860 0x7f82e014f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.182+0000 7f82de800640 1 -- 172.21.15.46:0/2786833225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82e00c6cf0 msgr2=0x7f82e00cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.182+0000 7f82de800640 1 --2- 172.21.15.46:0/2786833225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82e00c6cf0 0x7f82e00cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.182+0000 7f82de800640 1 -- 172.21.15.46:0/2786833225 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d8009a70 con 0x7f82e00cecf0 2024-02-19T06:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.182+0000 7f1904c00640 1 -- 172.21.15.46:0/4249512030 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f18fc0145a0 con 0x7f19000ddc20 2024-02-19T06:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.181+0000 7f8e6cc00640 1 -- start start 2024-02-19T06:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7f8e6cc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e680d0760 0x7f8e680d2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7f8e6cc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e680d3490 0x7f8e680cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7f8e6cc00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e680d0b40 0x7f8e680d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7f8e6cc00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e680d01c0 con 0x7f8e680d0b40 2024-02-19T06:58:03.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7f8e6cc00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e68162390 con 0x7f8e680d0760 2024-02-19T06:58:03.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7f8e6cc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e681625f0 con 0x7f8e680d3490 2024-02-19T06:58:03.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7f8e66800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e680d0b40 0x7f8e680d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7f8e66800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e680d0b40 0x7f8e680d1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38338/0 (socket says 172.21.15.46:38338) 2024-02-19T06:58:03.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7f8e66800640 1 -- 172.21.15.46:0/1910680656 learned_addr learned my addr 172.21.15.46:0/1910680656 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:03.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f8e65e00640 1 --2- 172.21.15.46:0/1910680656 >> v2:172.21.15.142:3300/0 conn(0x7f8e680d0760 0x7f8e680d2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7fb118800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1100c51a0 0x7fb11015f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7fb118800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb110160200 0x7fb11015fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7fb118800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11009a440 con 0x7fb11015eee0 2024-02-19T06:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7fb118800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1100cc140 con 0x7fb1100c51a0 2024-02-19T06:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7fb118800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100cc2d0 con 0x7fb110160200 2024-02-19T06:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7fb115e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb11015eee0 0x7fb1100b2580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53256/0 (socket says 172.21.15.46:53256) 2024-02-19T06:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7fb115e00640 1 -- 172.21.15.46:0/3324186018 learned_addr learned my addr 172.21.15.46:0/3324186018 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7fb115400640 1 --2- 172.21.15.46:0/3324186018 >> v2:172.21.15.142:3300/0 conn(0x7fb1100c51a0 0x7fb11015f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f30c9600640 1 -- 172.21.15.46:0/2501863365 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f30cc0f0580 con 0x7f30c4048fb0 2024-02-19T06:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f8e66800640 1 -- 172.21.15.46:0/1910680656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e680d3490 msgr2=0x7f8e680cfc80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-19T06:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f8e66800640 1 --2- 172.21.15.46:0/1910680656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e680d3490 0x7f8e680cfc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f8e66800640 1 -- 172.21.15.46:0/1910680656 >> v2:172.21.15.142:3300/0 conn(0x7f8e680d0760 msgr2=0x7f8e680d2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f8e66800640 1 --2- 172.21.15.46:0/1910680656 >> v2:172.21.15.142:3300/0 conn(0x7f8e680d0760 0x7f8e680d2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f8e66800640 1 -- 172.21.15.46:0/1910680656 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e681628d0 con 0x7f8e680d0b40 2024-02-19T06:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7f1904c00640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f18ec06b860 0x7f18ec06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f1904c00640 1 -- 172.21.15.46:0/4249512030 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18fc08a9f0 con 0x7f19000ddc20 2024-02-19T06:58:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7fb116800640 1 --2- 172.21.15.46:0/3324186018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb110160200 0x7fb11015fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7fb114a00640 1 -- 172.21.15.46:0/3324186018 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054429744 0 0) 0x7fb11009a440 con 0x7fb11015eee0 2024-02-19T06:58:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f190d200640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f18ec06b860 0x7f18ec06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.183+0000 7f82de800640 1 --2- 172.21.15.46:0/2786833225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e00cecf0 0x7f82e014fe70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f82d000c480 tx=0x7f82d000c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f18d1400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f18cc0b2f30 0x7f18cc0b3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f18d1400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18cc0b2460 0x7f18cc162f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f18d1400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc166640 con 0x7f18cc071000 2024-02-19T06:58:03.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.185+0000 7fb114a00640 1 -- 172.21.15.46:0/3324186018 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0f8003520 con 0x7fb11015eee0 2024-02-19T06:58:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.185+0000 7f8e65e00640 1 --2- 172.21.15.46:0/1910680656 >> v2:172.21.15.142:3300/0 conn(0x7f8e680d0760 0x7f8e680d2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.185+0000 7f935e000640 1 --2- 172.21.15.46:0/3848933233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93580cecc0 0x7f93580b0530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f934c009870 tx=0x7f934c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41ecf0f94e0330d server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.185+0000 7fb115400640 1 -- 172.21.15.46:0/3324186018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb110160200 msgr2=0x7fb11015fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.185+0000 7fb115400640 1 --2- 172.21.15.46:0/3324186018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb110160200 0x7fb11015fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.185+0000 7fb115400640 1 -- 172.21.15.46:0/3324186018 >> v1:172.21.15.46:6789/0 conn(0x7fb11015eee0 legacy=0x7fb1100b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f18d1400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc159250 con 0x7f18cc0b2f30 2024-02-19T06:58:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f18d1400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc06e6f0 con 0x7f18cc0b2460 2024-02-19T06:58:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7f18c9e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18cc0b2460 0x7f18cc162f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.185+0000 7fb115400640 1 -- 172.21.15.46:0/3324186018 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11009a690 con 0x7fb1100c51a0 2024-02-19T06:58:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.185+0000 7f190d200640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f18ec06b860 0x7f18ec06dd20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f18f8007ce0 tx=0x7f18f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.185+0000 7f18c9e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18cc0b2460 0x7f18cc162f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:46052/0 (socket says 172.21.15.46:46052) 2024-02-19T06:58:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.185+0000 7f18c9e00640 1 -- 172.21.15.46:0/4028763507 learned_addr learned my addr 172.21.15.46:0/4028763507 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.185+0000 7f18c9e00640 1 -- 172.21.15.46:0/4028763507 >> v2:172.21.15.46:3300/0 conn(0x7f18cc0b2f30 msgr2=0x7f18cc0b3310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-19T06:58:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.186+0000 7f18c9e00640 1 --2- 172.21.15.46:0/4028763507 >> v2:172.21.15.46:3300/0 conn(0x7f18cc0b2f30 0x7f18cc0b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.186+0000 7f18c9e00640 1 -- 172.21.15.46:0/4028763507 >> v1:172.21.15.142:6789/0 conn(0x7f18cc071000 legacy=0x7f18cc071490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-19T06:58:03.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.186+0000 7f18c9e00640 1 -- 172.21.15.46:0/4028763507 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc0b3850 con 0x7f18cc0b2460 2024-02-19T06:58:03.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.184+0000 7fe5c6a00640 1 -- 172.21.15.46:0/32901915 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe5bc01a400 con 0x7fe5d00d1c50 2024-02-19T06:58:03.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.186+0000 7fe5c6a00640 1 --2- 172.21.15.46:0/32901915 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe5b006b8e0 0x7fe5b006dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.186+0000 7fe5c6a00640 1 -- 172.21.15.46:0/32901915 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5bc08a140 con 0x7fe5d00d1c50 2024-02-19T06:58:03.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.186+0000 7f8e66800640 1 --2- 172.21.15.46:0/1910680656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e680d0b40 0x7f8e680d1960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e680b58d0 tx=0x7f8e5402b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8857be58cfc6a67a server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.186+0000 7fe5cea00640 1 --2- 172.21.15.46:0/32901915 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe5b006b8e0 0x7fe5b006dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.186+0000 7f8e64a00640 1 -- 172.21.15.46:0/1910680656 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54030800 con 0x7f8e680d0b40 2024-02-19T06:58:03.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.187+0000 7f9357e00640 1 -- 172.21.15.46:0/3848933233 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c031640 con 0x7f93580cecc0 2024-02-19T06:58:03.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.187+0000 7f9357e00640 1 -- 172.21.15.46:0/3848933233 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c0317a0 con 0x7f93580cecc0 2024-02-19T06:58:03.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.187+0000 7f9357e00640 1 -- 172.21.15.46:0/3848933233 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c031b30 con 0x7f93580cecc0 2024-02-19T06:58:03.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.187+0000 7f8e64a00640 1 -- 172.21.15.46:0/1910680656 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e54030960 con 0x7f8e680d0b40 2024-02-19T06:58:03.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.187+0000 7f8e64a00640 1 -- 172.21.15.46:0/1910680656 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54030cf0 con 0x7f8e680d0b40 2024-02-19T06:58:03.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.187+0000 7f18c9e00640 1 --2- 172.21.15.46:0/4028763507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18cc0b2460 0x7f18cc162f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009e50 tx=0x7f18c402be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f26ac0d8338e113b server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.187+0000 7fb115400640 1 --2- 172.21.15.46:0/3324186018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1100c51a0 0x7fb11015f660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1000097a0 tx=0x7fb10002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc86332d6afe8658 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.187+0000 7f8e6cc00640 1 -- 172.21.15.46:0/1910680656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e680d0b40 msgr2=0x7f8e680d1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.187+0000 7f8e6cc00640 1 --2- 172.21.15.46:0/1910680656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e680d0b40 0x7f8e680d1960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e680b58d0 tx=0x7f8e5402b940 comp rx=0 tx=0).stop 2024-02-19T06:58:03.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.187+0000 7f9360000640 1 -- 172.21.15.46:0/3848933233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93580cecc0 msgr2=0x7f93580b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.187+0000 7f9360000640 1 --2- 172.21.15.46:0/3848933233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93580cecc0 0x7f93580b0530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f934c009870 tx=0x7f934c02b8f0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f9360000640 1 -- 172.21.15.46:0/3848933233 shutdown_connections 2024-02-19T06:58:03.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f9360000640 1 --2- 172.21.15.46:0/3848933233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93580cecc0 0x7f93580b0530 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f9360000640 1 --2- 172.21.15.46:0/3848933233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93580c6cf0 0x7f93580d3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f9360000640 1 -- 172.21.15.46:0/3848933233 >> 172.21.15.46:0/3848933233 conn(0x7f935808afc0 msgr2=0x7f93580d3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f8e6cc00640 1 -- 172.21.15.46:0/1910680656 shutdown_connections 2024-02-19T06:58:03.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f8e6cc00640 1 --2- 172.21.15.46:0/1910680656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e680d0b40 0x7f8e680d1960 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f8e6cc00640 1 --2- 172.21.15.46:0/1910680656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e680d3490 0x7f8e680cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f8e6cc00640 1 --2- 172.21.15.46:0/1910680656 >> v2:172.21.15.142:3300/0 conn(0x7f8e680d0760 0x7f8e680d2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f8e6cc00640 1 -- 172.21.15.46:0/1910680656 >> 172.21.15.46:0/1910680656 conn(0x7f8e68066ca0 msgr2=0x7f8e680670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7fe5cea00640 1 --2- 172.21.15.46:0/32901915 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe5b006b8e0 0x7fe5b006dda0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0000c00 tx=0x7fe5c0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f8e6cc00640 1 -- 172.21.15.46:0/1910680656 shutdown_connections 2024-02-19T06:58:03.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f9360000640 1 -- 172.21.15.46:0/3848933233 shutdown_connections 2024-02-19T06:58:03.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f18c9400640 1 -- 172.21.15.46:0/4028763507 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c402c9f0 con 0x7f18cc0b2460 2024-02-19T06:58:03.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f8e6cc00640 1 -- 172.21.15.46:0/1910680656 wait complete. 2024-02-19T06:58:03.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f18c9400640 1 -- 172.21.15.46:0/4028763507 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c402cb50 con 0x7f18cc0b2460 2024-02-19T06:58:03.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f18c9400640 1 -- 172.21.15.46:0/4028763507 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c40343f0 con 0x7f18cc0b2460 2024-02-19T06:58:03.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.188+0000 7f9360000640 1 -- 172.21.15.46:0/3848933233 wait complete. 2024-02-19T06:58:03.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.189+0000 7f18d1400640 1 -- 172.21.15.46:0/4028763507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18cc0b2460 msgr2=0x7f18cc162f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.189+0000 7f18d1400640 1 --2- 172.21.15.46:0/4028763507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18cc0b2460 0x7f18cc162f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009e50 tx=0x7f18c402be50 comp rx=0 tx=0).stop 2024-02-19T06:58:03.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.190+0000 7f9360000640 1 Processor -- start 2024-02-19T06:58:03.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.190+0000 7f18d1400640 1 -- 172.21.15.46:0/4028763507 shutdown_connections 2024-02-19T06:58:03.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.190+0000 7f18d1400640 1 --2- 172.21.15.46:0/4028763507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18cc0b2460 0x7f18cc162f20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.190+0000 7f18d1400640 1 --2- 172.21.15.46:0/4028763507 >> v2:172.21.15.46:3300/0 conn(0x7f18cc0b2f30 0x7f18cc0b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.190+0000 7f18d1400640 1 -- 172.21.15.46:0/4028763507 >> 172.21.15.46:0/4028763507 conn(0x7f18cc066f70 msgr2=0x7f18cc06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.190+0000 7f18d1400640 1 -- 172.21.15.46:0/4028763507 shutdown_connections 2024-02-19T06:58:03.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.190+0000 7f9360000640 1 -- start start 2024-02-19T06:58:03.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.190+0000 7f8e6cc00640 1 Processor -- start 2024-02-19T06:58:03.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.190+0000 7f8e6cc00640 1 -- start start 2024-02-19T06:58:03.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.190+0000 7f18d1400640 1 -- 172.21.15.46:0/4028763507 wait complete. 2024-02-19T06:58:03.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.191+0000 7f9360000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93580c6cf0 0x7f93581f7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.191+0000 7f9360000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93580ce860 0x7f93580b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.191+0000 7f9360000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93580cecc0 0x7f93580c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.192+0000 7f9360000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93581f79d0 con 0x7f93580cecc0 2024-02-19T06:58:03.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.192+0000 7f9360000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93580c77c0 con 0x7f93580c6cf0 2024-02-19T06:58:03.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.192+0000 7f9360000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93580b66e0 con 0x7f93580ce860 2024-02-19T06:58:03.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.192+0000 7f935d600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93580c6cf0 0x7f93581f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.192+0000 7f935cc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93580ce860 0x7f93580b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.192+0000 7f935cc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93580ce860 0x7f93580b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:46064/0 (socket says 172.21.15.46:46064) 2024-02-19T06:58:03.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.192+0000 7f935cc00640 1 -- 172.21.15.46:0/292255751 learned_addr learned my addr 172.21.15.46:0/292255751 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:03.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.192+0000 7f935e000640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93580cecc0 0x7f93580c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.192+0000 7f8e6cc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e680d0760 0x7f8e68152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.193+0000 7f935e000640 1 -- 172.21.15.46:0/292255751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93580ce860 msgr2=0x7f93580b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.193+0000 7f935e000640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93580ce860 0x7f93580b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.193+0000 7f8e6cc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e680d0b40 0x7f8e680c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.193+0000 7f935e000640 1 -- 172.21.15.46:0/292255751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93580c6cf0 msgr2=0x7f93581f7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.193+0000 7f935e000640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93580c6cf0 0x7f93581f7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.193+0000 7f935e000640 1 -- 172.21.15.46:0/292255751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0094d0 con 0x7f93580cecc0 2024-02-19T06:58:03.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.193+0000 7f8e6cc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e680d3490 0x7f8e680c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.193+0000 7f935d600640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93580c6cf0 0x7f93581f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:58:03.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.193+0000 7f8e65e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e680d0760 0x7f8e68152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.193+0000 7f8e65e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e680d0760 0x7f8e68152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38362/0 (socket says 172.21.15.46:38362) 2024-02-19T06:58:03.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.193+0000 7f8e65e00640 1 -- 172.21.15.46:0/3454134578 learned_addr learned my addr 172.21.15.46:0/3454134578 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:03.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.193+0000 7f8e65400640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e680d0b40 0x7f8e680c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f8e6cc00640 1 -- 172.21.15.46:0/3454134578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6815f810 con 0x7f8e680d0760 2024-02-19T06:58:03.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f8e6cc00640 1 -- 172.21.15.46:0/3454134578 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6815d850 con 0x7f8e680d0b40 2024-02-19T06:58:03.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f8e6cc00640 1 -- 172.21.15.46:0/3454134578 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6815db30 con 0x7f8e680d3490 2024-02-19T06:58:03.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f935e000640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93580cecc0 0x7f93580c7c50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f934c033000 tx=0x7f934c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f8e66800640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e680d3490 0x7f8e680c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f9355600640 1 -- 172.21.15.46:0/292255751 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c03ac40 con 0x7f93580cecc0 2024-02-19T06:58:03.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f18d1400640 1 Processor -- start 2024-02-19T06:58:03.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f8e65e00640 1 -- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e680d3490 msgr2=0x7f8e680c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f8e65e00640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e680d3490 0x7f8e680c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f18d1400640 1 -- start start 2024-02-19T06:58:03.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f9360000640 1 -- 172.21.15.46:0/292255751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93580b9390 con 0x7f93580cecc0 2024-02-19T06:58:03.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f9360000640 1 -- 172.21.15.46:0/292255751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93580c7450 con 0x7f93580cecc0 2024-02-19T06:58:03.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f9355600640 1 -- 172.21.15.46:0/292255751 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c03ada0 con 0x7f93580cecc0 2024-02-19T06:58:03.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.194+0000 7f9355600640 1 -- 172.21.15.46:0/292255751 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c044630 con 0x7f93580cecc0 2024-02-19T06:58:03.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.195+0000 7f8e65e00640 1 -- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e680d0b40 msgr2=0x7f8e680c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.195+0000 7f8e65e00640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e680d0b40 0x7f8e680c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.195+0000 7f8e65e00640 1 -- 172.21.15.46:0/3454134578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e540094d0 con 0x7f8e680d0760 2024-02-19T06:58:03.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.195+0000 7f8e65400640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e680d0b40 0x7f8e680c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:58:03.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.196+0000 7f8e65e00640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e680d0760 0x7f8e68152ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800c7f0 tx=0x7f8e5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.196+0000 7f8e5e000640 1 -- 172.21.15.46:0/3454134578 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e58007820 con 0x7f8e680d0760 2024-02-19T06:58:03.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.196+0000 7f18d1400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18cc071000 0x7f18cc1f8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.196+0000 7f18d1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18cc0b2460 0x7f18cc0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.196+0000 7f18d1400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18cc0b2f30 0x7f18cc1f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.196+0000 7f18d1400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0cc990 con 0x7f18cc0b2460 2024-02-19T06:58:03.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.196+0000 7f18d1400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0cc760 con 0x7f18cc071000 2024-02-19T06:58:03.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.196+0000 7f18d1400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0ce5e0 con 0x7f18cc0b2f30 2024-02-19T06:58:03.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.196+0000 7f8e5e000640 1 -- 172.21.15.46:0/3454134578 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e58007980 con 0x7f8e680d0760 2024-02-19T06:58:03.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.196+0000 7f8e6cc00640 1 -- 172.21.15.46:0/3454134578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6815de10 con 0x7f8e680d0760 2024-02-19T06:58:03.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.196+0000 7f8e5e000640 1 -- 172.21.15.46:0/3454134578 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e58007cf0 con 0x7f8e680d0760 2024-02-19T06:58:03.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.196+0000 7f8e6cc00640 1 -- 172.21.15.46:0/3454134578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6815e3d0 con 0x7f8e680d0760 2024-02-19T06:58:03.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.197+0000 7f9355600640 1 -- 172.21.15.46:0/292255751 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f934c02f050 con 0x7f93580cecc0 2024-02-19T06:58:03.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.197+0000 7f18ca800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18cc071000 0x7f18cc1f8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.197+0000 7f18ca800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18cc071000 0x7f18cc1f8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43304/0 (socket says 172.21.15.46:43304) 2024-02-19T06:58:03.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.197+0000 7f18ca800640 1 -- 172.21.15.46:0/3903188383 learned_addr learned my addr 172.21.15.46:0/3903188383 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:03.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.197+0000 7f18c9e00640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18cc0b2460 0x7f18cc0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.197+0000 7f18cb200640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18cc0b2f30 0x7f18cc1f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.197+0000 7f9360000640 1 -- 172.21.15.46:0/292255751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93580c7970 con 0x7f93580cecc0 2024-02-19T06:58:03.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.198+0000 7f9355600640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f933806b810 0x7f933806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.198+0000 7f9355600640 1 -- 172.21.15.46:0/292255751 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f934c0abf00 con 0x7f93580cecc0 2024-02-19T06:58:03.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.198+0000 7f935d600640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f933806b810 0x7f933806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.198+0000 7f18c9e00640 1 -- 172.21.15.46:0/3903188383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18cc0b2f30 msgr2=0x7f18cc1f6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.198+0000 7f18c9e00640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18cc0b2f30 0x7f18cc1f6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.198+0000 7f18c9e00640 1 -- 172.21.15.46:0/3903188383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18cc071000 msgr2=0x7f18cc1f8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.198+0000 7f18c9e00640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18cc071000 0x7f18cc1f8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.198+0000 7f18c9e00640 1 -- 172.21.15.46:0/3903188383 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4009b30 con 0x7f18cc0b2460 2024-02-19T06:58:03.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.198+0000 7f8e6cc00640 1 -- 172.21.15.46:0/3454134578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e680b6be0 con 0x7f8e680d0760 2024-02-19T06:58:03.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.199+0000 7f18c9e00640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18cc0b2460 0x7f18cc0cc220 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f18cc06e830 tx=0x7f18c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.199+0000 7f935d600640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f933806b810 0x7f933806dcd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9350007fd0 tx=0x7f935000e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.199+0000 7f8e5e000640 1 -- 172.21.15.46:0/3454134578 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8e580113f0 con 0x7f8e680d0760 2024-02-19T06:58:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.200+0000 7f8e5e000640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e4806b810 0x7f8e4806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.200+0000 7f8e5e000640 1 -- 172.21.15.46:0/3454134578 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e5808a200 con 0x7f8e680d0760 2024-02-19T06:58:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.201+0000 7f8e65400640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e4806b810 0x7f8e4806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.202+0000 7f8e65400640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e4806b810 0x7f8e4806dcd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e68160cb0 tx=0x7f8e6000d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.203+0000 7f82d6000640 1 -- 172.21.15.46:0/2786833225 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0005ce0 con 0x7f82e00cecf0 2024-02-19T06:58:03.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.203+0000 7f82e5000640 1 -- 172.21.15.46:0/2786833225 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e00b7990 con 0x7f82e00cecf0 2024-02-19T06:58:03.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.203+0000 7f82e5000640 1 -- 172.21.15.46:0/2786833225 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e00b7d20 con 0x7f82e00cecf0 2024-02-19T06:58:03.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.203+0000 7fb114a00640 1 -- 172.21.15.46:0/3324186018 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100031780 con 0x7fb1100c51a0 2024-02-19T06:58:03.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.204+0000 7f1904c00640 1 -- 172.21.15.46:0/4249512030 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f19000e0c60 con 0x7f19000ddc20 2024-02-19T06:58:03.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.204+0000 7f82e5000640 1 -- 172.21.15.46:0/2786833225 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e0067ba0 con 0x7f82e00cecf0 2024-02-19T06:58:03.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.207+0000 7f18c2a00640 1 -- 172.21.15.46:0/3903188383 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4009510 con 0x7f18cc0b2460 2024-02-19T06:58:03.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.208+0000 7f18d1400640 1 -- 172.21.15.46:0/3903188383 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc0ce880 con 0x7f18cc0b2460 2024-02-19T06:58:03.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.208+0000 7f9355600640 1 -- 172.21.15.46:0/292255751 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f93580c7970 con 0x7f93580cecc0 2024-02-19T06:58:03.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.208+0000 7f18d1400640 1 -- 172.21.15.46:0/3903188383 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc0cee40 con 0x7f18cc0b2460 2024-02-19T06:58:03.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.209+0000 7f18d1400640 1 -- 172.21.15.46:0/3903188383 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18cc067ba0 con 0x7f18cc0b2460 2024-02-19T06:58:03.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.216+0000 7fb114a00640 1 -- 172.21.15.46:0/3324186018 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1000318e0 con 0x7fb1100c51a0 2024-02-19T06:58:03.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.216+0000 7fe5c6a00640 1 -- 172.21.15.46:0/32901915 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe5bc054bd0 con 0x7fe5d00d1c50 2024-02-19T06:58:03.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.216+0000 7fb114a00640 1 -- 172.21.15.46:0/3324186018 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100031c50 con 0x7fb1100c51a0 2024-02-19T06:58:03.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.216+0000 7f82d6000640 1 -- 172.21.15.46:0/2786833225 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d0005e40 con 0x7f82e00cecf0 2024-02-19T06:58:03.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.217+0000 7fb118800640 1 -- 172.21.15.46:0/3324186018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1100c51a0 msgr2=0x7fb11015f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.217+0000 7fb118800640 1 --2- 172.21.15.46:0/3324186018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1100c51a0 0x7fb11015f660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1000097a0 tx=0x7fb10002b820 comp rx=0 tx=0).stop 2024-02-19T06:58:03.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.217+0000 7f82d6000640 1 -- 172.21.15.46:0/2786833225 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0007270 con 0x7f82e00cecf0 2024-02-19T06:58:03.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.218+0000 7f18c2a00640 1 -- 172.21.15.46:0/3903188383 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c403e450 con 0x7f18cc0b2460 2024-02-19T06:58:03.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.218+0000 7f18c2a00640 1 -- 172.21.15.46:0/3903188383 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c403e800 con 0x7f18cc0b2460 2024-02-19T06:58:03.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.219+0000 7fb118800640 1 -- 172.21.15.46:0/3324186018 shutdown_connections 2024-02-19T06:58:03.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.219+0000 7fb118800640 1 --2- 172.21.15.46:0/3324186018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb110160200 0x7fb11015fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.219+0000 7fb118800640 1 --2- 172.21.15.46:0/3324186018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1100c51a0 0x7fb11015f660 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.219+0000 7fb118800640 1 -- 172.21.15.46:0/3324186018 >> 172.21.15.46:0/3324186018 conn(0x7fb1100b3140 msgr2=0x7fb1100b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.219+0000 7f82d6000640 1 -- 172.21.15.46:0/2786833225 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f82d0007490 con 0x7f82e00cecf0 2024-02-19T06:58:03.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.219+0000 7fb118800640 1 -- 172.21.15.46:0/3324186018 shutdown_connections 2024-02-19T06:58:03.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.220+0000 7fb118800640 1 -- 172.21.15.46:0/3324186018 wait complete. 2024-02-19T06:58:03.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.221+0000 7f82d6000640 1 --2- 172.21.15.46:0/2786833225 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f82c006b810 0x7f82c006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.221+0000 7f82d6000640 1 -- 172.21.15.46:0/2786833225 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82d008a810 con 0x7f82e00cecf0 2024-02-19T06:58:03.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.221+0000 7f18c2a00640 1 -- 172.21.15.46:0/3903188383 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f18c403e960 con 0x7f18cc0b2460 2024-02-19T06:58:03.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.222+0000 7f8e5e000640 1 -- 172.21.15.46:0/3454134578 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8e680b6be0 con 0x7f8e680d0760 2024-02-19T06:58:03.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.223+0000 7fb118800640 1 Processor -- start 2024-02-19T06:58:03.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.223+0000 7f82dde00640 1 --2- 172.21.15.46:0/2786833225 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f82c006b810 0x7f82c006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.223+0000 7f18c2a00640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f18ac06b810 0x7f18ac06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.223+0000 7f18c2a00640 1 -- 172.21.15.46:0/3903188383 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18c40ad580 con 0x7f18cc0b2460 2024-02-19T06:58:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.224+0000 7fb118800640 1 -- start start 2024-02-19T06:58:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.224+0000 7f18ca800640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f18ac06b810 0x7f18ac06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.225+0000 7f82dde00640 1 --2- 172.21.15.46:0/2786833225 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f82c006b810 0x7f82c006dcd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82d8036000 tx=0x7f82d802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.225+0000 7fb118800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100c51a0 0x7fb1100b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.225+0000 7fb118800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11015eee0 0x7fb1100b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.225+0000 7fb118800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb110160200 0x7fb11006d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.225+0000 7fb118800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1101f3a40 con 0x7fb1100c51a0 2024-02-19T06:58:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.225+0000 7fb118800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1101f3d20 con 0x7fb11015eee0 2024-02-19T06:58:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.225+0000 7fb118800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1101f4000 con 0x7fb110160200 2024-02-19T06:58:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.225+0000 7f18ca800640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f18ac06b810 0x7f18ac06dcd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0099a0 tx=0x7f18bc006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.226+0000 7fb115e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100c51a0 0x7fb1100b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.226+0000 7fb115e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100c51a0 0x7fb1100b6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38378/0 (socket says 172.21.15.46:38378) 2024-02-19T06:58:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.226+0000 7fb115e00640 1 -- 172.21.15.46:0/4032710734 learned_addr learned my addr 172.21.15.46:0/4032710734 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.226+0000 7fb116800640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb110160200 0x7fb11006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.226+0000 7fb115400640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11015eee0 0x7fb1100b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.227+0000 7fb115e00640 1 -- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb110160200 msgr2=0x7fb11006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.227+0000 7fb115e00640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb110160200 0x7fb11006d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.227+0000 7fb115e00640 1 -- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11015eee0 msgr2=0x7fb1100b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.227+0000 7fb115e00640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11015eee0 0x7fb1100b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.227+0000 7fb115e00640 1 -- 172.21.15.46:0/4032710734 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb100009400 con 0x7fb1100c51a0 2024-02-19T06:58:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.228+0000 7fb115e00640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100c51a0 0x7fb1100b6070 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb10400c780 tx=0x7fb10400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.228+0000 7fb10a000640 1 -- 172.21.15.46:0/4032710734 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb104005ab0 con 0x7fb1100c51a0 2024-02-19T06:58:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.228+0000 7fb10a000640 1 -- 172.21.15.46:0/4032710734 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb104005c10 con 0x7fb1100c51a0 2024-02-19T06:58:03.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.228+0000 7fb10a000640 1 -- 172.21.15.46:0/4032710734 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb104005ab0 con 0x7fb1100c51a0 2024-02-19T06:58:03.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.229+0000 7fb118800640 1 -- 172.21.15.46:0/4032710734 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1101f42e0 con 0x7fb1100c51a0 2024-02-19T06:58:03.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.229+0000 7f18c2a00640 1 -- 172.21.15.46:0/3903188383 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f18c4078160 con 0x7f18cc0b2460 2024-02-19T06:58:03.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.229+0000 7fb118800640 1 -- 172.21.15.46:0/4032710734 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11006dad0 con 0x7fb1100c51a0 2024-02-19T06:58:03.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.230+0000 7fb118800640 1 -- 172.21.15.46:0/4032710734 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1101f4470 con 0x7fb1100c51a0 2024-02-19T06:58:03.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.231+0000 7f82d6000640 1 -- 172.21.15.46:0/2786833225 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f82d0055220 con 0x7f82e00cecf0 2024-02-19T06:58:03.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.243+0000 7fb10a000640 1 -- 172.21.15.46:0/4032710734 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb104007070 con 0x7fb1100c51a0 2024-02-19T06:58:03.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.245+0000 7fb10a000640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb0f406b870 0x7fb0f406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:03.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.246+0000 7fb10a000640 1 -- 172.21.15.46:0/4032710734 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb104089bf0 con 0x7fb1100c51a0 2024-02-19T06:58:03.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.246+0000 7fb10a000640 1 -- 172.21.15.46:0/4032710734 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb104088460 con 0x7fb1100c51a0 2024-02-19T06:58:03.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.249+0000 7fb115400640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb0f406b870 0x7fb0f406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:03.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.253+0000 7fb115400640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb0f406b870 0x7fb0f406dd30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb100036000 tx=0x7fb100008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:03.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.622+0000 7f30d2e00640 1 -- 172.21.15.46:0/2501863365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f30c4047fe0 con 0x7f30c4048fb0 2024-02-19T06:58:03.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.623+0000 7f30c9600640 1 -- 172.21.15.46:0/2501863365 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f30cc0b8090 con 0x7f30c4048fb0 2024-02-19T06:58:03.628 INFO:teuthology.orchestra.run.smithi046.stdout:60129542148 2024-02-19T06:58:03.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.627+0000 7f30bea00640 1 -- 172.21.15.46:0/2501863365 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f30ac06b840 msgr2=0x7f30ac06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.627+0000 7f30bea00640 1 --2- 172.21.15.46:0/2501863365 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f30ac06b840 0x7f30ac06dd00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f30c0007a00 tx=0x7f30c00014f0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.627+0000 7f30bea00640 1 -- 172.21.15.46:0/2501863365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c4048fb0 msgr2=0x7f30c4180360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.627+0000 7f30bea00640 1 --2- 172.21.15.46:0/2501863365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c4048fb0 0x7f30c4180360 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0692b0 tx=0x7f30cc069e60 comp rx=0 tx=0).stop 2024-02-19T06:58:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.629+0000 7f30bea00640 1 -- 172.21.15.46:0/2501863365 shutdown_connections 2024-02-19T06:58:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.629+0000 7f30bea00640 1 --2- 172.21.15.46:0/2501863365 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f30ac06b840 0x7f30ac06dd00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.629+0000 7f30bea00640 1 --2- 172.21.15.46:0/2501863365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30c4048fb0 0x7f30c4180360 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.629+0000 7f30bea00640 1 --2- 172.21.15.46:0/2501863365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30c40daec0 0x7f30c4048a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.629+0000 7f30bea00640 1 --2- 172.21.15.46:0/2501863365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b400b600 0x7f30c40d9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.629+0000 7f30bea00640 1 -- 172.21.15.46:0/2501863365 >> 172.21.15.46:0/2501863365 conn(0x7f30c4009fb0 msgr2=0x7f30c4053f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.630+0000 7f30bea00640 1 -- 172.21.15.46:0/2501863365 shutdown_connections 2024-02-19T06:58:03.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.630+0000 7f30bea00640 1 -- 172.21.15.46:0/2501863365 wait complete. 2024-02-19T06:58:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.632+0000 7f190fc00640 1 -- 172.21.15.46:0/4249512030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f19000e0c60 con 0x7f19000ddc20 2024-02-19T06:58:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.633+0000 7f1904c00640 1 -- 172.21.15.46:0/4249512030 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f19000e0c60 con 0x7f19000ddc20 2024-02-19T06:58:03.638 INFO:teuthology.orchestra.run.smithi046.stdout:60129542150 2024-02-19T06:58:03.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.636+0000 7f190fc00640 1 -- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f18ec06b860 msgr2=0x7f18ec06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.636+0000 7f190fc00640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f18ec06b860 0x7f18ec06dd20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f18f8007ce0 tx=0x7f18f8009040 comp rx=0 tx=0).stop 2024-02-19T06:58:03.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.636+0000 7f190fc00640 1 -- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19000ddc20 msgr2=0x7f19000d40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.636+0000 7f190fc00640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19000ddc20 0x7f19000d40c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18fc011960 tx=0x7f18fc011e20 comp rx=0 tx=0).stop 2024-02-19T06:58:03.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.637+0000 7f9360000640 1 -- 172.21.15.46:0/292255751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f93580c7970 con 0x7f93580cecc0 2024-02-19T06:58:03.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.638+0000 7f190fc00640 1 -- 172.21.15.46:0/4249512030 shutdown_connections 2024-02-19T06:58:03.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.638+0000 7f190fc00640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f18ec06b860 0x7f18ec06dd20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.638+0000 7f190fc00640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19000df900 0x7f19000d4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.638+0000 7f190fc00640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19000ddc20 0x7f19000d40c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.638+0000 7f190fc00640 1 --2- 172.21.15.46:0/4249512030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18f0004f50 0x7f19000d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.638+0000 7f190fc00640 1 -- 172.21.15.46:0/4249512030 >> 172.21.15.46:0/4249512030 conn(0x7f1900009fb0 msgr2=0x7f19000d51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.638+0000 7f190fc00640 1 -- 172.21.15.46:0/4249512030 shutdown_connections 2024-02-19T06:58:03.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.638+0000 7f190fc00640 1 -- 172.21.15.46:0/4249512030 wait complete. 2024-02-19T06:58:03.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.640+0000 7f9355600640 1 -- 172.21.15.46:0/292255751 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f934c035020 con 0x7f93580cecc0 2024-02-19T06:58:03.646 INFO:teuthology.orchestra.run.smithi046.stdout:60129542148 2024-02-19T06:58:03.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.644+0000 7f9360000640 1 -- 172.21.15.46:0/292255751 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f933806b810 msgr2=0x7f933806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.644+0000 7f9360000640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f933806b810 0x7f933806dcd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9350007fd0 tx=0x7f935000e040 comp rx=0 tx=0).stop 2024-02-19T06:58:03.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.644+0000 7f9360000640 1 -- 172.21.15.46:0/292255751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93580cecc0 msgr2=0x7f93580c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.644+0000 7f9360000640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93580cecc0 0x7f93580c7c50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f934c033000 tx=0x7f934c0046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.645+0000 7f9360000640 1 -- 172.21.15.46:0/292255751 shutdown_connections 2024-02-19T06:58:03.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.645+0000 7f9360000640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f933806b810 0x7f933806dcd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.645+0000 7f9360000640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93580cecc0 0x7f93580c7c50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.645+0000 7f9360000640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93580ce860 0x7f93580b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.645+0000 7f9360000640 1 --2- 172.21.15.46:0/292255751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93580c6cf0 0x7f93581f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.645+0000 7f9360000640 1 -- 172.21.15.46:0/292255751 >> 172.21.15.46:0/292255751 conn(0x7f935808afc0 msgr2=0x7f93580b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.645+0000 7f9360000640 1 -- 172.21.15.46:0/292255751 shutdown_connections 2024-02-19T06:58:03.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.645+0000 7f9360000640 1 -- 172.21.15.46:0/292255751 wait complete. 2024-02-19T06:58:03.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.652+0000 7fe5bbe00640 1 -- 172.21.15.46:0/32901915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe5a4005540 con 0x7fe5d00d1c50 2024-02-19T06:58:03.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.653+0000 7fe5c6a00640 1 -- 172.21.15.46:0/32901915 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5bc058290 con 0x7fe5d00d1c50 2024-02-19T06:58:03.655 INFO:teuthology.orchestra.run.smithi046.stdout:60129542149 2024-02-19T06:58:03.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.657+0000 7fe5bbe00640 1 -- 172.21.15.46:0/32901915 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe5b006b8e0 msgr2=0x7fe5b006dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.657+0000 7fe5bbe00640 1 --2- 172.21.15.46:0/32901915 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe5b006b8e0 0x7fe5b006dda0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0000c00 tx=0x7fe5c0008030 comp rx=0 tx=0).stop 2024-02-19T06:58:03.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.657+0000 7fe5bbe00640 1 -- 172.21.15.46:0/32901915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5d00d1c50 msgr2=0x7fe5d01ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.657+0000 7fe5bbe00640 1 --2- 172.21.15.46:0/32901915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5d00d1c50 0x7fe5d01ff9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00b410 tx=0x7fe5bc00b8d0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.1 2024-02-19T06:58:03.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.658+0000 7fe5bbe00640 1 -- 172.21.15.46:0/32901915 shutdown_connections 2024-02-19T06:58:03.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.658+0000 7fe5bbe00640 1 --2- 172.21.15.46:0/32901915 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe5b006b8e0 0x7fe5b006dda0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.658+0000 7fe5bbe00640 1 --2- 172.21.15.46:0/32901915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5d015d960 0x7fe5d00b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.658+0000 7fe5bbe00640 1 --2- 172.21.15.46:0/32901915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5d00d1c50 0x7fe5d01ff9e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.658+0000 7fe5bbe00640 1 --2- 172.21.15.46:0/32901915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5d00d1320 0x7fe5d015fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.658+0000 7fe5bbe00640 1 -- 172.21.15.46:0/32901915 >> 172.21.15.46:0/32901915 conn(0x7fe5d009c9e0 msgr2=0x7fe5d00d34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.658+0000 7fe5bbe00640 1 -- 172.21.15.46:0/32901915 shutdown_connections 2024-02-19T06:58:03.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.659+0000 7fe5bbe00640 1 -- 172.21.15.46:0/32901915 wait complete. 2024-02-19T06:58:03.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.660+0000 7f18d1400640 1 -- 172.21.15.46:0/3903188383 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f18cc06d0f0 con 0x7f18cc0b2460 2024-02-19T06:58:03.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.661+0000 7f18c2a00640 1 -- 172.21.15.46:0/3903188383 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18c407b820 con 0x7f18cc0b2460 2024-02-19T06:58:03.664 INFO:teuthology.orchestra.run.smithi046.stdout:60129542148 2024-02-19T06:58:03.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.0 2024-02-19T06:58:03.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.665+0000 7f18d1400640 1 -- 172.21.15.46:0/3903188383 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f18ac06b810 msgr2=0x7f18ac06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.665+0000 7f18d1400640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f18ac06b810 0x7f18ac06dcd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0099a0 tx=0x7f18bc006f90 comp rx=0 tx=0).stop 2024-02-19T06:58:03.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.665+0000 7f18d1400640 1 -- 172.21.15.46:0/3903188383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18cc0b2460 msgr2=0x7f18cc0cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.665+0000 7f18d1400640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18cc0b2460 0x7f18cc0cc220 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f18cc06e830 tx=0x7f18c4004a40 comp rx=0 tx=0).stop 2024-02-19T06:58:03.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.665+0000 7f18d1400640 1 -- 172.21.15.46:0/3903188383 shutdown_connections 2024-02-19T06:58:03.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.665+0000 7f18d1400640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f18ac06b810 0x7f18ac06dcd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.665+0000 7f18d1400640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18cc0b2f30 0x7f18cc1f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.665+0000 7f18d1400640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18cc0b2460 0x7f18cc0cc220 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.665+0000 7f18d1400640 1 --2- 172.21.15.46:0/3903188383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18cc071000 0x7f18cc1f8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.665+0000 7f18d1400640 1 -- 172.21.15.46:0/3903188383 >> 172.21.15.46:0/3903188383 conn(0x7f18cc066f70 msgr2=0x7f18cc164d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.665+0000 7f18d1400640 1 -- 172.21.15.46:0/3903188383 shutdown_connections 2024-02-19T06:58:03.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.665+0000 7f18d1400640 1 -- 172.21.15.46:0/3903188383 wait complete. 2024-02-19T06:58:03.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.667+0000 7f8e6cc00640 1 -- 172.21.15.46:0/3454134578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8e680b6be0 con 0x7f8e680d0760 2024-02-19T06:58:03.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.667+0000 7f8e5e000640 1 -- 172.21.15.46:0/3454134578 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e680b6be0 con 0x7f8e680d0760 2024-02-19T06:58:03.670 INFO:teuthology.orchestra.run.smithi046.stdout:64424509446 2024-02-19T06:58:03.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.670+0000 7f82e5000640 1 -- 172.21.15.46:0/2786833225 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f82e00cae00 con 0x7f82e00cecf0 2024-02-19T06:58:03.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.671+0000 7f8e6cc00640 1 -- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e4806b810 msgr2=0x7f8e4806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.671+0000 7f8e6cc00640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e4806b810 0x7f8e4806dcd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e68160cb0 tx=0x7f8e6000d040 comp rx=0 tx=0).stop 2024-02-19T06:58:03.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.671+0000 7f8e6cc00640 1 -- 172.21.15.46:0/3454134578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e680d0760 msgr2=0x7f8e68152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.671+0000 7f8e6cc00640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e680d0760 0x7f8e68152ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800c7f0 tx=0x7f8e5800ccb0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.671+0000 7f8e6cc00640 1 -- 172.21.15.46:0/3454134578 shutdown_connections 2024-02-19T06:58:03.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.671+0000 7f8e6cc00640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e4806b810 0x7f8e4806dcd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.671+0000 7f8e6cc00640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e680d3490 0x7f8e680c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.671+0000 7f8e6cc00640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e680d0b40 0x7f8e680c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.671+0000 7f8e6cc00640 1 --2- 172.21.15.46:0/3454134578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e680d0760 0x7f8e68152ab0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.671+0000 7f8e6cc00640 1 -- 172.21.15.46:0/3454134578 >> 172.21.15.46:0/3454134578 conn(0x7f8e68066ca0 msgr2=0x7f8e681604c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.671+0000 7f8e6cc00640 1 -- 172.21.15.46:0/3454134578 shutdown_connections 2024-02-19T06:58:03.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.671+0000 7f82d6000640 1 -- 172.21.15.46:0/2786833225 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82d00588e0 con 0x7f82e00cecf0 2024-02-19T06:58:03.675 INFO:teuthology.orchestra.run.smithi046.stdout:60129542148 2024-02-19T06:58:03.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.671+0000 7f8e6cc00640 1 -- 172.21.15.46:0/3454134578 wait complete. 2024-02-19T06:58:03.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.4 2024-02-19T06:58:03.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.674+0000 7f82e5000640 1 -- 172.21.15.46:0/2786833225 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f82c006b810 msgr2=0x7f82c006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.674+0000 7f82e5000640 1 --2- 172.21.15.46:0/2786833225 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f82c006b810 0x7f82c006dcd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82d8036000 tx=0x7f82d802e000 comp rx=0 tx=0).stop 2024-02-19T06:58:03.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.674+0000 7f82e5000640 1 -- 172.21.15.46:0/2786833225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e00cecf0 msgr2=0x7f82e014fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.674+0000 7f82e5000640 1 --2- 172.21.15.46:0/2786833225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e00cecf0 0x7f82e014fe70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f82d000c480 tx=0x7f82d000c940 comp rx=0 tx=0).stop 2024-02-19T06:58:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.674+0000 7f82e5000640 1 -- 172.21.15.46:0/2786833225 shutdown_connections 2024-02-19T06:58:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.674+0000 7f82e5000640 1 --2- 172.21.15.46:0/2786833225 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f82c006b810 0x7f82c006dcd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.674+0000 7f82e5000640 1 --2- 172.21.15.46:0/2786833225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e00cecf0 0x7f82e014fe70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.674+0000 7f82e5000640 1 --2- 172.21.15.46:0/2786833225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82e00ce860 0x7f82e014f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.674+0000 7f82e5000640 1 --2- 172.21.15.46:0/2786833225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82e00c6cf0 0x7f82e00cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.674+0000 7f82e5000640 1 -- 172.21.15.46:0/2786833225 >> 172.21.15.46:0/2786833225 conn(0x7f82e008afc0 msgr2=0x7f82e015afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.675+0000 7f82e5000640 1 -- 172.21.15.46:0/2786833225 shutdown_connections 2024-02-19T06:58:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.675+0000 7f82e5000640 1 -- 172.21.15.46:0/2786833225 wait complete. 2024-02-19T06:58:03.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.681+0000 7fb118800640 1 -- 172.21.15.46:0/4032710734 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb11006bc90 con 0x7fb1100c51a0 2024-02-19T06:58:03.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.682+0000 7fb10a000640 1 -- 172.21.15.46:0/4032710734 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb104021020 con 0x7fb1100c51a0 2024-02-19T06:58:03.684 INFO:teuthology.orchestra.run.smithi046.stdout:64424509445 2024-02-19T06:58:03.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.2 2024-02-19T06:58:03.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.685+0000 7fb118800640 1 -- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb0f406b870 msgr2=0x7fb0f406dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.685+0000 7fb118800640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb0f406b870 0x7fb0f406dd30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb100036000 tx=0x7fb100008030 comp rx=0 tx=0).stop 2024-02-19T06:58:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.685+0000 7fb118800640 1 -- 172.21.15.46:0/4032710734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100c51a0 msgr2=0x7fb1100b6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.685+0000 7fb118800640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100c51a0 0x7fb1100b6070 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb10400c780 tx=0x7fb10400cc40 comp rx=0 tx=0).stop 2024-02-19T06:58:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.685+0000 7fb118800640 1 -- 172.21.15.46:0/4032710734 shutdown_connections 2024-02-19T06:58:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.685+0000 7fb118800640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb0f406b870 0x7fb0f406dd30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.685+0000 7fb118800640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb110160200 0x7fb11006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.685+0000 7fb118800640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11015eee0 0x7fb1100b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.685+0000 7fb118800640 1 --2- 172.21.15.46:0/4032710734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100c51a0 0x7fb1100b6070 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.685+0000 7fb118800640 1 -- 172.21.15.46:0/4032710734 >> 172.21.15.46:0/4032710734 conn(0x7fb1100b3140 msgr2=0x7fb11015e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.685+0000 7fb118800640 1 -- 172.21.15.46:0/4032710734 shutdown_connections 2024-02-19T06:58:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:03.685+0000 7fb118800640 1 -- 172.21.15.46:0/4032710734 wait complete. 2024-02-19T06:58:03.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.7 2024-02-19T06:58:03.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-02-19T06:58:03.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.3 2024-02-19T06:58:03.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2024-02-19T06:58:04.662 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-19T06:58:04.667 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-19T06:58:04.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-19T06:58:04.687 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-19T06:58:04.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-19T06:58:04.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-19T06:58:04.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-19T06:58:04.706 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-19T06:58:04.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.932+0000 7faaabc00640 1 Processor -- start 2024-02-19T06:58:04.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.932+0000 7faaabc00640 1 -- start start 2024-02-19T06:58:04.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.934+0000 7faaabc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa40cfe10 0x7faaa4162d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.934+0000 7faaabc00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa4071bc0 con 0x7faaa40b2f80 2024-02-19T06:58:04.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.934+0000 7faaabc00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa40b2250 con 0x7faaa4162970 2024-02-19T06:58:04.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.934+0000 7faaabc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40b2af0 con 0x7faaa40cfe10 2024-02-19T06:58:04.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.936+0000 7faaa9c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa40cfe10 0x7faaa4162d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.936+0000 7faaa9200640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7faaa4162970 0x7faaa4070e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:52606/0 (socket says 172.21.15.46:52606) 2024-02-19T06:58:04.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.936+0000 7faaa9200640 1 -- 172.21.15.46:0/3032507421 learned_addr learned my addr 172.21.15.46:0/3032507421 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:04.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.936+0000 7faaa3400640 1 -- 172.21.15.46:0/3032507421 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138962081 0 0) 0x7faaa40b2250 con 0x7faaa4162970 2024-02-19T06:58:04.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.937+0000 7faaa3400640 1 -- 172.21.15.46:0/3032507421 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa8c003520 con 0x7faaa4162970 2024-02-19T06:58:04.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.937+0000 7faaa9c00640 1 -- 172.21.15.46:0/3032507421 >> v1:172.21.15.142:6789/0 conn(0x7faaa4162970 legacy=0x7faaa4070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:04.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.937+0000 7faaa3400640 1 -- 172.21.15.46:0/3032507421 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378441955 0 0) 0x7faaa4071bc0 con 0x7faaa40b2f80 2024-02-19T06:58:04.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.938+0000 7faaa9c00640 1 -- 172.21.15.46:0/3032507421 >> v1:172.21.15.46:6789/0 conn(0x7faaa40b2f80 legacy=0x7faaa40cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:04.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.938+0000 7faaa9c00640 1 -- 172.21.15.46:0/3032507421 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa40718e0 con 0x7faaa40cfe10 2024-02-19T06:58:04.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.940+0000 7faaa9c00640 1 --2- 172.21.15.46:0/3032507421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa40cfe10 0x7faaa4162d50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faa98009750 tx=0x7faa9802b5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5357b2fff829710 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:04.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.941+0000 7faaa3400640 1 -- 172.21.15.46:0/3032507421 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c001a20 con 0x7faaa40cfe10 2024-02-19T06:58:04.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.941+0000 7faaa3400640 1 -- 172.21.15.46:0/3032507421 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9802e050 con 0x7faaa40cfe10 2024-02-19T06:58:04.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.942+0000 7faaa3400640 1 -- 172.21.15.46:0/3032507421 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98030730 con 0x7faaa40cfe10 2024-02-19T06:58:04.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.943+0000 7f14e1c00640 1 Processor -- start 2024-02-19T06:58:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.943+0000 7faaabc00640 1 -- 172.21.15.46:0/3032507421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa40cfe10 msgr2=0x7faaa4162d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.943+0000 7faaabc00640 1 --2- 172.21.15.46:0/3032507421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa40cfe10 0x7faaa4162d50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faa98009750 tx=0x7faa9802b5d0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.943+0000 7faaabc00640 1 -- 172.21.15.46:0/3032507421 shutdown_connections 2024-02-19T06:58:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.943+0000 7faaabc00640 1 --2- 172.21.15.46:0/3032507421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa40cfe10 0x7faaa4162d50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.943+0000 7faaabc00640 1 -- 172.21.15.46:0/3032507421 >> 172.21.15.46:0/3032507421 conn(0x7faaa406afa0 msgr2=0x7faaa406b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.943+0000 7faaabc00640 1 -- 172.21.15.46:0/3032507421 shutdown_connections 2024-02-19T06:58:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.944+0000 7faaabc00640 1 -- 172.21.15.46:0/3032507421 wait complete. 2024-02-19T06:58:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.943+0000 7f14e1c00640 1 -- start start 2024-02-19T06:58:04.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.946+0000 7f14e1c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14d40e7bd0 0x7f14d4039b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.946+0000 7f14e1c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f14d40e7680 0x7f14d4051a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.946+0000 7f14e1c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d403b870 con 0x7f14d40e72a0 2024-02-19T06:58:04.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.946+0000 7f14e1c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d403bb50 con 0x7f14d40e7680 2024-02-19T06:58:04.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.946+0000 7f14e1c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d403be30 con 0x7f14d40e7bd0 2024-02-19T06:58:04.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.947+0000 7faaabc00640 1 Processor -- start 2024-02-19T06:58:04.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.948+0000 7faaabc00640 1 -- start start 2024-02-19T06:58:04.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.948+0000 7f14db400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f14d40e7680 0x7f14d4051a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.948+0000 7f14daa00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f14d40e72a0 0x7f14d4051320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53286/0 (socket says 172.21.15.46:53286) 2024-02-19T06:58:04.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.946+0000 7f40b1000640 1 Processor -- start 2024-02-19T06:58:04.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.946+0000 7f40b1000640 1 -- start start 2024-02-19T06:58:04.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.948+0000 7f40b1000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40ac0b3630 0x7f40ac162d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.948+0000 7f40b1000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40ac06d390 0x7f40ac06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.948+0000 7f40b1000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ac15c740 con 0x7f40ac15c360 2024-02-19T06:58:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.948+0000 7f40b1000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac071fa0 con 0x7f40ac0b3630 2024-02-19T06:58:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.948+0000 7f40b1000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac071420 con 0x7f40ac06d390 2024-02-19T06:58:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.949+0000 7f40a1400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40ac0b3630 0x7f40ac162d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.949+0000 7f40a9e00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f40ac15c360 0x7f40ac0b2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:52610/0 (socket says 172.21.15.46:52610) 2024-02-19T06:58:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.949+0000 7f40a9e00640 1 -- 172.21.15.46:0/2239234993 learned_addr learned my addr 172.21.15.46:0/2239234993 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.948+0000 7f14daa00640 1 -- 172.21.15.46:0/3238415169 learned_addr learned my addr 172.21.15.46:0/3238415169 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.948+0000 7f14da000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14d40e7bd0 0x7f14d4039b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.949+0000 7f14d9600640 1 -- 172.21.15.46:0/3238415169 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807353508 0 0) 0x7f14d403b870 con 0x7f14d40e72a0 2024-02-19T06:58:04.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.949+0000 7f40aa800640 1 --2- 172.21.15.46:0/2239234993 >> v2:172.21.15.142:3300/0 conn(0x7f40ac06d390 0x7f40ac06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.950+0000 7f14d9600640 1 -- 172.21.15.46:0/3238415169 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14c0003520 con 0x7f14d40e72a0 2024-02-19T06:58:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.950+0000 7f14da000640 1 -- 172.21.15.46:0/3238415169 >> v2:172.21.15.46:3300/0 conn(0x7f14d40e7680 msgr2=0x7f14d4051a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.950+0000 7f14da000640 1 --2- 172.21.15.46:0/3238415169 >> v2:172.21.15.46:3300/0 conn(0x7f14d40e7680 0x7f14d4051a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.950+0000 7f14da000640 1 -- 172.21.15.46:0/3238415169 >> v1:172.21.15.46:6789/0 conn(0x7f14d40e72a0 legacy=0x7f14d4051320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.950+0000 7f14da000640 1 -- 172.21.15.46:0/3238415169 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d403c110 con 0x7f14d40e7bd0 2024-02-19T06:58:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.950+0000 7f14db400640 1 --2- 172.21.15.46:0/3238415169 >> v2:172.21.15.46:3300/0 conn(0x7f14d40e7680 0x7f14d4051a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.951+0000 7faaabc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faaa40b2f80 0x7faaa40afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.951+0000 7faaabc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaa40cfe10 0x7faaa40b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.951+0000 7faaabc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa4162970 0x7faaa4151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.951+0000 7faaabc00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415a2f0 con 0x7faaa40b2f80 2024-02-19T06:58:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.951+0000 7faaabc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415a500 con 0x7faaa40cfe10 2024-02-19T06:58:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.951+0000 7faaabc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415a7e0 con 0x7faaa4162970 2024-02-19T06:58:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.951+0000 7faaa9200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faaa40b2f80 0x7faaa40afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.951+0000 7faaa9200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faaa40b2f80 0x7faaa40afb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38394/0 (socket says 172.21.15.46:38394) 2024-02-19T06:58:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.951+0000 7faaa9200640 1 -- 172.21.15.46:0/834729771 learned_addr learned my addr 172.21.15.46:0/834729771 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.952+0000 7faaa3e00640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaa40cfe10 0x7faaa40b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.952+0000 7faaa9c00640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa4162970 0x7faaa4151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.952+0000 7faaa9200640 1 -- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa4162970 msgr2=0x7faaa4151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.951+0000 7f40a1400640 1 -- 172.21.15.46:0/2239234993 >> v2:172.21.15.142:3300/0 conn(0x7f40ac06d390 msgr2=0x7f40ac06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.951+0000 7f40a1400640 1 --2- 172.21.15.46:0/2239234993 >> v2:172.21.15.142:3300/0 conn(0x7f40ac06d390 0x7f40ac06d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.951+0000 7f40a1400640 1 -- 172.21.15.46:0/2239234993 >> v1:172.21.15.142:6789/0 conn(0x7f40ac15c360 legacy=0x7f40ac0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.951+0000 7f40a1400640 1 -- 172.21.15.46:0/2239234993 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac071700 con 0x7f40ac0b3630 2024-02-19T06:58:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.952+0000 7faaa9200640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa4162970 0x7faaa4151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.952+0000 7f40a1400640 1 --2- 172.21.15.46:0/2239234993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac0b3630 0x7f40ac162d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0b4410 tx=0x7f409402be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afbddb88f45daf0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.952+0000 7faaa9200640 1 -- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaa40cfe10 msgr2=0x7faaa40b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.952+0000 7faaa9200640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaa40cfe10 0x7faaa40b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.952+0000 7faaa9200640 1 -- 172.21.15.46:0/834729771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa98009400 con 0x7faaa40b2f80 2024-02-19T06:58:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.953+0000 7faaa3e00640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaa40cfe10 0x7faaa40b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.953+0000 7f14da000640 1 --2- 172.21.15.46:0/3238415169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d40e7bd0 0x7f14d4039b20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14d400bb00 tx=0x7f14cc02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d4da191f22032fa server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.953+0000 7faaa9c00640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa4162970 0x7faaa4151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.953+0000 7f40a9400640 1 -- 172.21.15.46:0/2239234993 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409402cc20 con 0x7f40ac0b3630 2024-02-19T06:58:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.953+0000 7faaa9200640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faaa40b2f80 0x7faaa40afb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00cb40 tx=0x7faa9c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.953+0000 7f40a9400640 1 -- 172.21.15.46:0/2239234993 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409402cd80 con 0x7f40ac0b3630 2024-02-19T06:58:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.953+0000 7f40a9400640 1 -- 172.21.15.46:0/2239234993 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4094034660 con 0x7f40ac0b3630 2024-02-19T06:58:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.954+0000 7faaa0c00640 1 -- 172.21.15.46:0/834729771 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00a890 con 0x7faaa40b2f80 2024-02-19T06:58:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.954+0000 7faaa0c00640 1 -- 172.21.15.46:0/834729771 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c00a9f0 con 0x7faaa40b2f80 2024-02-19T06:58:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.954+0000 7faaa0c00640 1 -- 172.21.15.46:0/834729771 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00ae20 con 0x7faaa40b2f80 2024-02-19T06:58:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.955+0000 7f40b1000640 1 -- 172.21.15.46:0/2239234993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac0b3630 msgr2=0x7f40ac162d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.955+0000 7f40b1000640 1 --2- 172.21.15.46:0/2239234993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac0b3630 0x7f40ac162d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0b4410 tx=0x7f409402be70 comp rx=0 tx=0).stop 2024-02-19T06:58:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.955+0000 7f14d9600640 1 -- 172.21.15.46:0/3238415169 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc02e070 con 0x7f14d40e7bd0 2024-02-19T06:58:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.955+0000 7f14d9600640 1 -- 172.21.15.46:0/3238415169 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc0315a0 con 0x7f14d40e7bd0 2024-02-19T06:58:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.955+0000 7f14d9600640 1 -- 172.21.15.46:0/3238415169 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc031930 con 0x7f14d40e7bd0 2024-02-19T06:58:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.955+0000 7faaabc00640 1 -- 172.21.15.46:0/834729771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa415aac0 con 0x7faaa40b2f80 2024-02-19T06:58:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.955+0000 7f40b1000640 1 -- 172.21.15.46:0/2239234993 shutdown_connections 2024-02-19T06:58:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.956+0000 7f40b1000640 1 --2- 172.21.15.46:0/2239234993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac0b3630 0x7f40ac162d40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.956+0000 7f40b1000640 1 --2- 172.21.15.46:0/2239234993 >> v2:172.21.15.142:3300/0 conn(0x7f40ac06d390 0x7f40ac06d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.956+0000 7f40b1000640 1 -- 172.21.15.46:0/2239234993 >> 172.21.15.46:0/2239234993 conn(0x7f40ac066cd0 msgr2=0x7f40ac06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.956+0000 7f40b1000640 1 -- 172.21.15.46:0/2239234993 shutdown_connections 2024-02-19T06:58:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.956+0000 7f40b1000640 1 -- 172.21.15.46:0/2239234993 wait complete. 2024-02-19T06:58:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.956+0000 7f14e1c00640 1 -- 172.21.15.46:0/3238415169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d40e7bd0 msgr2=0x7f14d4039b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.956+0000 7f14e1c00640 1 --2- 172.21.15.46:0/3238415169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d40e7bd0 0x7f14d4039b20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14d400bb00 tx=0x7f14cc02b840 comp rx=0 tx=0).stop 2024-02-19T06:58:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.956+0000 7faaabc00640 1 -- 172.21.15.46:0/834729771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa40b1be0 con 0x7faaa40b2f80 2024-02-19T06:58:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.956+0000 7f14e1c00640 1 -- 172.21.15.46:0/3238415169 shutdown_connections 2024-02-19T06:58:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.956+0000 7f14e1c00640 1 --2- 172.21.15.46:0/3238415169 >> v2:172.21.15.46:3300/0 conn(0x7f14d40e7680 0x7f14d4051a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.956+0000 7f14e1c00640 1 --2- 172.21.15.46:0/3238415169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d40e7bd0 0x7f14d4039b20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.956+0000 7f14e1c00640 1 -- 172.21.15.46:0/3238415169 >> 172.21.15.46:0/3238415169 conn(0x7f14d4056cd0 msgr2=0x7f14d40570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.957+0000 7f14e1c00640 1 -- 172.21.15.46:0/3238415169 shutdown_connections 2024-02-19T06:58:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.957+0000 7f14e1c00640 1 -- 172.21.15.46:0/3238415169 wait complete. 2024-02-19T06:58:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.959+0000 7f14e1c00640 1 Processor -- start 2024-02-19T06:58:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.960+0000 7f40b1000640 1 Processor -- start 2024-02-19T06:58:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.960+0000 7f14e1c00640 1 -- start start 2024-02-19T06:58:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.960+0000 7f40b1000640 1 -- start start 2024-02-19T06:58:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.962+0000 7f40b1000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40ac06d390 0x7f40ac0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.962+0000 7f14e1c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d40e72a0 0x7f14d40ded90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.962+0000 7f40b1000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40ac0b3630 0x7f40ac149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.960+0000 7faaa0c00640 1 -- 172.21.15.46:0/834729771 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7faa9c0070d0 con 0x7faaa40b2f80 2024-02-19T06:58:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.962+0000 7faaa0c00640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7faa8406b8e0 0x7faa8406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.962+0000 7faaabc00640 1 -- 172.21.15.46:0/834729771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa40b1dd0 con 0x7faaa40b2f80 2024-02-19T06:58:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.962+0000 7faaa0c00640 1 -- 172.21.15.46:0/834729771 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa9c08a3c0 con 0x7faaa40b2f80 2024-02-19T06:58:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.962+0000 7f40b1000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15c360 0x7f40ac0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.963+0000 7f40b1000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac1478a0 con 0x7f40ac15c360 2024-02-19T06:58:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.963+0000 7f40b1000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac1486b0 con 0x7f40ac06d390 2024-02-19T06:58:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.963+0000 7f40a9e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40ac06d390 0x7f40ac0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.963+0000 7f40aa800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15c360 0x7f40ac0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.962+0000 7f14e1c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d40e7680 0x7f14d40d5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.963+0000 7f40aa800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15c360 0x7f40ac0afe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38410/0 (socket says 172.21.15.46:38410) 2024-02-19T06:58:04.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.963+0000 7f40aa800640 1 -- 172.21.15.46:0/95561801 learned_addr learned my addr 172.21.15.46:0/95561801 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:04.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.963+0000 7f40a1400640 1 --2- 172.21.15.46:0/95561801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40ac0b3630 0x7f40ac149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.963+0000 7f40b1000640 1 -- 172.21.15.46:0/95561801 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac15ddf0 con 0x7f40ac0b3630 2024-02-19T06:58:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.963+0000 7f14e1c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d40e7bd0 0x7f14d40d7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.963+0000 7f14daa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d40e72a0 0x7f14d40ded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.964+0000 7f14db400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d40e7bd0 0x7f14d40d7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.964+0000 7f14db400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d40e7bd0 0x7f14d40d7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38418/0 (socket says 172.21.15.46:38418) 2024-02-19T06:58:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.964+0000 7f14db400640 1 -- 172.21.15.46:0/324499148 learned_addr learned my addr 172.21.15.46:0/324499148 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.964+0000 7f14daa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d40e72a0 0x7f14d40ded90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43352/0 (socket says 172.21.15.46:43352) 2024-02-19T06:58:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.965+0000 7f14e1c00640 1 -- 172.21.15.46:0/324499148 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d404e910 con 0x7f14d40e7bd0 2024-02-19T06:58:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.965+0000 7f14e1c00640 1 -- 172.21.15.46:0/324499148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40d6c90 con 0x7f14d40e72a0 2024-02-19T06:58:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.965+0000 7f14da000640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d40e7680 0x7f14d40d5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.965+0000 7f40aa800640 1 -- 172.21.15.46:0/95561801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40ac0b3630 msgr2=0x7f40ac149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.965+0000 7f40aa800640 1 --2- 172.21.15.46:0/95561801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40ac0b3630 0x7f40ac149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.965+0000 7f40aa800640 1 -- 172.21.15.46:0/95561801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40ac06d390 msgr2=0x7f40ac0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.965+0000 7f40aa800640 1 --2- 172.21.15.46:0/95561801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40ac06d390 0x7f40ac0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.965+0000 7f40aa800640 1 -- 172.21.15.46:0/95561801 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4094009a70 con 0x7f40ac15c360 2024-02-19T06:58:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.965+0000 7f14e1c00640 1 -- 172.21.15.46:0/324499148 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40d66d0 con 0x7f14d40e7680 2024-02-19T06:58:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.966+0000 7f40aa800640 1 --2- 172.21.15.46:0/95561801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15c360 0x7f40ac0afe40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f40a400d800 tx=0x7f40a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.966+0000 7f14db400640 1 -- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d40e7680 msgr2=0x7f14d40d5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.966+0000 7f14db400640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d40e7680 0x7f14d40d5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.966+0000 7f14db400640 1 -- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d40e72a0 msgr2=0x7f14d40ded90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.966+0000 7f14db400640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d40e72a0 0x7f14d40ded90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.966+0000 7f14db400640 1 -- 172.21.15.46:0/324499148 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc009400 con 0x7f14d40e7bd0 2024-02-19T06:58:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.966+0000 7f14da000640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d40e7680 0x7f14d40d5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.967+0000 7faaa3e00640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7faa8406b8e0 0x7faa8406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.967+0000 7f14db400640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d40e7bd0 0x7f14d40d7470 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f14dc050150 tx=0x7f14dc0740a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:04.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.968+0000 7faaa3e00640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7faa8406b8e0 0x7faa8406dda0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faaa4155790 tx=0x7faa90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.973+0000 7f40a2a00640 1 -- 172.21.15.46:0/95561801 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a400b6c0 con 0x7f40ac15c360 2024-02-19T06:58:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.973+0000 7f40b1000640 1 -- 172.21.15.46:0/95561801 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ac147ae0 con 0x7f40ac15c360 2024-02-19T06:58:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.973+0000 7f14d2a00640 1 -- 172.21.15.46:0/324499148 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc074780 con 0x7f14d40e7bd0 2024-02-19T06:58:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.973+0000 7f14e1c00640 1 -- 172.21.15.46:0/324499148 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d40d69b0 con 0x7f14d40e7bd0 2024-02-19T06:58:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.973+0000 7f14e1c00640 1 -- 172.21.15.46:0/324499148 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d40df2d0 con 0x7f14d40e7bd0 2024-02-19T06:58:04.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.973+0000 7f40b1000640 1 -- 172.21.15.46:0/95561801 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ac148060 con 0x7f40ac15c360 2024-02-19T06:58:04.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.974+0000 7faaa0c00640 1 -- 172.21.15.46:0/834729771 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faa9c054dc0 con 0x7faaa40b2f80 2024-02-19T06:58:04.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.975+0000 7f409b400640 1 -- 172.21.15.46:0/95561801 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4084005290 con 0x7f40ac15c360 2024-02-19T06:58:04.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.975+0000 7f40a2a00640 1 -- 172.21.15.46:0/95561801 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a400b820 con 0x7f40ac15c360 2024-02-19T06:58:04.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.975+0000 7f40a2a00640 1 -- 172.21.15.46:0/95561801 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a400b6c0 con 0x7f40ac15c360 2024-02-19T06:58:04.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.975+0000 7f14d2a00640 1 -- 172.21.15.46:0/324499148 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc0748e0 con 0x7f14d40e7bd0 2024-02-19T06:58:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.975+0000 7f14d2a00640 1 -- 172.21.15.46:0/324499148 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc074780 con 0x7f14d40e7bd0 2024-02-19T06:58:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.980+0000 7f14d2a00640 1 -- 172.21.15.46:0/324499148 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f14dc09c440 con 0x7f14d40e7bd0 2024-02-19T06:58:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.981+0000 7f14e1c00640 1 -- 172.21.15.46:0/324499148 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b4005290 con 0x7f14d40e7bd0 2024-02-19T06:58:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.982+0000 7f40a2a00640 1 -- 172.21.15.46:0/95561801 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f40a400b990 con 0x7f40ac15c360 2024-02-19T06:58:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.982+0000 7f14d2a00640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f14bc06b870 0x7f14bc06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.983+0000 7f14d2a00640 1 -- 172.21.15.46:0/324499148 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14dc104430 con 0x7f14d40e7bd0 2024-02-19T06:58:04.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.983+0000 7f14daa00640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f14bc06b870 0x7f14bc06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.983+0000 7f40a2a00640 1 --2- 172.21.15.46:0/95561801 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f408806b870 0x7f408806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:04.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.984+0000 7f40a2a00640 1 -- 172.21.15.46:0/95561801 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40a408ad10 con 0x7f40ac15c360 2024-02-19T06:58:04.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.984+0000 7f40a9e00640 1 --2- 172.21.15.46:0/95561801 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f408806b870 0x7f408806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:04.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.985+0000 7f14daa00640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f14bc06b870 0x7f14bc06dd30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14c80011e0 tx=0x7f14c8007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:04.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.985+0000 7f40a9e00640 1 --2- 172.21.15.46:0/95561801 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f408806b870 0x7f408806dd30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f409c005880 tx=0x7f409c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:04.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.988+0000 7f40a2a00640 1 -- 172.21.15.46:0/95561801 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f40a40557c0 con 0x7f40ac15c360 2024-02-19T06:58:04.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:04.997+0000 7f14d2a00640 1 -- 172.21.15.46:0/324499148 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f14dc0cef90 con 0x7f14d40e7bd0 2024-02-19T06:58:05.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.021+0000 7fac87c00640 1 Processor -- start 2024-02-19T06:58:05.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.021+0000 7fac87c00640 1 -- start start 2024-02-19T06:58:05.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.023+0000 7fac87c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac80150b20 0x7fac800b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.023+0000 7fac87c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fac800cf3c0 0x7fac800cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.023+0000 7fac87c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac800cfd50 con 0x7fac800b29a0 2024-02-19T06:58:05.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.023+0000 7fac87c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac80150f00 con 0x7fac80150b20 2024-02-19T06:58:05.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.023+0000 7fac87c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8006e0d0 con 0x7fac800cf3c0 2024-02-19T06:58:05.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.024+0000 7fac85c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fac800cf3c0 0x7fac800cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.024+0000 7fac85c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fac800cf3c0 0x7fac800cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43366/0 (socket says 172.21.15.46:43366) 2024-02-19T06:58:05.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.024+0000 7fac85c00640 1 -- 172.21.15.46:0/792898943 learned_addr learned my addr 172.21.15.46:0/792898943 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:05.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.025+0000 7fac85200640 1 --2- 172.21.15.46:0/792898943 >> v2:172.21.15.46:3300/0 conn(0x7fac80150b20 0x7fac800b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.025+0000 7fac85c00640 1 -- 172.21.15.46:0/792898943 >> v2:172.21.15.46:3300/0 conn(0x7fac80150b20 msgr2=0x7fac800b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:05.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.026+0000 7fac7f400640 1 -- 172.21.15.46:0/792898943 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330388260 0 0) 0x7fac70001110 con 0x7fac800b29a0 2024-02-19T06:58:05.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.026+0000 7fac85c00640 1 --2- 172.21.15.46:0/792898943 >> v2:172.21.15.46:3300/0 conn(0x7fac80150b20 0x7fac800b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.026+0000 7fac85c00640 1 -- 172.21.15.46:0/792898943 >> v1:172.21.15.46:6789/0 conn(0x7fac800b29a0 legacy=0x7fac8006e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.026+0000 7fac85c00640 1 -- 172.21.15.46:0/792898943 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8006d7c0 con 0x7fac800cf3c0 2024-02-19T06:58:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.026+0000 7fac85200640 1 --2- 172.21.15.46:0/792898943 >> v2:172.21.15.46:3300/0 conn(0x7fac80150b20 0x7fac800b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:58:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.027+0000 7f6432200640 1 Processor -- start 2024-02-19T06:58:05.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.028+0000 7fac85c00640 1 --2- 172.21.15.46:0/792898943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac800cf3c0 0x7fac800cf810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009870 tx=0x7fac6c02b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1be181c8f499bd5a server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.028+0000 7f6432200640 1 -- start start 2024-02-19T06:58:05.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.029+0000 7fac7f400640 1 -- 172.21.15.46:0/792898943 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c030870 con 0x7fac800cf3c0 2024-02-19T06:58:05.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.029+0000 7fac7f400640 1 -- 172.21.15.46:0/792898943 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c0309d0 con 0x7fac800cf3c0 2024-02-19T06:58:05.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.029+0000 7fac7f400640 1 -- 172.21.15.46:0/792898943 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c030da0 con 0x7fac800cf3c0 2024-02-19T06:58:05.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.030+0000 7fac87c00640 1 -- 172.21.15.46:0/792898943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac800cf3c0 msgr2=0x7fac800cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.030+0000 7fac87c00640 1 --2- 172.21.15.46:0/792898943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac800cf3c0 0x7fac800cf810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009870 tx=0x7fac6c02b9b0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.030+0000 7f6432200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64240df420 0x7f642404fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.030+0000 7f6432200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f642404ffd0 0x7f6424054270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.030+0000 7fac87c00640 1 -- 172.21.15.46:0/792898943 shutdown_connections 2024-02-19T06:58:05.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.030+0000 7fac87c00640 1 --2- 172.21.15.46:0/792898943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac800cf3c0 0x7fac800cf810 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.030+0000 7fac87c00640 1 --2- 172.21.15.46:0/792898943 >> v2:172.21.15.46:3300/0 conn(0x7fac80150b20 0x7fac800b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.030+0000 7fac87c00640 1 -- 172.21.15.46:0/792898943 >> 172.21.15.46:0/792898943 conn(0x7fac80066cd0 msgr2=0x7fac8006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.030+0000 7f6432200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64240068a0 con 0x7f642400aaa0 2024-02-19T06:58:05.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.030+0000 7f6432200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6424007770 con 0x7f642404ffd0 2024-02-19T06:58:05.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.031+0000 7fac87c00640 1 -- 172.21.15.46:0/792898943 shutdown_connections 2024-02-19T06:58:05.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.031+0000 7fac87c00640 1 -- 172.21.15.46:0/792898943 wait complete. 2024-02-19T06:58:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.030+0000 7f6432200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6424050480 con 0x7f64240df420 2024-02-19T06:58:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.031+0000 7f642b400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64240df420 0x7f642404fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.031+0000 7f642b400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64240df420 0x7f642404fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43382/0 (socket says 172.21.15.46:43382) 2024-02-19T06:58:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.031+0000 7f642b400640 1 -- 172.21.15.46:0/2442939508 learned_addr learned my addr 172.21.15.46:0/2442939508 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.031+0000 7f642be00640 1 --2- 172.21.15.46:0/2442939508 >> v2:172.21.15.46:3300/0 conn(0x7f642404ffd0 0x7f6424054270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.032+0000 7f642b400640 1 -- 172.21.15.46:0/2442939508 >> v2:172.21.15.46:3300/0 conn(0x7f642404ffd0 msgr2=0x7f6424054270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:05.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.032+0000 7f642b400640 1 --2- 172.21.15.46:0/2442939508 >> v2:172.21.15.46:3300/0 conn(0x7f642404ffd0 0x7f6424054270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.033+0000 7f642b400640 1 -- 172.21.15.46:0/2442939508 >> v1:172.21.15.46:6789/0 conn(0x7f642400aaa0 legacy=0x7f64240382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.033+0000 7f642b400640 1 -- 172.21.15.46:0/2442939508 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6424006af0 con 0x7f64240df420 2024-02-19T06:58:05.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.034+0000 7f642be00640 1 --2- 172.21.15.46:0/2442939508 >> v2:172.21.15.46:3300/0 conn(0x7f642404ffd0 0x7f6424054270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.034+0000 7fac87c00640 1 Processor -- start 2024-02-19T06:58:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.035+0000 7fac87c00640 1 -- start start 2024-02-19T06:58:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.035+0000 7f642b400640 1 --2- 172.21.15.46:0/2442939508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64240df420 0x7f642404fa90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f64240529b0 tx=0x7f641802b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=399b0a16fcfb6e09 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.036+0000 7f642a000640 1 -- 172.21.15.46:0/2442939508 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418033620 con 0x7f64240df420 2024-02-19T06:58:05.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.036+0000 7f642a000640 1 -- 172.21.15.46:0/2442939508 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6418033780 con 0x7f64240df420 2024-02-19T06:58:05.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.036+0000 7f642a000640 1 -- 172.21.15.46:0/2442939508 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418033b10 con 0x7f64240df420 2024-02-19T06:58:05.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.036+0000 7fac87c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac800b29a0 0x7fac80151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.036+0000 7fac87c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800cf3c0 0x7fac80151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.037+0000 7fac87c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac80150b20 0x7fac8014ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.037+0000 7f6432200640 1 -- 172.21.15.46:0/2442939508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64240df420 msgr2=0x7f642404fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.037+0000 7f6432200640 1 --2- 172.21.15.46:0/2442939508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64240df420 0x7f642404fa90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f64240529b0 tx=0x7f641802b850 comp rx=0 tx=0).stop 2024-02-19T06:58:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.037+0000 7fac87c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac80152050 con 0x7fac80150b20 2024-02-19T06:58:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.038+0000 7f6432200640 1 -- 172.21.15.46:0/2442939508 shutdown_connections 2024-02-19T06:58:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.038+0000 7f6432200640 1 --2- 172.21.15.46:0/2442939508 >> v2:172.21.15.46:3300/0 conn(0x7f642404ffd0 0x7f6424054270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.038+0000 7f6432200640 1 --2- 172.21.15.46:0/2442939508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64240df420 0x7f642404fa90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.038+0000 7f6432200640 1 -- 172.21.15.46:0/2442939508 >> 172.21.15.46:0/2442939508 conn(0x7f6424009fb0 msgr2=0x7f642400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.037+0000 7fac87c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac801f7ab0 con 0x7fac800b29a0 2024-02-19T06:58:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.037+0000 7fac87c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac801578f0 con 0x7fac800cf3c0 2024-02-19T06:58:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.038+0000 7fac7fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800cf3c0 0x7fac80151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.038+0000 7fac7fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800cf3c0 0x7fac80151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:46152/0 (socket says 172.21.15.46:46152) 2024-02-19T06:58:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.038+0000 7fac7fe00640 1 -- 172.21.15.46:0/4029477745 learned_addr learned my addr 172.21.15.46:0/4029477745 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:05.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.038+0000 7f6432200640 1 -- 172.21.15.46:0/2442939508 shutdown_connections 2024-02-19T06:58:05.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.038+0000 7f6432200640 1 -- 172.21.15.46:0/2442939508 wait complete. 2024-02-19T06:58:05.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.038+0000 7fac85200640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac800b29a0 0x7fac80151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.038+0000 7fac85c00640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac80150b20 0x7fac8014ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.039+0000 7fac7fe00640 1 -- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac800b29a0 msgr2=0x7fac80151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.039+0000 7fac7fe00640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac800b29a0 0x7fac80151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.039+0000 7fbe8b000640 1 Processor -- start 2024-02-19T06:58:05.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.039+0000 7fac7fe00640 1 -- 172.21.15.46:0/4029477745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac80150b20 msgr2=0x7fac8014ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.039+0000 7fc1c0400640 1 Processor -- start 2024-02-19T06:58:05.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.039+0000 7fac7fe00640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac80150b20 0x7fac8014ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.039+0000 7fac7fe00640 1 -- 172.21.15.46:0/4029477745 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7800c300 con 0x7fac800cf3c0 2024-02-19T06:58:05.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.040+0000 7ffb5a200640 1 Processor -- start 2024-02-19T06:58:05.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.040+0000 7fac7fe00640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800cf3c0 0x7fac80151b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fac7000c3f0 tx=0x7fac7000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.039+0000 7fbe8b000640 1 -- start start 2024-02-19T06:58:05.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.040+0000 7ffb5a200640 1 -- start start 2024-02-19T06:58:05.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.040+0000 7fc1c0400640 1 -- start start 2024-02-19T06:58:05.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.041+0000 7fbe8b000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbe84158750 0x7fbe840d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.041+0000 7fbe8b000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe84162280 0x7fbe840d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.041+0000 7fbe8b000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe840ced30 con 0x7fbe840cf1c0 2024-02-19T06:58:05.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.041+0000 7fbe8b000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe841628e0 con 0x7fbe84158750 2024-02-19T06:58:05.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.041+0000 7fbe8b000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840ce400 con 0x7fbe84162280 2024-02-19T06:58:05.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.042+0000 7fc1c0400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1b80d0a00 0x7fc1b8161b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.042+0000 7fc1c0400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b80ced30 con 0x7fc1b8158750 2024-02-19T06:58:05.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.042+0000 7fc1c0400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b81628e0 con 0x7fc1b80cf1c0 2024-02-19T06:58:05.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.042+0000 7fc1c0400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80ce400 con 0x7fc1b80d0a00 2024-02-19T06:58:05.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.040+0000 7fac7cc00640 1 -- 172.21.15.46:0/4029477745 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac700035f0 con 0x7fac800cf3c0 2024-02-19T06:58:05.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.040+0000 7fac7cc00640 1 -- 172.21.15.46:0/4029477745 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac70003770 con 0x7fac800cf3c0 2024-02-19T06:58:05.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.040+0000 7fac7cc00640 1 -- 172.21.15.46:0/4029477745 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac70003b20 con 0x7fac800cf3c0 2024-02-19T06:58:05.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.042+0000 7fac87c00640 1 -- 172.21.15.46:0/4029477745 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6c0094d0 con 0x7fac800cf3c0 2024-02-19T06:58:05.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.042+0000 7fac87c00640 1 -- 172.21.15.46:0/4029477745 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac801f7cc0 con 0x7fac800cf3c0 2024-02-19T06:58:05.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.042+0000 7f6432200640 1 Processor -- start 2024-02-19T06:58:05.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.042+0000 7ffb5a200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb5416ac80 0x7ffb5416d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.042+0000 7ffb5a200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb54166640 con 0x7ffb540b2460 2024-02-19T06:58:05.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.042+0000 7ffb5a200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5406e6f0 con 0x7ffb540b2f30 2024-02-19T06:58:05.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.042+0000 7ffb5a200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54163630 con 0x7ffb5416ac80 2024-02-19T06:58:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.042+0000 7fc1bda00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc1b8158750 0x7fc1b80d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53316/0 (socket says 172.21.15.46:53316) 2024-02-19T06:58:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.043+0000 7fc1bda00640 1 -- 172.21.15.46:0/2607155823 learned_addr learned my addr 172.21.15.46:0/2607155823 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.043+0000 7fc1bd000640 1 --2- 172.21.15.46:0/2607155823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1b80d0a00 0x7fc1b8161b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.043+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739387010 0 0) 0x7fc1b80ced30 con 0x7fc1b8158750 2024-02-19T06:58:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.043+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1a0003520 con 0x7fc1b8158750 2024-02-19T06:58:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.043+0000 7ffb4aa00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ffb540b2460 0x7ffb54162f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53324/0 (socket says 172.21.15.46:53324) 2024-02-19T06:58:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.043+0000 7ffb4aa00640 1 -- 172.21.15.46:0/521615263 learned_addr learned my addr 172.21.15.46:0/521615263 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.043+0000 7ffb53e00640 1 --2- 172.21.15.46:0/521615263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb5416ac80 0x7ffb5416d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.043+0000 7f6432200640 1 -- start start 2024-02-19T06:58:05.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553387851 0 0) 0x7fc1b81628e0 con 0x7fc1b80cf1c0 2024-02-19T06:58:05.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b80ced30 con 0x7fc1b80cf1c0 2024-02-19T06:58:05.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3757523932 0 0) 0x7fc1a0003520 con 0x7fc1b8158750 2024-02-19T06:58:05.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1b80d0a00 msgr2=0x7fc1b8161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:05.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 --2- 172.21.15.46:0/2607155823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1b80d0a00 0x7fc1b8161b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 >> v1:172.21.15.142:6789/0 conn(0x7fc1b80cf1c0 legacy=0x7fc1b81620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fac87c00640 1 -- 172.21.15.46:0/4029477745 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac80067ba0 con 0x7fac800cf3c0 2024-02-19T06:58:05.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7ffb53e00640 1 -- 172.21.15.46:0/521615263 >> v1:172.21.15.142:6789/0 conn(0x7ffb540b2f30 legacy=0x7ffb540b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7ffb53e00640 1 -- 172.21.15.46:0/521615263 >> v1:172.21.15.46:6789/0 conn(0x7ffb540b2460 legacy=0x7ffb54162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:05.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7ffb53e00640 1 -- 172.21.15.46:0/521615263 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb54165a30 con 0x7ffb5416ac80 2024-02-19T06:58:05.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.043+0000 7fbe83e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbe84158750 0x7fbe840d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fbe83e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbe84158750 0x7fbe840d02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38432/0 (socket says 172.21.15.46:38432) 2024-02-19T06:58:05.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fbe83e00640 1 -- 172.21.15.46:0/4206695914 learned_addr learned my addr 172.21.15.46:0/4206695914 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:05.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.043+0000 7fbe83400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbe840cf1c0 0x7fbe84161b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53336/0 (socket says 172.21.15.46:53336) 2024-02-19T06:58:05.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b80ce6e0 con 0x7fc1b8158750 2024-02-19T06:58:05.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fc1ac001670 con 0x7fc1b8158750 2024-02-19T06:58:05.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 >> v1:172.21.15.46:6789/0 conn(0x7fc1b8158750 legacy=0x7fc1b80d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 --2- 172.21.15.46:0/2607155823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a0003b30 0x7fc1a0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 --2- 172.21.15.46:0/2607155823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a00047c0 0x7fc1a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 --2- 172.21.15.46:0/2607155823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a0005180 0x7fc1a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80ce400 con 0x7fc1a0003b30 2024-02-19T06:58:05.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a000bfa0 con 0x7fc1a0005180 2024-02-19T06:58:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.044+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a000c160 con 0x7fc1a00047c0 2024-02-19T06:58:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.045+0000 7fc1bda00640 1 --2- 172.21.15.46:0/2607155823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a0003b30 0x7fc1a0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.045+0000 7fc1be400640 1 --2- 172.21.15.46:0/2607155823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a0005180 0x7fc1a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.043+0000 7fbe89000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe84162280 0x7fbe840d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.045+0000 7fc1bd000640 1 --2- 172.21.15.46:0/2607155823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a00047c0 0x7fc1a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7fc1be400640 1 -- 172.21.15.46:0/2607155823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a00047c0 msgr2=0x7fc1a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:05.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7fc1be400640 1 --2- 172.21.15.46:0/2607155823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a00047c0 0x7fc1a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7fc1be400640 1 -- 172.21.15.46:0/2607155823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a0003b30 msgr2=0x7fc1a0003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:05.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7f6432200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f642400aaa0 0x7f6424047610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7f6432200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642404ffd0 0x7f64240d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7fbe82a00640 1 -- 172.21.15.46:0/4206695914 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828234544 0 0) 0x7fbe840ced30 con 0x7fbe840cf1c0 2024-02-19T06:58:05.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7fbe82a00640 1 -- 172.21.15.46:0/4206695914 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe68003520 con 0x7fbe840cf1c0 2024-02-19T06:58:05.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7fc1be400640 1 --2- 172.21.15.46:0/2607155823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a0003b30 0x7fc1a0003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7fc1be400640 1 -- 172.21.15.46:0/2607155823 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a0003520 con 0x7fc1a0005180 2024-02-19T06:58:05.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7fc1bda00640 1 --2- 172.21.15.46:0/2607155823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1a0003b30 0x7fc1a0003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:58:05.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7f6432200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64240df420 0x7f6424034450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7f6432200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64240cff80 con 0x7f642404ffd0 2024-02-19T06:58:05.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7f6432200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64240e2240 con 0x7f642400aaa0 2024-02-19T06:58:05.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7f6432200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6424047b50 con 0x7f64240df420 2024-02-19T06:58:05.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.047+0000 7f642b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f642400aaa0 0x7f6424047610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.047+0000 7f642b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f642400aaa0 0x7f6424047610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43412/0 (socket says 172.21.15.46:43412) 2024-02-19T06:58:05.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.047+0000 7f642b400640 1 -- 172.21.15.46:0/3294466064 learned_addr learned my addr 172.21.15.46:0/3294466064 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:05.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7fbe83e00640 1 -- 172.21.15.46:0/4206695914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe84162280 msgr2=0x7fbe840d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:05.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7fbe83e00640 1 --2- 172.21.15.46:0/4206695914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe84162280 0x7fbe840d0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.046+0000 7fbe83e00640 1 -- 172.21.15.46:0/4206695914 >> v1:172.21.15.46:6789/0 conn(0x7fbe840cf1c0 legacy=0x7fbe84161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.047+0000 7fbe83e00640 1 -- 172.21.15.46:0/4206695914 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe840ce6e0 con 0x7fbe84158750 2024-02-19T06:58:05.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.047+0000 7f642aa00640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642404ffd0 0x7f64240d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.047+0000 7f642be00640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64240df420 0x7f6424034450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.047+0000 7fac7cc00640 1 -- 172.21.15.46:0/4029477745 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fac70003c80 con 0x7fac800cf3c0 2024-02-19T06:58:05.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.048+0000 7f642aa00640 1 -- 172.21.15.46:0/3294466064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64240df420 msgr2=0x7f6424034450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.048+0000 7f642aa00640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64240df420 0x7f6424034450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.048+0000 7f642aa00640 1 -- 172.21.15.46:0/3294466064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f642400aaa0 msgr2=0x7f6424047610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.048+0000 7f642aa00640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f642400aaa0 0x7f6424047610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.048+0000 7f642aa00640 1 -- 172.21.15.46:0/3294466064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64180094d0 con 0x7f642404ffd0 2024-02-19T06:58:05.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.048+0000 7ffb53e00640 1 --2- 172.21.15.46:0/521615263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb5416ac80 0x7ffb5416d070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0097d0 tx=0x7ffb4c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a99fcefdcf44717 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.048+0000 7f642aa00640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642404ffd0 0x7f64240d03a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f642c068250 tx=0x7f642c0740a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.049+0000 7fc1be400640 1 --2- 172.21.15.46:0/2607155823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a0005180 0x7fc1a000b980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0001fc0 tx=0x7fc1a00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57d4767d9c0dd977 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.049+0000 7f641f400640 1 -- 172.21.15.46:0/3294466064 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c074990 con 0x7f642404ffd0 2024-02-19T06:58:05.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.049+0000 7fac7cc00640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fac6006b8e0 0x7fac6006dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.049+0000 7fac7cc00640 1 -- 172.21.15.46:0/4029477745 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac70089650 con 0x7fac800cf3c0 2024-02-19T06:58:05.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.049+0000 7fac85200640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fac6006b8e0 0x7fac6006dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.049+0000 7f641f400640 1 -- 172.21.15.46:0/3294466064 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c092400 con 0x7f642404ffd0 2024-02-19T06:58:05.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.049+0000 7f641f400640 1 -- 172.21.15.46:0/3294466064 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c092670 con 0x7f642404ffd0 2024-02-19T06:58:05.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.049+0000 7f6432200640 1 -- 172.21.15.46:0/3294466064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64240d0bf0 con 0x7f642404ffd0 2024-02-19T06:58:05.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.049+0000 7f6432200640 1 -- 172.21.15.46:0/3294466064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64240d0eb0 con 0x7f642404ffd0 2024-02-19T06:58:05.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.049+0000 7fbe83e00640 1 --2- 172.21.15.46:0/4206695914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe84158750 0x7fbe840d02f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009870 tx=0x7fbe7402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc07b48ecba22c66 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.050+0000 7fbe82a00640 1 -- 172.21.15.46:0/4206695914 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74030840 con 0x7fbe84158750 2024-02-19T06:58:05.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.050+0000 7fbe82a00640 1 -- 172.21.15.46:0/4206695914 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe740309a0 con 0x7fbe84158750 2024-02-19T06:58:05.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.050+0000 7fbe82a00640 1 -- 172.21.15.46:0/4206695914 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74030d10 con 0x7fbe84158750 2024-02-19T06:58:05.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.050+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0003b70 con 0x7fc1a0005180 2024-02-19T06:58:05.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.051+0000 7fbe8b000640 1 -- 172.21.15.46:0/4206695914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe84158750 msgr2=0x7fbe840d02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.051+0000 7fbe8b000640 1 --2- 172.21.15.46:0/4206695914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe84158750 0x7fbe840d02f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009870 tx=0x7fbe7402b980 comp rx=0 tx=0).stop 2024-02-19T06:58:05.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.051+0000 7fbe8b000640 1 -- 172.21.15.46:0/4206695914 shutdown_connections 2024-02-19T06:58:05.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.051+0000 7fbe8b000640 1 --2- 172.21.15.46:0/4206695914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe84162280 0x7fbe840d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.051+0000 7fbe8b000640 1 --2- 172.21.15.46:0/4206695914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe84158750 0x7fbe840d02f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.051+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b0003cf0 con 0x7fc1a0005180 2024-02-19T06:58:05.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.051+0000 7f6432200640 1 -- 172.21.15.46:0/3294466064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642404f900 con 0x7f642404ffd0 2024-02-19T06:58:05.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.051+0000 7fc1b7e00640 1 -- 172.21.15.46:0/2607155823 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0005310 con 0x7fc1a0005180 2024-02-19T06:58:05.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.051+0000 7fbe8b000640 1 -- 172.21.15.46:0/4206695914 >> 172.21.15.46:0/4206695914 conn(0x7fbe8406be20 msgr2=0x7fbe8406c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.051+0000 7fbe8b000640 1 -- 172.21.15.46:0/4206695914 shutdown_connections 2024-02-19T06:58:05.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.052+0000 7fbe8b000640 1 -- 172.21.15.46:0/4206695914 wait complete. 2024-02-19T06:58:05.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.052+0000 7fac85200640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fac6006b8e0 0x7fac6006dda0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fac78003f00 tx=0x7fac7800c060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.052+0000 7f641f400640 1 -- 172.21.15.46:0/3294466064 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f642c0927d0 con 0x7f642404ffd0 2024-02-19T06:58:05.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.052+0000 7fc1c0400640 1 -- 172.21.15.46:0/2607155823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a0005180 msgr2=0x7fc1a000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.052+0000 7fc1c0400640 1 --2- 172.21.15.46:0/2607155823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a0005180 0x7fc1a000b980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0001fc0 tx=0x7fc1a00057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.053+0000 7fc1be400640 1 -- 172.21.15.46:0/2607155823 reap_dead start 2024-02-19T06:58:05.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.053+0000 7fc1c0400640 1 -- 172.21.15.46:0/2607155823 shutdown_connections 2024-02-19T06:58:05.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.053+0000 7fc1c0400640 1 -- 172.21.15.46:0/2607155823 >> 172.21.15.46:0/2607155823 conn(0x7fc1b806be20 msgr2=0x7fc1b806c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.053+0000 7fc1c0400640 1 -- 172.21.15.46:0/2607155823 shutdown_connections 2024-02-19T06:58:05.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.053+0000 7fc1c0400640 1 -- 172.21.15.46:0/2607155823 wait complete. 2024-02-19T06:58:05.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.053+0000 7f641f400640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f640c06b860 0x7f640c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.054+0000 7f641f400640 1 -- 172.21.15.46:0/3294466064 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f642c104680 con 0x7f642404ffd0 2024-02-19T06:58:05.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.054+0000 7f642b400640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f640c06b860 0x7f640c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.054+0000 7fbe8b000640 1 Processor -- start 2024-02-19T06:58:05.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.055+0000 7fbe8b000640 1 -- start start 2024-02-19T06:58:05.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.056+0000 7f642b400640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f640c06b860 0x7f640c06dd20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f641802b890 tx=0x7f6418008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.056+0000 7fc1c0400640 1 Processor -- start 2024-02-19T06:58:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.056+0000 7fc1c0400640 1 -- start start 2024-02-19T06:58:05.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.056+0000 7fbe8b000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe840cf1c0 0x7fbe840c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.056+0000 7fbe8b000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe84162280 0x7fbe840c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.056+0000 7fbe8b000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe8415a370 0x7fbe840c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.056+0000 7fbe8b000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8415a8a0 con 0x7fbe8415a370 2024-02-19T06:58:05.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.056+0000 7fbe8b000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8415ab80 con 0x7fbe840cf1c0 2024-02-19T06:58:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.056+0000 7fbe8b000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8415ae60 con 0x7fbe84162280 2024-02-19T06:58:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.057+0000 7fbe83e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe840cf1c0 0x7fbe840c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.057+0000 7fbe89000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe8415a370 0x7fbe840c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.057+0000 7fbe89000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe8415a370 0x7fbe840c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38462/0 (socket says 172.21.15.46:38462) 2024-02-19T06:58:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.057+0000 7fbe89000640 1 -- 172.21.15.46:0/733652037 learned_addr learned my addr 172.21.15.46:0/733652037 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.057+0000 7fbe83e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe840cf1c0 0x7fbe840c7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43414/0 (socket says 172.21.15.46:43414) 2024-02-19T06:58:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.057+0000 7fbe83400640 1 --2- 172.21.15.46:0/733652037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe84162280 0x7fbe840c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.058+0000 7fbe89000640 1 -- 172.21.15.46:0/733652037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe84162280 msgr2=0x7fbe840c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.058+0000 7fbe89000640 1 --2- 172.21.15.46:0/733652037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe84162280 0x7fbe840c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.058+0000 7fbe89000640 1 -- 172.21.15.46:0/733652037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe840cf1c0 msgr2=0x7fbe840c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.058+0000 7fbe89000640 1 --2- 172.21.15.46:0/733652037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe840cf1c0 0x7fbe840c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.058+0000 7fbe89000640 1 -- 172.21.15.46:0/733652037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe740094d0 con 0x7fbe8415a370 2024-02-19T06:58:05.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.058+0000 7fc1c0400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a0005180 0x7fc1b815aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.058+0000 7fc1c0400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b8151690 0x7fc1b815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.058+0000 7fc1c0400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1b8151be0 0x7fc1b8158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.058+0000 7fc1c0400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b815b990 con 0x7fc1b8151690 2024-02-19T06:58:05.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.058+0000 7fc1c0400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b815b6b0 con 0x7fc1a0005180 2024-02-19T06:58:05.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.058+0000 7fc1c0400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b815bef0 con 0x7fc1b8151be0 2024-02-19T06:58:05.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.058+0000 7fbe89000640 1 --2- 172.21.15.46:0/733652037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe8415a370 0x7fbe840c9590 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00efc0 tx=0x7fbe7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.058+0000 7fc1bd000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b8151690 0x7fc1b815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.059+0000 7fc1be400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1b8151be0 0x7fc1b8158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.059+0000 7fc1be400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1b8151be0 0x7fc1b8158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:46210/0 (socket says 172.21.15.46:46210) 2024-02-19T06:58:05.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.059+0000 7fc1be400640 1 -- 172.21.15.46:0/2827145451 learned_addr learned my addr 172.21.15.46:0/2827145451 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:05.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.059+0000 7fc1bda00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a0005180 0x7fc1b815aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.059+0000 7fbe7be00640 1 -- 172.21.15.46:0/733652037 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c009ba0 con 0x7fbe8415a370 2024-02-19T06:58:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.059+0000 7fbe7be00640 1 -- 172.21.15.46:0/733652037 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c00f040 con 0x7fbe8415a370 2024-02-19T06:58:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.059+0000 7fbe7be00640 1 -- 172.21.15.46:0/733652037 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0146c0 con 0x7fbe8415a370 2024-02-19T06:58:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.059+0000 7fbe8b000640 1 -- 172.21.15.46:0/733652037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8415b140 con 0x7fbe8415a370 2024-02-19T06:58:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.059+0000 7fc1bd000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b8151690 0x7fc1b815b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38472/0 (socket says 172.21.15.46:38472) 2024-02-19T06:58:05.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.059+0000 7f641f400640 1 -- 172.21.15.46:0/3294466064 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f642c0cf130 con 0x7f642404ffd0 2024-02-19T06:58:05.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.059+0000 7fbe8b000640 1 -- 172.21.15.46:0/733652037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8414b440 con 0x7fbe8415a370 2024-02-19T06:58:05.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.060+0000 7fc1be400640 1 -- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a0005180 msgr2=0x7fc1b815aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.060+0000 7fc1be400640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a0005180 0x7fc1b815aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.060+0000 7fc1be400640 1 -- 172.21.15.46:0/2827145451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b8151690 msgr2=0x7fc1b815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.061+0000 7fc1be400640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b8151690 0x7fc1b815b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.061+0000 7fc1be400640 1 -- 172.21.15.46:0/2827145451 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b815c1d0 con 0x7fc1b8151be0 2024-02-19T06:58:05.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.061+0000 7fc1bda00640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a0005180 0x7fc1b815aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:05.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.061+0000 7fbe8b000640 1 -- 172.21.15.46:0/733652037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c005290 con 0x7fbe8415a370 2024-02-19T06:58:05.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.061+0000 7fc1bd000640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b8151690 0x7fc1b815b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:58:05.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.061+0000 7fc1be400640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1b8151be0 0x7fc1b8158b40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0008fd0 tx=0x7fc1b0001650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.062+0000 7fbe7be00640 1 -- 172.21.15.46:0/733652037 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbe7c014820 con 0x7fbe8415a370 2024-02-19T06:58:05.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.063+0000 7fbe7be00640 1 --2- 172.21.15.46:0/733652037 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbe6406b860 0x7fbe6406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.064+0000 7fbe7be00640 1 -- 172.21.15.46:0/733652037 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe7c08af20 con 0x7fbe8415a370 2024-02-19T06:58:05.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.064+0000 7fbe83e00640 1 --2- 172.21.15.46:0/733652037 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbe6406b860 0x7fbe6406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.066+0000 7fbe83e00640 1 --2- 172.21.15.46:0/733652037 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbe6406b860 0x7fbe6406dd20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe74036000 tx=0x7fbe74008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.067+0000 7ffb52a00640 1 -- 172.21.15.46:0/521615263 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c031780 con 0x7ffb5416ac80 2024-02-19T06:58:05.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.067+0000 7ffb52a00640 1 -- 172.21.15.46:0/521615263 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c0318e0 con 0x7ffb5416ac80 2024-02-19T06:58:05.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.067+0000 7ffb52a00640 1 -- 172.21.15.46:0/521615263 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c031c70 con 0x7ffb5416ac80 2024-02-19T06:58:05.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.067+0000 7fc1b5600640 1 -- 172.21.15.46:0/2827145451 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b00050d0 con 0x7fc1b8151be0 2024-02-19T06:58:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.067+0000 7fc1b5600640 1 -- 172.21.15.46:0/2827145451 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b0005500 con 0x7fc1b8151be0 2024-02-19T06:58:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.067+0000 7fc1b5600640 1 -- 172.21.15.46:0/2827145451 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b002c570 con 0x7fc1b8151be0 2024-02-19T06:58:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.067+0000 7fac7cc00640 1 -- 172.21.15.46:0/4029477745 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac70054100 con 0x7fac800cf3c0 2024-02-19T06:58:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.067+0000 7fbe7be00640 1 -- 172.21.15.46:0/733652037 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbe7c055920 con 0x7fbe8415a370 2024-02-19T06:58:05.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.068+0000 7fc1c0400640 1 -- 172.21.15.46:0/2827145451 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b815c4b0 con 0x7fc1b8151be0 2024-02-19T06:58:05.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.068+0000 7fc1c0400640 1 -- 172.21.15.46:0/2827145451 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b8159260 con 0x7fc1b8151be0 2024-02-19T06:58:05.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.068+0000 7ffb5a200640 1 -- 172.21.15.46:0/521615263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb5416ac80 msgr2=0x7ffb5416d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.068+0000 7ffb5a200640 1 --2- 172.21.15.46:0/521615263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb5416ac80 0x7ffb5416d070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0097d0 tx=0x7ffb4c02b820 comp rx=0 tx=0).stop 2024-02-19T06:58:05.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.069+0000 7ffb5a200640 1 -- 172.21.15.46:0/521615263 shutdown_connections 2024-02-19T06:58:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.069+0000 7ffb5a200640 1 --2- 172.21.15.46:0/521615263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb5416ac80 0x7ffb5416d070 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.069+0000 7ffb5a200640 1 -- 172.21.15.46:0/521615263 >> 172.21.15.46:0/521615263 conn(0x7ffb54066f70 msgr2=0x7ffb5406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.069+0000 7ffb5a200640 1 -- 172.21.15.46:0/521615263 shutdown_connections 2024-02-19T06:58:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.069+0000 7ffb5a200640 1 -- 172.21.15.46:0/521615263 wait complete. 2024-02-19T06:58:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.072+0000 7fc1c0400640 1 -- 172.21.15.46:0/2827145451 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b8159260 con 0x7fc1b8151be0 2024-02-19T06:58:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.072+0000 7ffb5a200640 1 Processor -- start 2024-02-19T06:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.072+0000 7ffb5a200640 1 -- start start 2024-02-19T06:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.074+0000 7ffb5a200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb540b2460 0x7ffb5415e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.074+0000 7ffb5a200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb540b2f30 0x7ffb54163b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.074+0000 7ffb5a200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb5416ac80 0x7ffb540cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.074+0000 7ffb5a200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5415a1a0 con 0x7ffb5416ac80 2024-02-19T06:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.074+0000 7ffb5a200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5415a3f0 con 0x7ffb540b2460 2024-02-19T06:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.074+0000 7ffb5a200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5415a6d0 con 0x7ffb540b2f30 2024-02-19T06:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.075+0000 7ffb53400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb540b2460 0x7ffb5415e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.075+0000 7ffb53400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb540b2460 0x7ffb5415e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:43432/0 (socket says 172.21.15.46:43432) 2024-02-19T06:58:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.075+0000 7ffb53400640 1 -- 172.21.15.46:0/226251743 learned_addr learned my addr 172.21.15.46:0/226251743 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.075+0000 7ffb53e00640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb5416ac80 0x7ffb540cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.075+0000 7ffb4aa00640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb540b2f30 0x7ffb54163b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.076+0000 7ffb53400640 1 -- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb540b2f30 msgr2=0x7ffb54163b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.076+0000 7ffb53400640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb540b2f30 0x7ffb54163b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.076+0000 7ffb53400640 1 -- 172.21.15.46:0/226251743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb5416ac80 msgr2=0x7ffb540cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.076+0000 7ffb53400640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb5416ac80 0x7ffb540cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.076+0000 7ffb53400640 1 -- 172.21.15.46:0/226251743 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c009400 con 0x7ffb540b2460 2024-02-19T06:58:05.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.076+0000 7ffb53e00640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb5416ac80 0x7ffb540cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:58:05.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.076+0000 7fc1b5600640 1 -- 172.21.15.46:0/2827145451 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc1b002c6d0 con 0x7fc1b8151be0 2024-02-19T06:58:05.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.078+0000 7fc1b5600640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc19806b8e0 0x7fc19806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.078+0000 7fc1b5600640 1 -- 172.21.15.46:0/2827145451 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1b00ab760 con 0x7fc1b8151be0 2024-02-19T06:58:05.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.079+0000 7ffb53400640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb540b2460 0x7ffb5415e890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400c450 tx=0x7ffb4400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.079+0000 7fc1bda00640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc19806b8e0 0x7fc19806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.081+0000 7fc1bda00640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc19806b8e0 0x7fc19806dda0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac001eb0 tx=0x7fc1ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.080+0000 7ffb4be00640 1 -- 172.21.15.46:0/226251743 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb440052d0 con 0x7ffb540b2460 2024-02-19T06:58:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.080+0000 7ffb4be00640 1 -- 172.21.15.46:0/226251743 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb44005430 con 0x7ffb540b2460 2024-02-19T06:58:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.080+0000 7ffb4be00640 1 -- 172.21.15.46:0/226251743 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb44012870 con 0x7ffb540b2460 2024-02-19T06:58:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.080+0000 7ffb5a200640 1 -- 172.21.15.46:0/226251743 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5415a9b0 con 0x7ffb540b2460 2024-02-19T06:58:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.080+0000 7ffb5a200640 1 -- 172.21.15.46:0/226251743 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5415af70 con 0x7ffb540b2460 2024-02-19T06:58:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.081+0000 7ffb5a200640 1 -- 172.21.15.46:0/226251743 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb540b2880 con 0x7ffb540b2460 2024-02-19T06:58:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.084+0000 7ffb4be00640 1 -- 172.21.15.46:0/226251743 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ffb440129d0 con 0x7ffb540b2460 2024-02-19T06:58:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.086+0000 7ffb4be00640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ffb3006b810 0x7ffb3006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.086+0000 7ffb4be00640 1 -- 172.21.15.46:0/226251743 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb4408a770 con 0x7ffb540b2460 2024-02-19T06:58:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.087+0000 7ffb4aa00640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ffb3006b810 0x7ffb3006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.088+0000 7ffb4aa00640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ffb3006b810 0x7ffb3006dcd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffb540cb580 tx=0x7ffb3c009530 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.099+0000 7fc1b5600640 1 -- 172.21.15.46:0/2827145451 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc1b00761f0 con 0x7fc1b8151be0 2024-02-19T06:58:05.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.107+0000 7ffb4be00640 1 -- 172.21.15.46:0/226251743 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb44055170 con 0x7ffb540b2460 2024-02-19T06:58:05.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.394+0000 7f14e1c00640 1 -- 172.21.15.46:0/324499148 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f14b4005810 con 0x7f14d40e7bd0 2024-02-19T06:58:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.395+0000 7f14d2a00640 1 -- 172.21.15.46:0/324499148 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14dc0d2650 con 0x7f14d40e7bd0 2024-02-19T06:58:05.399 INFO:teuthology.orchestra.run.smithi046.stdout:60129542150 2024-02-19T06:58:05.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.398+0000 7f14e1c00640 1 -- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f14bc06b870 msgr2=0x7f14bc06dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.398+0000 7f14e1c00640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f14bc06b870 0x7f14bc06dd30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14c80011e0 tx=0x7f14c8007d30 comp rx=0 tx=0).stop 2024-02-19T06:58:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.399+0000 7f14e1c00640 1 -- 172.21.15.46:0/324499148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d40e7bd0 msgr2=0x7f14d40d7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.399+0000 7f14e1c00640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d40e7bd0 0x7f14d40d7470 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f14dc050150 tx=0x7f14dc0740a0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.399+0000 7f14e1c00640 1 -- 172.21.15.46:0/324499148 shutdown_connections 2024-02-19T06:58:05.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.399+0000 7f14e1c00640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f14bc06b870 0x7f14bc06dd30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.400+0000 7f14e1c00640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14d40e7bd0 0x7f14d40d7470 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.400+0000 7f14e1c00640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d40e7680 0x7f14d40d5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.400+0000 7f14e1c00640 1 --2- 172.21.15.46:0/324499148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d40e72a0 0x7f14d40ded90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.400+0000 7f14e1c00640 1 -- 172.21.15.46:0/324499148 >> 172.21.15.46:0/324499148 conn(0x7f14d4056cd0 msgr2=0x7f14d40db3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.400+0000 7f14e1c00640 1 -- 172.21.15.46:0/324499148 shutdown_connections 2024-02-19T06:58:05.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.401+0000 7f14e1c00640 1 -- 172.21.15.46:0/324499148 wait complete. 2024-02-19T06:58:05.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.411+0000 7faaabc00640 1 -- 172.21.15.46:0/834729771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faaa415afe0 con 0x7faaa40b2f80 2024-02-19T06:58:05.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.412+0000 7faaa0c00640 1 -- 172.21.15.46:0/834729771 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faaa415afe0 con 0x7faaa40b2f80 2024-02-19T06:58:05.415 INFO:teuthology.orchestra.run.smithi046.stdout:60129542150 2024-02-19T06:58:05.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.416+0000 7faaabc00640 1 -- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7faa8406b8e0 msgr2=0x7faa8406dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.416+0000 7faaabc00640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7faa8406b8e0 0x7faa8406dda0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faaa4155790 tx=0x7faa90009040 comp rx=0 tx=0).stop 2024-02-19T06:58:05.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.416+0000 7faaabc00640 1 -- 172.21.15.46:0/834729771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faaa40b2f80 msgr2=0x7faaa40afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.416+0000 7faaabc00640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faaa40b2f80 0x7faaa40afb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00cb40 tx=0x7faa9c00a060 comp rx=0 tx=0).stop 2024-02-19T06:58:05.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.416+0000 7f409b400640 1 -- 172.21.15.46:0/95561801 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4084005810 con 0x7f40ac15c360 2024-02-19T06:58:05.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.417+0000 7faaabc00640 1 -- 172.21.15.46:0/834729771 shutdown_connections 2024-02-19T06:58:05.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.417+0000 7faaabc00640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7faa8406b8e0 0x7faa8406dda0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.417+0000 7faaabc00640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa4162970 0x7faaa4151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.417+0000 7faaabc00640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaa40cfe10 0x7faaa40b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.417+0000 7faaabc00640 1 --2- 172.21.15.46:0/834729771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faaa40b2f80 0x7faaa40afb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.417+0000 7faaabc00640 1 -- 172.21.15.46:0/834729771 >> 172.21.15.46:0/834729771 conn(0x7faaa406afa0 msgr2=0x7faaa4070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.417+0000 7f40a2a00640 1 -- 172.21.15.46:0/95561801 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f40a4058e80 con 0x7f40ac15c360 2024-02-19T06:58:05.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.417+0000 7faaabc00640 1 -- 172.21.15.46:0/834729771 shutdown_connections 2024-02-19T06:58:05.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.418+0000 7faaabc00640 1 -- 172.21.15.46:0/834729771 wait complete. 2024-02-19T06:58:05.421 INFO:teuthology.orchestra.run.smithi046.stdout:60129542152 2024-02-19T06:58:05.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.421+0000 7f409b400640 1 -- 172.21.15.46:0/95561801 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f408806b870 msgr2=0x7f408806dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.421+0000 7f409b400640 1 --2- 172.21.15.46:0/95561801 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f408806b870 0x7f408806dd30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f409c005880 tx=0x7f409c009040 comp rx=0 tx=0).stop 2024-02-19T06:58:05.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.421+0000 7f409b400640 1 -- 172.21.15.46:0/95561801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15c360 msgr2=0x7f40ac0afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.421+0000 7f409b400640 1 --2- 172.21.15.46:0/95561801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15c360 0x7f40ac0afe40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f40a400d800 tx=0x7f40a400dcc0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.422+0000 7f409b400640 1 -- 172.21.15.46:0/95561801 shutdown_connections 2024-02-19T06:58:05.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.422+0000 7f409b400640 1 --2- 172.21.15.46:0/95561801 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f408806b870 0x7f408806dd30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.422+0000 7f409b400640 1 --2- 172.21.15.46:0/95561801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15c360 0x7f40ac0afe40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.422+0000 7f409b400640 1 --2- 172.21.15.46:0/95561801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40ac0b3630 0x7f40ac149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.422+0000 7f409b400640 1 --2- 172.21.15.46:0/95561801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40ac06d390 0x7f40ac0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.422+0000 7f409b400640 1 -- 172.21.15.46:0/95561801 >> 172.21.15.46:0/95561801 conn(0x7f40ac066cd0 msgr2=0x7f40ac0b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.423+0000 7f409b400640 1 -- 172.21.15.46:0/95561801 shutdown_connections 2024-02-19T06:58:05.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.423+0000 7f409b400640 1 -- 172.21.15.46:0/95561801 wait complete. 2024-02-19T06:58:05.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-02-19T06:58:05.432 DEBUG:teuthology.parallel:result is None 2024-02-19T06:58:05.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-02-19T06:58:05.447 DEBUG:teuthology.parallel:result is None 2024-02-19T06:58:05.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2024-02-19T06:58:05.452 DEBUG:teuthology.parallel:result is None 2024-02-19T06:58:05.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.468+0000 7f6432200640 1 -- 172.21.15.46:0/3294466064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f64240d00c0 con 0x7f642404ffd0 2024-02-19T06:58:05.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.468+0000 7f641f400640 1 -- 172.21.15.46:0/3294466064 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f642c0d27f0 con 0x7f642404ffd0 2024-02-19T06:58:05.471 INFO:teuthology.orchestra.run.smithi046.stdout:60129542150 2024-02-19T06:58:05.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.469+0000 7fbe8b000640 1 -- 172.21.15.46:0/733652037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbe5c005540 con 0x7fbe8415a370 2024-02-19T06:58:05.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.469+0000 7fbe7be00640 1 -- 172.21.15.46:0/733652037 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe7c018020 con 0x7fbe8415a370 2024-02-19T06:58:05.472 INFO:teuthology.orchestra.run.smithi046.stdout:64424509447 2024-02-19T06:58:05.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.471+0000 7f6432200640 1 -- 172.21.15.46:0/3294466064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f640c06b860 msgr2=0x7f640c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.471+0000 7f6432200640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f640c06b860 0x7f640c06dd20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f641802b890 tx=0x7f6418008030 comp rx=0 tx=0).stop 2024-02-19T06:58:05.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.471+0000 7f6432200640 1 -- 172.21.15.46:0/3294466064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642404ffd0 msgr2=0x7f64240d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.471+0000 7f6432200640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642404ffd0 0x7f64240d03a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f642c068250 tx=0x7f642c0740a0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7f6432200640 1 -- 172.21.15.46:0/3294466064 shutdown_connections 2024-02-19T06:58:05.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7f6432200640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f640c06b860 0x7f640c06dd20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7f6432200640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64240df420 0x7f6424034450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7f6432200640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642404ffd0 0x7f64240d03a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7f6432200640 1 --2- 172.21.15.46:0/3294466064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f642400aaa0 0x7f6424047610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7f6432200640 1 -- 172.21.15.46:0/3294466064 >> 172.21.15.46:0/3294466064 conn(0x7f6424009fb0 msgr2=0x7f64240372c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7fbe8b000640 1 -- 172.21.15.46:0/733652037 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbe6406b860 msgr2=0x7fbe6406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7fbe8b000640 1 --2- 172.21.15.46:0/733652037 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbe6406b860 0x7fbe6406dd20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe74036000 tx=0x7fbe74008030 comp rx=0 tx=0).stop 2024-02-19T06:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7fbe8b000640 1 -- 172.21.15.46:0/733652037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe8415a370 msgr2=0x7fbe840c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7fbe8b000640 1 --2- 172.21.15.46:0/733652037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe8415a370 0x7fbe840c9590 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00efc0 tx=0x7fbe7c00c490 comp rx=0 tx=0).stop 2024-02-19T06:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7f6432200640 1 -- 172.21.15.46:0/3294466064 shutdown_connections 2024-02-19T06:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7fbe8b000640 1 -- 172.21.15.46:0/733652037 shutdown_connections 2024-02-19T06:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7fbe8b000640 1 --2- 172.21.15.46:0/733652037 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbe6406b860 0x7fbe6406dd20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7fbe8b000640 1 --2- 172.21.15.46:0/733652037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe8415a370 0x7fbe840c9590 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7fbe8b000640 1 --2- 172.21.15.46:0/733652037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe84162280 0x7fbe840c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7fbe8b000640 1 --2- 172.21.15.46:0/733652037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe840cf1c0 0x7fbe840c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7fbe8b000640 1 -- 172.21.15.46:0/733652037 >> 172.21.15.46:0/733652037 conn(0x7fbe8406be20 msgr2=0x7fbe840d2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7f6432200640 1 -- 172.21.15.46:0/3294466064 wait complete. 2024-02-19T06:58:05.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7fbe8b000640 1 -- 172.21.15.46:0/733652037 shutdown_connections 2024-02-19T06:58:05.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.472+0000 7fbe8b000640 1 -- 172.21.15.46:0/733652037 wait complete. 2024-02-19T06:58:05.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.476+0000 7fac87c00640 1 -- 172.21.15.46:0/4029477745 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fac8006d5a0 con 0x7fac800cf3c0 2024-02-19T06:58:05.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.477+0000 7fac7cc00640 1 -- 172.21.15.46:0/4029477745 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fac700577c0 con 0x7fac800cf3c0 2024-02-19T06:58:05.479 INFO:teuthology.orchestra.run.smithi046.stdout:60129542151 2024-02-19T06:58:05.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.480+0000 7fac87c00640 1 -- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fac6006b8e0 msgr2=0x7fac6006dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.480+0000 7fac87c00640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fac6006b8e0 0x7fac6006dda0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fac78003f00 tx=0x7fac7800c060 comp rx=0 tx=0).stop 2024-02-19T06:58:05.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.480+0000 7fac87c00640 1 -- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800cf3c0 msgr2=0x7fac80151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.480+0000 7fac87c00640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800cf3c0 0x7fac80151b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fac7000c3f0 tx=0x7fac7000c8b0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.480+0000 7fac87c00640 1 -- 172.21.15.46:0/4029477745 shutdown_connections 2024-02-19T06:58:05.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.480+0000 7fac87c00640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fac6006b8e0 0x7fac6006dda0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.480+0000 7fac87c00640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac80150b20 0x7fac8014ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.480+0000 7fac87c00640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800cf3c0 0x7fac80151b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.480+0000 7fac87c00640 1 --2- 172.21.15.46:0/4029477745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac800b29a0 0x7fac80151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.480+0000 7fac87c00640 1 -- 172.21.15.46:0/4029477745 >> 172.21.15.46:0/4029477745 conn(0x7fac80066cd0 msgr2=0x7fac800cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.481+0000 7fac87c00640 1 -- 172.21.15.46:0/4029477745 shutdown_connections 2024-02-19T06:58:05.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.481+0000 7fac87c00640 1 -- 172.21.15.46:0/4029477745 wait complete. 2024-02-19T06:58:05.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.489+0000 7ffb5a200640 1 -- 172.21.15.46:0/226251743 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ffb5415b190 con 0x7ffb540b2460 2024-02-19T06:58:05.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.490+0000 7ffb4be00640 1 -- 172.21.15.46:0/226251743 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb44058830 con 0x7ffb540b2460 2024-02-19T06:58:05.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-02-19T06:58:05.493 INFO:teuthology.orchestra.run.smithi046.stdout:64424509446 2024-02-19T06:58:05.493 DEBUG:teuthology.parallel:result is None 2024-02-19T06:58:05.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.492+0000 7ffb5a200640 1 -- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ffb3006b810 msgr2=0x7ffb3006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.492+0000 7ffb5a200640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ffb3006b810 0x7ffb3006dcd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffb540cb580 tx=0x7ffb3c009530 comp rx=0 tx=0).stop 2024-02-19T06:58:05.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.492+0000 7ffb5a200640 1 -- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb540b2460 msgr2=0x7ffb5415e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.492+0000 7ffb5a200640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb540b2460 0x7ffb5415e890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400c450 tx=0x7ffb4400c910 comp rx=0 tx=0).stop 2024-02-19T06:58:05.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.493+0000 7ffb5a200640 1 -- 172.21.15.46:0/226251743 shutdown_connections 2024-02-19T06:58:05.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.493+0000 7ffb5a200640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ffb3006b810 0x7ffb3006dcd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.493+0000 7ffb5a200640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb5416ac80 0x7ffb540cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.493+0000 7ffb5a200640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb540b2f30 0x7ffb54163b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.493+0000 7ffb5a200640 1 --2- 172.21.15.46:0/226251743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb540b2460 0x7ffb5415e890 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.493+0000 7ffb5a200640 1 -- 172.21.15.46:0/226251743 >> 172.21.15.46:0/226251743 conn(0x7ffb54066f70 msgr2=0x7ffb540b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.493+0000 7ffb5a200640 1 -- 172.21.15.46:0/226251743 shutdown_connections 2024-02-19T06:58:05.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.493+0000 7ffb5a200640 1 -- 172.21.15.46:0/226251743 wait complete. 2024-02-19T06:58:05.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-02-19T06:58:05.499 DEBUG:teuthology.parallel:result is None 2024-02-19T06:58:05.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2024-02-19T06:58:05.508 DEBUG:teuthology.parallel:result is None 2024-02-19T06:58:05.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2024-02-19T06:58:05.514 DEBUG:teuthology.parallel:result is None 2024-02-19T06:58:05.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.516+0000 7fc1c0400640 1 -- 172.21.15.46:0/2827145451 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc1b8159260 con 0x7fc1b8151be0 2024-02-19T06:58:05.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.516+0000 7fc1b5600640 1 -- 172.21.15.46:0/2827145451 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1b00798b0 con 0x7fc1b8151be0 2024-02-19T06:58:05.519 INFO:teuthology.orchestra.run.smithi046.stdout:60129542150 2024-02-19T06:58:05.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.519+0000 7fc1c0400640 1 -- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc19806b8e0 msgr2=0x7fc19806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.519+0000 7fc1c0400640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc19806b8e0 0x7fc19806dda0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac001eb0 tx=0x7fc1ac009040 comp rx=0 tx=0).stop 2024-02-19T06:58:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.519+0000 7fc1c0400640 1 -- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1b8151be0 msgr2=0x7fc1b8158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.519+0000 7fc1c0400640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1b8151be0 0x7fc1b8158b40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0008fd0 tx=0x7fc1b0001650 comp rx=0 tx=0).stop 2024-02-19T06:58:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.519+0000 7fc1c0400640 1 -- 172.21.15.46:0/2827145451 shutdown_connections 2024-02-19T06:58:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.519+0000 7fc1c0400640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc19806b8e0 0x7fc19806dda0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.519+0000 7fc1c0400640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1b8151be0 0x7fc1b8158b40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.519+0000 7fc1c0400640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b8151690 0x7fc1b815b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.519+0000 7fc1c0400640 1 --2- 172.21.15.46:0/2827145451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a0005180 0x7fc1b815aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.519+0000 7fc1c0400640 1 -- 172.21.15.46:0/2827145451 >> 172.21.15.46:0/2827145451 conn(0x7fc1b806be20 msgr2=0x7fc1b80b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.519+0000 7fc1c0400640 1 -- 172.21.15.46:0/2827145451 shutdown_connections 2024-02-19T06:58:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.519+0000 7fc1c0400640 1 -- 172.21.15.46:0/2827145451 wait complete. 2024-02-19T06:58:05.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-02-19T06:58:05.538 DEBUG:teuthology.parallel:result is None 2024-02-19T06:58:05.538 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-19T06:58:05.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-19T06:58:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.793+0000 7f7f1f200640 1 Processor -- start 2024-02-19T06:58:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.793+0000 7f7f1f200640 1 -- start start 2024-02-19T06:58:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.794+0000 7f7f1f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f20162230 0x7f7f200cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.794+0000 7f7f1f200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7f2015dbd0 0x7f7f200d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.794+0000 7f7f1f200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f200cf770 con 0x7f7f2015d7f0 2024-02-19T06:58:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.794+0000 7f7f1f200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f200d28d0 con 0x7f7f2015dbd0 2024-02-19T06:58:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.794+0000 7f7f1f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200d1400 con 0x7f7f20162230 2024-02-19T06:58:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.794+0000 7f7f1de00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7f2015d7f0 0x7f7f200d21c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59962/0 (socket says 172.21.15.46:59962) 2024-02-19T06:58:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.794+0000 7f7f1e800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7f2015dbd0 0x7f7f200d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.794+0000 7f7f1de00640 1 -- 172.21.15.46:0/3331304800 learned_addr learned my addr 172.21.15.46:0/3331304800 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.795+0000 7f7f1e800640 1 -- 172.21.15.46:0/3331304800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f20162230 msgr2=0x7f7f200cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.795+0000 7f7f1e800640 1 --2- 172.21.15.46:0/3331304800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f20162230 0x7f7f200cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.795+0000 7f7f1e800640 1 -- 172.21.15.46:0/3331304800 >> v1:172.21.15.46:6789/0 conn(0x7f7f2015d7f0 legacy=0x7f7f200d21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.795+0000 7f7f1e800640 1 -- 172.21.15.46:0/3331304800 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f200d16e0 con 0x7f7f2015dbd0 2024-02-19T06:58:05.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.796+0000 7f7f1e800640 1 --2- 172.21.15.46:0/3331304800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f2015dbd0 0x7f7f200d34f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7f180097a0 tx=0x7f7f1802b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a676b782de4277b server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.796+0000 7f7f1ca00640 1 -- 172.21.15.46:0/3331304800 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18030710 con 0x7f7f2015dbd0 2024-02-19T06:58:05.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.796+0000 7f7f1ca00640 1 -- 172.21.15.46:0/3331304800 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1802e050 con 0x7f7f2015dbd0 2024-02-19T06:58:05.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.796+0000 7f7f1ca00640 1 -- 172.21.15.46:0/3331304800 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18030a90 con 0x7f7f2015dbd0 2024-02-19T06:58:05.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.796+0000 7f7f1f200640 1 -- 172.21.15.46:0/3331304800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f2015dbd0 msgr2=0x7f7f200d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.797+0000 7f7f1f200640 1 --2- 172.21.15.46:0/3331304800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f2015dbd0 0x7f7f200d34f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7f180097a0 tx=0x7f7f1802b660 comp rx=0 tx=0).stop 2024-02-19T06:58:05.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.797+0000 7f7f1f200640 1 -- 172.21.15.46:0/3331304800 shutdown_connections 2024-02-19T06:58:05.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.797+0000 7f7f1f200640 1 --2- 172.21.15.46:0/3331304800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f2015dbd0 0x7f7f200d34f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.797+0000 7f7f1f200640 1 --2- 172.21.15.46:0/3331304800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f20162230 0x7f7f200cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.797+0000 7f7f1f200640 1 -- 172.21.15.46:0/3331304800 >> 172.21.15.46:0/3331304800 conn(0x7f7f2009ca70 msgr2=0x7f7f2008afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:05.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.797+0000 7f7f1f200640 1 -- 172.21.15.46:0/3331304800 shutdown_connections 2024-02-19T06:58:05.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.797+0000 7f7f1f200640 1 -- 172.21.15.46:0/3331304800 wait complete. 2024-02-19T06:58:05.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.798+0000 7f7f1f200640 1 Processor -- start 2024-02-19T06:58:05.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.799+0000 7f7f1f200640 1 -- start start 2024-02-19T06:58:05.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.799+0000 7f7f1f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2015d7f0 0x7f7f200c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.799+0000 7f7f1f200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f2015dbd0 0x7f7f200b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.799+0000 7f7f1f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f20162230 0x7f7f200c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.799+0000 7f7f1f200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f201f6eb0 con 0x7f7f2015dbd0 2024-02-19T06:58:05.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.799+0000 7f7f1f200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f201f7190 con 0x7f7f2015d7f0 2024-02-19T06:58:05.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.799+0000 7f7f1f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f201f7470 con 0x7f7f20162230 2024-02-19T06:58:05.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.800+0000 7f7f1d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f2015dbd0 0x7f7f200b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.800+0000 7f7f1d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f2015dbd0 0x7f7f200b2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41708/0 (socket says 172.21.15.46:41708) 2024-02-19T06:58:05.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.800+0000 7f7f1d400640 1 -- 172.21.15.46:0/887897068 learned_addr learned my addr 172.21.15.46:0/887897068 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:05.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.800+0000 7f7f1de00640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2015d7f0 0x7f7f200c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.800+0000 7f7f1e800640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f20162230 0x7f7f200c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.800+0000 7f7f1d400640 1 -- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f20162230 msgr2=0x7f7f200c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.800+0000 7f7f1d400640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f20162230 0x7f7f200c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.800+0000 7f7f1d400640 1 -- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2015d7f0 msgr2=0x7f7f200c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:05.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.800+0000 7f7f1d400640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2015d7f0 0x7f7f200c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:05.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.800+0000 7f7f1d400640 1 -- 172.21.15.46:0/887897068 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f18009400 con 0x7f7f2015dbd0 2024-02-19T06:58:05.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.801+0000 7f7f1d400640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f2015dbd0 0x7f7f200b2940 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000ba50 tx=0x7f7f1000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.801+0000 7f7f16000640 1 -- 172.21.15.46:0/887897068 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000cbe0 con 0x7f7f2015dbd0 2024-02-19T06:58:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.801+0000 7f7f16000640 1 -- 172.21.15.46:0/887897068 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1000cd60 con 0x7f7f2015dbd0 2024-02-19T06:58:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.801+0000 7f7f16000640 1 -- 172.21.15.46:0/887897068 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10014680 con 0x7f7f2015dbd0 2024-02-19T06:58:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.801+0000 7f7f1f200640 1 -- 172.21.15.46:0/887897068 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f201f7750 con 0x7f7f2015dbd0 2024-02-19T06:58:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.801+0000 7f7f1f200640 1 -- 172.21.15.46:0/887897068 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f201f6b40 con 0x7f7f2015dbd0 2024-02-19T06:58:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.802+0000 7f7f1f200640 1 -- 172.21.15.46:0/887897068 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2004eee0 con 0x7f7f2015dbd0 2024-02-19T06:58:05.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.803+0000 7f7f16000640 1 -- 172.21.15.46:0/887897068 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7f1001d3b0 con 0x7f7f2015dbd0 2024-02-19T06:58:05.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.805+0000 7f7f16000640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7efc06b810 0x7f7efc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:05.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.805+0000 7f7f16000640 1 -- 172.21.15.46:0/887897068 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f1008a1a0 con 0x7f7f2015dbd0 2024-02-19T06:58:05.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.805+0000 7f7f1de00640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7efc06b810 0x7f7efc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:05.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.806+0000 7f7f1de00640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7efc06b810 0x7f7efc06dcd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f08000f60 tx=0x7f7f08007c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:05.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.810+0000 7f7f16000640 1 -- 172.21.15.46:0/887897068 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7f10054bb0 con 0x7f7f2015dbd0 2024-02-19T06:58:05.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:05.996+0000 7f7f1f200640 1 -- 172.21.15.46:0/887897068 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f200d1ca0 con 0x7f7efc06b810 2024-02-19T06:58:06.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.017+0000 7f7f16000640 1 -- 172.21.15.46:0/887897068 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264374 (secure 0 0 0) 0x7f7f08007340 con 0x7f7efc06b810 2024-02-19T06:58:06.023 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:06.024 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-02-19T06:58:06.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.022+0000 7f7f1f200640 1 -- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7efc06b810 msgr2=0x7f7efc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:06.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.023+0000 7f7f1f200640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7efc06b810 0x7f7efc06dcd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f08000f60 tx=0x7f7f08007c60 comp rx=0 tx=0).stop 2024-02-19T06:58:06.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.023+0000 7f7f1f200640 1 -- 172.21.15.46:0/887897068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f2015dbd0 msgr2=0x7f7f200b2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:06.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.023+0000 7f7f1f200640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f2015dbd0 0x7f7f200b2940 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000ba50 tx=0x7f7f1000bf10 comp rx=0 tx=0).stop 2024-02-19T06:58:06.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.023+0000 7f7f1f200640 1 -- 172.21.15.46:0/887897068 shutdown_connections 2024-02-19T06:58:06.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.023+0000 7f7f1f200640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7efc06b810 0x7f7efc06dcd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.023+0000 7f7f1f200640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f20162230 0x7f7f200c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.023+0000 7f7f1f200640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f2015dbd0 0x7f7f200b2940 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.023+0000 7f7f1f200640 1 --2- 172.21.15.46:0/887897068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2015d7f0 0x7f7f200c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.023+0000 7f7f1f200640 1 -- 172.21.15.46:0/887897068 >> 172.21.15.46:0/887897068 conn(0x7f7f2009ca70 msgr2=0x7f7f200d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:06.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.023+0000 7f7f1f200640 1 -- 172.21.15.46:0/887897068 shutdown_connections 2024-02-19T06:58:06.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.023+0000 7f7f1f200640 1 -- 172.21.15.46:0/887897068 wait complete. 2024-02-19T06:58:06.043 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-02-19T06:58:05.671340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235768,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738952,"statfs":{"total":773094113280,"available":772852686848,"internally_reserved":0,"allocated":3022848,"data_stored":1810564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.840264"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843569+0000","last_change":"2024-02-19T06:57:55.881582+0000","last_active":"2024-02-19T06:57:56.843569+0000","last_peered":"2024-02-19T06:57:56.843569+0000","last_clean":"2024-02-19T06:57:56.843569+0000","last_became_active":"2024-02-19T06:57:55.880789+0000","last_became_peered":"2024-02-19T06:57:55.880789+0000","last_unstale":"2024-02-19T06:57:56.843569+0000","last_undegraded":"2024-02-19T06:57:56.843569+0000","last_fullsized":"2024-02-19T06:57:56.843569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:24:57.181299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838514+0000","last_change":"2024-02-19T06:57:55.875781+0000","last_active":"2024-02-19T06:57:56.838514+0000","last_peered":"2024-02-19T06:57:56.838514+0000","last_clean":"2024-02-19T06:57:56.838514+0000","last_became_active":"2024-02-19T06:57:55.875457+0000","last_became_peered":"2024-02-19T06:57:55.875457+0000","last_unstale":"2024-02-19T06:57:56.838514+0000","last_undegraded":"2024-02-19T06:57:56.838514+0000","last_fullsized":"2024-02-19T06:57:56.838514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296432+0000","last_change":"2024-02-19T06:57:55.879795+0000","last_active":"2024-02-19T06:57:57.296432+0000","last_peered":"2024-02-19T06:57:57.296432+0000","last_clean":"2024-02-19T06:57:57.296432+0000","last_became_active":"2024-02-19T06:57:55.879476+0000","last_became_peered":"2024-02-19T06:57:55.879476+0000","last_unstale":"2024-02-19T06:57:57.296432+0000","last_undegraded":"2024-02-19T06:57:57.296432+0000","last_fullsized":"2024-02-19T06:57:57.296432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:26:02.934116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297501+0000","last_change":"2024-02-19T06:57:55.863246+0000","last_active":"2024-02-19T06:57:57.297501+0000","last_peered":"2024-02-19T06:57:57.297501+0000","last_clean":"2024-02-19T06:57:57.297501+0000","last_became_active":"2024-02-19T06:57:55.862759+0000","last_became_peered":"2024-02-19T06:57:55.862759+0000","last_unstale":"2024-02-19T06:57:57.297501+0000","last_undegraded":"2024-02-19T06:57:57.297501+0000","last_fullsized":"2024-02-19T06:57:57.297501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:02:01.947104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841155+0000","last_change":"2024-02-19T06:57:55.857896+0000","last_active":"2024-02-19T06:57:56.841155+0000","last_peered":"2024-02-19T06:57:56.841155+0000","last_clean":"2024-02-19T06:57:56.841155+0000","last_became_active":"2024-02-19T06:57:55.857608+0000","last_became_peered":"2024-02-19T06:57:55.857608+0000","last_unstale":"2024-02-19T06:57:56.841155+0000","last_undegraded":"2024-02-19T06:57:56.841155+0000","last_fullsized":"2024-02-19T06:57:56.841155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:24:14.106586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296899+0000","last_change":"2024-02-19T06:57:55.867450+0000","last_active":"2024-02-19T06:57:57.296899+0000","last_peered":"2024-02-19T06:57:57.296899+0000","last_clean":"2024-02-19T06:57:57.296899+0000","last_became_active":"2024-02-19T06:57:55.867181+0000","last_became_peered":"2024-02-19T06:57:55.867181+0000","last_unstale":"2024-02-19T06:57:57.296899+0000","last_undegraded":"2024-02-19T06:57:57.296899+0000","last_fullsized":"2024-02-19T06:57:57.296899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.840561+0000","last_change":"2024-02-19T06:57:55.870845+0000","last_active":"2024-02-19T06:57:56.840561+0000","last_peered":"2024-02-19T06:57:56.840561+0000","last_clean":"2024-02-19T06:57:56.840561+0000","last_became_active":"2024-02-19T06:57:55.870532+0000","last_became_peered":"2024-02-19T06:57:55.870532+0000","last_unstale":"2024-02-19T06:57:56.840561+0000","last_undegraded":"2024-02-19T06:57:56.840561+0000","last_fullsized":"2024-02-19T06:57:56.840561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:32:16.779230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297147+0000","last_change":"2024-02-19T06:57:55.869272+0000","last_active":"2024-02-19T06:57:57.297147+0000","last_peered":"2024-02-19T06:57:57.297147+0000","last_clean":"2024-02-19T06:57:57.297147+0000","last_became_active":"2024-02-19T06:57:55.867903+0000","last_became_peered":"2024-02-19T06:57:55.867903+0000","last_unstale":"2024-02-19T06:57:57.297147+0000","last_undegraded":"2024-02-19T06:57:57.297147+0000","last_fullsized":"2024-02-19T06:57:57.297147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:33:37.227028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843541+0000","last_change":"2024-02-19T06:57:55.869047+0000","last_active":"2024-02-19T06:57:56.843541+0000","last_peered":"2024-02-19T06:57:56.843541+0000","last_clean":"2024-02-19T06:57:56.843541+0000","last_became_active":"2024-02-19T06:57:55.868781+0000","last_became_peered":"2024-02-19T06:57:55.868781+0000","last_unstale":"2024-02-19T06:57:56.843541+0000","last_undegraded":"2024-02-19T06:57:56.843541+0000","last_fullsized":"2024-02-19T06:57:56.843541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:47:51.163933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299489+0000","last_change":"2024-02-19T06:57:55.878539+0000","last_active":"2024-02-19T06:57:57.299489+0000","last_peered":"2024-02-19T06:57:57.299489+0000","last_clean":"2024-02-19T06:57:57.299489+0000","last_became_active":"2024-02-19T06:57:55.877859+0000","last_became_peered":"2024-02-19T06:57:55.877859+0000","last_unstale":"2024-02-19T06:57:57.299489+0000","last_undegraded":"2024-02-19T06:57:57.299489+0000","last_fullsized":"2024-02-19T06:57:57.299489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299028+0000","last_change":"2024-02-19T06:57:55.876129+0000","last_active":"2024-02-19T06:57:57.299028+0000","last_peered":"2024-02-19T06:57:57.299028+0000","last_clean":"2024-02-19T06:57:57.299028+0000","last_became_active":"2024-02-19T06:57:55.875481+0000","last_became_peered":"2024-02-19T06:57:55.875481+0000","last_unstale":"2024-02-19T06:57:57.299028+0000","last_undegraded":"2024-02-19T06:57:57.299028+0000","last_fullsized":"2024-02-19T06:57:57.299028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842411+0000","last_change":"2024-02-19T06:57:55.879728+0000","last_active":"2024-02-19T06:57:56.842411+0000","last_peered":"2024-02-19T06:57:56.842411+0000","last_clean":"2024-02-19T06:57:56.842411+0000","last_became_active":"2024-02-19T06:57:55.878922+0000","last_became_peered":"2024-02-19T06:57:55.878922+0000","last_unstale":"2024-02-19T06:57:56.842411+0000","last_undegraded":"2024-02-19T06:57:56.842411+0000","last_fullsized":"2024-02-19T06:57:56.842411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:42:35.923860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298289+0000","last_change":"2024-02-19T06:57:55.863333+0000","last_active":"2024-02-19T06:57:57.298289+0000","last_peered":"2024-02-19T06:57:57.298289+0000","last_clean":"2024-02-19T06:57:57.298289+0000","last_became_active":"2024-02-19T06:57:55.863137+0000","last_became_peered":"2024-02-19T06:57:55.863137+0000","last_unstale":"2024-02-19T06:57:57.298289+0000","last_undegraded":"2024-02-19T06:57:57.298289+0000","last_fullsized":"2024-02-19T06:57:57.298289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:16:45.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296260+0000","last_change":"2024-02-19T06:57:55.870376+0000","last_active":"2024-02-19T06:57:57.296260+0000","last_peered":"2024-02-19T06:57:57.296260+0000","last_clean":"2024-02-19T06:57:57.296260+0000","last_became_active":"2024-02-19T06:57:55.865453+0000","last_became_peered":"2024-02-19T06:57:55.865453+0000","last_unstale":"2024-02-19T06:57:57.296260+0000","last_undegraded":"2024-02-19T06:57:57.296260+0000","last_fullsized":"2024-02-19T06:57:57.296260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:10:54.622454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838056+0000","last_change":"2024-02-19T06:57:55.866944+0000","last_active":"2024-02-19T06:57:56.838056+0000","last_peered":"2024-02-19T06:57:56.838056+0000","last_clean":"2024-02-19T06:57:56.838056+0000","last_became_active":"2024-02-19T06:57:55.866168+0000","last_became_peered":"2024-02-19T06:57:55.866168+0000","last_unstale":"2024-02-19T06:57:56.838056+0000","last_undegraded":"2024-02-19T06:57:56.838056+0000","last_fullsized":"2024-02-19T06:57:56.838056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:33:37.227028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296615+0000","last_change":"2024-02-19T06:57:55.866999+0000","last_active":"2024-02-19T06:57:57.296615+0000","last_peered":"2024-02-19T06:57:57.296615+0000","last_clean":"2024-02-19T06:57:57.296615+0000","last_became_active":"2024-02-19T06:57:55.866721+0000","last_became_peered":"2024-02-19T06:57:55.866721+0000","last_unstale":"2024-02-19T06:57:57.296615+0000","last_undegraded":"2024-02-19T06:57:57.296615+0000","last_fullsized":"2024-02-19T06:57:57.296615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299188+0000","last_change":"2024-02-19T06:57:55.855201+0000","last_active":"2024-02-19T06:57:57.299188+0000","last_peered":"2024-02-19T06:57:57.299188+0000","last_clean":"2024-02-19T06:57:57.299188+0000","last_became_active":"2024-02-19T06:57:55.854955+0000","last_became_peered":"2024-02-19T06:57:55.854955+0000","last_unstale":"2024-02-19T06:57:57.299188+0000","last_undegraded":"2024-02-19T06:57:57.299188+0000","last_fullsized":"2024-02-19T06:57:57.299188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:44:06.998192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298443+0000","last_change":"2024-02-19T06:57:55.876606+0000","last_active":"2024-02-19T06:57:57.298443+0000","last_peered":"2024-02-19T06:57:57.298443+0000","last_clean":"2024-02-19T06:57:57.298443+0000","last_became_active":"2024-02-19T06:57:55.876334+0000","last_became_peered":"2024-02-19T06:57:55.876334+0000","last_unstale":"2024-02-19T06:57:57.298443+0000","last_undegraded":"2024-02-19T06:57:57.298443+0000","last_fullsized":"2024-02-19T06:57:57.298443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:34:02.546590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843210+0000","last_change":"2024-02-19T06:57:55.861233+0000","last_active":"2024-02-19T06:57:56.843210+0000","last_peered":"2024-02-19T06:57:56.843210+0000","last_clean":"2024-02-19T06:57:56.843210+0000","last_became_active":"2024-02-19T06:57:55.860849+0000","last_became_peered":"2024-02-19T06:57:55.860849+0000","last_unstale":"2024-02-19T06:57:56.843210+0000","last_undegraded":"2024-02-19T06:57:56.843210+0000","last_fullsized":"2024-02-19T06:57:56.843210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:58:02.081784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298883+0000","last_change":"2024-02-19T06:57:55.879542+0000","last_active":"2024-02-19T06:57:57.298883+0000","last_peered":"2024-02-19T06:57:57.298883+0000","last_clean":"2024-02-19T06:57:57.298883+0000","last_became_active":"2024-02-19T06:57:55.876325+0000","last_became_peered":"2024-02-19T06:57:55.876325+0000","last_unstale":"2024-02-19T06:57:57.298883+0000","last_undegraded":"2024-02-19T06:57:57.298883+0000","last_fullsized":"2024-02-19T06:57:57.298883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:19:13.712235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296072+0000","last_change":"2024-02-19T06:57:55.882287+0000","last_active":"2024-02-19T06:57:57.296072+0000","last_peered":"2024-02-19T06:57:57.296072+0000","last_clean":"2024-02-19T06:57:57.296072+0000","last_became_active":"2024-02-19T06:57:55.881847+0000","last_became_peered":"2024-02-19T06:57:55.881847+0000","last_unstale":"2024-02-19T06:57:57.296072+0000","last_undegraded":"2024-02-19T06:57:57.296072+0000","last_fullsized":"2024-02-19T06:57:57.296072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:26:43.190851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297087+0000","last_change":"2024-02-19T06:57:55.855047+0000","last_active":"2024-02-19T06:57:57.297087+0000","last_peered":"2024-02-19T06:57:57.297087+0000","last_clean":"2024-02-19T06:57:57.297087+0000","last_became_active":"2024-02-19T06:57:55.854699+0000","last_became_peered":"2024-02-19T06:57:55.854699+0000","last_unstale":"2024-02-19T06:57:57.297087+0000","last_undegraded":"2024-02-19T06:57:57.297087+0000","last_fullsized":"2024-02-19T06:57:57.297087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:16:45.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297920+0000","last_change":"2024-02-19T06:57:55.869732+0000","last_active":"2024-02-19T06:57:57.297920+0000","last_peered":"2024-02-19T06:57:57.297920+0000","last_clean":"2024-02-19T06:57:57.297920+0000","last_became_active":"2024-02-19T06:57:55.869159+0000","last_became_peered":"2024-02-19T06:57:55.869159+0000","last_unstale":"2024-02-19T06:57:57.297920+0000","last_undegraded":"2024-02-19T06:57:57.297920+0000","last_fullsized":"2024-02-19T06:57:57.297920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296891+0000","last_change":"2024-02-19T06:57:55.863170+0000","last_active":"2024-02-19T06:57:57.296891+0000","last_peered":"2024-02-19T06:57:57.296891+0000","last_clean":"2024-02-19T06:57:57.296891+0000","last_became_active":"2024-02-19T06:57:55.862285+0000","last_became_peered":"2024-02-19T06:57:55.862285+0000","last_unstale":"2024-02-19T06:57:57.296891+0000","last_undegraded":"2024-02-19T06:57:57.296891+0000","last_fullsized":"2024-02-19T06:57:57.296891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299100+0000","last_change":"2024-02-19T06:57:55.869627+0000","last_active":"2024-02-19T06:57:57.299100+0000","last_peered":"2024-02-19T06:57:57.299100+0000","last_clean":"2024-02-19T06:57:57.299100+0000","last_became_active":"2024-02-19T06:57:55.869305+0000","last_became_peered":"2024-02-19T06:57:55.869305+0000","last_unstale":"2024-02-19T06:57:57.299100+0000","last_undegraded":"2024-02-19T06:57:57.299100+0000","last_fullsized":"2024-02-19T06:57:57.299100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:02:01.947104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299832+0000","last_change":"2024-02-19T06:57:55.872539+0000","last_active":"2024-02-19T06:57:57.299832+0000","last_peered":"2024-02-19T06:57:57.299832+0000","last_clean":"2024-02-19T06:57:57.299832+0000","last_became_active":"2024-02-19T06:57:55.871775+0000","last_became_peered":"2024-02-19T06:57:55.871775+0000","last_unstale":"2024-02-19T06:57:57.299832+0000","last_undegraded":"2024-02-19T06:57:57.299832+0000","last_fullsized":"2024-02-19T06:57:57.299832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838731+0000","last_change":"2024-02-19T06:57:55.864536+0000","last_active":"2024-02-19T06:57:56.838731+0000","last_peered":"2024-02-19T06:57:56.838731+0000","last_clean":"2024-02-19T06:57:56.838731+0000","last_became_active":"2024-02-19T06:57:55.864079+0000","last_became_peered":"2024-02-19T06:57:55.864079+0000","last_unstale":"2024-02-19T06:57:56.838731+0000","last_undegraded":"2024-02-19T06:57:56.838731+0000","last_fullsized":"2024-02-19T06:57:56.838731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296866+0000","last_change":"2024-02-19T06:57:55.868409+0000","last_active":"2024-02-19T06:57:57.296866+0000","last_peered":"2024-02-19T06:57:57.296866+0000","last_clean":"2024-02-19T06:57:57.296866+0000","last_became_active":"2024-02-19T06:57:55.868136+0000","last_became_peered":"2024-02-19T06:57:55.868136+0000","last_unstale":"2024-02-19T06:57:57.296866+0000","last_undegraded":"2024-02-19T06:57:57.296866+0000","last_fullsized":"2024-02-19T06:57:57.296866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:36:55.635583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296486+0000","last_change":"2024-02-19T06:57:55.883330+0000","last_active":"2024-02-19T06:57:57.296486+0000","last_peered":"2024-02-19T06:57:57.296486+0000","last_clean":"2024-02-19T06:57:57.296486+0000","last_became_active":"2024-02-19T06:57:55.881827+0000","last_became_peered":"2024-02-19T06:57:55.881827+0000","last_unstale":"2024-02-19T06:57:57.296486+0000","last_undegraded":"2024-02-19T06:57:57.296486+0000","last_fullsized":"2024-02-19T06:57:57.296486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:30:53.058177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297284+0000","last_change":"2024-02-19T06:57:55.869285+0000","last_active":"2024-02-19T06:57:57.297284+0000","last_peered":"2024-02-19T06:57:57.297284+0000","last_clean":"2024-02-19T06:57:57.297284+0000","last_became_active":"2024-02-19T06:57:55.868584+0000","last_became_peered":"2024-02-19T06:57:55.868584+0000","last_unstale":"2024-02-19T06:57:57.297284+0000","last_undegraded":"2024-02-19T06:57:57.297284+0000","last_fullsized":"2024-02-19T06:57:57.297284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:19:34.393218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297058+0000","last_change":"2024-02-19T06:57:55.859224+0000","last_active":"2024-02-19T06:57:57.297058+0000","last_peered":"2024-02-19T06:57:57.297058+0000","last_clean":"2024-02-19T06:57:57.297058+0000","last_became_active":"2024-02-19T06:57:55.858917+0000","last_became_peered":"2024-02-19T06:57:55.858917+0000","last_unstale":"2024-02-19T06:57:57.297058+0000","last_undegraded":"2024-02-19T06:57:57.297058+0000","last_fullsized":"2024-02-19T06:57:57.297058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T06:59:02.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297505+0000","last_change":"2024-02-19T06:57:55.874779+0000","last_active":"2024-02-19T06:57:57.297505+0000","last_peered":"2024-02-19T06:57:57.297505+0000","last_clean":"2024-02-19T06:57:57.297505+0000","last_became_active":"2024-02-19T06:57:55.868999+0000","last_became_peered":"2024-02-19T06:57:55.868999+0000","last_unstale":"2024-02-19T06:57:57.297505+0000","last_undegraded":"2024-02-19T06:57:57.297505+0000","last_fullsized":"2024-02-19T06:57:57.297505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:36:55.635583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.840892+0000","last_change":"2024-02-19T06:57:55.848789+0000","last_active":"2024-02-19T06:57:56.840892+0000","last_peered":"2024-02-19T06:57:56.840892+0000","last_clean":"2024-02-19T06:57:56.840892+0000","last_became_active":"2024-02-19T06:57:55.848272+0000","last_became_peered":"2024-02-19T06:57:55.848272+0000","last_unstale":"2024-02-19T06:57:56.840892+0000","last_undegraded":"2024-02-19T06:57:56.840892+0000","last_fullsized":"2024-02-19T06:57:56.840892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:31:25.479236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298851+0000","last_change":"2024-02-19T06:57:54.848533+0000","last_active":"2024-02-19T06:57:57.298851+0000","last_peered":"2024-02-19T06:57:57.298851+0000","last_clean":"2024-02-19T06:57:57.298851+0000","last_became_active":"2024-02-19T06:57:54.847588+0000","last_became_peered":"2024-02-19T06:57:54.847588+0000","last_unstale":"2024-02-19T06:57:57.298851+0000","last_undegraded":"2024-02-19T06:57:57.298851+0000","last_fullsized":"2024-02-19T06:57:57.298851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:48:35.345147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296871+0000","last_change":"2024-02-19T06:57:55.873153+0000","last_active":"2024-02-19T06:57:57.296871+0000","last_peered":"2024-02-19T06:57:57.296871+0000","last_clean":"2024-02-19T06:57:57.296871+0000","last_became_active":"2024-02-19T06:57:55.872845+0000","last_became_peered":"2024-02-19T06:57:55.872845+0000","last_unstale":"2024-02-19T06:57:57.296871+0000","last_undegraded":"2024-02-19T06:57:57.296871+0000","last_fullsized":"2024-02-19T06:57:57.296871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:38:12.022068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298413+0000","last_change":"2024-02-19T06:57:54.845309+0000","last_active":"2024-02-19T06:57:57.298413+0000","last_peered":"2024-02-19T06:57:57.298413+0000","last_clean":"2024-02-19T06:57:57.298413+0000","last_became_active":"2024-02-19T06:57:54.845046+0000","last_became_peered":"2024-02-19T06:57:54.845046+0000","last_unstale":"2024-02-19T06:57:57.298413+0000","last_undegraded":"2024-02-19T06:57:57.298413+0000","last_fullsized":"2024-02-19T06:57:57.298413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:04:53.869596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298172+0000","last_change":"2024-02-19T06:57:54.853227+0000","last_active":"2024-02-19T06:57:57.298172+0000","last_peered":"2024-02-19T06:57:57.298172+0000","last_clean":"2024-02-19T06:57:57.298172+0000","last_became_active":"2024-02-19T06:57:54.852992+0000","last_became_peered":"2024-02-19T06:57:54.852992+0000","last_unstale":"2024-02-19T06:57:57.298172+0000","last_undegraded":"2024-02-19T06:57:57.298172+0000","last_fullsized":"2024-02-19T06:57:57.298172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:28:51.362957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297490+0000","last_change":"2024-02-19T06:57:55.867102+0000","last_active":"2024-02-19T06:57:57.297490+0000","last_peered":"2024-02-19T06:57:57.297490+0000","last_clean":"2024-02-19T06:57:57.297490+0000","last_became_active":"2024-02-19T06:57:55.866831+0000","last_became_peered":"2024-02-19T06:57:55.866831+0000","last_unstale":"2024-02-19T06:57:57.297490+0000","last_undegraded":"2024-02-19T06:57:57.297490+0000","last_fullsized":"2024-02-19T06:57:57.297490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298008+0000","last_change":"2024-02-19T06:57:54.836938+0000","last_active":"2024-02-19T06:57:57.298008+0000","last_peered":"2024-02-19T06:57:57.298008+0000","last_clean":"2024-02-19T06:57:57.298008+0000","last_became_active":"2024-02-19T06:57:54.836538+0000","last_became_peered":"2024-02-19T06:57:54.836538+0000","last_unstale":"2024-02-19T06:57:57.298008+0000","last_undegraded":"2024-02-19T06:57:57.298008+0000","last_fullsized":"2024-02-19T06:57:57.298008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:44:55.409988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838441+0000","last_change":"2024-02-19T06:57:55.857240+0000","last_active":"2024-02-19T06:57:56.838441+0000","last_peered":"2024-02-19T06:57:56.838441+0000","last_clean":"2024-02-19T06:57:56.838441+0000","last_became_active":"2024-02-19T06:57:55.856505+0000","last_became_peered":"2024-02-19T06:57:55.856505+0000","last_unstale":"2024-02-19T06:57:56.838441+0000","last_undegraded":"2024-02-19T06:57:56.838441+0000","last_fullsized":"2024-02-19T06:57:56.838441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299283+0000","last_change":"2024-02-19T06:57:54.849649+0000","last_active":"2024-02-19T06:57:57.299283+0000","last_peered":"2024-02-19T06:57:57.299283+0000","last_clean":"2024-02-19T06:57:57.299283+0000","last_became_active":"2024-02-19T06:57:54.848543+0000","last_became_peered":"2024-02-19T06:57:54.848543+0000","last_unstale":"2024-02-19T06:57:57.299283+0000","last_undegraded":"2024-02-19T06:57:57.299283+0000","last_fullsized":"2024-02-19T06:57:57.299283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:59:11.619972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299748+0000","last_change":"2024-02-19T06:57:55.856202+0000","last_active":"2024-02-19T06:57:57.299748+0000","last_peered":"2024-02-19T06:57:57.299748+0000","last_clean":"2024-02-19T06:57:57.299748+0000","last_became_active":"2024-02-19T06:57:55.855896+0000","last_became_peered":"2024-02-19T06:57:55.855896+0000","last_unstale":"2024-02-19T06:57:57.299748+0000","last_undegraded":"2024-02-19T06:57:57.299748+0000","last_fullsized":"2024-02-19T06:57:57.299748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:58:48.198207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298578+0000","last_change":"2024-02-19T06:57:54.849568+0000","last_active":"2024-02-19T06:57:57.298578+0000","last_peered":"2024-02-19T06:57:57.298578+0000","last_clean":"2024-02-19T06:57:57.298578+0000","last_became_active":"2024-02-19T06:57:54.849259+0000","last_became_peered":"2024-02-19T06:57:54.849259+0000","last_unstale":"2024-02-19T06:57:57.298578+0000","last_undegraded":"2024-02-19T06:57:57.298578+0000","last_fullsized":"2024-02-19T06:57:57.298578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:59:11.619972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296283+0000","last_change":"2024-02-19T06:57:55.879987+0000","last_active":"2024-02-19T06:57:57.296283+0000","last_peered":"2024-02-19T06:57:57.296283+0000","last_clean":"2024-02-19T06:57:57.296283+0000","last_became_active":"2024-02-19T06:57:55.874213+0000","last_became_peered":"2024-02-19T06:57:55.874213+0000","last_unstale":"2024-02-19T06:57:57.296283+0000","last_undegraded":"2024-02-19T06:57:57.296283+0000","last_fullsized":"2024-02-19T06:57:57.296283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:13:00.717755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838753+0000","last_change":"2024-02-19T06:57:54.842446+0000","last_active":"2024-02-19T06:57:56.838753+0000","last_peered":"2024-02-19T06:57:56.838753+0000","last_clean":"2024-02-19T06:57:56.838753+0000","last_became_active":"2024-02-19T06:57:54.842159+0000","last_became_peered":"2024-02-19T06:57:54.842159+0000","last_unstale":"2024-02-19T06:57:56.838753+0000","last_undegraded":"2024-02-19T06:57:56.838753+0000","last_fullsized":"2024-02-19T06:57:56.838753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:59:42.541017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842413+0000","last_change":"2024-02-19T06:57:55.861662+0000","last_active":"2024-02-19T06:57:56.842413+0000","last_peered":"2024-02-19T06:57:56.842413+0000","last_clean":"2024-02-19T06:57:56.842413+0000","last_became_active":"2024-02-19T06:57:55.861272+0000","last_became_peered":"2024-02-19T06:57:55.861272+0000","last_unstale":"2024-02-19T06:57:56.842413+0000","last_undegraded":"2024-02-19T06:57:56.842413+0000","last_fullsized":"2024-02-19T06:57:56.842413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:34:02.546590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298720+0000","last_change":"2024-02-19T06:57:54.848390+0000","last_active":"2024-02-19T06:57:57.298720+0000","last_peered":"2024-02-19T06:57:57.298720+0000","last_clean":"2024-02-19T06:57:57.298720+0000","last_became_active":"2024-02-19T06:57:54.848036+0000","last_became_peered":"2024-02-19T06:57:54.848036+0000","last_unstale":"2024-02-19T06:57:57.298720+0000","last_undegraded":"2024-02-19T06:57:57.298720+0000","last_fullsized":"2024-02-19T06:57:57.298720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:44:55.409988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841529+0000","last_change":"2024-02-19T06:57:55.865916+0000","last_active":"2024-02-19T06:57:56.841529+0000","last_peered":"2024-02-19T06:57:56.841529+0000","last_clean":"2024-02-19T06:57:56.841529+0000","last_became_active":"2024-02-19T06:57:55.865239+0000","last_became_peered":"2024-02-19T06:57:55.865239+0000","last_unstale":"2024-02-19T06:57:56.841529+0000","last_undegraded":"2024-02-19T06:57:56.841529+0000","last_fullsized":"2024-02-19T06:57:56.841529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:22:32.626274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297160+0000","last_change":"2024-02-19T06:57:54.845625+0000","last_active":"2024-02-19T06:57:57.297160+0000","last_peered":"2024-02-19T06:57:57.297160+0000","last_clean":"2024-02-19T06:57:57.297160+0000","last_became_active":"2024-02-19T06:57:54.845135+0000","last_became_peered":"2024-02-19T06:57:54.845135+0000","last_unstale":"2024-02-19T06:57:57.297160+0000","last_undegraded":"2024-02-19T06:57:57.297160+0000","last_fullsized":"2024-02-19T06:57:57.297160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:31:12.486420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296648+0000","last_change":"2024-02-19T06:57:55.879354+0000","last_active":"2024-02-19T06:57:57.296648+0000","last_peered":"2024-02-19T06:57:57.296648+0000","last_clean":"2024-02-19T06:57:57.296648+0000","last_became_active":"2024-02-19T06:57:55.878992+0000","last_became_peered":"2024-02-19T06:57:55.878992+0000","last_unstale":"2024-02-19T06:57:57.296648+0000","last_undegraded":"2024-02-19T06:57:57.296648+0000","last_fullsized":"2024-02-19T06:57:57.296648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:02:58.620182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297355+0000","last_change":"2024-02-19T06:57:54.846040+0000","last_active":"2024-02-19T06:57:57.297355+0000","last_peered":"2024-02-19T06:57:57.297355+0000","last_clean":"2024-02-19T06:57:57.297355+0000","last_became_active":"2024-02-19T06:57:54.845607+0000","last_became_peered":"2024-02-19T06:57:54.845607+0000","last_unstale":"2024-02-19T06:57:57.297355+0000","last_undegraded":"2024-02-19T06:57:57.297355+0000","last_fullsized":"2024-02-19T06:57:57.297355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:04:53.869596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841142+0000","last_change":"2024-02-19T06:57:55.873658+0000","last_active":"2024-02-19T06:57:56.841142+0000","last_peered":"2024-02-19T06:57:56.841142+0000","last_clean":"2024-02-19T06:57:56.841142+0000","last_became_active":"2024-02-19T06:57:55.868108+0000","last_became_peered":"2024-02-19T06:57:55.868108+0000","last_unstale":"2024-02-19T06:57:56.841142+0000","last_undegraded":"2024-02-19T06:57:56.841142+0000","last_fullsized":"2024-02-19T06:57:56.841142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:51:32.064277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297967+0000","last_change":"2024-02-19T06:57:54.847587+0000","last_active":"2024-02-19T06:57:57.297967+0000","last_peered":"2024-02-19T06:57:57.297967+0000","last_clean":"2024-02-19T06:57:57.297967+0000","last_became_active":"2024-02-19T06:57:54.844899+0000","last_became_peered":"2024-02-19T06:57:54.844899+0000","last_unstale":"2024-02-19T06:57:57.297967+0000","last_undegraded":"2024-02-19T06:57:57.297967+0000","last_fullsized":"2024-02-19T06:57:57.297967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:51:03.784955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297605+0000","last_change":"2024-02-19T06:57:55.868933+0000","last_active":"2024-02-19T06:57:57.297605+0000","last_peered":"2024-02-19T06:57:57.297605+0000","last_clean":"2024-02-19T06:57:57.297605+0000","last_became_active":"2024-02-19T06:57:55.868592+0000","last_became_peered":"2024-02-19T06:57:55.868592+0000","last_unstale":"2024-02-19T06:57:57.297605+0000","last_undegraded":"2024-02-19T06:57:57.297605+0000","last_fullsized":"2024-02-19T06:57:57.297605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:33:37.227028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297451+0000","last_change":"2024-02-19T06:57:54.831858+0000","last_active":"2024-02-19T06:57:57.297451+0000","last_peered":"2024-02-19T06:57:57.297451+0000","last_clean":"2024-02-19T06:57:57.297451+0000","last_became_active":"2024-02-19T06:57:54.831512+0000","last_became_peered":"2024-02-19T06:57:54.831512+0000","last_unstale":"2024-02-19T06:57:57.297451+0000","last_undegraded":"2024-02-19T06:57:57.297451+0000","last_fullsized":"2024-02-19T06:57:57.297451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:48:18.433112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.839899+0000","last_change":"2024-02-19T06:57:55.872697+0000","last_active":"2024-02-19T06:57:56.839899+0000","last_peered":"2024-02-19T06:57:56.839899+0000","last_clean":"2024-02-19T06:57:56.839899+0000","last_became_active":"2024-02-19T06:57:55.872411+0000","last_became_peered":"2024-02-19T06:57:55.872411+0000","last_unstale":"2024-02-19T06:57:56.839899+0000","last_undegraded":"2024-02-19T06:57:56.839899+0000","last_fullsized":"2024-02-19T06:57:56.839899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:44:33.781212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842124+0000","last_change":"2024-02-19T06:57:54.844428+0000","last_active":"2024-02-19T06:57:56.842124+0000","last_peered":"2024-02-19T06:57:56.842124+0000","last_clean":"2024-02-19T06:57:56.842124+0000","last_became_active":"2024-02-19T06:57:54.844078+0000","last_became_peered":"2024-02-19T06:57:54.844078+0000","last_unstale":"2024-02-19T06:57:56.842124+0000","last_undegraded":"2024-02-19T06:57:56.842124+0000","last_fullsized":"2024-02-19T06:57:56.842124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:48:12.144495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843194+0000","last_change":"2024-02-19T06:57:55.869556+0000","last_active":"2024-02-19T06:57:56.843194+0000","last_peered":"2024-02-19T06:57:56.843194+0000","last_clean":"2024-02-19T06:57:56.843194+0000","last_became_active":"2024-02-19T06:57:55.869252+0000","last_became_peered":"2024-02-19T06:57:55.869252+0000","last_unstale":"2024-02-19T06:57:56.843194+0000","last_undegraded":"2024-02-19T06:57:56.843194+0000","last_fullsized":"2024-02-19T06:57:56.843194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:34:32.534931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298549+0000","last_change":"2024-02-19T06:57:54.848350+0000","last_active":"2024-02-19T06:57:57.298549+0000","last_peered":"2024-02-19T06:57:57.298549+0000","last_clean":"2024-02-19T06:57:57.298549+0000","last_became_active":"2024-02-19T06:57:54.848006+0000","last_became_peered":"2024-02-19T06:57:54.848006+0000","last_unstale":"2024-02-19T06:57:57.298549+0000","last_undegraded":"2024-02-19T06:57:57.298549+0000","last_fullsized":"2024-02-19T06:57:57.298549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:51:48.627075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843747+0000","last_change":"2024-02-19T06:57:55.872749+0000","last_active":"2024-02-19T06:57:56.843747+0000","last_peered":"2024-02-19T06:57:56.843747+0000","last_clean":"2024-02-19T06:57:56.843747+0000","last_became_active":"2024-02-19T06:57:55.872475+0000","last_became_peered":"2024-02-19T06:57:55.872475+0000","last_unstale":"2024-02-19T06:57:56.843747+0000","last_undegraded":"2024-02-19T06:57:56.843747+0000","last_fullsized":"2024-02-19T06:57:56.843747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:48:48.733251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.839076+0000","last_change":"2024-02-19T06:57:54.835766+0000","last_active":"2024-02-19T06:57:56.839076+0000","last_peered":"2024-02-19T06:57:56.839076+0000","last_clean":"2024-02-19T06:57:56.839076+0000","last_became_active":"2024-02-19T06:57:54.835407+0000","last_became_peered":"2024-02-19T06:57:54.835407+0000","last_unstale":"2024-02-19T06:57:56.839076+0000","last_undegraded":"2024-02-19T06:57:56.839076+0000","last_fullsized":"2024-02-19T06:57:56.839076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:09:02.273345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297872+0000","last_change":"2024-02-19T06:57:55.875676+0000","last_active":"2024-02-19T06:57:57.297872+0000","last_peered":"2024-02-19T06:57:57.297872+0000","last_clean":"2024-02-19T06:57:57.297872+0000","last_became_active":"2024-02-19T06:57:55.874703+0000","last_became_peered":"2024-02-19T06:57:55.874703+0000","last_unstale":"2024-02-19T06:57:57.297872+0000","last_undegraded":"2024-02-19T06:57:57.297872+0000","last_fullsized":"2024-02-19T06:57:57.297872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:07:14.896235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298413+0000","last_change":"2024-02-19T06:57:54.842701+0000","last_active":"2024-02-19T06:57:57.298413+0000","last_peered":"2024-02-19T06:57:57.298413+0000","last_clean":"2024-02-19T06:57:57.298413+0000","last_became_active":"2024-02-19T06:57:54.842305+0000","last_became_peered":"2024-02-19T06:57:54.842305+0000","last_unstale":"2024-02-19T06:57:57.298413+0000","last_undegraded":"2024-02-19T06:57:57.298413+0000","last_fullsized":"2024-02-19T06:57:57.298413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:31:12.486420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842830+0000","last_change":"2024-02-19T06:57:55.865803+0000","last_active":"2024-02-19T06:57:56.842830+0000","last_peered":"2024-02-19T06:57:56.842830+0000","last_clean":"2024-02-19T06:57:56.842830+0000","last_became_active":"2024-02-19T06:57:55.865239+0000","last_became_peered":"2024-02-19T06:57:55.865239+0000","last_unstale":"2024-02-19T06:57:56.842830+0000","last_undegraded":"2024-02-19T06:57:56.842830+0000","last_fullsized":"2024-02-19T06:57:56.842830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:14:32.464297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841305+0000","last_change":"2024-02-19T06:57:45.353063+0000","last_active":"2024-02-19T06:57:56.841305+0000","last_peered":"2024-02-19T06:57:56.841305+0000","last_clean":"2024-02-19T06:57:56.841305+0000","last_became_active":"2024-02-19T06:57:45.350602+0000","last_became_peered":"2024-02-19T06:57:45.350602+0000","last_unstale":"2024-02-19T06:57:56.841305+0000","last_undegraded":"2024-02-19T06:57:56.841305+0000","last_fullsized":"2024-02-19T06:57:56.841305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_clean_scrub_stamp":"2024-02-19T06:57:44.230095+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:04:42.513180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297047+0000","last_change":"2024-02-19T06:57:54.839055+0000","last_active":"2024-02-19T06:57:57.297047+0000","last_peered":"2024-02-19T06:57:57.297047+0000","last_clean":"2024-02-19T06:57:57.297047+0000","last_became_active":"2024-02-19T06:57:54.838769+0000","last_became_peered":"2024-02-19T06:57:54.838769+0000","last_unstale":"2024-02-19T06:57:57.297047+0000","last_undegraded":"2024-02-19T06:57:57.297047+0000","last_fullsized":"2024-02-19T06:57:57.297047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:48:35.345147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.295995+0000","last_change":"2024-02-19T06:57:55.864141+0000","last_active":"2024-02-19T06:57:57.295995+0000","last_peered":"2024-02-19T06:57:57.295995+0000","last_clean":"2024-02-19T06:57:57.295995+0000","last_became_active":"2024-02-19T06:57:55.863841+0000","last_became_peered":"2024-02-19T06:57:55.863841+0000","last_unstale":"2024-02-19T06:57:57.295995+0000","last_undegraded":"2024-02-19T06:57:57.295995+0000","last_fullsized":"2024-02-19T06:57:57.295995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:18:12.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841663+0000","last_change":"2024-02-19T06:57:54.830847+0000","last_active":"2024-02-19T06:57:56.841663+0000","last_peered":"2024-02-19T06:57:56.841663+0000","last_clean":"2024-02-19T06:57:56.841663+0000","last_became_active":"2024-02-19T06:57:54.830511+0000","last_became_peered":"2024-02-19T06:57:54.830511+0000","last_unstale":"2024-02-19T06:57:56.841663+0000","last_undegraded":"2024-02-19T06:57:56.841663+0000","last_fullsized":"2024-02-19T06:57:56.841663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T06:59:01.746042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.295829+0000","last_change":"2024-02-19T06:57:55.870925+0000","last_active":"2024-02-19T06:57:57.295829+0000","last_peered":"2024-02-19T06:57:57.295829+0000","last_clean":"2024-02-19T06:57:57.295829+0000","last_became_active":"2024-02-19T06:57:55.870616+0000","last_became_peered":"2024-02-19T06:57:55.870616+0000","last_unstale":"2024-02-19T06:57:57.295829+0000","last_undegraded":"2024-02-19T06:57:57.295829+0000","last_fullsized":"2024-02-19T06:57:57.295829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:43:48.726828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297970+0000","last_change":"2024-02-19T06:57:54.848662+0000","last_active":"2024-02-19T06:57:57.297970+0000","last_peered":"2024-02-19T06:57:57.297970+0000","last_clean":"2024-02-19T06:57:57.297970+0000","last_became_active":"2024-02-19T06:57:54.848378+0000","last_became_peered":"2024-02-19T06:57:54.848378+0000","last_unstale":"2024-02-19T06:57:57.297970+0000","last_undegraded":"2024-02-19T06:57:57.297970+0000","last_fullsized":"2024-02-19T06:57:57.297970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:48:40.438231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.837477+0000","last_change":"2024-02-19T06:57:55.848725+0000","last_active":"2024-02-19T06:57:56.837477+0000","last_peered":"2024-02-19T06:57:56.837477+0000","last_clean":"2024-02-19T06:57:56.837477+0000","last_became_active":"2024-02-19T06:57:55.846707+0000","last_became_peered":"2024-02-19T06:57:55.846707+0000","last_unstale":"2024-02-19T06:57:56.837477+0000","last_undegraded":"2024-02-19T06:57:56.837477+0000","last_fullsized":"2024-02-19T06:57:56.837477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:36:55.635583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297591+0000","last_change":"2024-02-19T06:57:54.836285+0000","last_active":"2024-02-19T06:57:57.297591+0000","last_peered":"2024-02-19T06:57:57.297591+0000","last_clean":"2024-02-19T06:57:57.297591+0000","last_became_active":"2024-02-19T06:57:54.831238+0000","last_became_peered":"2024-02-19T06:57:54.831238+0000","last_unstale":"2024-02-19T06:57:57.297591+0000","last_undegraded":"2024-02-19T06:57:57.297591+0000","last_fullsized":"2024-02-19T06:57:57.297591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:51:03.784955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841596+0000","last_change":"2024-02-19T06:57:55.884751+0000","last_active":"2024-02-19T06:57:56.841596+0000","last_peered":"2024-02-19T06:57:56.841596+0000","last_clean":"2024-02-19T06:57:56.841596+0000","last_became_active":"2024-02-19T06:57:55.884444+0000","last_became_peered":"2024-02-19T06:57:55.884444+0000","last_unstale":"2024-02-19T06:57:56.841596+0000","last_undegraded":"2024-02-19T06:57:56.841596+0000","last_fullsized":"2024-02-19T06:57:56.841596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T06:59:02.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838502+0000","last_change":"2024-02-19T06:57:54.849999+0000","last_active":"2024-02-19T06:57:56.838502+0000","last_peered":"2024-02-19T06:57:56.838502+0000","last_clean":"2024-02-19T06:57:56.838502+0000","last_became_active":"2024-02-19T06:57:54.849632+0000","last_became_peered":"2024-02-19T06:57:54.849632+0000","last_unstale":"2024-02-19T06:57:56.838502+0000","last_undegraded":"2024-02-19T06:57:56.838502+0000","last_fullsized":"2024-02-19T06:57:56.838502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:59:11.619972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298324+0000","last_change":"2024-02-19T06:57:55.864794+0000","last_active":"2024-02-19T06:57:57.298324+0000","last_peered":"2024-02-19T06:57:57.298324+0000","last_clean":"2024-02-19T06:57:57.298324+0000","last_became_active":"2024-02-19T06:57:55.864493+0000","last_became_peered":"2024-02-19T06:57:55.864493+0000","last_unstale":"2024-02-19T06:57:57.298324+0000","last_undegraded":"2024-02-19T06:57:57.298324+0000","last_fullsized":"2024-02-19T06:57:57.298324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:13:32.804426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843295+0000","last_change":"2024-02-19T06:57:54.844059+0000","last_active":"2024-02-19T06:57:56.843295+0000","last_peered":"2024-02-19T06:57:56.843295+0000","last_clean":"2024-02-19T06:57:56.843295+0000","last_became_active":"2024-02-19T06:57:54.843728+0000","last_became_peered":"2024-02-19T06:57:54.843728+0000","last_unstale":"2024-02-19T06:57:56.843295+0000","last_undegraded":"2024-02-19T06:57:56.843295+0000","last_fullsized":"2024-02-19T06:57:56.843295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:29:04.812047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838149+0000","last_change":"2024-02-19T06:57:55.850256+0000","last_active":"2024-02-19T06:57:56.838149+0000","last_peered":"2024-02-19T06:57:56.838149+0000","last_clean":"2024-02-19T06:57:56.838149+0000","last_became_active":"2024-02-19T06:57:55.846503+0000","last_became_peered":"2024-02-19T06:57:55.846503+0000","last_unstale":"2024-02-19T06:57:56.838149+0000","last_undegraded":"2024-02-19T06:57:56.838149+0000","last_fullsized":"2024-02-19T06:57:56.838149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:19:13.712235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.695919+0000","last_change":"2024-02-19T06:57:54.845587+0000","last_active":"2024-02-19T06:57:57.695919+0000","last_peered":"2024-02-19T06:57:57.695919+0000","last_clean":"2024-02-19T06:57:57.695919+0000","last_became_active":"2024-02-19T06:57:54.844017+0000","last_became_peered":"2024-02-19T06:57:54.844017+0000","last_unstale":"2024-02-19T06:57:57.695919+0000","last_undegraded":"2024-02-19T06:57:57.695919+0000","last_fullsized":"2024-02-19T06:57:57.695919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:11:06.185390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299468+0000","last_change":"2024-02-19T06:57:55.873485+0000","last_active":"2024-02-19T06:57:57.299468+0000","last_peered":"2024-02-19T06:57:57.299468+0000","last_clean":"2024-02-19T06:57:57.299468+0000","last_became_active":"2024-02-19T06:57:55.873179+0000","last_became_peered":"2024-02-19T06:57:55.873179+0000","last_unstale":"2024-02-19T06:57:57.299468+0000","last_undegraded":"2024-02-19T06:57:57.299468+0000","last_fullsized":"2024-02-19T06:57:57.299468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:45:59.994639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299321+0000","last_change":"2024-02-19T06:57:54.849235+0000","last_active":"2024-02-19T06:57:57.299321+0000","last_peered":"2024-02-19T06:57:57.299321+0000","last_clean":"2024-02-19T06:57:57.299321+0000","last_became_active":"2024-02-19T06:57:54.848969+0000","last_became_peered":"2024-02-19T06:57:54.848969+0000","last_unstale":"2024-02-19T06:57:57.299321+0000","last_undegraded":"2024-02-19T06:57:57.299321+0000","last_fullsized":"2024-02-19T06:57:57.299321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:59:42.541017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297324+0000","last_change":"2024-02-19T06:57:55.878312+0000","last_active":"2024-02-19T06:57:57.297324+0000","last_peered":"2024-02-19T06:57:57.297324+0000","last_clean":"2024-02-19T06:57:57.297324+0000","last_became_active":"2024-02-19T06:57:55.872331+0000","last_became_peered":"2024-02-19T06:57:55.872331+0000","last_unstale":"2024-02-19T06:57:57.297324+0000","last_undegraded":"2024-02-19T06:57:57.297324+0000","last_fullsized":"2024-02-19T06:57:57.297324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:16:19.287368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841162+0000","last_change":"2024-02-19T06:57:54.851412+0000","last_active":"2024-02-19T06:57:56.841162+0000","last_peered":"2024-02-19T06:57:56.841162+0000","last_clean":"2024-02-19T06:57:56.841162+0000","last_became_active":"2024-02-19T06:57:54.849764+0000","last_became_peered":"2024-02-19T06:57:54.849764+0000","last_unstale":"2024-02-19T06:57:56.841162+0000","last_undegraded":"2024-02-19T06:57:56.841162+0000","last_fullsized":"2024-02-19T06:57:56.841162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:31:24.467437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.840874+0000","last_change":"2024-02-19T06:57:55.859782+0000","last_active":"2024-02-19T06:57:56.840874+0000","last_peered":"2024-02-19T06:57:56.840874+0000","last_clean":"2024-02-19T06:57:56.840874+0000","last_became_active":"2024-02-19T06:57:55.859506+0000","last_became_peered":"2024-02-19T06:57:55.859506+0000","last_unstale":"2024-02-19T06:57:56.840874+0000","last_undegraded":"2024-02-19T06:57:56.840874+0000","last_fullsized":"2024-02-19T06:57:56.840874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:14:51.291554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838183+0000","last_change":"2024-02-19T06:57:54.833195+0000","last_active":"2024-02-19T06:57:56.838183+0000","last_peered":"2024-02-19T06:57:56.838183+0000","last_clean":"2024-02-19T06:57:56.838183+0000","last_became_active":"2024-02-19T06:57:54.832921+0000","last_became_peered":"2024-02-19T06:57:54.832921+0000","last_unstale":"2024-02-19T06:57:56.838183+0000","last_undegraded":"2024-02-19T06:57:56.838183+0000","last_fullsized":"2024-02-19T06:57:56.838183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:51:03.784955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297856+0000","last_change":"2024-02-19T06:57:55.863807+0000","last_active":"2024-02-19T06:57:57.297856+0000","last_peered":"2024-02-19T06:57:57.297856+0000","last_clean":"2024-02-19T06:57:57.297856+0000","last_became_active":"2024-02-19T06:57:55.862327+0000","last_became_peered":"2024-02-19T06:57:55.862327+0000","last_unstale":"2024-02-19T06:57:57.297856+0000","last_undegraded":"2024-02-19T06:57:57.297856+0000","last_fullsized":"2024-02-19T06:57:57.297856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.837924+0000","last_change":"2024-02-19T06:57:54.847191+0000","last_active":"2024-02-19T06:57:56.837924+0000","last_peered":"2024-02-19T06:57:56.837924+0000","last_clean":"2024-02-19T06:57:56.837924+0000","last_became_active":"2024-02-19T06:57:54.846893+0000","last_became_peered":"2024-02-19T06:57:54.846893+0000","last_unstale":"2024-02-19T06:57:56.837924+0000","last_undegraded":"2024-02-19T06:57:56.837924+0000","last_fullsized":"2024-02-19T06:57:56.837924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:44:55.409988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298592+0000","last_change":"2024-02-19T06:57:55.882338+0000","last_active":"2024-02-19T06:57:57.298592+0000","last_peered":"2024-02-19T06:57:57.298592+0000","last_clean":"2024-02-19T06:57:57.298592+0000","last_became_active":"2024-02-19T06:57:55.881014+0000","last_became_peered":"2024-02-19T06:57:55.881014+0000","last_unstale":"2024-02-19T06:57:57.298592+0000","last_undegraded":"2024-02-19T06:57:57.298592+0000","last_fullsized":"2024-02-19T06:57:57.298592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:19:34.393218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841316+0000","last_change":"2024-02-19T06:57:54.845977+0000","last_active":"2024-02-19T06:57:56.841316+0000","last_peered":"2024-02-19T06:57:56.841316+0000","last_clean":"2024-02-19T06:57:56.841316+0000","last_became_active":"2024-02-19T06:57:54.845651+0000","last_became_peered":"2024-02-19T06:57:54.845651+0000","last_unstale":"2024-02-19T06:57:56.841316+0000","last_undegraded":"2024-02-19T06:57:56.841316+0000","last_fullsized":"2024-02-19T06:57:56.841316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:42:34.912061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297311+0000","last_change":"2024-02-19T06:57:55.870900+0000","last_active":"2024-02-19T06:57:57.297311+0000","last_peered":"2024-02-19T06:57:57.297311+0000","last_clean":"2024-02-19T06:57:57.297311+0000","last_became_active":"2024-02-19T06:57:55.870632+0000","last_became_peered":"2024-02-19T06:57:55.870632+0000","last_unstale":"2024-02-19T06:57:57.297311+0000","last_undegraded":"2024-02-19T06:57:57.297311+0000","last_fullsized":"2024-02-19T06:57:57.297311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:18:12.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298148+0000","last_change":"2024-02-19T06:57:55.863948+0000","last_active":"2024-02-19T06:57:57.298148+0000","last_peered":"2024-02-19T06:57:57.298148+0000","last_clean":"2024-02-19T06:57:57.298148+0000","last_became_active":"2024-02-19T06:57:55.863663+0000","last_became_peered":"2024-02-19T06:57:55.863663+0000","last_unstale":"2024-02-19T06:57:57.298148+0000","last_undegraded":"2024-02-19T06:57:57.298148+0000","last_fullsized":"2024-02-19T06:57:57.298148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:06:41.609470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841684+0000","last_change":"2024-02-19T06:57:54.841874+0000","last_active":"2024-02-19T06:57:56.841684+0000","last_peered":"2024-02-19T06:57:56.841684+0000","last_clean":"2024-02-19T06:57:56.841684+0000","last_became_active":"2024-02-19T06:57:54.841500+0000","last_became_peered":"2024-02-19T06:57:54.841500+0000","last_unstale":"2024-02-19T06:57:56.841684+0000","last_undegraded":"2024-02-19T06:57:56.841684+0000","last_fullsized":"2024-02-19T06:57:56.841684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:34:01.534791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297567+0000","last_change":"2024-02-19T06:57:55.864005+0000","last_active":"2024-02-19T06:57:57.297567+0000","last_peered":"2024-02-19T06:57:57.297567+0000","last_clean":"2024-02-19T06:57:57.297567+0000","last_became_active":"2024-02-19T06:57:55.863634+0000","last_became_peered":"2024-02-19T06:57:55.863634+0000","last_unstale":"2024-02-19T06:57:57.297567+0000","last_undegraded":"2024-02-19T06:57:57.297567+0000","last_fullsized":"2024-02-19T06:57:57.297567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:45:59.994639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842721+0000","last_change":"2024-02-19T06:57:54.845418+0000","last_active":"2024-02-19T06:57:56.842721+0000","last_peered":"2024-02-19T06:57:56.842721+0000","last_clean":"2024-02-19T06:57:56.842721+0000","last_became_active":"2024-02-19T06:57:54.845134+0000","last_became_peered":"2024-02-19T06:57:54.845134+0000","last_unstale":"2024-02-19T06:57:56.842721+0000","last_undegraded":"2024-02-19T06:57:56.842721+0000","last_fullsized":"2024-02-19T06:57:56.842721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:37:22.505873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.295990+0000","last_change":"2024-02-19T06:57:55.880160+0000","last_active":"2024-02-19T06:57:57.295990+0000","last_peered":"2024-02-19T06:57:57.295990+0000","last_clean":"2024-02-19T06:57:57.295990+0000","last_became_active":"2024-02-19T06:57:55.879826+0000","last_became_peered":"2024-02-19T06:57:55.879826+0000","last_unstale":"2024-02-19T06:57:57.295990+0000","last_undegraded":"2024-02-19T06:57:57.295990+0000","last_fullsized":"2024-02-19T06:57:57.295990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:31:58.448215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297341+0000","last_change":"2024-02-19T06:57:54.848100+0000","last_active":"2024-02-19T06:57:57.297341+0000","last_peered":"2024-02-19T06:57:57.297341+0000","last_clean":"2024-02-19T06:57:57.297341+0000","last_became_active":"2024-02-19T06:57:54.847632+0000","last_became_peered":"2024-02-19T06:57:54.847632+0000","last_unstale":"2024-02-19T06:57:57.297341+0000","last_undegraded":"2024-02-19T06:57:57.297341+0000","last_fullsized":"2024-02-19T06:57:57.297341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:04:53.869596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297229+0000","last_change":"2024-02-19T06:57:55.873869+0000","last_active":"2024-02-19T06:57:57.297229+0000","last_peered":"2024-02-19T06:57:57.297229+0000","last_clean":"2024-02-19T06:57:57.297229+0000","last_became_active":"2024-02-19T06:57:55.873711+0000","last_became_peered":"2024-02-19T06:57:55.873711+0000","last_unstale":"2024-02-19T06:57:57.297229+0000","last_undegraded":"2024-02-19T06:57:57.297229+0000","last_fullsized":"2024-02-19T06:57:57.297229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:19:13.712235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296492+0000","last_change":"2024-02-19T06:57:54.846614+0000","last_active":"2024-02-19T06:57:57.296492+0000","last_peered":"2024-02-19T06:57:57.296492+0000","last_clean":"2024-02-19T06:57:57.296492+0000","last_became_active":"2024-02-19T06:57:54.846293+0000","last_became_peered":"2024-02-19T06:57:54.846293+0000","last_unstale":"2024-02-19T06:57:57.296492+0000","last_undegraded":"2024-02-19T06:57:57.296492+0000","last_fullsized":"2024-02-19T06:57:57.296492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:14:50.279754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":79738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7969999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.865}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6719999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":78216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3119999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8580000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.234}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6059999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":669076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6319999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.722}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9950000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":78252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.893}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":79738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4020000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7969999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.927}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.956}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":78126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7330000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":78286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6850000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5670000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":669132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T06:58:06.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-19T06:58:06.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.300+0000 7f13b5200640 1 Processor -- start 2024-02-19T06:58:06.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.300+0000 7f13b5200640 1 -- start start 2024-02-19T06:58:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.302+0000 7f13b5200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0159c00 0x7f13b0071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.302+0000 7f13b5200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13b00b2e90 0x7f13b0072400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.302+0000 7f13b5200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f13b0159fe0 0x7f13b015da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.302+0000 7f13b5200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b00cea90 con 0x7f13b0159fe0 2024-02-19T06:58:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.302+0000 7f13b5200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b00c9ff0 con 0x7f13b00b2e90 2024-02-19T06:58:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.302+0000 7f13b5200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00cec90 con 0x7f13b0159c00 2024-02-19T06:58:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.302+0000 7f13afe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f13b0159fe0 0x7f13b015da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.302+0000 7f13afe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f13b0159fe0 0x7f13b015da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41716/0 (socket says 172.21.15.46:41716) 2024-02-19T06:58:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.302+0000 7f13afe00640 1 -- 172.21.15.46:0/3483998242 learned_addr learned my addr 172.21.15.46:0/3483998242 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.303+0000 7f13af400640 1 --2- 172.21.15.46:0/3483998242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0159c00 0x7f13b0071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.303+0000 7f13a7e00640 1 --2- 172.21.15.46:0/3483998242 >> v2:172.21.15.142:3300/0 conn(0x7f13b00b2e90 0x7f13b0072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.303+0000 7f13afe00640 1 -- 172.21.15.46:0/3483998242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0159c00 msgr2=0x7f13b0071ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.303+0000 7f13afe00640 1 --2- 172.21.15.46:0/3483998242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0159c00 0x7f13b0071ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.303+0000 7f13afe00640 1 -- 172.21.15.46:0/3483998242 >> v2:172.21.15.142:3300/0 conn(0x7f13b00b2e90 msgr2=0x7f13b0072400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.303+0000 7f13afe00640 1 --2- 172.21.15.46:0/3483998242 >> v2:172.21.15.142:3300/0 conn(0x7f13b00b2e90 0x7f13b0072400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.303+0000 7f13afe00640 1 -- 172.21.15.46:0/3483998242 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b00cef70 con 0x7f13b0159fe0 2024-02-19T06:58:06.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.304+0000 7f13afe00640 1 --2- 172.21.15.46:0/3483998242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13b0159fe0 0x7f13b015da10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f13b0070ac0 tx=0x7f13a802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db82d8f368fb53f server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:06.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.304+0000 7f13aea00640 1 -- 172.21.15.46:0/3483998242 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a802c9e0 con 0x7f13b0159fe0 2024-02-19T06:58:06.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.304+0000 7f13aea00640 1 -- 172.21.15.46:0/3483998242 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a802cb40 con 0x7f13b0159fe0 2024-02-19T06:58:06.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.304+0000 7f13aea00640 1 -- 172.21.15.46:0/3483998242 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a80343f0 con 0x7f13b0159fe0 2024-02-19T06:58:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.305+0000 7f13b5200640 1 -- 172.21.15.46:0/3483998242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13b0159fe0 msgr2=0x7f13b015da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.305+0000 7f13b5200640 1 --2- 172.21.15.46:0/3483998242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13b0159fe0 0x7f13b015da10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f13b0070ac0 tx=0x7f13a802be40 comp rx=0 tx=0).stop 2024-02-19T06:58:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.305+0000 7f13b5200640 1 -- 172.21.15.46:0/3483998242 shutdown_connections 2024-02-19T06:58:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.305+0000 7f13b5200640 1 --2- 172.21.15.46:0/3483998242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13b0159fe0 0x7f13b015da10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.305+0000 7f13b5200640 1 --2- 172.21.15.46:0/3483998242 >> v2:172.21.15.142:3300/0 conn(0x7f13b00b2e90 0x7f13b0072400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.305+0000 7f13b5200640 1 --2- 172.21.15.46:0/3483998242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0159c00 0x7f13b0071ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.305+0000 7f13b5200640 1 -- 172.21.15.46:0/3483998242 >> 172.21.15.46:0/3483998242 conn(0x7f13b006afa0 msgr2=0x7f13b006b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.305+0000 7f13b5200640 1 -- 172.21.15.46:0/3483998242 shutdown_connections 2024-02-19T06:58:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.305+0000 7f13b5200640 1 -- 172.21.15.46:0/3483998242 wait complete. 2024-02-19T06:58:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.307+0000 7f13b5200640 1 Processor -- start 2024-02-19T06:58:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.307+0000 7f13b5200640 1 -- start start 2024-02-19T06:58:06.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.307+0000 7f13b5200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13b00b2e90 0x7f13b00af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:06.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.307+0000 7f13b5200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0159c00 0x7f13b00c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:06.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13b5200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b0159fe0 0x7f13b00ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:06.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13b5200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00b0120 con 0x7f13b00b2e90 2024-02-19T06:58:06.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13b5200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00c76e0 con 0x7f13b0159fe0 2024-02-19T06:58:06.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13b5200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00c79c0 con 0x7f13b0159c00 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13af400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13b00b2e90 0x7f13b00af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13af400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13b00b2e90 0x7f13b00af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41720/0 (socket says 172.21.15.46:41720) 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13af400640 1 -- 172.21.15.46:0/1325611864 learned_addr learned my addr 172.21.15.46:0/1325611864 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13af400640 1 -- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0159c00 msgr2=0x7f13b00c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13a7e00640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0159c00 0x7f13b00c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13afe00640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b0159fe0 0x7f13b00ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13af400640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0159c00 0x7f13b00c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13af400640 1 -- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b0159fe0 msgr2=0x7f13b00ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13af400640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b0159fe0 0x7f13b00ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13af400640 1 -- 172.21.15.46:0/1325611864 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a8009b30 con 0x7f13b00b2e90 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.308+0000 7f13af400640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13b00b2e90 0x7f13b00af840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f13a000d5f0 tx=0x7f13a000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.309+0000 7f13a7400640 1 -- 172.21.15.46:0/1325611864 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a00125f0 con 0x7f13b00b2e90 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.309+0000 7f13a7400640 1 -- 172.21.15.46:0/1325611864 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a0012750 con 0x7f13b00b2e90 2024-02-19T06:58:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.309+0000 7f13b5200640 1 -- 172.21.15.46:0/1325611864 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b00c7ca0 con 0x7f13b00b2e90 2024-02-19T06:58:06.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.309+0000 7f13a7400640 1 -- 172.21.15.46:0/1325611864 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0012b00 con 0x7f13b00b2e90 2024-02-19T06:58:06.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.309+0000 7f13b5200640 1 -- 172.21.15.46:0/1325611864 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b00afd80 con 0x7f13b00b2e90 2024-02-19T06:58:06.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.310+0000 7f13b5200640 1 -- 172.21.15.46:0/1325611864 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b004eee0 con 0x7f13b00b2e90 2024-02-19T06:58:06.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.311+0000 7f13a7400640 1 -- 172.21.15.46:0/1325611864 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f13a0012c60 con 0x7f13b00b2e90 2024-02-19T06:58:06.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.312+0000 7f13a7400640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f138c06b810 0x7f138c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:06.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.312+0000 7f13a7400640 1 -- 172.21.15.46:0/1325611864 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13a008a7d0 con 0x7f13b00b2e90 2024-02-19T06:58:06.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.312+0000 7f13a7e00640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f138c06b810 0x7f138c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:06.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.313+0000 7f13a7e00640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f138c06b810 0x7f138c06dcd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1398006fd0 tx=0x7f1398008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:06.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.316+0000 7f13a7400640 1 -- 172.21.15.46:0/1325611864 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f13a0055150 con 0x7f13b00b2e90 2024-02-19T06:58:06.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.502+0000 7f13b5200640 1 -- 172.21.15.46:0/1325611864 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13b0072940 con 0x7f138c06b810 2024-02-19T06:58:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.522+0000 7f13a7400640 1 -- 172.21.15.46:0/1325611864 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264374 (secure 0 0 0) 0x7f13980133f0 con 0x7f138c06b810 2024-02-19T06:58:06.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-02-19T06:58:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.527+0000 7f13b5200640 1 -- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f138c06b810 msgr2=0x7f138c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.527+0000 7f13b5200640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f138c06b810 0x7f138c06dcd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1398006fd0 tx=0x7f1398008040 comp rx=0 tx=0).stop 2024-02-19T06:58:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.527+0000 7f13b5200640 1 -- 172.21.15.46:0/1325611864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13b00b2e90 msgr2=0x7f13b00af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.527+0000 7f13b5200640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13b00b2e90 0x7f13b00af840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f13a000d5f0 tx=0x7f13a000dab0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.527+0000 7f13b5200640 1 -- 172.21.15.46:0/1325611864 shutdown_connections 2024-02-19T06:58:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.527+0000 7f13b5200640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f138c06b810 0x7f138c06dcd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.527+0000 7f13b5200640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b0159fe0 0x7f13b00ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.527+0000 7f13b5200640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13b0159c00 0x7f13b00c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.527+0000 7f13b5200640 1 --2- 172.21.15.46:0/1325611864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13b00b2e90 0x7f13b00af840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.527+0000 7f13b5200640 1 -- 172.21.15.46:0/1325611864 >> 172.21.15.46:0/1325611864 conn(0x7f13b006afa0 msgr2=0x7f13b00ac1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.528+0000 7f13b5200640 1 -- 172.21.15.46:0/1325611864 shutdown_connections 2024-02-19T06:58:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.528+0000 7f13b5200640 1 -- 172.21.15.46:0/1325611864 wait complete. 2024-02-19T06:58:06.549 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-02-19T06:58:05.671340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235768,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738952,"statfs":{"total":773094113280,"available":772852686848,"internally_reserved":0,"allocated":3022848,"data_stored":1810564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.840264"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843569+0000","last_change":"2024-02-19T06:57:55.881582+0000","last_active":"2024-02-19T06:57:56.843569+0000","last_peered":"2024-02-19T06:57:56.843569+0000","last_clean":"2024-02-19T06:57:56.843569+0000","last_became_active":"2024-02-19T06:57:55.880789+0000","last_became_peered":"2024-02-19T06:57:55.880789+0000","last_unstale":"2024-02-19T06:57:56.843569+0000","last_undegraded":"2024-02-19T06:57:56.843569+0000","last_fullsized":"2024-02-19T06:57:56.843569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:24:57.181299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838514+0000","last_change":"2024-02-19T06:57:55.875781+0000","last_active":"2024-02-19T06:57:56.838514+0000","last_peered":"2024-02-19T06:57:56.838514+0000","last_clean":"2024-02-19T06:57:56.838514+0000","last_became_active":"2024-02-19T06:57:55.875457+0000","last_became_peered":"2024-02-19T06:57:55.875457+0000","last_unstale":"2024-02-19T06:57:56.838514+0000","last_undegraded":"2024-02-19T06:57:56.838514+0000","last_fullsized":"2024-02-19T06:57:56.838514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296432+0000","last_change":"2024-02-19T06:57:55.879795+0000","last_active":"2024-02-19T06:57:57.296432+0000","last_peered":"2024-02-19T06:57:57.296432+0000","last_clean":"2024-02-19T06:57:57.296432+0000","last_became_active":"2024-02-19T06:57:55.879476+0000","last_became_peered":"2024-02-19T06:57:55.879476+0000","last_unstale":"2024-02-19T06:57:57.296432+0000","last_undegraded":"2024-02-19T06:57:57.296432+0000","last_fullsized":"2024-02-19T06:57:57.296432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:26:02.934116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297501+0000","last_change":"2024-02-19T06:57:55.863246+0000","last_active":"2024-02-19T06:57:57.297501+0000","last_peered":"2024-02-19T06:57:57.297501+0000","last_clean":"2024-02-19T06:57:57.297501+0000","last_became_active":"2024-02-19T06:57:55.862759+0000","last_became_peered":"2024-02-19T06:57:55.862759+0000","last_unstale":"2024-02-19T06:57:57.297501+0000","last_undegraded":"2024-02-19T06:57:57.297501+0000","last_fullsized":"2024-02-19T06:57:57.297501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:02:01.947104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841155+0000","last_change":"2024-02-19T06:57:55.857896+0000","last_active":"2024-02-19T06:57:56.841155+0000","last_peered":"2024-02-19T06:57:56.841155+0000","last_clean":"2024-02-19T06:57:56.841155+0000","last_became_active":"2024-02-19T06:57:55.857608+0000","last_became_peered":"2024-02-19T06:57:55.857608+0000","last_unstale":"2024-02-19T06:57:56.841155+0000","last_undegraded":"2024-02-19T06:57:56.841155+0000","last_fullsized":"2024-02-19T06:57:56.841155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:24:14.106586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296899+0000","last_change":"2024-02-19T06:57:55.867450+0000","last_active":"2024-02-19T06:57:57.296899+0000","last_peered":"2024-02-19T06:57:57.296899+0000","last_clean":"2024-02-19T06:57:57.296899+0000","last_became_active":"2024-02-19T06:57:55.867181+0000","last_became_peered":"2024-02-19T06:57:55.867181+0000","last_unstale":"2024-02-19T06:57:57.296899+0000","last_undegraded":"2024-02-19T06:57:57.296899+0000","last_fullsized":"2024-02-19T06:57:57.296899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.840561+0000","last_change":"2024-02-19T06:57:55.870845+0000","last_active":"2024-02-19T06:57:56.840561+0000","last_peered":"2024-02-19T06:57:56.840561+0000","last_clean":"2024-02-19T06:57:56.840561+0000","last_became_active":"2024-02-19T06:57:55.870532+0000","last_became_peered":"2024-02-19T06:57:55.870532+0000","last_unstale":"2024-02-19T06:57:56.840561+0000","last_undegraded":"2024-02-19T06:57:56.840561+0000","last_fullsized":"2024-02-19T06:57:56.840561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:32:16.779230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297147+0000","last_change":"2024-02-19T06:57:55.869272+0000","last_active":"2024-02-19T06:57:57.297147+0000","last_peered":"2024-02-19T06:57:57.297147+0000","last_clean":"2024-02-19T06:57:57.297147+0000","last_became_active":"2024-02-19T06:57:55.867903+0000","last_became_peered":"2024-02-19T06:57:55.867903+0000","last_unstale":"2024-02-19T06:57:57.297147+0000","last_undegraded":"2024-02-19T06:57:57.297147+0000","last_fullsized":"2024-02-19T06:57:57.297147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:33:37.227028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843541+0000","last_change":"2024-02-19T06:57:55.869047+0000","last_active":"2024-02-19T06:57:56.843541+0000","last_peered":"2024-02-19T06:57:56.843541+0000","last_clean":"2024-02-19T06:57:56.843541+0000","last_became_active":"2024-02-19T06:57:55.868781+0000","last_became_peered":"2024-02-19T06:57:55.868781+0000","last_unstale":"2024-02-19T06:57:56.843541+0000","last_undegraded":"2024-02-19T06:57:56.843541+0000","last_fullsized":"2024-02-19T06:57:56.843541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:47:51.163933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299489+0000","last_change":"2024-02-19T06:57:55.878539+0000","last_active":"2024-02-19T06:57:57.299489+0000","last_peered":"2024-02-19T06:57:57.299489+0000","last_clean":"2024-02-19T06:57:57.299489+0000","last_became_active":"2024-02-19T06:57:55.877859+0000","last_became_peered":"2024-02-19T06:57:55.877859+0000","last_unstale":"2024-02-19T06:57:57.299489+0000","last_undegraded":"2024-02-19T06:57:57.299489+0000","last_fullsized":"2024-02-19T06:57:57.299489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299028+0000","last_change":"2024-02-19T06:57:55.876129+0000","last_active":"2024-02-19T06:57:57.299028+0000","last_peered":"2024-02-19T06:57:57.299028+0000","last_clean":"2024-02-19T06:57:57.299028+0000","last_became_active":"2024-02-19T06:57:55.875481+0000","last_became_peered":"2024-02-19T06:57:55.875481+0000","last_unstale":"2024-02-19T06:57:57.299028+0000","last_undegraded":"2024-02-19T06:57:57.299028+0000","last_fullsized":"2024-02-19T06:57:57.299028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842411+0000","last_change":"2024-02-19T06:57:55.879728+0000","last_active":"2024-02-19T06:57:56.842411+0000","last_peered":"2024-02-19T06:57:56.842411+0000","last_clean":"2024-02-19T06:57:56.842411+0000","last_became_active":"2024-02-19T06:57:55.878922+0000","last_became_peered":"2024-02-19T06:57:55.878922+0000","last_unstale":"2024-02-19T06:57:56.842411+0000","last_undegraded":"2024-02-19T06:57:56.842411+0000","last_fullsized":"2024-02-19T06:57:56.842411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:42:35.923860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298289+0000","last_change":"2024-02-19T06:57:55.863333+0000","last_active":"2024-02-19T06:57:57.298289+0000","last_peered":"2024-02-19T06:57:57.298289+0000","last_clean":"2024-02-19T06:57:57.298289+0000","last_became_active":"2024-02-19T06:57:55.863137+0000","last_became_peered":"2024-02-19T06:57:55.863137+0000","last_unstale":"2024-02-19T06:57:57.298289+0000","last_undegraded":"2024-02-19T06:57:57.298289+0000","last_fullsized":"2024-02-19T06:57:57.298289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:16:45.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296260+0000","last_change":"2024-02-19T06:57:55.870376+0000","last_active":"2024-02-19T06:57:57.296260+0000","last_peered":"2024-02-19T06:57:57.296260+0000","last_clean":"2024-02-19T06:57:57.296260+0000","last_became_active":"2024-02-19T06:57:55.865453+0000","last_became_peered":"2024-02-19T06:57:55.865453+0000","last_unstale":"2024-02-19T06:57:57.296260+0000","last_undegraded":"2024-02-19T06:57:57.296260+0000","last_fullsized":"2024-02-19T06:57:57.296260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:10:54.622454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838056+0000","last_change":"2024-02-19T06:57:55.866944+0000","last_active":"2024-02-19T06:57:56.838056+0000","last_peered":"2024-02-19T06:57:56.838056+0000","last_clean":"2024-02-19T06:57:56.838056+0000","last_became_active":"2024-02-19T06:57:55.866168+0000","last_became_peered":"2024-02-19T06:57:55.866168+0000","last_unstale":"2024-02-19T06:57:56.838056+0000","last_undegraded":"2024-02-19T06:57:56.838056+0000","last_fullsized":"2024-02-19T06:57:56.838056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:33:37.227028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296615+0000","last_change":"2024-02-19T06:57:55.866999+0000","last_active":"2024-02-19T06:57:57.296615+0000","last_peered":"2024-02-19T06:57:57.296615+0000","last_clean":"2024-02-19T06:57:57.296615+0000","last_became_active":"2024-02-19T06:57:55.866721+0000","last_became_peered":"2024-02-19T06:57:55.866721+0000","last_unstale":"2024-02-19T06:57:57.296615+0000","last_undegraded":"2024-02-19T06:57:57.296615+0000","last_fullsized":"2024-02-19T06:57:57.296615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299188+0000","last_change":"2024-02-19T06:57:55.855201+0000","last_active":"2024-02-19T06:57:57.299188+0000","last_peered":"2024-02-19T06:57:57.299188+0000","last_clean":"2024-02-19T06:57:57.299188+0000","last_became_active":"2024-02-19T06:57:55.854955+0000","last_became_peered":"2024-02-19T06:57:55.854955+0000","last_unstale":"2024-02-19T06:57:57.299188+0000","last_undegraded":"2024-02-19T06:57:57.299188+0000","last_fullsized":"2024-02-19T06:57:57.299188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:44:06.998192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298443+0000","last_change":"2024-02-19T06:57:55.876606+0000","last_active":"2024-02-19T06:57:57.298443+0000","last_peered":"2024-02-19T06:57:57.298443+0000","last_clean":"2024-02-19T06:57:57.298443+0000","last_became_active":"2024-02-19T06:57:55.876334+0000","last_became_peered":"2024-02-19T06:57:55.876334+0000","last_unstale":"2024-02-19T06:57:57.298443+0000","last_undegraded":"2024-02-19T06:57:57.298443+0000","last_fullsized":"2024-02-19T06:57:57.298443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:34:02.546590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843210+0000","last_change":"2024-02-19T06:57:55.861233+0000","last_active":"2024-02-19T06:57:56.843210+0000","last_peered":"2024-02-19T06:57:56.843210+0000","last_clean":"2024-02-19T06:57:56.843210+0000","last_became_active":"2024-02-19T06:57:55.860849+0000","last_became_peered":"2024-02-19T06:57:55.860849+0000","last_unstale":"2024-02-19T06:57:56.843210+0000","last_undegraded":"2024-02-19T06:57:56.843210+0000","last_fullsized":"2024-02-19T06:57:56.843210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:58:02.081784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298883+0000","last_change":"2024-02-19T06:57:55.879542+0000","last_active":"2024-02-19T06:57:57.298883+0000","last_peered":"2024-02-19T06:57:57.298883+0000","last_clean":"2024-02-19T06:57:57.298883+0000","last_became_active":"2024-02-19T06:57:55.876325+0000","last_became_peered":"2024-02-19T06:57:55.876325+0000","last_unstale":"2024-02-19T06:57:57.298883+0000","last_undegraded":"2024-02-19T06:57:57.298883+0000","last_fullsized":"2024-02-19T06:57:57.298883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:19:13.712235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296072+0000","last_change":"2024-02-19T06:57:55.882287+0000","last_active":"2024-02-19T06:57:57.296072+0000","last_peered":"2024-02-19T06:57:57.296072+0000","last_clean":"2024-02-19T06:57:57.296072+0000","last_became_active":"2024-02-19T06:57:55.881847+0000","last_became_peered":"2024-02-19T06:57:55.881847+0000","last_unstale":"2024-02-19T06:57:57.296072+0000","last_undegraded":"2024-02-19T06:57:57.296072+0000","last_fullsized":"2024-02-19T06:57:57.296072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:26:43.190851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297087+0000","last_change":"2024-02-19T06:57:55.855047+0000","last_active":"2024-02-19T06:57:57.297087+0000","last_peered":"2024-02-19T06:57:57.297087+0000","last_clean":"2024-02-19T06:57:57.297087+0000","last_became_active":"2024-02-19T06:57:55.854699+0000","last_became_peered":"2024-02-19T06:57:55.854699+0000","last_unstale":"2024-02-19T06:57:57.297087+0000","last_undegraded":"2024-02-19T06:57:57.297087+0000","last_fullsized":"2024-02-19T06:57:57.297087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:16:45.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297920+0000","last_change":"2024-02-19T06:57:55.869732+0000","last_active":"2024-02-19T06:57:57.297920+0000","last_peered":"2024-02-19T06:57:57.297920+0000","last_clean":"2024-02-19T06:57:57.297920+0000","last_became_active":"2024-02-19T06:57:55.869159+0000","last_became_peered":"2024-02-19T06:57:55.869159+0000","last_unstale":"2024-02-19T06:57:57.297920+0000","last_undegraded":"2024-02-19T06:57:57.297920+0000","last_fullsized":"2024-02-19T06:57:57.297920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296891+0000","last_change":"2024-02-19T06:57:55.863170+0000","last_active":"2024-02-19T06:57:57.296891+0000","last_peered":"2024-02-19T06:57:57.296891+0000","last_clean":"2024-02-19T06:57:57.296891+0000","last_became_active":"2024-02-19T06:57:55.862285+0000","last_became_peered":"2024-02-19T06:57:55.862285+0000","last_unstale":"2024-02-19T06:57:57.296891+0000","last_undegraded":"2024-02-19T06:57:57.296891+0000","last_fullsized":"2024-02-19T06:57:57.296891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299100+0000","last_change":"2024-02-19T06:57:55.869627+0000","last_active":"2024-02-19T06:57:57.299100+0000","last_peered":"2024-02-19T06:57:57.299100+0000","last_clean":"2024-02-19T06:57:57.299100+0000","last_became_active":"2024-02-19T06:57:55.869305+0000","last_became_peered":"2024-02-19T06:57:55.869305+0000","last_unstale":"2024-02-19T06:57:57.299100+0000","last_undegraded":"2024-02-19T06:57:57.299100+0000","last_fullsized":"2024-02-19T06:57:57.299100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:02:01.947104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299832+0000","last_change":"2024-02-19T06:57:55.872539+0000","last_active":"2024-02-19T06:57:57.299832+0000","last_peered":"2024-02-19T06:57:57.299832+0000","last_clean":"2024-02-19T06:57:57.299832+0000","last_became_active":"2024-02-19T06:57:55.871775+0000","last_became_peered":"2024-02-19T06:57:55.871775+0000","last_unstale":"2024-02-19T06:57:57.299832+0000","last_undegraded":"2024-02-19T06:57:57.299832+0000","last_fullsized":"2024-02-19T06:57:57.299832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838731+0000","last_change":"2024-02-19T06:57:55.864536+0000","last_active":"2024-02-19T06:57:56.838731+0000","last_peered":"2024-02-19T06:57:56.838731+0000","last_clean":"2024-02-19T06:57:56.838731+0000","last_became_active":"2024-02-19T06:57:55.864079+0000","last_became_peered":"2024-02-19T06:57:55.864079+0000","last_unstale":"2024-02-19T06:57:56.838731+0000","last_undegraded":"2024-02-19T06:57:56.838731+0000","last_fullsized":"2024-02-19T06:57:56.838731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:47:35.589711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296866+0000","last_change":"2024-02-19T06:57:55.868409+0000","last_active":"2024-02-19T06:57:57.296866+0000","last_peered":"2024-02-19T06:57:57.296866+0000","last_clean":"2024-02-19T06:57:57.296866+0000","last_became_active":"2024-02-19T06:57:55.868136+0000","last_became_peered":"2024-02-19T06:57:55.868136+0000","last_unstale":"2024-02-19T06:57:57.296866+0000","last_undegraded":"2024-02-19T06:57:57.296866+0000","last_fullsized":"2024-02-19T06:57:57.296866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:36:55.635583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296486+0000","last_change":"2024-02-19T06:57:55.883330+0000","last_active":"2024-02-19T06:57:57.296486+0000","last_peered":"2024-02-19T06:57:57.296486+0000","last_clean":"2024-02-19T06:57:57.296486+0000","last_became_active":"2024-02-19T06:57:55.881827+0000","last_became_peered":"2024-02-19T06:57:55.881827+0000","last_unstale":"2024-02-19T06:57:57.296486+0000","last_undegraded":"2024-02-19T06:57:57.296486+0000","last_fullsized":"2024-02-19T06:57:57.296486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:30:53.058177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297284+0000","last_change":"2024-02-19T06:57:55.869285+0000","last_active":"2024-02-19T06:57:57.297284+0000","last_peered":"2024-02-19T06:57:57.297284+0000","last_clean":"2024-02-19T06:57:57.297284+0000","last_became_active":"2024-02-19T06:57:55.868584+0000","last_became_peered":"2024-02-19T06:57:55.868584+0000","last_unstale":"2024-02-19T06:57:57.297284+0000","last_undegraded":"2024-02-19T06:57:57.297284+0000","last_fullsized":"2024-02-19T06:57:57.297284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:19:34.393218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297058+0000","last_change":"2024-02-19T06:57:55.859224+0000","last_active":"2024-02-19T06:57:57.297058+0000","last_peered":"2024-02-19T06:57:57.297058+0000","last_clean":"2024-02-19T06:57:57.297058+0000","last_became_active":"2024-02-19T06:57:55.858917+0000","last_became_peered":"2024-02-19T06:57:55.858917+0000","last_unstale":"2024-02-19T06:57:57.297058+0000","last_undegraded":"2024-02-19T06:57:57.297058+0000","last_fullsized":"2024-02-19T06:57:57.297058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T06:59:02.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297505+0000","last_change":"2024-02-19T06:57:55.874779+0000","last_active":"2024-02-19T06:57:57.297505+0000","last_peered":"2024-02-19T06:57:57.297505+0000","last_clean":"2024-02-19T06:57:57.297505+0000","last_became_active":"2024-02-19T06:57:55.868999+0000","last_became_peered":"2024-02-19T06:57:55.868999+0000","last_unstale":"2024-02-19T06:57:57.297505+0000","last_undegraded":"2024-02-19T06:57:57.297505+0000","last_fullsized":"2024-02-19T06:57:57.297505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:36:55.635583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.840892+0000","last_change":"2024-02-19T06:57:55.848789+0000","last_active":"2024-02-19T06:57:56.840892+0000","last_peered":"2024-02-19T06:57:56.840892+0000","last_clean":"2024-02-19T06:57:56.840892+0000","last_became_active":"2024-02-19T06:57:55.848272+0000","last_became_peered":"2024-02-19T06:57:55.848272+0000","last_unstale":"2024-02-19T06:57:56.840892+0000","last_undegraded":"2024-02-19T06:57:56.840892+0000","last_fullsized":"2024-02-19T06:57:56.840892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:31:25.479236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298851+0000","last_change":"2024-02-19T06:57:54.848533+0000","last_active":"2024-02-19T06:57:57.298851+0000","last_peered":"2024-02-19T06:57:57.298851+0000","last_clean":"2024-02-19T06:57:57.298851+0000","last_became_active":"2024-02-19T06:57:54.847588+0000","last_became_peered":"2024-02-19T06:57:54.847588+0000","last_unstale":"2024-02-19T06:57:57.298851+0000","last_undegraded":"2024-02-19T06:57:57.298851+0000","last_fullsized":"2024-02-19T06:57:57.298851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:48:35.345147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296871+0000","last_change":"2024-02-19T06:57:55.873153+0000","last_active":"2024-02-19T06:57:57.296871+0000","last_peered":"2024-02-19T06:57:57.296871+0000","last_clean":"2024-02-19T06:57:57.296871+0000","last_became_active":"2024-02-19T06:57:55.872845+0000","last_became_peered":"2024-02-19T06:57:55.872845+0000","last_unstale":"2024-02-19T06:57:57.296871+0000","last_undegraded":"2024-02-19T06:57:57.296871+0000","last_fullsized":"2024-02-19T06:57:57.296871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:38:12.022068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298413+0000","last_change":"2024-02-19T06:57:54.845309+0000","last_active":"2024-02-19T06:57:57.298413+0000","last_peered":"2024-02-19T06:57:57.298413+0000","last_clean":"2024-02-19T06:57:57.298413+0000","last_became_active":"2024-02-19T06:57:54.845046+0000","last_became_peered":"2024-02-19T06:57:54.845046+0000","last_unstale":"2024-02-19T06:57:57.298413+0000","last_undegraded":"2024-02-19T06:57:57.298413+0000","last_fullsized":"2024-02-19T06:57:57.298413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:04:53.869596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298172+0000","last_change":"2024-02-19T06:57:54.853227+0000","last_active":"2024-02-19T06:57:57.298172+0000","last_peered":"2024-02-19T06:57:57.298172+0000","last_clean":"2024-02-19T06:57:57.298172+0000","last_became_active":"2024-02-19T06:57:54.852992+0000","last_became_peered":"2024-02-19T06:57:54.852992+0000","last_unstale":"2024-02-19T06:57:57.298172+0000","last_undegraded":"2024-02-19T06:57:57.298172+0000","last_fullsized":"2024-02-19T06:57:57.298172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:28:51.362957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297490+0000","last_change":"2024-02-19T06:57:55.867102+0000","last_active":"2024-02-19T06:57:57.297490+0000","last_peered":"2024-02-19T06:57:57.297490+0000","last_clean":"2024-02-19T06:57:57.297490+0000","last_became_active":"2024-02-19T06:57:55.866831+0000","last_became_peered":"2024-02-19T06:57:55.866831+0000","last_unstale":"2024-02-19T06:57:57.297490+0000","last_undegraded":"2024-02-19T06:57:57.297490+0000","last_fullsized":"2024-02-19T06:57:57.297490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298008+0000","last_change":"2024-02-19T06:57:54.836938+0000","last_active":"2024-02-19T06:57:57.298008+0000","last_peered":"2024-02-19T06:57:57.298008+0000","last_clean":"2024-02-19T06:57:57.298008+0000","last_became_active":"2024-02-19T06:57:54.836538+0000","last_became_peered":"2024-02-19T06:57:54.836538+0000","last_unstale":"2024-02-19T06:57:57.298008+0000","last_undegraded":"2024-02-19T06:57:57.298008+0000","last_fullsized":"2024-02-19T06:57:57.298008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:44:55.409988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838441+0000","last_change":"2024-02-19T06:57:55.857240+0000","last_active":"2024-02-19T06:57:56.838441+0000","last_peered":"2024-02-19T06:57:56.838441+0000","last_clean":"2024-02-19T06:57:56.838441+0000","last_became_active":"2024-02-19T06:57:55.856505+0000","last_became_peered":"2024-02-19T06:57:55.856505+0000","last_unstale":"2024-02-19T06:57:56.838441+0000","last_undegraded":"2024-02-19T06:57:56.838441+0000","last_fullsized":"2024-02-19T06:57:56.838441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:32:53.430159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299283+0000","last_change":"2024-02-19T06:57:54.849649+0000","last_active":"2024-02-19T06:57:57.299283+0000","last_peered":"2024-02-19T06:57:57.299283+0000","last_clean":"2024-02-19T06:57:57.299283+0000","last_became_active":"2024-02-19T06:57:54.848543+0000","last_became_peered":"2024-02-19T06:57:54.848543+0000","last_unstale":"2024-02-19T06:57:57.299283+0000","last_undegraded":"2024-02-19T06:57:57.299283+0000","last_fullsized":"2024-02-19T06:57:57.299283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:59:11.619972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299748+0000","last_change":"2024-02-19T06:57:55.856202+0000","last_active":"2024-02-19T06:57:57.299748+0000","last_peered":"2024-02-19T06:57:57.299748+0000","last_clean":"2024-02-19T06:57:57.299748+0000","last_became_active":"2024-02-19T06:57:55.855896+0000","last_became_peered":"2024-02-19T06:57:55.855896+0000","last_unstale":"2024-02-19T06:57:57.299748+0000","last_undegraded":"2024-02-19T06:57:57.299748+0000","last_fullsized":"2024-02-19T06:57:57.299748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:58:48.198207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298578+0000","last_change":"2024-02-19T06:57:54.849568+0000","last_active":"2024-02-19T06:57:57.298578+0000","last_peered":"2024-02-19T06:57:57.298578+0000","last_clean":"2024-02-19T06:57:57.298578+0000","last_became_active":"2024-02-19T06:57:54.849259+0000","last_became_peered":"2024-02-19T06:57:54.849259+0000","last_unstale":"2024-02-19T06:57:57.298578+0000","last_undegraded":"2024-02-19T06:57:57.298578+0000","last_fullsized":"2024-02-19T06:57:57.298578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:59:11.619972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296283+0000","last_change":"2024-02-19T06:57:55.879987+0000","last_active":"2024-02-19T06:57:57.296283+0000","last_peered":"2024-02-19T06:57:57.296283+0000","last_clean":"2024-02-19T06:57:57.296283+0000","last_became_active":"2024-02-19T06:57:55.874213+0000","last_became_peered":"2024-02-19T06:57:55.874213+0000","last_unstale":"2024-02-19T06:57:57.296283+0000","last_undegraded":"2024-02-19T06:57:57.296283+0000","last_fullsized":"2024-02-19T06:57:57.296283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:13:00.717755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838753+0000","last_change":"2024-02-19T06:57:54.842446+0000","last_active":"2024-02-19T06:57:56.838753+0000","last_peered":"2024-02-19T06:57:56.838753+0000","last_clean":"2024-02-19T06:57:56.838753+0000","last_became_active":"2024-02-19T06:57:54.842159+0000","last_became_peered":"2024-02-19T06:57:54.842159+0000","last_unstale":"2024-02-19T06:57:56.838753+0000","last_undegraded":"2024-02-19T06:57:56.838753+0000","last_fullsized":"2024-02-19T06:57:56.838753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:59:42.541017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842413+0000","last_change":"2024-02-19T06:57:55.861662+0000","last_active":"2024-02-19T06:57:56.842413+0000","last_peered":"2024-02-19T06:57:56.842413+0000","last_clean":"2024-02-19T06:57:56.842413+0000","last_became_active":"2024-02-19T06:57:55.861272+0000","last_became_peered":"2024-02-19T06:57:55.861272+0000","last_unstale":"2024-02-19T06:57:56.842413+0000","last_undegraded":"2024-02-19T06:57:56.842413+0000","last_fullsized":"2024-02-19T06:57:56.842413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:34:02.546590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298720+0000","last_change":"2024-02-19T06:57:54.848390+0000","last_active":"2024-02-19T06:57:57.298720+0000","last_peered":"2024-02-19T06:57:57.298720+0000","last_clean":"2024-02-19T06:57:57.298720+0000","last_became_active":"2024-02-19T06:57:54.848036+0000","last_became_peered":"2024-02-19T06:57:54.848036+0000","last_unstale":"2024-02-19T06:57:57.298720+0000","last_undegraded":"2024-02-19T06:57:57.298720+0000","last_fullsized":"2024-02-19T06:57:57.298720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:44:55.409988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841529+0000","last_change":"2024-02-19T06:57:55.865916+0000","last_active":"2024-02-19T06:57:56.841529+0000","last_peered":"2024-02-19T06:57:56.841529+0000","last_clean":"2024-02-19T06:57:56.841529+0000","last_became_active":"2024-02-19T06:57:55.865239+0000","last_became_peered":"2024-02-19T06:57:55.865239+0000","last_unstale":"2024-02-19T06:57:56.841529+0000","last_undegraded":"2024-02-19T06:57:56.841529+0000","last_fullsized":"2024-02-19T06:57:56.841529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:22:32.626274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297160+0000","last_change":"2024-02-19T06:57:54.845625+0000","last_active":"2024-02-19T06:57:57.297160+0000","last_peered":"2024-02-19T06:57:57.297160+0000","last_clean":"2024-02-19T06:57:57.297160+0000","last_became_active":"2024-02-19T06:57:54.845135+0000","last_became_peered":"2024-02-19T06:57:54.845135+0000","last_unstale":"2024-02-19T06:57:57.297160+0000","last_undegraded":"2024-02-19T06:57:57.297160+0000","last_fullsized":"2024-02-19T06:57:57.297160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:31:12.486420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296648+0000","last_change":"2024-02-19T06:57:55.879354+0000","last_active":"2024-02-19T06:57:57.296648+0000","last_peered":"2024-02-19T06:57:57.296648+0000","last_clean":"2024-02-19T06:57:57.296648+0000","last_became_active":"2024-02-19T06:57:55.878992+0000","last_became_peered":"2024-02-19T06:57:55.878992+0000","last_unstale":"2024-02-19T06:57:57.296648+0000","last_undegraded":"2024-02-19T06:57:57.296648+0000","last_fullsized":"2024-02-19T06:57:57.296648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:02:58.620182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297355+0000","last_change":"2024-02-19T06:57:54.846040+0000","last_active":"2024-02-19T06:57:57.297355+0000","last_peered":"2024-02-19T06:57:57.297355+0000","last_clean":"2024-02-19T06:57:57.297355+0000","last_became_active":"2024-02-19T06:57:54.845607+0000","last_became_peered":"2024-02-19T06:57:54.845607+0000","last_unstale":"2024-02-19T06:57:57.297355+0000","last_undegraded":"2024-02-19T06:57:57.297355+0000","last_fullsized":"2024-02-19T06:57:57.297355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:04:53.869596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841142+0000","last_change":"2024-02-19T06:57:55.873658+0000","last_active":"2024-02-19T06:57:56.841142+0000","last_peered":"2024-02-19T06:57:56.841142+0000","last_clean":"2024-02-19T06:57:56.841142+0000","last_became_active":"2024-02-19T06:57:55.868108+0000","last_became_peered":"2024-02-19T06:57:55.868108+0000","last_unstale":"2024-02-19T06:57:56.841142+0000","last_undegraded":"2024-02-19T06:57:56.841142+0000","last_fullsized":"2024-02-19T06:57:56.841142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:51:32.064277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297967+0000","last_change":"2024-02-19T06:57:54.847587+0000","last_active":"2024-02-19T06:57:57.297967+0000","last_peered":"2024-02-19T06:57:57.297967+0000","last_clean":"2024-02-19T06:57:57.297967+0000","last_became_active":"2024-02-19T06:57:54.844899+0000","last_became_peered":"2024-02-19T06:57:54.844899+0000","last_unstale":"2024-02-19T06:57:57.297967+0000","last_undegraded":"2024-02-19T06:57:57.297967+0000","last_fullsized":"2024-02-19T06:57:57.297967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:51:03.784955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297605+0000","last_change":"2024-02-19T06:57:55.868933+0000","last_active":"2024-02-19T06:57:57.297605+0000","last_peered":"2024-02-19T06:57:57.297605+0000","last_clean":"2024-02-19T06:57:57.297605+0000","last_became_active":"2024-02-19T06:57:55.868592+0000","last_became_peered":"2024-02-19T06:57:55.868592+0000","last_unstale":"2024-02-19T06:57:57.297605+0000","last_undegraded":"2024-02-19T06:57:57.297605+0000","last_fullsized":"2024-02-19T06:57:57.297605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:33:37.227028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297451+0000","last_change":"2024-02-19T06:57:54.831858+0000","last_active":"2024-02-19T06:57:57.297451+0000","last_peered":"2024-02-19T06:57:57.297451+0000","last_clean":"2024-02-19T06:57:57.297451+0000","last_became_active":"2024-02-19T06:57:54.831512+0000","last_became_peered":"2024-02-19T06:57:54.831512+0000","last_unstale":"2024-02-19T06:57:57.297451+0000","last_undegraded":"2024-02-19T06:57:57.297451+0000","last_fullsized":"2024-02-19T06:57:57.297451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:48:18.433112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.839899+0000","last_change":"2024-02-19T06:57:55.872697+0000","last_active":"2024-02-19T06:57:56.839899+0000","last_peered":"2024-02-19T06:57:56.839899+0000","last_clean":"2024-02-19T06:57:56.839899+0000","last_became_active":"2024-02-19T06:57:55.872411+0000","last_became_peered":"2024-02-19T06:57:55.872411+0000","last_unstale":"2024-02-19T06:57:56.839899+0000","last_undegraded":"2024-02-19T06:57:56.839899+0000","last_fullsized":"2024-02-19T06:57:56.839899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:44:33.781212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842124+0000","last_change":"2024-02-19T06:57:54.844428+0000","last_active":"2024-02-19T06:57:56.842124+0000","last_peered":"2024-02-19T06:57:56.842124+0000","last_clean":"2024-02-19T06:57:56.842124+0000","last_became_active":"2024-02-19T06:57:54.844078+0000","last_became_peered":"2024-02-19T06:57:54.844078+0000","last_unstale":"2024-02-19T06:57:56.842124+0000","last_undegraded":"2024-02-19T06:57:56.842124+0000","last_fullsized":"2024-02-19T06:57:56.842124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:48:12.144495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843194+0000","last_change":"2024-02-19T06:57:55.869556+0000","last_active":"2024-02-19T06:57:56.843194+0000","last_peered":"2024-02-19T06:57:56.843194+0000","last_clean":"2024-02-19T06:57:56.843194+0000","last_became_active":"2024-02-19T06:57:55.869252+0000","last_became_peered":"2024-02-19T06:57:55.869252+0000","last_unstale":"2024-02-19T06:57:56.843194+0000","last_undegraded":"2024-02-19T06:57:56.843194+0000","last_fullsized":"2024-02-19T06:57:56.843194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:34:32.534931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298549+0000","last_change":"2024-02-19T06:57:54.848350+0000","last_active":"2024-02-19T06:57:57.298549+0000","last_peered":"2024-02-19T06:57:57.298549+0000","last_clean":"2024-02-19T06:57:57.298549+0000","last_became_active":"2024-02-19T06:57:54.848006+0000","last_became_peered":"2024-02-19T06:57:54.848006+0000","last_unstale":"2024-02-19T06:57:57.298549+0000","last_undegraded":"2024-02-19T06:57:57.298549+0000","last_fullsized":"2024-02-19T06:57:57.298549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:51:48.627075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843747+0000","last_change":"2024-02-19T06:57:55.872749+0000","last_active":"2024-02-19T06:57:56.843747+0000","last_peered":"2024-02-19T06:57:56.843747+0000","last_clean":"2024-02-19T06:57:56.843747+0000","last_became_active":"2024-02-19T06:57:55.872475+0000","last_became_peered":"2024-02-19T06:57:55.872475+0000","last_unstale":"2024-02-19T06:57:56.843747+0000","last_undegraded":"2024-02-19T06:57:56.843747+0000","last_fullsized":"2024-02-19T06:57:56.843747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:48:48.733251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.839076+0000","last_change":"2024-02-19T06:57:54.835766+0000","last_active":"2024-02-19T06:57:56.839076+0000","last_peered":"2024-02-19T06:57:56.839076+0000","last_clean":"2024-02-19T06:57:56.839076+0000","last_became_active":"2024-02-19T06:57:54.835407+0000","last_became_peered":"2024-02-19T06:57:54.835407+0000","last_unstale":"2024-02-19T06:57:56.839076+0000","last_undegraded":"2024-02-19T06:57:56.839076+0000","last_fullsized":"2024-02-19T06:57:56.839076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:09:02.273345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297872+0000","last_change":"2024-02-19T06:57:55.875676+0000","last_active":"2024-02-19T06:57:57.297872+0000","last_peered":"2024-02-19T06:57:57.297872+0000","last_clean":"2024-02-19T06:57:57.297872+0000","last_became_active":"2024-02-19T06:57:55.874703+0000","last_became_peered":"2024-02-19T06:57:55.874703+0000","last_unstale":"2024-02-19T06:57:57.297872+0000","last_undegraded":"2024-02-19T06:57:57.297872+0000","last_fullsized":"2024-02-19T06:57:57.297872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:07:14.896235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298413+0000","last_change":"2024-02-19T06:57:54.842701+0000","last_active":"2024-02-19T06:57:57.298413+0000","last_peered":"2024-02-19T06:57:57.298413+0000","last_clean":"2024-02-19T06:57:57.298413+0000","last_became_active":"2024-02-19T06:57:54.842305+0000","last_became_peered":"2024-02-19T06:57:54.842305+0000","last_unstale":"2024-02-19T06:57:57.298413+0000","last_undegraded":"2024-02-19T06:57:57.298413+0000","last_fullsized":"2024-02-19T06:57:57.298413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:31:12.486420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842830+0000","last_change":"2024-02-19T06:57:55.865803+0000","last_active":"2024-02-19T06:57:56.842830+0000","last_peered":"2024-02-19T06:57:56.842830+0000","last_clean":"2024-02-19T06:57:56.842830+0000","last_became_active":"2024-02-19T06:57:55.865239+0000","last_became_peered":"2024-02-19T06:57:55.865239+0000","last_unstale":"2024-02-19T06:57:56.842830+0000","last_undegraded":"2024-02-19T06:57:56.842830+0000","last_fullsized":"2024-02-19T06:57:56.842830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:14:32.464297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841305+0000","last_change":"2024-02-19T06:57:45.353063+0000","last_active":"2024-02-19T06:57:56.841305+0000","last_peered":"2024-02-19T06:57:56.841305+0000","last_clean":"2024-02-19T06:57:56.841305+0000","last_became_active":"2024-02-19T06:57:45.350602+0000","last_became_peered":"2024-02-19T06:57:45.350602+0000","last_unstale":"2024-02-19T06:57:56.841305+0000","last_undegraded":"2024-02-19T06:57:56.841305+0000","last_fullsized":"2024-02-19T06:57:56.841305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_clean_scrub_stamp":"2024-02-19T06:57:44.230095+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:04:42.513180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297047+0000","last_change":"2024-02-19T06:57:54.839055+0000","last_active":"2024-02-19T06:57:57.297047+0000","last_peered":"2024-02-19T06:57:57.297047+0000","last_clean":"2024-02-19T06:57:57.297047+0000","last_became_active":"2024-02-19T06:57:54.838769+0000","last_became_peered":"2024-02-19T06:57:54.838769+0000","last_unstale":"2024-02-19T06:57:57.297047+0000","last_undegraded":"2024-02-19T06:57:57.297047+0000","last_fullsized":"2024-02-19T06:57:57.297047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:48:35.345147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.295995+0000","last_change":"2024-02-19T06:57:55.864141+0000","last_active":"2024-02-19T06:57:57.295995+0000","last_peered":"2024-02-19T06:57:57.295995+0000","last_clean":"2024-02-19T06:57:57.295995+0000","last_became_active":"2024-02-19T06:57:55.863841+0000","last_became_peered":"2024-02-19T06:57:55.863841+0000","last_unstale":"2024-02-19T06:57:57.295995+0000","last_undegraded":"2024-02-19T06:57:57.295995+0000","last_fullsized":"2024-02-19T06:57:57.295995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:18:12.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841663+0000","last_change":"2024-02-19T06:57:54.830847+0000","last_active":"2024-02-19T06:57:56.841663+0000","last_peered":"2024-02-19T06:57:56.841663+0000","last_clean":"2024-02-19T06:57:56.841663+0000","last_became_active":"2024-02-19T06:57:54.830511+0000","last_became_peered":"2024-02-19T06:57:54.830511+0000","last_unstale":"2024-02-19T06:57:56.841663+0000","last_undegraded":"2024-02-19T06:57:56.841663+0000","last_fullsized":"2024-02-19T06:57:56.841663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T06:59:01.746042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.295829+0000","last_change":"2024-02-19T06:57:55.870925+0000","last_active":"2024-02-19T06:57:57.295829+0000","last_peered":"2024-02-19T06:57:57.295829+0000","last_clean":"2024-02-19T06:57:57.295829+0000","last_became_active":"2024-02-19T06:57:55.870616+0000","last_became_peered":"2024-02-19T06:57:55.870616+0000","last_unstale":"2024-02-19T06:57:57.295829+0000","last_undegraded":"2024-02-19T06:57:57.295829+0000","last_fullsized":"2024-02-19T06:57:57.295829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:43:48.726828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297970+0000","last_change":"2024-02-19T06:57:54.848662+0000","last_active":"2024-02-19T06:57:57.297970+0000","last_peered":"2024-02-19T06:57:57.297970+0000","last_clean":"2024-02-19T06:57:57.297970+0000","last_became_active":"2024-02-19T06:57:54.848378+0000","last_became_peered":"2024-02-19T06:57:54.848378+0000","last_unstale":"2024-02-19T06:57:57.297970+0000","last_undegraded":"2024-02-19T06:57:57.297970+0000","last_fullsized":"2024-02-19T06:57:57.297970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:48:40.438231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.837477+0000","last_change":"2024-02-19T06:57:55.848725+0000","last_active":"2024-02-19T06:57:56.837477+0000","last_peered":"2024-02-19T06:57:56.837477+0000","last_clean":"2024-02-19T06:57:56.837477+0000","last_became_active":"2024-02-19T06:57:55.846707+0000","last_became_peered":"2024-02-19T06:57:55.846707+0000","last_unstale":"2024-02-19T06:57:56.837477+0000","last_undegraded":"2024-02-19T06:57:56.837477+0000","last_fullsized":"2024-02-19T06:57:56.837477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:36:55.635583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297591+0000","last_change":"2024-02-19T06:57:54.836285+0000","last_active":"2024-02-19T06:57:57.297591+0000","last_peered":"2024-02-19T06:57:57.297591+0000","last_clean":"2024-02-19T06:57:57.297591+0000","last_became_active":"2024-02-19T06:57:54.831238+0000","last_became_peered":"2024-02-19T06:57:54.831238+0000","last_unstale":"2024-02-19T06:57:57.297591+0000","last_undegraded":"2024-02-19T06:57:57.297591+0000","last_fullsized":"2024-02-19T06:57:57.297591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:51:03.784955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841596+0000","last_change":"2024-02-19T06:57:55.884751+0000","last_active":"2024-02-19T06:57:56.841596+0000","last_peered":"2024-02-19T06:57:56.841596+0000","last_clean":"2024-02-19T06:57:56.841596+0000","last_became_active":"2024-02-19T06:57:55.884444+0000","last_became_peered":"2024-02-19T06:57:55.884444+0000","last_unstale":"2024-02-19T06:57:56.841596+0000","last_undegraded":"2024-02-19T06:57:56.841596+0000","last_fullsized":"2024-02-19T06:57:56.841596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T06:59:02.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838502+0000","last_change":"2024-02-19T06:57:54.849999+0000","last_active":"2024-02-19T06:57:56.838502+0000","last_peered":"2024-02-19T06:57:56.838502+0000","last_clean":"2024-02-19T06:57:56.838502+0000","last_became_active":"2024-02-19T06:57:54.849632+0000","last_became_peered":"2024-02-19T06:57:54.849632+0000","last_unstale":"2024-02-19T06:57:56.838502+0000","last_undegraded":"2024-02-19T06:57:56.838502+0000","last_fullsized":"2024-02-19T06:57:56.838502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:59:11.619972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298324+0000","last_change":"2024-02-19T06:57:55.864794+0000","last_active":"2024-02-19T06:57:57.298324+0000","last_peered":"2024-02-19T06:57:57.298324+0000","last_clean":"2024-02-19T06:57:57.298324+0000","last_became_active":"2024-02-19T06:57:55.864493+0000","last_became_peered":"2024-02-19T06:57:55.864493+0000","last_unstale":"2024-02-19T06:57:57.298324+0000","last_undegraded":"2024-02-19T06:57:57.298324+0000","last_fullsized":"2024-02-19T06:57:57.298324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:13:32.804426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.843295+0000","last_change":"2024-02-19T06:57:54.844059+0000","last_active":"2024-02-19T06:57:56.843295+0000","last_peered":"2024-02-19T06:57:56.843295+0000","last_clean":"2024-02-19T06:57:56.843295+0000","last_became_active":"2024-02-19T06:57:54.843728+0000","last_became_peered":"2024-02-19T06:57:54.843728+0000","last_unstale":"2024-02-19T06:57:56.843295+0000","last_undegraded":"2024-02-19T06:57:56.843295+0000","last_fullsized":"2024-02-19T06:57:56.843295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:29:04.812047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838149+0000","last_change":"2024-02-19T06:57:55.850256+0000","last_active":"2024-02-19T06:57:56.838149+0000","last_peered":"2024-02-19T06:57:56.838149+0000","last_clean":"2024-02-19T06:57:56.838149+0000","last_became_active":"2024-02-19T06:57:55.846503+0000","last_became_peered":"2024-02-19T06:57:55.846503+0000","last_unstale":"2024-02-19T06:57:56.838149+0000","last_undegraded":"2024-02-19T06:57:56.838149+0000","last_fullsized":"2024-02-19T06:57:56.838149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:19:13.712235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.695919+0000","last_change":"2024-02-19T06:57:54.845587+0000","last_active":"2024-02-19T06:57:57.695919+0000","last_peered":"2024-02-19T06:57:57.695919+0000","last_clean":"2024-02-19T06:57:57.695919+0000","last_became_active":"2024-02-19T06:57:54.844017+0000","last_became_peered":"2024-02-19T06:57:54.844017+0000","last_unstale":"2024-02-19T06:57:57.695919+0000","last_undegraded":"2024-02-19T06:57:57.695919+0000","last_fullsized":"2024-02-19T06:57:57.695919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:11:06.185390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299468+0000","last_change":"2024-02-19T06:57:55.873485+0000","last_active":"2024-02-19T06:57:57.299468+0000","last_peered":"2024-02-19T06:57:57.299468+0000","last_clean":"2024-02-19T06:57:57.299468+0000","last_became_active":"2024-02-19T06:57:55.873179+0000","last_became_peered":"2024-02-19T06:57:55.873179+0000","last_unstale":"2024-02-19T06:57:57.299468+0000","last_undegraded":"2024-02-19T06:57:57.299468+0000","last_fullsized":"2024-02-19T06:57:57.299468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:45:59.994639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.299321+0000","last_change":"2024-02-19T06:57:54.849235+0000","last_active":"2024-02-19T06:57:57.299321+0000","last_peered":"2024-02-19T06:57:57.299321+0000","last_clean":"2024-02-19T06:57:57.299321+0000","last_became_active":"2024-02-19T06:57:54.848969+0000","last_became_peered":"2024-02-19T06:57:54.848969+0000","last_unstale":"2024-02-19T06:57:57.299321+0000","last_undegraded":"2024-02-19T06:57:57.299321+0000","last_fullsized":"2024-02-19T06:57:57.299321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:59:42.541017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297324+0000","last_change":"2024-02-19T06:57:55.878312+0000","last_active":"2024-02-19T06:57:57.297324+0000","last_peered":"2024-02-19T06:57:57.297324+0000","last_clean":"2024-02-19T06:57:57.297324+0000","last_became_active":"2024-02-19T06:57:55.872331+0000","last_became_peered":"2024-02-19T06:57:55.872331+0000","last_unstale":"2024-02-19T06:57:57.297324+0000","last_undegraded":"2024-02-19T06:57:57.297324+0000","last_fullsized":"2024-02-19T06:57:57.297324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:16:19.287368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841162+0000","last_change":"2024-02-19T06:57:54.851412+0000","last_active":"2024-02-19T06:57:56.841162+0000","last_peered":"2024-02-19T06:57:56.841162+0000","last_clean":"2024-02-19T06:57:56.841162+0000","last_became_active":"2024-02-19T06:57:54.849764+0000","last_became_peered":"2024-02-19T06:57:54.849764+0000","last_unstale":"2024-02-19T06:57:56.841162+0000","last_undegraded":"2024-02-19T06:57:56.841162+0000","last_fullsized":"2024-02-19T06:57:56.841162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:31:24.467437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.840874+0000","last_change":"2024-02-19T06:57:55.859782+0000","last_active":"2024-02-19T06:57:56.840874+0000","last_peered":"2024-02-19T06:57:56.840874+0000","last_clean":"2024-02-19T06:57:56.840874+0000","last_became_active":"2024-02-19T06:57:55.859506+0000","last_became_peered":"2024-02-19T06:57:55.859506+0000","last_unstale":"2024-02-19T06:57:56.840874+0000","last_undegraded":"2024-02-19T06:57:56.840874+0000","last_fullsized":"2024-02-19T06:57:56.840874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:14:51.291554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.838183+0000","last_change":"2024-02-19T06:57:54.833195+0000","last_active":"2024-02-19T06:57:56.838183+0000","last_peered":"2024-02-19T06:57:56.838183+0000","last_clean":"2024-02-19T06:57:56.838183+0000","last_became_active":"2024-02-19T06:57:54.832921+0000","last_became_peered":"2024-02-19T06:57:54.832921+0000","last_unstale":"2024-02-19T06:57:56.838183+0000","last_undegraded":"2024-02-19T06:57:56.838183+0000","last_fullsized":"2024-02-19T06:57:56.838183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:51:03.784955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297856+0000","last_change":"2024-02-19T06:57:55.863807+0000","last_active":"2024-02-19T06:57:57.297856+0000","last_peered":"2024-02-19T06:57:57.297856+0000","last_clean":"2024-02-19T06:57:57.297856+0000","last_became_active":"2024-02-19T06:57:55.862327+0000","last_became_peered":"2024-02-19T06:57:55.862327+0000","last_unstale":"2024-02-19T06:57:57.297856+0000","last_undegraded":"2024-02-19T06:57:57.297856+0000","last_fullsized":"2024-02-19T06:57:57.297856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:41:50.687629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.837924+0000","last_change":"2024-02-19T06:57:54.847191+0000","last_active":"2024-02-19T06:57:56.837924+0000","last_peered":"2024-02-19T06:57:56.837924+0000","last_clean":"2024-02-19T06:57:56.837924+0000","last_became_active":"2024-02-19T06:57:54.846893+0000","last_became_peered":"2024-02-19T06:57:54.846893+0000","last_unstale":"2024-02-19T06:57:56.837924+0000","last_undegraded":"2024-02-19T06:57:56.837924+0000","last_fullsized":"2024-02-19T06:57:56.837924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:44:55.409988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298592+0000","last_change":"2024-02-19T06:57:55.882338+0000","last_active":"2024-02-19T06:57:57.298592+0000","last_peered":"2024-02-19T06:57:57.298592+0000","last_clean":"2024-02-19T06:57:57.298592+0000","last_became_active":"2024-02-19T06:57:55.881014+0000","last_became_peered":"2024-02-19T06:57:55.881014+0000","last_unstale":"2024-02-19T06:57:57.298592+0000","last_undegraded":"2024-02-19T06:57:57.298592+0000","last_fullsized":"2024-02-19T06:57:57.298592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:19:34.393218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841316+0000","last_change":"2024-02-19T06:57:54.845977+0000","last_active":"2024-02-19T06:57:56.841316+0000","last_peered":"2024-02-19T06:57:56.841316+0000","last_clean":"2024-02-19T06:57:56.841316+0000","last_became_active":"2024-02-19T06:57:54.845651+0000","last_became_peered":"2024-02-19T06:57:54.845651+0000","last_unstale":"2024-02-19T06:57:56.841316+0000","last_undegraded":"2024-02-19T06:57:56.841316+0000","last_fullsized":"2024-02-19T06:57:56.841316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:42:34.912061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297311+0000","last_change":"2024-02-19T06:57:55.870900+0000","last_active":"2024-02-19T06:57:57.297311+0000","last_peered":"2024-02-19T06:57:57.297311+0000","last_clean":"2024-02-19T06:57:57.297311+0000","last_became_active":"2024-02-19T06:57:55.870632+0000","last_became_peered":"2024-02-19T06:57:55.870632+0000","last_unstale":"2024-02-19T06:57:57.297311+0000","last_undegraded":"2024-02-19T06:57:57.297311+0000","last_fullsized":"2024-02-19T06:57:57.297311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:18:12.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.298148+0000","last_change":"2024-02-19T06:57:55.863948+0000","last_active":"2024-02-19T06:57:57.298148+0000","last_peered":"2024-02-19T06:57:57.298148+0000","last_clean":"2024-02-19T06:57:57.298148+0000","last_became_active":"2024-02-19T06:57:55.863663+0000","last_became_peered":"2024-02-19T06:57:55.863663+0000","last_unstale":"2024-02-19T06:57:57.298148+0000","last_undegraded":"2024-02-19T06:57:57.298148+0000","last_fullsized":"2024-02-19T06:57:57.298148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:06:41.609470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.841684+0000","last_change":"2024-02-19T06:57:54.841874+0000","last_active":"2024-02-19T06:57:56.841684+0000","last_peered":"2024-02-19T06:57:56.841684+0000","last_clean":"2024-02-19T06:57:56.841684+0000","last_became_active":"2024-02-19T06:57:54.841500+0000","last_became_peered":"2024-02-19T06:57:54.841500+0000","last_unstale":"2024-02-19T06:57:56.841684+0000","last_undegraded":"2024-02-19T06:57:56.841684+0000","last_fullsized":"2024-02-19T06:57:56.841684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:34:01.534791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297567+0000","last_change":"2024-02-19T06:57:55.864005+0000","last_active":"2024-02-19T06:57:57.297567+0000","last_peered":"2024-02-19T06:57:57.297567+0000","last_clean":"2024-02-19T06:57:57.297567+0000","last_became_active":"2024-02-19T06:57:55.863634+0000","last_became_peered":"2024-02-19T06:57:55.863634+0000","last_unstale":"2024-02-19T06:57:57.297567+0000","last_undegraded":"2024-02-19T06:57:57.297567+0000","last_fullsized":"2024-02-19T06:57:57.297567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:45:59.994639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:56.842721+0000","last_change":"2024-02-19T06:57:54.845418+0000","last_active":"2024-02-19T06:57:56.842721+0000","last_peered":"2024-02-19T06:57:56.842721+0000","last_clean":"2024-02-19T06:57:56.842721+0000","last_became_active":"2024-02-19T06:57:54.845134+0000","last_became_peered":"2024-02-19T06:57:54.845134+0000","last_unstale":"2024-02-19T06:57:56.842721+0000","last_undegraded":"2024-02-19T06:57:56.842721+0000","last_fullsized":"2024-02-19T06:57:56.842721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:37:22.505873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.295990+0000","last_change":"2024-02-19T06:57:55.880160+0000","last_active":"2024-02-19T06:57:57.295990+0000","last_peered":"2024-02-19T06:57:57.295990+0000","last_clean":"2024-02-19T06:57:57.295990+0000","last_became_active":"2024-02-19T06:57:55.879826+0000","last_became_peered":"2024-02-19T06:57:55.879826+0000","last_unstale":"2024-02-19T06:57:57.295990+0000","last_undegraded":"2024-02-19T06:57:57.295990+0000","last_fullsized":"2024-02-19T06:57:57.295990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:31:58.448215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297341+0000","last_change":"2024-02-19T06:57:54.848100+0000","last_active":"2024-02-19T06:57:57.297341+0000","last_peered":"2024-02-19T06:57:57.297341+0000","last_clean":"2024-02-19T06:57:57.297341+0000","last_became_active":"2024-02-19T06:57:54.847632+0000","last_became_peered":"2024-02-19T06:57:54.847632+0000","last_unstale":"2024-02-19T06:57:57.297341+0000","last_undegraded":"2024-02-19T06:57:57.297341+0000","last_fullsized":"2024-02-19T06:57:57.297341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:04:53.869596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.297229+0000","last_change":"2024-02-19T06:57:55.873869+0000","last_active":"2024-02-19T06:57:57.297229+0000","last_peered":"2024-02-19T06:57:57.297229+0000","last_clean":"2024-02-19T06:57:57.297229+0000","last_became_active":"2024-02-19T06:57:55.873711+0000","last_became_peered":"2024-02-19T06:57:55.873711+0000","last_unstale":"2024-02-19T06:57:57.297229+0000","last_undegraded":"2024-02-19T06:57:57.297229+0000","last_fullsized":"2024-02-19T06:57:57.297229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:54.798564+0000","last_clean_scrub_stamp":"2024-02-19T06:57:54.798564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:19:13.712235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-19T06:57:57.296492+0000","last_change":"2024-02-19T06:57:54.846614+0000","last_active":"2024-02-19T06:57:57.296492+0000","last_peered":"2024-02-19T06:57:57.296492+0000","last_clean":"2024-02-19T06:57:57.296492+0000","last_became_active":"2024-02-19T06:57:54.846293+0000","last_became_peered":"2024-02-19T06:57:54.846293+0000","last_unstale":"2024-02-19T06:57:57.296492+0000","last_undegraded":"2024-02-19T06:57:57.296492+0000","last_fullsized":"2024-02-19T06:57:57.296492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:53.786764+0000","last_clean_scrub_stamp":"2024-02-19T06:57:53.786764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:14:50.279754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":79738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7969999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.865}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6719999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":78216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3119999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8580000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.234}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6059999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":669076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6319999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.722}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9950000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":78252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.893}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":79738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4020000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7969999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.927}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.956}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":78126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7330000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":78286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6850000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5670000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":669132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T06:58:06.555 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-19T06:58:06.555 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-19T06:58:06.555 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-19T06:58:06.555 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-19T06:58:06.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.806+0000 7fe546c00640 1 Processor -- start 2024-02-19T06:58:06.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.807+0000 7fe546c00640 1 -- start start 2024-02-19T06:58:06.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.808+0000 7fe546c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe54006da30 0x7fe5400b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:06.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.808+0000 7fe546c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe5400ced00 0x7fe5400b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:06.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.808+0000 7fe546c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5400cdde0 con 0x7fe54015a670 2024-02-19T06:58:06.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.808+0000 7fe546c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54006df10 con 0x7fe5400ced00 2024-02-19T06:58:06.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.808+0000 7fe546c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400cd4b0 con 0x7fe54006da30 2024-02-19T06:58:06.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.809+0000 7fe53fe00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe54015a670 0x7fe5400ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:32774/0 (socket says 172.21.15.46:32774) 2024-02-19T06:58:06.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.809+0000 7fe53fe00640 1 -- 172.21.15.46:0/2923202486 learned_addr learned my addr 172.21.15.46:0/2923202486 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:06.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.809+0000 7fe544c00640 1 --2- 172.21.15.46:0/2923202486 >> v2:172.21.15.142:3300/0 conn(0x7fe5400ced00 0x7fe5400b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:06.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.809+0000 7fe537e00640 1 --2- 172.21.15.46:0/2923202486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe54006da30 0x7fe5400b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:06.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.809+0000 7fe53f400640 1 -- 172.21.15.46:0/2923202486 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066286473 0 0) 0x7fe5400cdde0 con 0x7fe54015a670 2024-02-19T06:58:06.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.809+0000 7fe53f400640 1 -- 172.21.15.46:0/2923202486 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe524005730 con 0x7fe54015a670 2024-02-19T06:58:06.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.809+0000 7fe537e00640 1 -- 172.21.15.46:0/2923202486 >> v2:172.21.15.142:3300/0 conn(0x7fe5400ced00 msgr2=0x7fe5400b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:06.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.809+0000 7fe537e00640 1 --2- 172.21.15.46:0/2923202486 >> v2:172.21.15.142:3300/0 conn(0x7fe5400ced00 0x7fe5400b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.809+0000 7fe537e00640 1 -- 172.21.15.46:0/2923202486 >> v1:172.21.15.142:6789/0 conn(0x7fe54015a670 legacy=0x7fe5400ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:06.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.809+0000 7fe537e00640 1 -- 172.21.15.46:0/2923202486 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5400cd790 con 0x7fe54006da30 2024-02-19T06:58:06.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.811+0000 7fe537e00640 1 --2- 172.21.15.46:0/2923202486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe54006da30 0x7fe5400b2460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe5280097a0 tx=0x7fe52802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d16f530a81b52a8 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:06.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.811+0000 7fe53f400640 1 -- 172.21.15.46:0/2923202486 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528031830 con 0x7fe54006da30 2024-02-19T06:58:06.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.811+0000 7fe53f400640 1 -- 172.21.15.46:0/2923202486 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe528031990 con 0x7fe54006da30 2024-02-19T06:58:06.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.811+0000 7fe53f400640 1 -- 172.21.15.46:0/2923202486 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528031d00 con 0x7fe54006da30 2024-02-19T06:58:06.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.812+0000 7fe546c00640 1 -- 172.21.15.46:0/2923202486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe54006da30 msgr2=0x7fe5400b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:06.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.812+0000 7fe546c00640 1 --2- 172.21.15.46:0/2923202486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe54006da30 0x7fe5400b2460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe5280097a0 tx=0x7fe52802b8d0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.812+0000 7fe546c00640 1 -- 172.21.15.46:0/2923202486 shutdown_connections 2024-02-19T06:58:06.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.812+0000 7fe546c00640 1 --2- 172.21.15.46:0/2923202486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe54006da30 0x7fe5400b2460 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.812+0000 7fe546c00640 1 --2- 172.21.15.46:0/2923202486 >> v2:172.21.15.142:3300/0 conn(0x7fe5400ced00 0x7fe5400b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.812+0000 7fe546c00640 1 -- 172.21.15.46:0/2923202486 >> 172.21.15.46:0/2923202486 conn(0x7fe540066f70 msgr2=0x7fe54006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:06.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.812+0000 7fe546c00640 1 -- 172.21.15.46:0/2923202486 shutdown_connections 2024-02-19T06:58:06.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.812+0000 7fe546c00640 1 -- 172.21.15.46:0/2923202486 wait complete. 2024-02-19T06:58:06.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.813+0000 7fe546c00640 1 Processor -- start 2024-02-19T06:58:06.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.814+0000 7fe546c00640 1 -- start start 2024-02-19T06:58:06.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.814+0000 7fe546c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54006da30 0x7fe540150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:06.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe546c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5400ced00 0x7fe54015ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:06.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe546c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe54015a670 0x7fe5401ef670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:06.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe546c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe540151190 con 0x7fe54015a670 2024-02-19T06:58:06.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe546c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe540157460 con 0x7fe54006da30 2024-02-19T06:58:06.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe546c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe540157700 con 0x7fe5400ced00 2024-02-19T06:58:06.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe544c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe54015a670 0x7fe5401ef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:06.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe544c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe54015a670 0x7fe5401ef670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41728/0 (socket says 172.21.15.46:41728) 2024-02-19T06:58:06.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe544c00640 1 -- 172.21.15.46:0/2069516180 learned_addr learned my addr 172.21.15.46:0/2069516180 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:06.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe53fe00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54006da30 0x7fe540150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:06.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe537e00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5400ced00 0x7fe54015ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:06.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe544c00640 1 -- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5400ced00 msgr2=0x7fe54015ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:06.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe544c00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5400ced00 0x7fe54015ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe544c00640 1 -- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54006da30 msgr2=0x7fe540150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:06.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe544c00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54006da30 0x7fe540150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:06.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe544c00640 1 -- 172.21.15.46:0/2069516180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe528009400 con 0x7fe54015a670 2024-02-19T06:58:06.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.815+0000 7fe53fe00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54006da30 0x7fe540150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:06.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.816+0000 7fe544c00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe54015a670 0x7fe5401ef670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe53800efc0 tx=0x7fe53800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:06.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.816+0000 7fe53cc00640 1 -- 172.21.15.46:0/2069516180 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538014480 con 0x7fe54015a670 2024-02-19T06:58:06.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.816+0000 7fe53cc00640 1 -- 172.21.15.46:0/2069516180 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53800f040 con 0x7fe54015a670 2024-02-19T06:58:06.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.816+0000 7fe546c00640 1 -- 172.21.15.46:0/2069516180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5401579e0 con 0x7fe54015a670 2024-02-19T06:58:06.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.816+0000 7fe53cc00640 1 -- 172.21.15.46:0/2069516180 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538014820 con 0x7fe54015a670 2024-02-19T06:58:06.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.816+0000 7fe546c00640 1 -- 172.21.15.46:0/2069516180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe540150dd0 con 0x7fe54015a670 2024-02-19T06:58:06.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.817+0000 7fe546c00640 1 -- 172.21.15.46:0/2069516180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe540067ba0 con 0x7fe54015a670 2024-02-19T06:58:06.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.818+0000 7fe53cc00640 1 -- 172.21.15.46:0/2069516180 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe538014980 con 0x7fe54015a670 2024-02-19T06:58:06.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.819+0000 7fe53cc00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe51c06b810 0x7fe51c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:06.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.819+0000 7fe53cc00640 1 -- 172.21.15.46:0/2069516180 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe53808b1c0 con 0x7fe54015a670 2024-02-19T06:58:06.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.820+0000 7fe53fe00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe51c06b810 0x7fe51c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:06.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.821+0000 7fe53fe00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe51c06b810 0x7fe51c06dcd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe530007fd0 tx=0x7fe530009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:06.824+0000 7fe53cc00640 1 -- 172.21.15.46:0/2069516180 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe538055b40 con 0x7fe54015a670 2024-02-19T06:58:07.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.061+0000 7fe546c00640 1 -- 172.21.15.46:0/2069516180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe54006e1a0 con 0x7fe54015a670 2024-02-19T06:58:07.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.062+0000 7fe53cc00640 1 -- 172.21.15.46:0/2069516180 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe538059200 con 0x7fe54015a670 2024-02-19T06:58:07.064 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:07.065 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-19T06:58:07.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.064+0000 7fe546c00640 1 -- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe51c06b810 msgr2=0x7fe51c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:07.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.064+0000 7fe546c00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe51c06b810 0x7fe51c06dcd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe530007fd0 tx=0x7fe530009040 comp rx=0 tx=0).stop 2024-02-19T06:58:07.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.064+0000 7fe546c00640 1 -- 172.21.15.46:0/2069516180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe54015a670 msgr2=0x7fe5401ef670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:07.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.065+0000 7fe546c00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe54015a670 0x7fe5401ef670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe53800efc0 tx=0x7fe53800c490 comp rx=0 tx=0).stop 2024-02-19T06:58:07.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.065+0000 7fe546c00640 1 -- 172.21.15.46:0/2069516180 shutdown_connections 2024-02-19T06:58:07.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.065+0000 7fe546c00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe51c06b810 0x7fe51c06dcd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.065+0000 7fe546c00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe54015a670 0x7fe5401ef670 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.065+0000 7fe546c00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5400ced00 0x7fe54015ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.065+0000 7fe546c00640 1 --2- 172.21.15.46:0/2069516180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe54006da30 0x7fe540150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.065+0000 7fe546c00640 1 -- 172.21.15.46:0/2069516180 >> 172.21.15.46:0/2069516180 conn(0x7fe540066f70 msgr2=0x7fe54006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:07.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.065+0000 7fe546c00640 1 -- 172.21.15.46:0/2069516180 shutdown_connections 2024-02-19T06:58:07.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.065+0000 7fe546c00640 1 -- 172.21.15.46:0/2069516180 wait complete. 2024-02-19T06:58:07.085 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-19T06:58:07.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:07.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.304+0000 7f8857e00640 1 Processor -- start 2024-02-19T06:58:07.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.304+0000 7f8857e00640 1 -- start start 2024-02-19T06:58:07.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.305+0000 7f8857e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f88580cfe50 0x7f88580cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:07.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.305+0000 7f8857e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88580b3150 0x7f88580b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.305+0000 7f8857e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88580ac1a0 con 0x7f88580add30 2024-02-19T06:58:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.305+0000 7f8857e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88580ae110 con 0x7f88580cfe50 2024-02-19T06:58:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.305+0000 7f8857e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580cccb0 con 0x7f88580b3150 2024-02-19T06:58:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.306+0000 7f884e000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f88580cfe50 0x7f88580cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.306+0000 7f884e000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f88580cfe50 0x7f88580cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41730/0 (socket says 172.21.15.46:41730) 2024-02-19T06:58:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.306+0000 7f884e000640 1 -- 172.21.15.46:0/1400645702 learned_addr learned my addr 172.21.15.46:0/1400645702 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.306+0000 7f8857400640 1 --2- 172.21.15.46:0/1400645702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88580b3150 0x7f88580b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.306+0000 7f884e000640 1 -- 172.21.15.46:0/1400645702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88580b3150 msgr2=0x7f88580b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.306+0000 7f884e000640 1 --2- 172.21.15.46:0/1400645702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88580b3150 0x7f88580b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.306+0000 7f884e000640 1 -- 172.21.15.46:0/1400645702 >> v1:172.21.15.142:6789/0 conn(0x7f88580add30 legacy=0x7f88580cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.306+0000 7f884e000640 1 -- 172.21.15.46:0/1400645702 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580cded0 con 0x7f88580cfe50 2024-02-19T06:58:07.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.307+0000 7f884e000640 1 --2- 172.21.15.46:0/1400645702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88580cfe50 0x7f88580cc770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f88400098a0 tx=0x7f884002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f529193a65ce0805 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:07.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.308+0000 7f8856000640 1 -- 172.21.15.46:0/1400645702 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840031640 con 0x7f88580cfe50 2024-02-19T06:58:07.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.308+0000 7f8856000640 1 -- 172.21.15.46:0/1400645702 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88400317a0 con 0x7f88580cfe50 2024-02-19T06:58:07.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.308+0000 7f8856000640 1 -- 172.21.15.46:0/1400645702 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840031b30 con 0x7f88580cfe50 2024-02-19T06:58:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.308+0000 7f8857e00640 1 -- 172.21.15.46:0/1400645702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88580cfe50 msgr2=0x7f88580cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.308+0000 7f8857e00640 1 --2- 172.21.15.46:0/1400645702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88580cfe50 0x7f88580cc770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f88400098a0 tx=0x7f884002b8f0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.308+0000 7f8857e00640 1 -- 172.21.15.46:0/1400645702 shutdown_connections 2024-02-19T06:58:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.308+0000 7f8857e00640 1 --2- 172.21.15.46:0/1400645702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88580b3150 0x7f88580b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.308+0000 7f8857e00640 1 --2- 172.21.15.46:0/1400645702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88580cfe50 0x7f88580cc770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.308+0000 7f8857e00640 1 -- 172.21.15.46:0/1400645702 >> 172.21.15.46:0/1400645702 conn(0x7f885806afa0 msgr2=0x7f885806b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.308+0000 7f8857e00640 1 -- 172.21.15.46:0/1400645702 shutdown_connections 2024-02-19T06:58:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.308+0000 7f8857e00640 1 -- 172.21.15.46:0/1400645702 wait complete. 2024-02-19T06:58:07.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.310+0000 7f8857e00640 1 Processor -- start 2024-02-19T06:58:07.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.310+0000 7f8857e00640 1 -- start start 2024-02-19T06:58:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.311+0000 7f8857e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88580add30 0x7f88580c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.311+0000 7f8857e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88580b3150 0x7f88580c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.311+0000 7f8857e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88580cfe50 0x7f88580b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.311+0000 7f8857e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580af1b0 con 0x7f88580add30 2024-02-19T06:58:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.311+0000 7f8857e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581f6b00 con 0x7f88580cfe50 2024-02-19T06:58:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.311+0000 7f8857e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580aeed0 con 0x7f88580b3150 2024-02-19T06:58:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.312+0000 7f8856a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88580add30 0x7f88580c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.312+0000 7f8856a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88580add30 0x7f88580c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41736/0 (socket says 172.21.15.46:41736) 2024-02-19T06:58:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.312+0000 7f8856a00640 1 -- 172.21.15.46:0/3546700761 learned_addr learned my addr 172.21.15.46:0/3546700761 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.312+0000 7f884e000640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88580b3150 0x7f88580c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.312+0000 7f8857400640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88580cfe50 0x7f88580b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.312+0000 7f8856a00640 1 -- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88580b3150 msgr2=0x7f88580c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.312+0000 7f8856a00640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88580b3150 0x7f88580c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.312+0000 7f8856a00640 1 -- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88580cfe50 msgr2=0x7f88580b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.312+0000 7f8856a00640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88580cfe50 0x7f88580b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.312+0000 7f8856a00640 1 -- 172.21.15.46:0/3546700761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88400094d0 con 0x7f88580add30 2024-02-19T06:58:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.312+0000 7f8857400640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88580cfe50 0x7f88580b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.312+0000 7f8856a00640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88580add30 0x7f88580c85f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f884800c430 tx=0x7f884800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.313+0000 7f884fe00640 1 -- 172.21.15.46:0/3546700761 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848011790 con 0x7f88580add30 2024-02-19T06:58:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.313+0000 7f884fe00640 1 -- 172.21.15.46:0/3546700761 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88480118f0 con 0x7f88580add30 2024-02-19T06:58:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.313+0000 7f8857e00640 1 -- 172.21.15.46:0/3546700761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88580afe80 con 0x7f88580add30 2024-02-19T06:58:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.313+0000 7f884fe00640 1 -- 172.21.15.46:0/3546700761 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848011ce0 con 0x7f88580add30 2024-02-19T06:58:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.313+0000 7f8857e00640 1 -- 172.21.15.46:0/3546700761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88580b0440 con 0x7f88580add30 2024-02-19T06:58:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.314+0000 7f8857e00640 1 -- 172.21.15.46:0/3546700761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88580b0630 con 0x7f88580add30 2024-02-19T06:58:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.315+0000 7f884fe00640 1 -- 172.21.15.46:0/3546700761 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f884801c460 con 0x7f88580add30 2024-02-19T06:58:07.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.316+0000 7f884fe00640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f883406b840 0x7f883406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:07.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.316+0000 7f884fe00640 1 -- 172.21.15.46:0/3546700761 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f884808a140 con 0x7f88580add30 2024-02-19T06:58:07.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.317+0000 7f884e000640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f883406b840 0x7f883406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.318+0000 7f884e000640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f883406b840 0x7f883406dd00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8840036000 tx=0x7f884003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:07.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.321+0000 7f884fe00640 1 -- 172.21.15.46:0/3546700761 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8848054b60 con 0x7f88580add30 2024-02-19T06:58:07.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.514+0000 7f8857e00640 1 -- 172.21.15.46:0/3546700761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f885804eee0 con 0x7f88580add30 2024-02-19T06:58:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.517+0000 7f884fe00640 1 -- 172.21.15.46:0/3546700761 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f8848058220 con 0x7f88580add30 2024-02-19T06:58:07.521 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:07.521 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:56.828629+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:07.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.520+0000 7f8857e00640 1 -- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f883406b840 msgr2=0x7f883406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:07.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.520+0000 7f8857e00640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f883406b840 0x7f883406dd00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8840036000 tx=0x7f884003c040 comp rx=0 tx=0).stop 2024-02-19T06:58:07.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.520+0000 7f8857e00640 1 -- 172.21.15.46:0/3546700761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88580add30 msgr2=0x7f88580c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:07.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.520+0000 7f8857e00640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88580add30 0x7f88580c85f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f884800c430 tx=0x7f884800c8f0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.520+0000 7f8857e00640 1 -- 172.21.15.46:0/3546700761 shutdown_connections 2024-02-19T06:58:07.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.520+0000 7f8857e00640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f883406b840 0x7f883406dd00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.520+0000 7f8857e00640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88580cfe50 0x7f88580b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.520+0000 7f8857e00640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88580b3150 0x7f88580c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.520+0000 7f8857e00640 1 --2- 172.21.15.46:0/3546700761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88580add30 0x7f88580c85f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.520+0000 7f8857e00640 1 -- 172.21.15.46:0/3546700761 >> 172.21.15.46:0/3546700761 conn(0x7f885806afa0 msgr2=0x7f88580b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:07.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.520+0000 7f8857e00640 1 -- 172.21.15.46:0/3546700761 shutdown_connections 2024-02-19T06:58:07.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.520+0000 7f8857e00640 1 -- 172.21.15.46:0/3546700761 wait complete. 2024-02-19T06:58:07.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:07.542 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:07.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.768+0000 7f074c800640 1 Processor -- start 2024-02-19T06:58:07.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.768+0000 7f074c800640 1 -- start start 2024-02-19T06:58:07.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.770+0000 7f074c800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07440cf3d0 0x7f07440cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:07.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.770+0000 7f074c800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f074406d680 0x7f074406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:07.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.770+0000 7f074c800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0744071e80 con 0x7f0744145050 2024-02-19T06:58:07.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.770+0000 7f074c800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0744071020 con 0x7f074406d680 2024-02-19T06:58:07.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.770+0000 7f074c800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07440aef70 con 0x7f07440cf3d0 2024-02-19T06:58:07.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.770+0000 7f074a800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f074406d680 0x7f074406daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:07.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.770+0000 7f074a800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f074406d680 0x7f074406daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41742/0 (socket says 172.21.15.46:41742) 2024-02-19T06:58:07.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.770+0000 7f074a800640 1 -- 172.21.15.46:0/518810022 learned_addr learned my addr 172.21.15.46:0/518810022 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:07.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.770+0000 7f0749400640 1 --2- 172.21.15.46:0/518810022 >> v2:172.21.15.142:3300/0 conn(0x7f07440cf3d0 0x7f07440cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:07.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.771+0000 7f074a800640 1 -- 172.21.15.46:0/518810022 >> v2:172.21.15.142:3300/0 conn(0x7f07440cf3d0 msgr2=0x7f07440cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:07.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.771+0000 7f074a800640 1 --2- 172.21.15.46:0/518810022 >> v2:172.21.15.142:3300/0 conn(0x7f07440cf3d0 0x7f07440cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.771+0000 7f074a800640 1 -- 172.21.15.46:0/518810022 >> v1:172.21.15.142:6789/0 conn(0x7f0744145050 legacy=0x7f07440cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:07.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.771+0000 7f074a800640 1 -- 172.21.15.46:0/518810022 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07440cfd70 con 0x7f074406d680 2024-02-19T06:58:07.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.772+0000 7f074a800640 1 --2- 172.21.15.46:0/518810022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f074406d680 0x7f074406daf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f07440b4b50 tx=0x7f074002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd86f30df765cf5b server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:07.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.772+0000 7f0748a00640 1 -- 172.21.15.46:0/518810022 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074002ca80 con 0x7f074406d680 2024-02-19T06:58:07.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.772+0000 7f0748a00640 1 -- 172.21.15.46:0/518810022 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074002cbe0 con 0x7f074406d680 2024-02-19T06:58:07.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.772+0000 7f0748a00640 1 -- 172.21.15.46:0/518810022 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07400343f0 con 0x7f074406d680 2024-02-19T06:58:07.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.773+0000 7f074c800640 1 -- 172.21.15.46:0/518810022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f074406d680 msgr2=0x7f074406daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:07.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.773+0000 7f074c800640 1 --2- 172.21.15.46:0/518810022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f074406d680 0x7f074406daf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f07440b4b50 tx=0x7f074002bee0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.773+0000 7f074c800640 1 -- 172.21.15.46:0/518810022 shutdown_connections 2024-02-19T06:58:07.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.773+0000 7f074c800640 1 --2- 172.21.15.46:0/518810022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f074406d680 0x7f074406daf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.773+0000 7f074c800640 1 --2- 172.21.15.46:0/518810022 >> v2:172.21.15.142:3300/0 conn(0x7f07440cf3d0 0x7f07440cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.773+0000 7f074c800640 1 -- 172.21.15.46:0/518810022 >> 172.21.15.46:0/518810022 conn(0x7f0744066fc0 msgr2=0x7f074406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:07.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.773+0000 7f074c800640 1 -- 172.21.15.46:0/518810022 shutdown_connections 2024-02-19T06:58:07.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.773+0000 7f074c800640 1 -- 172.21.15.46:0/518810022 wait complete. 2024-02-19T06:58:07.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.775+0000 7f074c800640 1 Processor -- start 2024-02-19T06:58:07.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.775+0000 7f074c800640 1 -- start start 2024-02-19T06:58:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.776+0000 7f074c800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f074406d680 0x7f074415b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.776+0000 7f074c800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07440cf3d0 0x7f0744140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:07.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.776+0000 7f074c800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0744145050 0x7f0744141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.776+0000 7f074c800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0744140c30 con 0x7f0744145050 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.776+0000 7f074c800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074415c340 con 0x7f07440cf3d0 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.776+0000 7f074c800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0744140670 con 0x7f074406d680 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.777+0000 7f074a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0744145050 0x7f0744141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.777+0000 7f074a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0744145050 0x7f0744141450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41756/0 (socket says 172.21.15.46:41756) 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.777+0000 7f074a800640 1 -- 172.21.15.46:0/3783091150 learned_addr learned my addr 172.21.15.46:0/3783091150 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.777+0000 7f0749e00640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f074406d680 0x7f074415b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.777+0000 7f0749400640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07440cf3d0 0x7f0744140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.777+0000 7f074a800640 1 -- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f074406d680 msgr2=0x7f074415b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.777+0000 7f074a800640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f074406d680 0x7f074415b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.777+0000 7f074a800640 1 -- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07440cf3d0 msgr2=0x7f0744140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.777+0000 7f074a800640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07440cf3d0 0x7f0744140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.777+0000 7f074a800640 1 -- 172.21.15.46:0/3783091150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0740009b30 con 0x7f0744145050 2024-02-19T06:58:07.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.777+0000 7f074a800640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0744145050 0x7f0744141450 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0740036040 tx=0x7f0740004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.778+0000 7f073e000640 1 -- 172.21.15.46:0/3783091150 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0740009510 con 0x7f0744145050 2024-02-19T06:58:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.778+0000 7f073e000640 1 -- 172.21.15.46:0/3783091150 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074003e450 con 0x7f0744145050 2024-02-19T06:58:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.778+0000 7f073e000640 1 -- 172.21.15.46:0/3783091150 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074003e7e0 con 0x7f0744145050 2024-02-19T06:58:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.778+0000 7f074c800640 1 -- 172.21.15.46:0/3783091150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0744140950 con 0x7f0744145050 2024-02-19T06:58:07.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.778+0000 7f074c800640 1 -- 172.21.15.46:0/3783091150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074415b540 con 0x7f0744145050 2024-02-19T06:58:07.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.779+0000 7f074c800640 1 -- 172.21.15.46:0/3783091150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074415be30 con 0x7f0744145050 2024-02-19T06:58:07.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.780+0000 7f073e000640 1 -- 172.21.15.46:0/3783091150 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f074002cd50 con 0x7f0744145050 2024-02-19T06:58:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.781+0000 7f073e000640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f072806b810 0x7f072806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.781+0000 7f073e000640 1 -- 172.21.15.46:0/3783091150 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07400acd90 con 0x7f0744145050 2024-02-19T06:58:07.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.781+0000 7f0749e00640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f072806b810 0x7f072806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:07.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.782+0000 7f0749e00640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f072806b810 0x7f072806dcd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0738006fd0 tx=0x7f0738008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.785+0000 7f073e000640 1 -- 172.21.15.46:0/3783091150 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f074415be30 con 0x7f0744145050 2024-02-19T06:58:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.984+0000 7f074c800640 1 -- 172.21.15.46:0/3783091150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f074415be30 con 0x7f0744145050 2024-02-19T06:58:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.985+0000 7f073e000640 1 -- 172.21.15.46:0/3783091150 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f074415be30 con 0x7f0744145050 2024-02-19T06:58:07.988 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.988+0000 7f074c800640 1 -- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f072806b810 msgr2=0x7f072806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.988+0000 7f074c800640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f072806b810 0x7f072806dcd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0738006fd0 tx=0x7f0738008040 comp rx=0 tx=0).stop 2024-02-19T06:58:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.988+0000 7f074c800640 1 -- 172.21.15.46:0/3783091150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0744145050 msgr2=0x7f0744141450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.988+0000 7f074c800640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0744145050 0x7f0744141450 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0740036040 tx=0x7f0740004a40 comp rx=0 tx=0).stop 2024-02-19T06:58:07.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.988+0000 7f074c800640 1 -- 172.21.15.46:0/3783091150 shutdown_connections 2024-02-19T06:58:07.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.988+0000 7f074c800640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f072806b810 0x7f072806dcd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.988+0000 7f074c800640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0744145050 0x7f0744141450 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.988+0000 7f074c800640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07440cf3d0 0x7f0744140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.988+0000 7f074c800640 1 --2- 172.21.15.46:0/3783091150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f074406d680 0x7f074415b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:07.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.988+0000 7f074c800640 1 -- 172.21.15.46:0/3783091150 >> 172.21.15.46:0/3783091150 conn(0x7f0744066fc0 msgr2=0x7f0744142b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:07.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.989+0000 7f074c800640 1 -- 172.21.15.46:0/3783091150 shutdown_connections 2024-02-19T06:58:07.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:07.989+0000 7f074c800640 1 -- 172.21.15.46:0/3783091150 wait complete. 2024-02-19T06:58:08.011 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.231+0000 7fcc4c400640 1 Processor -- start 2024-02-19T06:58:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.232+0000 7fcc4c400640 1 -- start start 2024-02-19T06:58:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.233+0000 7fcc4c400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcc4415dc00 0x7fcc4415dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.233+0000 7fcc4c400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcc440aec10 0x7fcc44161d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.233+0000 7fcc4c400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc44162260 0x7fcc440cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.233+0000 7fcc4c400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4406ef90 con 0x7fcc4415dc00 2024-02-19T06:58:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.233+0000 7fcc4c400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc44161560 con 0x7fcc440aec10 2024-02-19T06:58:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.233+0000 7fcc4c400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4415e830 con 0x7fcc44162260 2024-02-19T06:58:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.234+0000 7fcc49a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcc4415dc00 0x7fcc4415dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.234+0000 7fcc49a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcc4415dc00 0x7fcc4415dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41760/0 (socket says 172.21.15.46:41760) 2024-02-19T06:58:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.234+0000 7fcc49a00640 1 -- 172.21.15.46:0/1295722919 learned_addr learned my addr 172.21.15.46:0/1295722919 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.234+0000 7fcc4a400640 1 --2- 172.21.15.46:0/1295722919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc44162260 0x7fcc440cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.234+0000 7fcc49000640 1 --2- 172.21.15.46:0/1295722919 >> v2:172.21.15.142:3300/0 conn(0x7fcc440aec10 0x7fcc44161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:08.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.234+0000 7fcc49a00640 1 -- 172.21.15.46:0/1295722919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc44162260 msgr2=0x7fcc440cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:08.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.234+0000 7fcc49a00640 1 --2- 172.21.15.46:0/1295722919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc44162260 0x7fcc440cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.234+0000 7fcc49a00640 1 -- 172.21.15.46:0/1295722919 >> v2:172.21.15.142:3300/0 conn(0x7fcc440aec10 msgr2=0x7fcc44161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:08.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.234+0000 7fcc49a00640 1 --2- 172.21.15.46:0/1295722919 >> v2:172.21.15.142:3300/0 conn(0x7fcc440aec10 0x7fcc44161d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.234+0000 7fcc49a00640 1 -- 172.21.15.46:0/1295722919 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4415eb10 con 0x7fcc4415dc00 2024-02-19T06:58:08.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.234+0000 7fcc49000640 1 --2- 172.21.15.46:0/1295722919 >> v2:172.21.15.142:3300/0 conn(0x7fcc440aec10 0x7fcc44161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:08.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.236+0000 7fcc49a00640 1 --2- 172.21.15.46:0/1295722919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc4415dc00 0x7fcc4415dfe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcc440b4b10 tx=0x7fcc3802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93da8ec19476a03 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:08.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.236+0000 7fcc43e00640 1 -- 172.21.15.46:0/1295722919 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38031860 con 0x7fcc4415dc00 2024-02-19T06:58:08.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.236+0000 7fcc43e00640 1 -- 172.21.15.46:0/1295722919 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc380319c0 con 0x7fcc4415dc00 2024-02-19T06:58:08.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.236+0000 7fcc43e00640 1 -- 172.21.15.46:0/1295722919 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38031d50 con 0x7fcc4415dc00 2024-02-19T06:58:08.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.237+0000 7fcc4c400640 1 -- 172.21.15.46:0/1295722919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc4415dc00 msgr2=0x7fcc4415dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:08.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.237+0000 7fcc4c400640 1 --2- 172.21.15.46:0/1295722919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc4415dc00 0x7fcc4415dfe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcc440b4b10 tx=0x7fcc3802b900 comp rx=0 tx=0).stop 2024-02-19T06:58:08.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.237+0000 7fcc4c400640 1 -- 172.21.15.46:0/1295722919 shutdown_connections 2024-02-19T06:58:08.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.237+0000 7fcc4c400640 1 --2- 172.21.15.46:0/1295722919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc44162260 0x7fcc440cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.237+0000 7fcc4c400640 1 --2- 172.21.15.46:0/1295722919 >> v2:172.21.15.142:3300/0 conn(0x7fcc440aec10 0x7fcc44161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.237+0000 7fcc4c400640 1 --2- 172.21.15.46:0/1295722919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc4415dc00 0x7fcc4415dfe0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.237+0000 7fcc4c400640 1 -- 172.21.15.46:0/1295722919 >> 172.21.15.46:0/1295722919 conn(0x7fcc44066fc0 msgr2=0x7fcc4406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:08.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.237+0000 7fcc4c400640 1 -- 172.21.15.46:0/1295722919 shutdown_connections 2024-02-19T06:58:08.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.237+0000 7fcc4c400640 1 -- 172.21.15.46:0/1295722919 wait complete. 2024-02-19T06:58:08.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.239+0000 7fcc4c400640 1 Processor -- start 2024-02-19T06:58:08.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.239+0000 7fcc4c400640 1 -- start start 2024-02-19T06:58:08.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc4c400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc440aec10 0x7fcc44155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:08.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc4c400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4415dc00 0x7fcc44157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:08.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc4c400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc44162260 0x7fcc4414af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:08.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc4c400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4415f160 con 0x7fcc440aec10 2024-02-19T06:58:08.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc4c400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4415f440 con 0x7fcc4415dc00 2024-02-19T06:58:08.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc4c400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4415f720 con 0x7fcc44162260 2024-02-19T06:58:08.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc49a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc440aec10 0x7fcc44155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:08.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc49a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc440aec10 0x7fcc44155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41764/0 (socket says 172.21.15.46:41764) 2024-02-19T06:58:08.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc49a00640 1 -- 172.21.15.46:0/2427581493 learned_addr learned my addr 172.21.15.46:0/2427581493 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:08.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc49a00640 1 -- 172.21.15.46:0/2427581493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc44162260 msgr2=0x7fcc4414af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:08.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc49a00640 1 --2- 172.21.15.46:0/2427581493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc44162260 0x7fcc4414af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc49a00640 1 -- 172.21.15.46:0/2427581493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4415dc00 msgr2=0x7fcc44157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:08.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc49a00640 1 --2- 172.21.15.46:0/2427581493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4415dc00 0x7fcc44157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.240+0000 7fcc49a00640 1 -- 172.21.15.46:0/2427581493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc380094d0 con 0x7fcc440aec10 2024-02-19T06:58:08.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.241+0000 7fcc49a00640 1 --2- 172.21.15.46:0/2427581493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc440aec10 0x7fcc44155910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcc3802b940 tx=0x7fcc380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:08.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.241+0000 7fcc41600640 1 -- 172.21.15.46:0/2427581493 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3803ad30 con 0x7fcc440aec10 2024-02-19T06:58:08.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.241+0000 7fcc41600640 1 -- 172.21.15.46:0/2427581493 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc380443f0 con 0x7fcc440aec10 2024-02-19T06:58:08.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.241+0000 7fcc4c400640 1 -- 172.21.15.46:0/2427581493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4415fa00 con 0x7fcc440aec10 2024-02-19T06:58:08.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.241+0000 7fcc41600640 1 -- 172.21.15.46:0/2427581493 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc380447a0 con 0x7fcc440aec10 2024-02-19T06:58:08.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.241+0000 7fcc4c400640 1 -- 172.21.15.46:0/2427581493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc44155e50 con 0x7fcc440aec10 2024-02-19T06:58:08.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.242+0000 7fcc4c400640 1 -- 172.21.15.46:0/2427581493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4415ff20 con 0x7fcc440aec10 2024-02-19T06:58:08.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.243+0000 7fcc41600640 1 -- 172.21.15.46:0/2427581493 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcc3804d450 con 0x7fcc440aec10 2024-02-19T06:58:08.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.244+0000 7fcc41600640 1 --2- 172.21.15.46:0/2427581493 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcc2406b840 0x7fcc2406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:08.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.244+0000 7fcc41600640 1 -- 172.21.15.46:0/2427581493 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc380ac730 con 0x7fcc440aec10 2024-02-19T06:58:08.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.245+0000 7fcc49000640 1 --2- 172.21.15.46:0/2427581493 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcc2406b840 0x7fcc2406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:08.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.246+0000 7fcc49000640 1 --2- 172.21.15.46:0/2427581493 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcc2406b840 0x7fcc2406dd00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcc30006fd0 tx=0x7fcc30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.249+0000 7fcc41600640 1 -- 172.21.15.46:0/2427581493 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc4415ff20 con 0x7fcc440aec10 2024-02-19T06:58:08.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.447+0000 7fcc4c400640 1 -- 172.21.15.46:0/2427581493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc4415ff20 con 0x7fcc440aec10 2024-02-19T06:58:08.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.448+0000 7fcc41600640 1 -- 172.21.15.46:0/2427581493 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc4415ff20 con 0x7fcc440aec10 2024-02-19T06:58:08.451 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.451+0000 7fcc4c400640 1 -- 172.21.15.46:0/2427581493 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcc2406b840 msgr2=0x7fcc2406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.451+0000 7fcc4c400640 1 --2- 172.21.15.46:0/2427581493 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcc2406b840 0x7fcc2406dd00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcc30006fd0 tx=0x7fcc30008040 comp rx=0 tx=0).stop 2024-02-19T06:58:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.451+0000 7fcc4c400640 1 -- 172.21.15.46:0/2427581493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc440aec10 msgr2=0x7fcc44155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.451+0000 7fcc4c400640 1 --2- 172.21.15.46:0/2427581493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc440aec10 0x7fcc44155910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcc3802b940 tx=0x7fcc380046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.451+0000 7fcc4c400640 1 -- 172.21.15.46:0/2427581493 shutdown_connections 2024-02-19T06:58:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.451+0000 7fcc4c400640 1 --2- 172.21.15.46:0/2427581493 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcc2406b840 0x7fcc2406dd00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.451+0000 7fcc4c400640 1 --2- 172.21.15.46:0/2427581493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc44162260 0x7fcc4414af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.451+0000 7fcc4c400640 1 --2- 172.21.15.46:0/2427581493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4415dc00 0x7fcc44157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.451+0000 7fcc4c400640 1 --2- 172.21.15.46:0/2427581493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc440aec10 0x7fcc44155910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.451+0000 7fcc4c400640 1 -- 172.21.15.46:0/2427581493 >> 172.21.15.46:0/2427581493 conn(0x7fcc44066fc0 msgr2=0x7fcc44071890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.451+0000 7fcc4c400640 1 -- 172.21.15.46:0/2427581493 shutdown_connections 2024-02-19T06:58:08.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.451+0000 7fcc4c400640 1 -- 172.21.15.46:0/2427581493 wait complete. 2024-02-19T06:58:08.471 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:08.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.699+0000 7f2284200640 1 Processor -- start 2024-02-19T06:58:08.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.699+0000 7f2284200640 1 -- start start 2024-02-19T06:58:08.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.701+0000 7f2284200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f227c0aec10 0x7f227c161d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.701+0000 7f2284200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c161560 con 0x7f227c162260 2024-02-19T06:58:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.701+0000 7f2284200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c15e830 con 0x7f227c15dc00 2024-02-19T06:58:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.701+0000 7f2284200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c06ef90 con 0x7f227c0aec10 2024-02-19T06:58:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.701+0000 7f2282200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f227c162260 0x7f227c0cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59964/0 (socket says 172.21.15.46:59964) 2024-02-19T06:58:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.701+0000 7f2282200640 1 -- 172.21.15.46:0/3383046851 learned_addr learned my addr 172.21.15.46:0/3383046851 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:08.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.702+0000 7f2280e00640 1 --2- 172.21.15.46:0/3383046851 >> v2:172.21.15.46:3300/0 conn(0x7f227c0aec10 0x7f227c161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:08.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.702+0000 7f227be00640 1 -- 172.21.15.46:0/3383046851 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091388455 0 0) 0x7f227c161560 con 0x7f227c162260 2024-02-19T06:58:08.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.702+0000 7f227be00640 1 -- 172.21.15.46:0/3383046851 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2264003520 con 0x7f227c162260 2024-02-19T06:58:08.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.702+0000 7f2280e00640 1 -- 172.21.15.46:0/3383046851 >> v1:172.21.15.142:6789/0 conn(0x7f227c15dc00 legacy=0x7f227c15dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:08.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.702+0000 7f2280e00640 1 -- 172.21.15.46:0/3383046851 >> v1:172.21.15.46:6789/0 conn(0x7f227c162260 legacy=0x7f227c0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:08.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.702+0000 7f2280e00640 1 -- 172.21.15.46:0/3383046851 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c15eb10 con 0x7f227c0aec10 2024-02-19T06:58:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.703+0000 7f2280e00640 1 --2- 172.21.15.46:0/3383046851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f227c0aec10 0x7f227c161d20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f22680097a0 tx=0x7f226802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4aec3f6e8f87cd server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.704+0000 7f227be00640 1 -- 172.21.15.46:0/3383046851 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268030610 con 0x7f227c0aec10 2024-02-19T06:58:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.704+0000 7f227be00640 1 -- 172.21.15.46:0/3383046851 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2268030770 con 0x7f227c0aec10 2024-02-19T06:58:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.704+0000 7f227be00640 1 -- 172.21.15.46:0/3383046851 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268030b00 con 0x7f227c0aec10 2024-02-19T06:58:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.704+0000 7f2284200640 1 -- 172.21.15.46:0/3383046851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f227c0aec10 msgr2=0x7f227c161d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.704+0000 7f2284200640 1 --2- 172.21.15.46:0/3383046851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f227c0aec10 0x7f227c161d20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f22680097a0 tx=0x7f226802b960 comp rx=0 tx=0).stop 2024-02-19T06:58:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.704+0000 7f2284200640 1 -- 172.21.15.46:0/3383046851 shutdown_connections 2024-02-19T06:58:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.704+0000 7f2284200640 1 --2- 172.21.15.46:0/3383046851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f227c0aec10 0x7f227c161d20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.704+0000 7f2284200640 1 -- 172.21.15.46:0/3383046851 >> 172.21.15.46:0/3383046851 conn(0x7f227c066fc0 msgr2=0x7f227c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.704+0000 7f2284200640 1 -- 172.21.15.46:0/3383046851 shutdown_connections 2024-02-19T06:58:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.704+0000 7f2284200640 1 -- 172.21.15.46:0/3383046851 wait complete. 2024-02-19T06:58:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.706+0000 7f2284200640 1 Processor -- start 2024-02-19T06:58:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.707+0000 7f2284200640 1 -- start start 2024-02-19T06:58:08.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.708+0000 7f2284200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f227c0aec10 0x7f227c14c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:08.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.708+0000 7f2284200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c15dc00 0x7f227c15f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:08.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.708+0000 7f2284200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c162260 0x7f227c15f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:08.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.708+0000 7f2284200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c160df0 con 0x7f227c0aec10 2024-02-19T06:58:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.708+0000 7f2284200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c14c720 con 0x7f227c162260 2024-02-19T06:58:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.708+0000 7f2284200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c1601e0 con 0x7f227c15dc00 2024-02-19T06:58:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.708+0000 7f2281800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f227c0aec10 0x7f227c14c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.708+0000 7f2281800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f227c0aec10 0x7f227c14c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41774/0 (socket says 172.21.15.46:41774) 2024-02-19T06:58:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.708+0000 7f2281800640 1 -- 172.21.15.46:0/632851297 learned_addr learned my addr 172.21.15.46:0/632851297 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.709+0000 7f2280e00640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c15dc00 0x7f227c15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.709+0000 7f2282200640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c162260 0x7f227c15f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.709+0000 7f2281800640 1 -- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c15dc00 msgr2=0x7f227c15f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.709+0000 7f2281800640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c15dc00 0x7f227c15f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.709+0000 7f2281800640 1 -- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c162260 msgr2=0x7f227c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.709+0000 7f2281800640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c162260 0x7f227c15f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.709+0000 7f2281800640 1 -- 172.21.15.46:0/632851297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2268009400 con 0x7f227c0aec10 2024-02-19T06:58:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.709+0000 7f2281800640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f227c0aec10 0x7f227c14c1e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f227000c3c0 tx=0x7f227000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:08.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.709+0000 7f2279600640 1 -- 172.21.15.46:0/632851297 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22700052d0 con 0x7f227c0aec10 2024-02-19T06:58:08.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.710+0000 7f2279600640 1 -- 172.21.15.46:0/632851297 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2270005450 con 0x7f227c0aec10 2024-02-19T06:58:08.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.710+0000 7f2279600640 1 -- 172.21.15.46:0/632851297 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270007260 con 0x7f227c0aec10 2024-02-19T06:58:08.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.710+0000 7f2284200640 1 -- 172.21.15.46:0/632851297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c1604c0 con 0x7f227c0aec10 2024-02-19T06:58:08.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.710+0000 7f2284200640 1 -- 172.21.15.46:0/632851297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c160a80 con 0x7f227c0aec10 2024-02-19T06:58:08.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.711+0000 7f2284200640 1 -- 172.21.15.46:0/632851297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c067ba0 con 0x7f227c0aec10 2024-02-19T06:58:08.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.712+0000 7f2279600640 1 -- 172.21.15.46:0/632851297 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f22700073c0 con 0x7f227c0aec10 2024-02-19T06:58:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.713+0000 7f2279600640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f225c06b840 0x7f225c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.713+0000 7f2279600640 1 -- 172.21.15.46:0/632851297 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2270089600 con 0x7f227c0aec10 2024-02-19T06:58:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.713+0000 7f2280e00640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f225c06b840 0x7f225c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.714+0000 7f2280e00640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f225c06b840 0x7f225c06dd00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2268036000 tx=0x7f226803b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.717+0000 7f2279600640 1 -- 172.21.15.46:0/632851297 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2270053f80 con 0x7f227c0aec10 2024-02-19T06:58:08.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.915+0000 7f2284200640 1 -- 172.21.15.46:0/632851297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f227c0d02f0 con 0x7f227c0aec10 2024-02-19T06:58:08.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.916+0000 7f2279600640 1 -- 172.21.15.46:0/632851297 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2270057640 con 0x7f227c0aec10 2024-02-19T06:58:08.919 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:08.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.918+0000 7f2284200640 1 -- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f225c06b840 msgr2=0x7f225c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:08.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.918+0000 7f2284200640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f225c06b840 0x7f225c06dd00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2268036000 tx=0x7f226803b040 comp rx=0 tx=0).stop 2024-02-19T06:58:08.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.918+0000 7f2284200640 1 -- 172.21.15.46:0/632851297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f227c0aec10 msgr2=0x7f227c14c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:08.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.918+0000 7f2284200640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f227c0aec10 0x7f227c14c1e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f227000c3c0 tx=0x7f227000c880 comp rx=0 tx=0).stop 2024-02-19T06:58:08.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.919+0000 7f2284200640 1 -- 172.21.15.46:0/632851297 shutdown_connections 2024-02-19T06:58:08.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.919+0000 7f2284200640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f225c06b840 0x7f225c06dd00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.919+0000 7f2284200640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f227c162260 0x7f227c15f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.919+0000 7f2284200640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f227c15dc00 0x7f227c15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.919+0000 7f2284200640 1 --2- 172.21.15.46:0/632851297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f227c0aec10 0x7f227c14c1e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:08.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.919+0000 7f2284200640 1 -- 172.21.15.46:0/632851297 >> 172.21.15.46:0/632851297 conn(0x7f227c066fc0 msgr2=0x7f227c0ad1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:08.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.919+0000 7f2284200640 1 -- 172.21.15.46:0/632851297 shutdown_connections 2024-02-19T06:58:08.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:08.919+0000 7f2284200640 1 -- 172.21.15.46:0/632851297 wait complete. 2024-02-19T06:58:08.939 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T06:58:09.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.154+0000 7fa799400640 1 Processor -- start 2024-02-19T06:58:09.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.155+0000 7fa799400640 1 -- start start 2024-02-19T06:58:09.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.156+0000 7fa799400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa794162360 0x7fa7940d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.156+0000 7fa799400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa7940b17c0 0x7fa7940cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.156+0000 7fa799400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7940ccb40 con 0x7fa7940b1360 2024-02-19T06:58:09.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.156+0000 7fa799400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7940cce20 con 0x7fa7940b17c0 2024-02-19T06:58:09.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.156+0000 7fa799400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79406b800 con 0x7fa794162360 2024-02-19T06:58:09.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.157+0000 7fa789e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa7940b1360 0x7fa7940ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59974/0 (socket says 172.21.15.46:59974) 2024-02-19T06:58:09.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.157+0000 7fa789e00640 1 -- 172.21.15.46:0/399271412 learned_addr learned my addr 172.21.15.46:0/399271412 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:09.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.157+0000 7fa793200640 1 --2- 172.21.15.46:0/399271412 >> v2:172.21.15.142:3300/0 conn(0x7fa7940b17c0 0x7fa7940cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.157+0000 7fa792800640 1 --2- 172.21.15.46:0/399271412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa794162360 0x7fa7940d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.157+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176041587 0 0) 0x7fa7940ccb40 con 0x7fa7940b1360 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.157+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa778003520 con 0x7fa7940b1360 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.157+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2292316839 0 0) 0x7fa778003520 con 0x7fa7940b1360 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.157+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa794162360 msgr2=0x7fa7940d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.157+0000 7fa791e00640 1 --2- 172.21.15.46:0/399271412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa794162360 0x7fa7940d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.157+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 >> v2:172.21.15.142:3300/0 conn(0x7fa7940b17c0 msgr2=0x7fa7940cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.157+0000 7fa791e00640 1 --2- 172.21.15.46:0/399271412 >> v2:172.21.15.142:3300/0 conn(0x7fa7940b17c0 0x7fa7940cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.157+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79406ad20 con 0x7fa7940b1360 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.157+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fa77c001670 con 0x7fa7940b1360 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 >> v1:172.21.15.46:6789/0 conn(0x7fa7940b1360 legacy=0x7fa7940ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa791e00640 1 --2- 172.21.15.46:0/399271412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa778003970 0x7fa778003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa791e00640 1 --2- 172.21.15.46:0/399271412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7780047c0 0x7fa778004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa791e00640 1 --2- 172.21.15.46:0/399271412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa794162360 0x7fa778005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940cce20 con 0x7fa7780047c0 2024-02-19T06:58:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79406b800 con 0x7fa778003970 2024-02-19T06:58:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77800b980 con 0x7fa794162360 2024-02-19T06:58:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa789e00640 1 --2- 172.21.15.46:0/399271412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7780047c0 0x7fa778004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa792800640 1 --2- 172.21.15.46:0/399271412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa778003970 0x7fa778003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa793200640 1 --2- 172.21.15.46:0/399271412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa794162360 0x7fa778005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa789e00640 1 -- 172.21.15.46:0/399271412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa794162360 msgr2=0x7fa778005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa789e00640 1 --2- 172.21.15.46:0/399271412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa794162360 0x7fa778005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa789e00640 1 -- 172.21.15.46:0/399271412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa778003970 msgr2=0x7fa778003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa789e00640 1 --2- 172.21.15.46:0/399271412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa778003970 0x7fa778003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa789e00640 1 -- 172.21.15.46:0/399271412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa778003520 con 0x7fa7780047c0 2024-02-19T06:58:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.158+0000 7fa793200640 1 --2- 172.21.15.46:0/399271412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa794162360 0x7fa778005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:09.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.159+0000 7fa789e00640 1 --2- 172.21.15.46:0/399271412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7780047c0 0x7fa778004c40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c270 tx=0x7fa7780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d6329ef9d45f12 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:09.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.160+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c02cae0 con 0x7fa7780047c0 2024-02-19T06:58:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.160+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c02cc40 con 0x7fa7780047c0 2024-02-19T06:58:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.160+0000 7fa791e00640 1 -- 172.21.15.46:0/399271412 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0058d0 con 0x7fa7780047c0 2024-02-19T06:58:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.160+0000 7fa799400640 1 -- 172.21.15.46:0/399271412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7780047c0 msgr2=0x7fa778004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.160+0000 7fa799400640 1 --2- 172.21.15.46:0/399271412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7780047c0 0x7fa778004c40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c270 tx=0x7fa7780057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.160+0000 7fa793200640 1 -- 172.21.15.46:0/399271412 reap_dead start 2024-02-19T06:58:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.161+0000 7fa799400640 1 -- 172.21.15.46:0/399271412 shutdown_connections 2024-02-19T06:58:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.161+0000 7fa799400640 1 -- 172.21.15.46:0/399271412 >> 172.21.15.46:0/399271412 conn(0x7fa794099a30 msgr2=0x7fa7940d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.161+0000 7fa799400640 1 -- 172.21.15.46:0/399271412 shutdown_connections 2024-02-19T06:58:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.161+0000 7fa799400640 1 -- 172.21.15.46:0/399271412 wait complete. 2024-02-19T06:58:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.162+0000 7fa799400640 1 Processor -- start 2024-02-19T06:58:09.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.163+0000 7fa799400640 1 -- start start 2024-02-19T06:58:09.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.163+0000 7fa799400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7780047c0 0x7fa79414b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.163+0000 7fa799400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7940ae5f0 0x7fa7940c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.163+0000 7fa799400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7940aea70 0x7fa7940c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.163+0000 7fa799400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940ae1d0 con 0x7fa7940ae5f0 2024-02-19T06:58:09.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.163+0000 7fa799400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940ad300 con 0x7fa7780047c0 2024-02-19T06:58:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.164+0000 7fa799400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940ad550 con 0x7fa7940aea70 2024-02-19T06:58:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.164+0000 7fa789e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7940ae5f0 0x7fa7940c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.164+0000 7fa789e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7940ae5f0 0x7fa7940c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41790/0 (socket says 172.21.15.46:41790) 2024-02-19T06:58:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.164+0000 7fa789e00640 1 -- 172.21.15.46:0/2473730519 learned_addr learned my addr 172.21.15.46:0/2473730519 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.164+0000 7fa792800640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7780047c0 0x7fa79414b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.164+0000 7fa793200640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7940aea70 0x7fa7940c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.164+0000 7fa789e00640 1 -- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7940aea70 msgr2=0x7fa7940c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.164+0000 7fa789e00640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7940aea70 0x7fa7940c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.164+0000 7fa789e00640 1 -- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7780047c0 msgr2=0x7fa79414b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.164+0000 7fa789e00640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7780047c0 0x7fa79414b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.164+0000 7fa789e00640 1 -- 172.21.15.46:0/2473730519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7940ad830 con 0x7fa7940ae5f0 2024-02-19T06:58:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.164+0000 7fa792800640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7780047c0 0x7fa79414b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:09.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.165+0000 7fa789e00640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7940ae5f0 0x7fa7940c68b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c210 tx=0x7fa77c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:09.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.165+0000 7fa78b400640 1 -- 172.21.15.46:0/2473730519 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c039030 con 0x7fa7940ae5f0 2024-02-19T06:58:09.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.165+0000 7fa78b400640 1 -- 172.21.15.46:0/2473730519 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c004c10 con 0x7fa7940ae5f0 2024-02-19T06:58:09.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.165+0000 7fa78b400640 1 -- 172.21.15.46:0/2473730519 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c03c040 con 0x7fa7940ae5f0 2024-02-19T06:58:09.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.165+0000 7fa799400640 1 -- 172.21.15.46:0/2473730519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7940adb10 con 0x7fa7940ae5f0 2024-02-19T06:58:09.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.165+0000 7fa799400640 1 -- 172.21.15.46:0/2473730519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7941f7020 con 0x7fa7940ae5f0 2024-02-19T06:58:09.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.166+0000 7fa799400640 1 -- 172.21.15.46:0/2473730519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa794067ba0 con 0x7fa7940ae5f0 2024-02-19T06:58:09.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.167+0000 7fa78b400640 1 -- 172.21.15.46:0/2473730519 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa77c032070 con 0x7fa7940ae5f0 2024-02-19T06:58:09.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.168+0000 7fa78b400640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa77006b810 0x7fa77006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.168+0000 7fa78b400640 1 -- 172.21.15.46:0/2473730519 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa77c0ab6c0 con 0x7fa7940ae5f0 2024-02-19T06:58:09.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.169+0000 7fa792800640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa77006b810 0x7fa77006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.170+0000 7fa792800640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa77006b810 0x7fa77006dcd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa784009970 tx=0x7fa784008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:09.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.172+0000 7fa78b400640 1 -- 172.21.15.46:0/2473730519 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa77c076040 con 0x7fa7940ae5f0 2024-02-19T06:58:09.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.417+0000 7fa799400640 1 -- 172.21.15.46:0/2473730519 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7940b6540 con 0x7fa7940ae5f0 2024-02-19T06:58:09.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.418+0000 7fa78b400640 1 -- 172.21.15.46:0/2473730519 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7fa77c079700 con 0x7fa7940ae5f0 2024-02-19T06:58:09.421 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:09.421 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/380368509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":380368509},{"type":"v1","addr":"172.21.15.46:6834","nonce":380368509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/957808004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":957808004},{"type":"v1","addr":"172.21.15.46:6835","nonce":957808004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1288321773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1288321773},{"type":"v1","addr":"172.21.15.142:6837","nonce":1288321773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:57:55.292605+0000","modified":"2024-02-19T06:57:58.373002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2651895852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2651895852},{"type":"v1","addr":"172.21.15.142:6836","nonce":2651895852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-19T06:58:09.421 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-02-19T06:58:09.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.421+0000 7fa799400640 1 -- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa77006b810 msgr2=0x7fa77006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:09.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.421+0000 7fa799400640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa77006b810 0x7fa77006dcd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa784009970 tx=0x7fa784008040 comp rx=0 tx=0).stop 2024-02-19T06:58:09.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.421+0000 7fa799400640 1 -- 172.21.15.46:0/2473730519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7940ae5f0 msgr2=0x7fa7940c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:09.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.421+0000 7fa799400640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7940ae5f0 0x7fa7940c68b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c210 tx=0x7fa77c001a00 comp rx=0 tx=0).stop 2024-02-19T06:58:09.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.421+0000 7fa799400640 1 -- 172.21.15.46:0/2473730519 shutdown_connections 2024-02-19T06:58:09.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.421+0000 7fa799400640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa77006b810 0x7fa77006dcd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.421+0000 7fa799400640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7940aea70 0x7fa7940c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.421+0000 7fa799400640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7940ae5f0 0x7fa7940c68b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.421+0000 7fa799400640 1 --2- 172.21.15.46:0/2473730519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7780047c0 0x7fa79414b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.421+0000 7fa799400640 1 -- 172.21.15.46:0/2473730519 >> 172.21.15.46:0/2473730519 conn(0x7fa794099a30 msgr2=0x7fa7940cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:09.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.421+0000 7fa799400640 1 -- 172.21.15.46:0/2473730519 shutdown_connections 2024-02-19T06:58:09.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.421+0000 7fa799400640 1 -- 172.21.15.46:0/2473730519 wait complete. 2024-02-19T06:58:09.442 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:09.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.649+0000 7fd3c4c00640 1 Processor -- start 2024-02-19T06:58:09.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.649+0000 7fd3c4c00640 1 -- start start 2024-02-19T06:58:09.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.650+0000 7fd3c4c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3c0162230 0x7fd3c00cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.650+0000 7fd3c4c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd3c015dbd0 0x7fd3c00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.650+0000 7fd3c4c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c00cf770 con 0x7fd3c015d7f0 2024-02-19T06:58:09.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.650+0000 7fd3c4c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c00d28d0 con 0x7fd3c015dbd0 2024-02-19T06:58:09.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.650+0000 7fd3c4c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00d1400 con 0x7fd3c0162230 2024-02-19T06:58:09.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.650+0000 7fd3bfe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd3c015dbd0 0x7fd3c00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.651+0000 7fd3bfe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd3c015dbd0 0x7fd3c00d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41794/0 (socket says 172.21.15.46:41794) 2024-02-19T06:58:09.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.651+0000 7fd3bfe00640 1 -- 172.21.15.46:0/2136010091 learned_addr learned my addr 172.21.15.46:0/2136010091 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:09.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.651+0000 7fd3b6a00640 1 --2- 172.21.15.46:0/2136010091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3c0162230 0x7fd3c00cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.651+0000 7fd3bfe00640 1 -- 172.21.15.46:0/2136010091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3c0162230 msgr2=0x7fd3c00cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:09.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.651+0000 7fd3bfe00640 1 --2- 172.21.15.46:0/2136010091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3c0162230 0x7fd3c00cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.651+0000 7fd3bfe00640 1 -- 172.21.15.46:0/2136010091 >> v1:172.21.15.142:6789/0 conn(0x7fd3c015d7f0 legacy=0x7fd3c00d21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:09.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.651+0000 7fd3bfe00640 1 -- 172.21.15.46:0/2136010091 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c00d16e0 con 0x7fd3c015dbd0 2024-02-19T06:58:09.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.652+0000 7fd3bfe00640 1 --2- 172.21.15.46:0/2136010091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3c015dbd0 0x7fd3c00d34f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009870 tx=0x7fd3b802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9342370df35276a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:09.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.652+0000 7fd3bea00640 1 -- 172.21.15.46:0/2136010091 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80317c0 con 0x7fd3c015dbd0 2024-02-19T06:58:09.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.652+0000 7fd3bea00640 1 -- 172.21.15.46:0/2136010091 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b8031920 con 0x7fd3c015dbd0 2024-02-19T06:58:09.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.652+0000 7fd3bea00640 1 -- 172.21.15.46:0/2136010091 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8031cb0 con 0x7fd3c015dbd0 2024-02-19T06:58:09.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.653+0000 7fd3c4c00640 1 -- 172.21.15.46:0/2136010091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3c015dbd0 msgr2=0x7fd3c00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:09.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.653+0000 7fd3c4c00640 1 --2- 172.21.15.46:0/2136010091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3c015dbd0 0x7fd3c00d34f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009870 tx=0x7fd3b802b860 comp rx=0 tx=0).stop 2024-02-19T06:58:09.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.653+0000 7fd3c4c00640 1 -- 172.21.15.46:0/2136010091 shutdown_connections 2024-02-19T06:58:09.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.653+0000 7fd3c4c00640 1 --2- 172.21.15.46:0/2136010091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3c015dbd0 0x7fd3c00d34f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.653+0000 7fd3c4c00640 1 --2- 172.21.15.46:0/2136010091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3c0162230 0x7fd3c00cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.653+0000 7fd3c4c00640 1 -- 172.21.15.46:0/2136010091 >> 172.21.15.46:0/2136010091 conn(0x7fd3c009ca70 msgr2=0x7fd3c008afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:09.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.653+0000 7fd3c4c00640 1 -- 172.21.15.46:0/2136010091 shutdown_connections 2024-02-19T06:58:09.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.653+0000 7fd3c4c00640 1 -- 172.21.15.46:0/2136010091 wait complete. 2024-02-19T06:58:09.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.655+0000 7fd3c4c00640 1 Processor -- start 2024-02-19T06:58:09.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.655+0000 7fd3c4c00640 1 -- start start 2024-02-19T06:58:09.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.656+0000 7fd3c4c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c015d7f0 0x7fd3c0151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.656+0000 7fd3c4c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3c015dbd0 0x7fd3c00b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.656+0000 7fd3c4c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3c0162230 0x7fd3c01527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.656+0000 7fd3c4c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00b2630 con 0x7fd3c015dbd0 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.656+0000 7fd3c4c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00b2070 con 0x7fd3c015d7f0 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.656+0000 7fd3c4c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00b2350 con 0x7fd3c0162230 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.656+0000 7fd3b6a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3c015dbd0 0x7fd3c00b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.656+0000 7fd3b6a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3c015dbd0 0x7fd3c00b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41806/0 (socket says 172.21.15.46:41806) 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.656+0000 7fd3b6a00640 1 -- 172.21.15.46:0/1477076642 learned_addr learned my addr 172.21.15.46:0/1477076642 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.657+0000 7fd3bf400640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c015d7f0 0x7fd3c0151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.657+0000 7fd3b6a00640 1 -- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3c0162230 msgr2=0x7fd3c01527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.657+0000 7fd3b6a00640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3c0162230 0x7fd3c01527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.657+0000 7fd3b6a00640 1 -- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c015d7f0 msgr2=0x7fd3c0151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.657+0000 7fd3b6a00640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c015d7f0 0x7fd3c0151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.657+0000 7fd3b6a00640 1 -- 172.21.15.46:0/1477076642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80094d0 con 0x7fd3c015dbd0 2024-02-19T06:58:09.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.657+0000 7fd3bf400640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c015d7f0 0x7fd3c0151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:09.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.657+0000 7fd3b6a00640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3c015dbd0 0x7fd3c00b1790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800d5f0 tx=0x7fd3a800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:09.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.657+0000 7fd3b7e00640 1 -- 172.21.15.46:0/1477076642 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a80125f0 con 0x7fd3c015dbd0 2024-02-19T06:58:09.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.657+0000 7fd3b7e00640 1 -- 172.21.15.46:0/1477076642 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a8012750 con 0x7fd3c015dbd0 2024-02-19T06:58:09.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.657+0000 7fd3b7e00640 1 -- 172.21.15.46:0/1477076642 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8012b00 con 0x7fd3c015dbd0 2024-02-19T06:58:09.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.657+0000 7fd3c4c00640 1 -- 172.21.15.46:0/1477076642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c00b03e0 con 0x7fd3c015dbd0 2024-02-19T06:58:09.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.657+0000 7fd3c4c00640 1 -- 172.21.15.46:0/1477076642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c00b1cd0 con 0x7fd3c015dbd0 2024-02-19T06:58:09.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.659+0000 7fd3c4c00640 1 -- 172.21.15.46:0/1477076642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c004eee0 con 0x7fd3c015dbd0 2024-02-19T06:58:09.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.659+0000 7fd3b7e00640 1 -- 172.21.15.46:0/1477076642 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd3a8012c60 con 0x7fd3c015dbd0 2024-02-19T06:58:09.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.661+0000 7fd3b7e00640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd39c06b810 0x7fd39c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:09.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.661+0000 7fd3b7e00640 1 -- 172.21.15.46:0/1477076642 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3a808a6b0 con 0x7fd3c015dbd0 2024-02-19T06:58:09.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.662+0000 7fd3bf400640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd39c06b810 0x7fd39c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:09.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.663+0000 7fd3bf400640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd39c06b810 0x7fd39c06dcd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0004520 tx=0x7fd3b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:09.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.666+0000 7fd3b7e00640 1 -- 172.21.15.46:0/1477076642 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd3a80550d0 con 0x7fd3c015dbd0 2024-02-19T06:58:09.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.864+0000 7fd3c4c00640 1 -- 172.21.15.46:0/1477076642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3c015d1d0 con 0x7fd3c015dbd0 2024-02-19T06:58:09.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.866+0000 7fd3b7e00640 1 -- 172.21.15.46:0/1477076642 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fd3a8058790 con 0x7fd3c015dbd0 2024-02-19T06:58:09.868 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:09.869 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:56.828629+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:09.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.868+0000 7fd3c4c00640 1 -- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd39c06b810 msgr2=0x7fd39c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:09.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.868+0000 7fd3c4c00640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd39c06b810 0x7fd39c06dcd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0004520 tx=0x7fd3b0009040 comp rx=0 tx=0).stop 2024-02-19T06:58:09.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.869+0000 7fd3c4c00640 1 -- 172.21.15.46:0/1477076642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3c015dbd0 msgr2=0x7fd3c00b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:09.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.869+0000 7fd3c4c00640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3c015dbd0 0x7fd3c00b1790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800d5f0 tx=0x7fd3a800dab0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.869+0000 7fd3c4c00640 1 -- 172.21.15.46:0/1477076642 shutdown_connections 2024-02-19T06:58:09.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.869+0000 7fd3c4c00640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd39c06b810 0x7fd39c06dcd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.869+0000 7fd3c4c00640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3c0162230 0x7fd3c01527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.869+0000 7fd3c4c00640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3c015dbd0 0x7fd3c00b1790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.869+0000 7fd3c4c00640 1 --2- 172.21.15.46:0/1477076642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c015d7f0 0x7fd3c0151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:09.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.869+0000 7fd3c4c00640 1 -- 172.21.15.46:0/1477076642 >> 172.21.15.46:0/1477076642 conn(0x7fd3c009ca70 msgr2=0x7fd3c006bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:09.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.869+0000 7fd3c4c00640 1 -- 172.21.15.46:0/1477076642 shutdown_connections 2024-02-19T06:58:09.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:09.869+0000 7fd3c4c00640 1 -- 172.21.15.46:0/1477076642 wait complete. 2024-02-19T06:58:09.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:09.891 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:10.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.119+0000 7f1b59000640 1 Processor -- start 2024-02-19T06:58:10.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.119+0000 7f1b59000640 1 -- start start 2024-02-19T06:58:10.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.121+0000 7f1b59000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1b540c22e0 0x7f1b540c2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:10.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.121+0000 7f1b59000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5406cef0 con 0x7f1b540cd340 2024-02-19T06:58:10.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.121+0000 7f1b59000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5406dd50 con 0x7f1b54161c20 2024-02-19T06:58:10.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.121+0000 7f1b59000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b540c2c60 con 0x7f1b540c22e0 2024-02-19T06:58:10.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.121+0000 7f1b53e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1b540cd340 0x7f1b540cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59978/0 (socket says 172.21.15.46:59978) 2024-02-19T06:58:10.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.121+0000 7f1b53e00640 1 -- 172.21.15.46:0/8358847 learned_addr learned my addr 172.21.15.46:0/8358847 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:10.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.121+0000 7f1b52a00640 1 --2- 172.21.15.46:0/8358847 >> v2:172.21.15.142:3300/0 conn(0x7f1b540c22e0 0x7f1b540c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:10.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.122+0000 7f1b52000640 1 -- 172.21.15.46:0/8358847 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135778435 0 0) 0x7f1b5406cef0 con 0x7f1b540cd340 2024-02-19T06:58:10.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.122+0000 7f1b52000640 1 -- 172.21.15.46:0/8358847 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b38003520 con 0x7f1b540cd340 2024-02-19T06:58:10.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.122+0000 7f1b52a00640 1 -- 172.21.15.46:0/8358847 >> v1:172.21.15.142:6789/0 conn(0x7f1b54161c20 legacy=0x7f1b540b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:10.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.122+0000 7f1b52a00640 1 -- 172.21.15.46:0/8358847 >> v1:172.21.15.46:6789/0 conn(0x7f1b540cd340 legacy=0x7f1b540cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:10.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.122+0000 7f1b52000640 1 -- 172.21.15.46:0/8358847 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4047181262 0 0) 0x7f1b38003520 con 0x7f1b540cd340 2024-02-19T06:58:10.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.122+0000 7f1b52a00640 1 -- 172.21.15.46:0/8358847 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b540cefd0 con 0x7f1b540c22e0 2024-02-19T06:58:10.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.123+0000 7f1b52a00640 1 --2- 172.21.15.46:0/8358847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b540c22e0 0x7f1b540c2720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1b400097a0 tx=0x7f1b4002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef09a21e06c1fe00 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.124+0000 7f1b52000640 1 -- 172.21.15.46:0/8358847 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c0019f0 con 0x7f1b540c22e0 2024-02-19T06:58:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.124+0000 7f1b52000640 1 -- 172.21.15.46:0/8358847 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b40031590 con 0x7f1b540c22e0 2024-02-19T06:58:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.124+0000 7f1b52000640 1 -- 172.21.15.46:0/8358847 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40031920 con 0x7f1b540c22e0 2024-02-19T06:58:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.124+0000 7f1b59000640 1 -- 172.21.15.46:0/8358847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b540c22e0 msgr2=0x7f1b540c2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.124+0000 7f1b59000640 1 --2- 172.21.15.46:0/8358847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b540c22e0 0x7f1b540c2720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1b400097a0 tx=0x7f1b4002b8b0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.125+0000 7f1b59000640 1 -- 172.21.15.46:0/8358847 shutdown_connections 2024-02-19T06:58:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.125+0000 7f1b59000640 1 --2- 172.21.15.46:0/8358847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b540c22e0 0x7f1b540c2720 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.125+0000 7f1b59000640 1 -- 172.21.15.46:0/8358847 >> 172.21.15.46:0/8358847 conn(0x7f1b5406ad60 msgr2=0x7f1b5406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.125+0000 7f1b59000640 1 -- 172.21.15.46:0/8358847 shutdown_connections 2024-02-19T06:58:10.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.125+0000 7f1b59000640 1 -- 172.21.15.46:0/8358847 wait complete. 2024-02-19T06:58:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.126+0000 7f1b59000640 1 Processor -- start 2024-02-19T06:58:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.127+0000 7f1b59000640 1 -- start start 2024-02-19T06:58:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.127+0000 7f1b59000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b540c22e0 0x7f1b540c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.127+0000 7f1b59000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b540cd340 0x7f1b54153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b59000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b54161c20 0x7f1b540c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b59000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b540c3cc0 con 0x7f1b540c22e0 2024-02-19T06:58:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b59000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b540c33c0 con 0x7f1b54161c20 2024-02-19T06:58:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b59000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b540c2e00 con 0x7f1b540cd340 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b53400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b540c22e0 0x7f1b540c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b53400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b540c22e0 0x7f1b540c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41812/0 (socket says 172.21.15.46:41812) 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b53400640 1 -- 172.21.15.46:0/1079298174 learned_addr learned my addr 172.21.15.46:0/1079298174 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b52a00640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b540cd340 0x7f1b54153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b53e00640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b54161c20 0x7f1b540c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b53400640 1 -- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b540cd340 msgr2=0x7f1b54153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b53400640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b540cd340 0x7f1b54153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b53400640 1 -- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b54161c20 msgr2=0x7f1b540c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b53400640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b54161c20 0x7f1b540c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b53400640 1 -- 172.21.15.46:0/1079298174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b40009400 con 0x7f1b540c22e0 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b52a00640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b540cd340 0x7f1b54153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.128+0000 7f1b53e00640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b54161c20 0x7f1b540c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.129+0000 7f1b53400640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b540c22e0 0x7f1b540c3780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400c400 tx=0x7f1b4400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.129+0000 7f1b4b400640 1 -- 172.21.15.46:0/1079298174 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b440052d0 con 0x7f1b540c22e0 2024-02-19T06:58:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.129+0000 7f1b4b400640 1 -- 172.21.15.46:0/1079298174 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b44005430 con 0x7f1b540c22e0 2024-02-19T06:58:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.129+0000 7f1b4b400640 1 -- 172.21.15.46:0/1079298174 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44003830 con 0x7f1b540c22e0 2024-02-19T06:58:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.129+0000 7f1b59000640 1 -- 172.21.15.46:0/1079298174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b540c30e0 con 0x7f1b540c22e0 2024-02-19T06:58:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.129+0000 7f1b59000640 1 -- 172.21.15.46:0/1079298174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b540ca7e0 con 0x7f1b540c22e0 2024-02-19T06:58:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.130+0000 7f1b59000640 1 -- 172.21.15.46:0/1079298174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b540680c0 con 0x7f1b540c22e0 2024-02-19T06:58:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.131+0000 7f1b4b400640 1 -- 172.21.15.46:0/1079298174 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1b44003990 con 0x7f1b540c22e0 2024-02-19T06:58:10.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.132+0000 7f1b4b400640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b3406b860 0x7f1b3406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:10.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.132+0000 7f1b4b400640 1 -- 172.21.15.46:0/1079298174 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b44089780 con 0x7f1b540c22e0 2024-02-19T06:58:10.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.133+0000 7f1b52a00640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b3406b860 0x7f1b3406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:10.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.134+0000 7f1b52a00640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b3406b860 0x7f1b3406dd20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b40036000 tx=0x7f1b4003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:10.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.136+0000 7f1b4b400640 1 -- 172.21.15.46:0/1079298174 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b44054210 con 0x7f1b540c22e0 2024-02-19T06:58:10.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.335+0000 7f1b59000640 1 -- 172.21.15.46:0/1079298174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b5404eee0 con 0x7f1b540c22e0 2024-02-19T06:58:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.336+0000 7f1b4b400640 1 -- 172.21.15.46:0/1079298174 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b440578d0 con 0x7f1b540c22e0 2024-02-19T06:58:10.339 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:10.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.339+0000 7f1b59000640 1 -- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b3406b860 msgr2=0x7f1b3406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:10.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.339+0000 7f1b59000640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b3406b860 0x7f1b3406dd20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b40036000 tx=0x7f1b4003d040 comp rx=0 tx=0).stop 2024-02-19T06:58:10.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.339+0000 7f1b59000640 1 -- 172.21.15.46:0/1079298174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b540c22e0 msgr2=0x7f1b540c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:10.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.339+0000 7f1b59000640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b540c22e0 0x7f1b540c3780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400c400 tx=0x7f1b4400c8c0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.339+0000 7f1b59000640 1 -- 172.21.15.46:0/1079298174 shutdown_connections 2024-02-19T06:58:10.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.339+0000 7f1b59000640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b3406b860 0x7f1b3406dd20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.339+0000 7f1b59000640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b54161c20 0x7f1b540c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.339+0000 7f1b59000640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b540cd340 0x7f1b54153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.339+0000 7f1b59000640 1 --2- 172.21.15.46:0/1079298174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b540c22e0 0x7f1b540c3780 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.339+0000 7f1b59000640 1 -- 172.21.15.46:0/1079298174 >> 172.21.15.46:0/1079298174 conn(0x7f1b5406ad60 msgr2=0x7f1b540b0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:10.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.339+0000 7f1b59000640 1 -- 172.21.15.46:0/1079298174 shutdown_connections 2024-02-19T06:58:10.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.339+0000 7f1b59000640 1 -- 172.21.15.46:0/1079298174 wait complete. 2024-02-19T06:58:10.361 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:10.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.585+0000 7f4989e00640 1 Processor -- start 2024-02-19T06:58:10.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.585+0000 7f4989e00640 1 -- start start 2024-02-19T06:58:10.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.586+0000 7f4989e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f498415dc00 0x7f498415dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:10.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.587+0000 7f4989e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f49840cf160 0x7f49840cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:10.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.587+0000 7f4989e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4984161560 con 0x7f49840aec10 2024-02-19T06:58:10.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.587+0000 7f4989e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498406ef90 con 0x7f49840cf160 2024-02-19T06:58:10.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.587+0000 7f4989e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49840cfb10 con 0x7f498415dc00 2024-02-19T06:58:10.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.587+0000 7f4983400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f49840cf160 0x7f49840cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:10.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.587+0000 7f4983400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f49840cf160 0x7f49840cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41822/0 (socket says 172.21.15.46:41822) 2024-02-19T06:58:10.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.587+0000 7f4983400640 1 -- 172.21.15.46:0/3693588882 learned_addr learned my addr 172.21.15.46:0/3693588882 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:10.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.587+0000 7f4982a00640 1 --2- 172.21.15.46:0/3693588882 >> v2:172.21.15.142:3300/0 conn(0x7f498415dc00 0x7f498415dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:10.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.587+0000 7f4983400640 1 -- 172.21.15.46:0/3693588882 >> v2:172.21.15.142:3300/0 conn(0x7f498415dc00 msgr2=0x7f498415dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:10.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.587+0000 7f4983400640 1 --2- 172.21.15.46:0/3693588882 >> v2:172.21.15.142:3300/0 conn(0x7f498415dc00 0x7f498415dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.587+0000 7f4983400640 1 -- 172.21.15.46:0/3693588882 >> v1:172.21.15.46:6789/0 conn(0x7f49840aec10 legacy=0x7f4984161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:10.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.587+0000 7f4983400640 1 -- 172.21.15.46:0/3693588882 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498415e830 con 0x7f49840cf160 2024-02-19T06:58:10.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.589+0000 7f4983400640 1 --2- 172.21.15.46:0/3693588882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49840cf160 0x7f49840cf5d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f49840b4a40 tx=0x7f497c02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e5173c5b1fc4c5 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:10.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.589+0000 7f4982000640 1 -- 172.21.15.46:0/3693588882 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c02cb10 con 0x7f49840cf160 2024-02-19T06:58:10.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.589+0000 7f4982000640 1 -- 172.21.15.46:0/3693588882 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c02cc70 con 0x7f49840cf160 2024-02-19T06:58:10.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.589+0000 7f4982000640 1 -- 172.21.15.46:0/3693588882 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0343f0 con 0x7f49840cf160 2024-02-19T06:58:10.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.590+0000 7f4989e00640 1 -- 172.21.15.46:0/3693588882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49840cf160 msgr2=0x7f49840cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:10.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.590+0000 7f4989e00640 1 --2- 172.21.15.46:0/3693588882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49840cf160 0x7f49840cf5d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f49840b4a40 tx=0x7f497c02bf70 comp rx=0 tx=0).stop 2024-02-19T06:58:10.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.590+0000 7f4989e00640 1 -- 172.21.15.46:0/3693588882 shutdown_connections 2024-02-19T06:58:10.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.590+0000 7f4989e00640 1 --2- 172.21.15.46:0/3693588882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49840cf160 0x7f49840cf5d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.590+0000 7f4989e00640 1 --2- 172.21.15.46:0/3693588882 >> v2:172.21.15.142:3300/0 conn(0x7f498415dc00 0x7f498415dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.590+0000 7f4989e00640 1 -- 172.21.15.46:0/3693588882 >> 172.21.15.46:0/3693588882 conn(0x7f4984066fc0 msgr2=0x7f498406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:10.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.590+0000 7f4989e00640 1 -- 172.21.15.46:0/3693588882 shutdown_connections 2024-02-19T06:58:10.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.590+0000 7f4989e00640 1 -- 172.21.15.46:0/3693588882 wait complete. 2024-02-19T06:58:10.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.592+0000 7f4989e00640 1 Processor -- start 2024-02-19T06:58:10.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.592+0000 7f4989e00640 1 -- start start 2024-02-19T06:58:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4989e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49840aec10 0x7f4984152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4989e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49840cf160 0x7f49840ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4989e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f498415dc00 0x7f49840add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4989e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49841541a0 con 0x7f49840aec10 2024-02-19T06:58:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4989e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4984157e10 con 0x7f498415dc00 2024-02-19T06:58:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4989e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4984154420 con 0x7f49840cf160 2024-02-19T06:58:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4982a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49840aec10 0x7f4984152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4982a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49840aec10 0x7f4984152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41836/0 (socket says 172.21.15.46:41836) 2024-02-19T06:58:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4982a00640 1 -- 172.21.15.46:0/466393250 learned_addr learned my addr 172.21.15.46:0/466393250 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4982a00640 1 -- 172.21.15.46:0/466393250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49840cf160 msgr2=0x7f49840ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4982a00640 1 --2- 172.21.15.46:0/466393250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49840cf160 0x7f49840ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4982a00640 1 -- 172.21.15.46:0/466393250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f498415dc00 msgr2=0x7f49840add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:10.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4982a00640 1 --2- 172.21.15.46:0/466393250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f498415dc00 0x7f49840add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.594+0000 7f4982a00640 1 -- 172.21.15.46:0/466393250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c009b30 con 0x7f49840aec10 2024-02-19T06:58:10.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.595+0000 7f4982a00640 1 --2- 172.21.15.46:0/466393250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49840aec10 0x7f4984152020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f497400d5f0 tx=0x7f497400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:10.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.595+0000 7f497be00640 1 -- 172.21.15.46:0/466393250 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49740125f0 con 0x7f49840aec10 2024-02-19T06:58:10.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.595+0000 7f497be00640 1 -- 172.21.15.46:0/466393250 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4974012750 con 0x7f49840aec10 2024-02-19T06:58:10.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.595+0000 7f497be00640 1 -- 172.21.15.46:0/466393250 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974012b00 con 0x7f49840aec10 2024-02-19T06:58:10.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.595+0000 7f4989e00640 1 -- 172.21.15.46:0/466393250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4984154700 con 0x7f49840aec10 2024-02-19T06:58:10.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.595+0000 7f4989e00640 1 -- 172.21.15.46:0/466393250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4984154cc0 con 0x7f49840aec10 2024-02-19T06:58:10.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.597+0000 7f4989e00640 1 -- 172.21.15.46:0/466393250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4984067ba0 con 0x7f49840aec10 2024-02-19T06:58:10.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.597+0000 7f497be00640 1 -- 172.21.15.46:0/466393250 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4974012c60 con 0x7f49840aec10 2024-02-19T06:58:10.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.598+0000 7f497be00640 1 --2- 172.21.15.46:0/466393250 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f496006b810 0x7f496006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:10.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.598+0000 7f497be00640 1 -- 172.21.15.46:0/466393250 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f497408a6b0 con 0x7f49840aec10 2024-02-19T06:58:10.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.599+0000 7f497a000640 1 --2- 172.21.15.46:0/466393250 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f496006b810 0x7f496006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:10.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.600+0000 7f497a000640 1 --2- 172.21.15.46:0/466393250 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f496006b810 0x7f496006dcd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f496c000f60 tx=0x7f496c0079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:10.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.603+0000 7f497be00640 1 -- 172.21.15.46:0/466393250 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f49740550d0 con 0x7f49840aec10 2024-02-19T06:58:10.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.802+0000 7f4989e00640 1 -- 172.21.15.46:0/466393250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49840d02f0 con 0x7f49840aec10 2024-02-19T06:58:10.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.803+0000 7f497be00640 1 -- 172.21.15.46:0/466393250 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4974058790 con 0x7f49840aec10 2024-02-19T06:58:10.806 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:10.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.806+0000 7f4989e00640 1 -- 172.21.15.46:0/466393250 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f496006b810 msgr2=0x7f496006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:10.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.806+0000 7f4989e00640 1 --2- 172.21.15.46:0/466393250 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f496006b810 0x7f496006dcd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f496c000f60 tx=0x7f496c0079d0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.806+0000 7f4989e00640 1 -- 172.21.15.46:0/466393250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49840aec10 msgr2=0x7f4984152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:10.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.806+0000 7f4989e00640 1 --2- 172.21.15.46:0/466393250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49840aec10 0x7f4984152020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f497400d5f0 tx=0x7f497400dab0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.806+0000 7f4989e00640 1 -- 172.21.15.46:0/466393250 shutdown_connections 2024-02-19T06:58:10.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.806+0000 7f4989e00640 1 --2- 172.21.15.46:0/466393250 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f496006b810 0x7f496006dcd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.806+0000 7f4989e00640 1 --2- 172.21.15.46:0/466393250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f498415dc00 0x7f49840add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.806+0000 7f4989e00640 1 --2- 172.21.15.46:0/466393250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49840cf160 0x7f49840ad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.806+0000 7f4989e00640 1 --2- 172.21.15.46:0/466393250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49840aec10 0x7f4984152020 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:10.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.806+0000 7f4989e00640 1 -- 172.21.15.46:0/466393250 >> 172.21.15.46:0/466393250 conn(0x7f4984066fc0 msgr2=0x7f4984071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:10.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.807+0000 7f4989e00640 1 -- 172.21.15.46:0/466393250 shutdown_connections 2024-02-19T06:58:10.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:10.807+0000 7f4989e00640 1 -- 172.21.15.46:0/466393250 wait complete. 2024-02-19T06:58:10.830 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:11.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.054+0000 7f83c5600640 1 Processor -- start 2024-02-19T06:58:11.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.054+0000 7f83c5600640 1 -- start start 2024-02-19T06:58:11.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.055+0000 7f83c5600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83c00cfc40 0x7f83c00b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:11.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.056+0000 7f83c5600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f83c00b2a20 0x7f83c006d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:11.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.056+0000 7f83c5600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c015be60 con 0x7f83c0155b20 2024-02-19T06:58:11.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.056+0000 7f83c5600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c015c140 con 0x7f83c00b2a20 2024-02-19T06:58:11.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.056+0000 7f83c5600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c015c420 con 0x7f83c00cfc40 2024-02-19T06:58:11.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.056+0000 7f83c4c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f83c00b2a20 0x7f83c006d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:11.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.056+0000 7f83c4c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f83c00b2a20 0x7f83c006d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41844/0 (socket says 172.21.15.46:41844) 2024-02-19T06:58:11.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.056+0000 7f83c4c00640 1 -- 172.21.15.46:0/3220405522 learned_addr learned my addr 172.21.15.46:0/3220405522 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:11.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.056+0000 7f83b7400640 1 --2- 172.21.15.46:0/3220405522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83c00cfc40 0x7f83c00b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:11.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.056+0000 7f83c4c00640 1 -- 172.21.15.46:0/3220405522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83c00cfc40 msgr2=0x7f83c00b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:11.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.056+0000 7f83c4c00640 1 --2- 172.21.15.46:0/3220405522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83c00cfc40 0x7f83c00b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.056+0000 7f83c4c00640 1 -- 172.21.15.46:0/3220405522 >> v1:172.21.15.142:6789/0 conn(0x7f83c0155b20 legacy=0x7f83c00cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:11.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.057+0000 7f83c4c00640 1 -- 172.21.15.46:0/3220405522 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c015c700 con 0x7f83c00b2a20 2024-02-19T06:58:11.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.058+0000 7f83c4c00640 1 --2- 172.21.15.46:0/3220405522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83c00b2a20 0x7f83c006d630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009870 tx=0x7f83b802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b71d3544e0bc224 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:11.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.058+0000 7f83bf400640 1 -- 172.21.15.46:0/3220405522 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8030840 con 0x7f83c00b2a20 2024-02-19T06:58:11.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.058+0000 7f83bf400640 1 -- 172.21.15.46:0/3220405522 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b80309a0 con 0x7f83c00b2a20 2024-02-19T06:58:11.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.058+0000 7f83bf400640 1 -- 172.21.15.46:0/3220405522 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8030d30 con 0x7f83c00b2a20 2024-02-19T06:58:11.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.058+0000 7f83c5600640 1 -- 172.21.15.46:0/3220405522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83c00b2a20 msgr2=0x7f83c006d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:11.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.058+0000 7f83c5600640 1 --2- 172.21.15.46:0/3220405522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83c00b2a20 0x7f83c006d630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009870 tx=0x7f83b802b980 comp rx=0 tx=0).stop 2024-02-19T06:58:11.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.059+0000 7f83c5600640 1 -- 172.21.15.46:0/3220405522 shutdown_connections 2024-02-19T06:58:11.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.059+0000 7f83c5600640 1 --2- 172.21.15.46:0/3220405522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83c00b2a20 0x7f83c006d630 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.059+0000 7f83c5600640 1 --2- 172.21.15.46:0/3220405522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83c00cfc40 0x7f83c00b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.059+0000 7f83c5600640 1 -- 172.21.15.46:0/3220405522 >> 172.21.15.46:0/3220405522 conn(0x7f83c006ad60 msgr2=0x7f83c006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:11.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.059+0000 7f83c5600640 1 -- 172.21.15.46:0/3220405522 shutdown_connections 2024-02-19T06:58:11.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.059+0000 7f83c5600640 1 -- 172.21.15.46:0/3220405522 wait complete. 2024-02-19T06:58:11.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.061+0000 7f83c5600640 1 Processor -- start 2024-02-19T06:58:11.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.061+0000 7f83c5600640 1 -- start start 2024-02-19T06:58:11.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.062+0000 7f83c5600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83c00b2a20 0x7f83c01f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:11.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.062+0000 7f83c5600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83c00cfc40 0x7f83c0154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:11.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.062+0000 7f83c5600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c0155b20 0x7f83c00723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:11.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.062+0000 7f83c5600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0153eb0 con 0x7f83c00cfc40 2024-02-19T06:58:11.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.062+0000 7f83c5600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0154100 con 0x7f83c0155b20 2024-02-19T06:58:11.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.062+0000 7f83c5600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01543e0 con 0x7f83c00b2a20 2024-02-19T06:58:11.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.062+0000 7f83b7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83c00cfc40 0x7f83c0154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:11.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.062+0000 7f83b7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83c00cfc40 0x7f83c0154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41850/0 (socket says 172.21.15.46:41850) 2024-02-19T06:58:11.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.062+0000 7f83b7400640 1 -- 172.21.15.46:0/1107762764 learned_addr learned my addr 172.21.15.46:0/1107762764 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:11.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.062+0000 7f83c4c00640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c0155b20 0x7f83c00723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:11.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.062+0000 7f83bfe00640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83c00b2a20 0x7f83c01f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:11.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.063+0000 7f83b7400640 1 -- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83c00b2a20 msgr2=0x7f83c01f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:11.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.063+0000 7f83b7400640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83c00b2a20 0x7f83c01f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.063+0000 7f83b7400640 1 -- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c0155b20 msgr2=0x7f83c00723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:11.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.063+0000 7f83b7400640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c0155b20 0x7f83c00723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.063+0000 7f83b7400640 1 -- 172.21.15.46:0/1107762764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b80094d0 con 0x7f83c00cfc40 2024-02-19T06:58:11.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.063+0000 7f83b7400640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83c00cfc40 0x7f83c0154ec0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f83a800d800 tx=0x7f83a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:11.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.063+0000 7f83bcc00640 1 -- 172.21.15.46:0/1107762764 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a800b6c0 con 0x7f83c00cfc40 2024-02-19T06:58:11.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.063+0000 7f83bcc00640 1 -- 172.21.15.46:0/1107762764 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a800b820 con 0x7f83c00cfc40 2024-02-19T06:58:11.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.063+0000 7f83bcc00640 1 -- 172.21.15.46:0/1107762764 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a800bbb0 con 0x7f83c00cfc40 2024-02-19T06:58:11.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.063+0000 7f83c5600640 1 -- 172.21.15.46:0/1107762764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c01546c0 con 0x7f83c00cfc40 2024-02-19T06:58:11.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.063+0000 7f83c5600640 1 -- 172.21.15.46:0/1107762764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c01f30d0 con 0x7f83c00cfc40 2024-02-19T06:58:11.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.064+0000 7f83c5600640 1 -- 172.21.15.46:0/1107762764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c015b590 con 0x7f83c00cfc40 2024-02-19T06:58:11.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.065+0000 7f83bcc00640 1 -- 172.21.15.46:0/1107762764 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f83a800bd10 con 0x7f83c00cfc40 2024-02-19T06:58:11.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.066+0000 7f83bcc00640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f839c06b840 0x7f839c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:11.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.066+0000 7f83bcc00640 1 -- 172.21.15.46:0/1107762764 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83a808a7b0 con 0x7f83c00cfc40 2024-02-19T06:58:11.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.067+0000 7f83bfe00640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f839c06b840 0x7f839c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:11.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.068+0000 7f83bfe00640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f839c06b840 0x7f839c06dd00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f83b00012e0 tx=0x7f83b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:11.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.071+0000 7f83bcc00640 1 -- 172.21.15.46:0/1107762764 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f83a8055130 con 0x7f83c00cfc40 2024-02-19T06:58:11.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.270+0000 7f83c5600640 1 -- 172.21.15.46:0/1107762764 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83c004eee0 con 0x7f83c00cfc40 2024-02-19T06:58:11.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.271+0000 7f83bcc00640 1 -- 172.21.15.46:0/1107762764 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f83a80587f0 con 0x7f83c00cfc40 2024-02-19T06:58:11.273 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.274+0000 7f83c5600640 1 -- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f839c06b840 msgr2=0x7f839c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.274+0000 7f83c5600640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f839c06b840 0x7f839c06dd00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f83b00012e0 tx=0x7f83b0009040 comp rx=0 tx=0).stop 2024-02-19T06:58:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.274+0000 7f83c5600640 1 -- 172.21.15.46:0/1107762764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83c00cfc40 msgr2=0x7f83c0154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.274+0000 7f83c5600640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83c00cfc40 0x7f83c0154ec0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f83a800d800 tx=0x7f83a800dcc0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.274+0000 7f83c5600640 1 -- 172.21.15.46:0/1107762764 shutdown_connections 2024-02-19T06:58:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.274+0000 7f83c5600640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f839c06b840 0x7f839c06dd00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.274+0000 7f83c5600640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c0155b20 0x7f83c00723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.274+0000 7f83c5600640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83c00cfc40 0x7f83c0154ec0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.274+0000 7f83c5600640 1 --2- 172.21.15.46:0/1107762764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83c00b2a20 0x7f83c01f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.274+0000 7f83c5600640 1 -- 172.21.15.46:0/1107762764 >> 172.21.15.46:0/1107762764 conn(0x7f83c006ad60 msgr2=0x7f83c00b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.274+0000 7f83c5600640 1 -- 172.21.15.46:0/1107762764 shutdown_connections 2024-02-19T06:58:11.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.274+0000 7f83c5600640 1 -- 172.21.15.46:0/1107762764 wait complete. 2024-02-19T06:58:11.295 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T06:58:11.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T06:58:11.385 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T06:58:11.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.509+0000 7fca48a00640 1 Processor -- start 2024-02-19T06:58:11.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.509+0000 7fca48a00640 1 -- start start 2024-02-19T06:58:11.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.510+0000 7fca48a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca4415dc40 0x7fca4406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:11.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.510+0000 7fca48a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b6ad0 0x7fca440d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:11.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.511+0000 7fca48a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4406cae0 con 0x7fca440ce920 2024-02-19T06:58:11.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.511+0000 7fca48a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca440cf1a0 con 0x7fca4415dc40 2024-02-19T06:58:11.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.511+0000 7fca48a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440d1aa0 con 0x7fca440b6ad0 2024-02-19T06:58:11.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.511+0000 7fca41e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca4415dc40 0x7fca4406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:11.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.511+0000 7fca41e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca4415dc40 0x7fca4406c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41854/0 (socket says 172.21.15.46:41854) 2024-02-19T06:58:11.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.511+0000 7fca41e00640 1 -- 172.21.15.46:0/1904549236 learned_addr learned my addr 172.21.15.46:0/1904549236 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:11.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.511+0000 7fca42800640 1 --1- 172.21.15.46:0/1904549236 >> v1:172.21.15.46:6789/0 conn(0x7fca440ce920 0x7fca44161630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60000/0 (socket says 172.21.15.46:60000) 2024-02-19T06:58:11.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.511+0000 7fca3be00640 1 --2- 172.21.15.46:0/1904549236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b6ad0 0x7fca440d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:11.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.511+0000 7fca41e00640 1 -- 172.21.15.46:0/1904549236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b6ad0 msgr2=0x7fca440d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:11.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.511+0000 7fca41e00640 1 --2- 172.21.15.46:0/1904549236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b6ad0 0x7fca440d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.511+0000 7fca41e00640 1 -- 172.21.15.46:0/1904549236 >> v1:172.21.15.46:6789/0 conn(0x7fca440ce920 legacy=0x7fca44161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:11.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.511+0000 7fca41e00640 1 -- 172.21.15.46:0/1904549236 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440ceec0 con 0x7fca4415dc40 2024-02-19T06:58:11.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.511+0000 7fca41400640 1 -- 172.21.15.46:0/1904549236 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306563224 0 0) 0x7fca4406cae0 con 0x7fca440ce920 2024-02-19T06:58:11.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.513+0000 7fca41e00640 1 --2- 172.21.15.46:0/1904549236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca4415dc40 0x7fca4406c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fca34009870 tx=0x7fca3402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80da2ff8e5d9c85 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:11.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.513+0000 7fca41400640 1 -- 172.21.15.46:0/1904549236 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34030840 con 0x7fca4415dc40 2024-02-19T06:58:11.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.513+0000 7fca41400640 1 -- 172.21.15.46:0/1904549236 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca340309a0 con 0x7fca4415dc40 2024-02-19T06:58:11.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.513+0000 7fca41400640 1 -- 172.21.15.46:0/1904549236 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34030d30 con 0x7fca4415dc40 2024-02-19T06:58:11.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.514+0000 7fca48a00640 1 -- 172.21.15.46:0/1904549236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca4415dc40 msgr2=0x7fca4406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:11.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.514+0000 7fca48a00640 1 --2- 172.21.15.46:0/1904549236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca4415dc40 0x7fca4406c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fca34009870 tx=0x7fca3402b980 comp rx=0 tx=0).stop 2024-02-19T06:58:11.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.514+0000 7fca48a00640 1 -- 172.21.15.46:0/1904549236 shutdown_connections 2024-02-19T06:58:11.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.514+0000 7fca48a00640 1 --2- 172.21.15.46:0/1904549236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b6ad0 0x7fca440d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.514+0000 7fca48a00640 1 --2- 172.21.15.46:0/1904549236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca4415dc40 0x7fca4406c5a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.514+0000 7fca48a00640 1 -- 172.21.15.46:0/1904549236 >> 172.21.15.46:0/1904549236 conn(0x7fca440b53d0 msgr2=0x7fca440b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:11.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.514+0000 7fca48a00640 1 -- 172.21.15.46:0/1904549236 shutdown_connections 2024-02-19T06:58:11.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.514+0000 7fca48a00640 1 -- 172.21.15.46:0/1904549236 wait complete. 2024-02-19T06:58:11.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.516+0000 7fca48a00640 1 Processor -- start 2024-02-19T06:58:11.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.516+0000 7fca48a00640 1 -- start start 2024-02-19T06:58:11.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca48a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b6ad0 0x7fca4414bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:11.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca48a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440ce920 0x7fca4415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:11.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca48a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca4415dc40 0x7fca4415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:11.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca48a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4414c320 con 0x7fca440ce920 2024-02-19T06:58:11.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca48a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4415f1f0 con 0x7fca4415dc40 2024-02-19T06:58:11.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca48a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4415e150 con 0x7fca440b6ad0 2024-02-19T06:58:11.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca3be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440ce920 0x7fca4415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:11.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca3be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440ce920 0x7fca4415a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41862/0 (socket says 172.21.15.46:41862) 2024-02-19T06:58:11.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca3be00640 1 -- 172.21.15.46:0/3945503868 learned_addr learned my addr 172.21.15.46:0/3945503868 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:11.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca3be00640 1 -- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b6ad0 msgr2=0x7fca4414bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:11.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca3be00640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b6ad0 0x7fca4414bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca42800640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca4415dc40 0x7fca4415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:11.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca3be00640 1 -- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca4415dc40 msgr2=0x7fca4415aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:11.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca3be00640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca4415dc40 0x7fca4415aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca3be00640 1 -- 172.21.15.46:0/3945503868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca340094d0 con 0x7fca440ce920 2024-02-19T06:58:11.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.517+0000 7fca42800640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca4415dc40 0x7fca4415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:11.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.518+0000 7fca3be00640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440ce920 0x7fca4415a5b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00d800 tx=0x7fca2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:11.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.518+0000 7fca3a000640 1 -- 172.21.15.46:0/3945503868 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c00b6c0 con 0x7fca440ce920 2024-02-19T06:58:11.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.518+0000 7fca3a000640 1 -- 172.21.15.46:0/3945503868 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c00b820 con 0x7fca440ce920 2024-02-19T06:58:11.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.518+0000 7fca3a000640 1 -- 172.21.15.46:0/3945503868 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c00bbb0 con 0x7fca440ce920 2024-02-19T06:58:11.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.518+0000 7fca48a00640 1 -- 172.21.15.46:0/3945503868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4415e430 con 0x7fca440ce920 2024-02-19T06:58:11.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.518+0000 7fca48a00640 1 -- 172.21.15.46:0/3945503868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4415e9f0 con 0x7fca440ce920 2024-02-19T06:58:11.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.520+0000 7fca48a00640 1 -- 172.21.15.46:0/3945503868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca44067ba0 con 0x7fca440ce920 2024-02-19T06:58:11.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.520+0000 7fca3a000640 1 -- 172.21.15.46:0/3945503868 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fca2c00bd10 con 0x7fca440ce920 2024-02-19T06:58:11.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.521+0000 7fca3a000640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fca2006b860 0x7fca2006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:11.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.521+0000 7fca3a000640 1 -- 172.21.15.46:0/3945503868 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca2c08a6f0 con 0x7fca440ce920 2024-02-19T06:58:11.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.522+0000 7fca41e00640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fca2006b860 0x7fca2006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:11.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.523+0000 7fca41e00640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fca2006b860 0x7fca2006dd20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fca34036000 tx=0x7fca34030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.526+0000 7fca3a000640 1 -- 172.21.15.46:0/3945503868 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca2c055180 con 0x7fca440ce920 2024-02-19T06:58:11.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.765+0000 7fca48a00640 1 -- 172.21.15.46:0/3945503868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca440ce700 con 0x7fca440ce920 2024-02-19T06:58:11.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.767+0000 7fca3a000640 1 -- 172.21.15.46:0/3945503868 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7fca2c058840 con 0x7fca440ce920 2024-02-19T06:58:11.769 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:11.769 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/380368509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":380368509},{"type":"v1","addr":"172.21.15.46:6834","nonce":380368509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/957808004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":957808004},{"type":"v1","addr":"172.21.15.46:6835","nonce":957808004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1288321773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1288321773},{"type":"v1","addr":"172.21.15.142:6837","nonce":1288321773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:57:55.292605+0000","modified":"2024-02-19T06:57:58.373002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2651895852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2651895852},{"type":"v1","addr":"172.21.15.142:6836","nonce":2651895852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-19T06:58:11.769 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-02-19T06:58:11.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.769+0000 7fca48a00640 1 -- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fca2006b860 msgr2=0x7fca2006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:11.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.769+0000 7fca48a00640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fca2006b860 0x7fca2006dd20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fca34036000 tx=0x7fca34030000 comp rx=0 tx=0).stop 2024-02-19T06:58:11.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.769+0000 7fca48a00640 1 -- 172.21.15.46:0/3945503868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440ce920 msgr2=0x7fca4415a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:11.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.769+0000 7fca48a00640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440ce920 0x7fca4415a5b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00d800 tx=0x7fca2c00dcc0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.769+0000 7fca48a00640 1 -- 172.21.15.46:0/3945503868 shutdown_connections 2024-02-19T06:58:11.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.769+0000 7fca48a00640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fca2006b860 0x7fca2006dd20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.769+0000 7fca48a00640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca4415dc40 0x7fca4415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.769+0000 7fca48a00640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440ce920 0x7fca4415a5b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.769+0000 7fca48a00640 1 --2- 172.21.15.46:0/3945503868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b6ad0 0x7fca4414bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:11.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.769+0000 7fca48a00640 1 -- 172.21.15.46:0/3945503868 >> 172.21.15.46:0/3945503868 conn(0x7fca440b53d0 msgr2=0x7fca4415c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:11.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.770+0000 7fca48a00640 1 -- 172.21.15.46:0/3945503868 shutdown_connections 2024-02-19T06:58:11.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:11.770+0000 7fca48a00640 1 -- 172.21.15.46:0/3945503868 wait complete. 2024-02-19T06:58:11.792 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:12.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.057+0000 7fec5be00640 1 Processor -- start 2024-02-19T06:58:12.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.057+0000 7fec5be00640 1 -- start start 2024-02-19T06:58:12.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.058+0000 7fec5be00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fec5c15b540 0x7fec5c0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:12.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.058+0000 7fec5be00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fec5c0cfe50 0x7fec5c0c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:12.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.058+0000 7fec5be00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c0cb5f0 con 0x7fec5c0cb150 2024-02-19T06:58:12.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.058+0000 7fec5be00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c15f270 con 0x7fec5c15b540 2024-02-19T06:58:12.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.058+0000 7fec5be00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c15f550 con 0x7fec5c0cfe50 2024-02-19T06:58:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.059+0000 7fec5aa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fec5c15b540 0x7fec5c0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.059+0000 7fec5aa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fec5c15b540 0x7fec5c0cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41874/0 (socket says 172.21.15.46:41874) 2024-02-19T06:58:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.059+0000 7fec5aa00640 1 -- 172.21.15.46:0/1318112851 learned_addr learned my addr 172.21.15.46:0/1318112851 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.059+0000 7fec5b400640 1 --2- 172.21.15.46:0/1318112851 >> v2:172.21.15.142:3300/0 conn(0x7fec5c0cfe50 0x7fec5c0c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.059+0000 7fec5aa00640 1 -- 172.21.15.46:0/1318112851 >> v2:172.21.15.142:3300/0 conn(0x7fec5c0cfe50 msgr2=0x7fec5c0c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.059+0000 7fec5aa00640 1 --2- 172.21.15.46:0/1318112851 >> v2:172.21.15.142:3300/0 conn(0x7fec5c0cfe50 0x7fec5c0c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.059+0000 7fec5aa00640 1 -- 172.21.15.46:0/1318112851 >> v1:172.21.15.142:6789/0 conn(0x7fec5c0cb150 legacy=0x7fec5c0cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:12.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.059+0000 7fec5aa00640 1 -- 172.21.15.46:0/1318112851 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c15f830 con 0x7fec5c15b540 2024-02-19T06:58:12.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.059+0000 7fec5b400640 1 --2- 172.21.15.46:0/1318112851 >> v2:172.21.15.142:3300/0 conn(0x7fec5c0cfe50 0x7fec5c0c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:12.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.060+0000 7fec5aa00640 1 --2- 172.21.15.46:0/1318112851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec5c15b540 0x7fec5c0cac10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0b2400 tx=0x7fec4c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a648541993f413a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:12.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.061+0000 7fec59600640 1 -- 172.21.15.46:0/1318112851 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c031870 con 0x7fec5c15b540 2024-02-19T06:58:12.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.061+0000 7fec59600640 1 -- 172.21.15.46:0/1318112851 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c0319d0 con 0x7fec5c15b540 2024-02-19T06:58:12.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.061+0000 7fec59600640 1 -- 172.21.15.46:0/1318112851 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c031d60 con 0x7fec5c15b540 2024-02-19T06:58:12.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.061+0000 7fec5be00640 1 -- 172.21.15.46:0/1318112851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec5c15b540 msgr2=0x7fec5c0cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:12.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.061+0000 7fec5be00640 1 --2- 172.21.15.46:0/1318112851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec5c15b540 0x7fec5c0cac10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0b2400 tx=0x7fec4c02b910 comp rx=0 tx=0).stop 2024-02-19T06:58:12.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.062+0000 7fec5be00640 1 -- 172.21.15.46:0/1318112851 shutdown_connections 2024-02-19T06:58:12.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.062+0000 7fec5be00640 1 --2- 172.21.15.46:0/1318112851 >> v2:172.21.15.142:3300/0 conn(0x7fec5c0cfe50 0x7fec5c0c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.062+0000 7fec5be00640 1 --2- 172.21.15.46:0/1318112851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec5c15b540 0x7fec5c0cac10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.062+0000 7fec5be00640 1 -- 172.21.15.46:0/1318112851 >> 172.21.15.46:0/1318112851 conn(0x7fec5c06afa0 msgr2=0x7fec5c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:12.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.062+0000 7fec5be00640 1 -- 172.21.15.46:0/1318112851 shutdown_connections 2024-02-19T06:58:12.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.062+0000 7fec5be00640 1 -- 172.21.15.46:0/1318112851 wait complete. 2024-02-19T06:58:12.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.063+0000 7fec5be00640 1 Processor -- start 2024-02-19T06:58:12.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.064+0000 7fec5be00640 1 -- start start 2024-02-19T06:58:12.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec5c0cb150 0x7fec5c1f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:12.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec5c0cfe50 0x7fec5c0c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:12.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec5c15b540 0x7fec5c14fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:12.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5be00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0c2db0 con 0x7fec5c0cfe50 2024-02-19T06:58:12.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5be00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0c3930 con 0x7fec5c15b540 2024-02-19T06:58:12.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5be00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0c3000 con 0x7fec5c0cb150 2024-02-19T06:58:12.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec5c0cfe50 0x7fec5c0c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:12.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec5c0cfe50 0x7fec5c0c3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41878/0 (socket says 172.21.15.46:41878) 2024-02-19T06:58:12.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5a000640 1 -- 172.21.15.46:0/1976564222 learned_addr learned my addr 172.21.15.46:0/1976564222 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:12.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5aa00640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec5c0cb150 0x7fec5c1f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:12.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5b400640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec5c15b540 0x7fec5c14fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:12.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5a000640 1 -- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec5c0cb150 msgr2=0x7fec5c1f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:12.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5a000640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec5c0cb150 0x7fec5c1f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5a000640 1 -- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec5c15b540 msgr2=0x7fec5c14fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:12.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5a000640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec5c15b540 0x7fec5c14fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5a000640 1 -- 172.21.15.46:0/1976564222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c0094d0 con 0x7fec5c0cfe50 2024-02-19T06:58:12.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.065+0000 7fec5b400640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec5c15b540 0x7fec5c14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:12.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.066+0000 7fec5a000640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec5c0cfe50 0x7fec5c0c3dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec4800c7f0 tx=0x7fec4800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:12.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.066+0000 7fec52a00640 1 -- 172.21.15.46:0/1976564222 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4800aa50 con 0x7fec5c0cfe50 2024-02-19T06:58:12.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.066+0000 7fec52a00640 1 -- 172.21.15.46:0/1976564222 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4800abb0 con 0x7fec5c0cfe50 2024-02-19T06:58:12.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.066+0000 7fec52a00640 1 -- 172.21.15.46:0/1976564222 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48012420 con 0x7fec5c0cfe50 2024-02-19T06:58:12.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.066+0000 7fec5be00640 1 -- 172.21.15.46:0/1976564222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c0c32e0 con 0x7fec5c0cfe50 2024-02-19T06:58:12.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.066+0000 7fec5be00640 1 -- 172.21.15.46:0/1976564222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c1f6b70 con 0x7fec5c0cfe50 2024-02-19T06:58:12.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.067+0000 7fec5be00640 1 -- 172.21.15.46:0/1976564222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c04eee0 con 0x7fec5c0cfe50 2024-02-19T06:58:12.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.069+0000 7fec52a00640 1 -- 172.21.15.46:0/1976564222 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fec48006b50 con 0x7fec5c0cfe50 2024-02-19T06:58:12.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.070+0000 7fec52a00640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fec3c06b810 0x7fec3c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:12.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.070+0000 7fec52a00640 1 -- 172.21.15.46:0/1976564222 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec4808aa10 con 0x7fec5c0cfe50 2024-02-19T06:58:12.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.070+0000 7fec5aa00640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fec3c06b810 0x7fec3c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:12.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.071+0000 7fec5aa00640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fec3c06b810 0x7fec3c06dcd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fec4c036000 tx=0x7fec4c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:12.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.073+0000 7fec52a00640 1 -- 172.21.15.46:0/1976564222 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fec48055410 con 0x7fec5c0cfe50 2024-02-19T06:58:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.270+0000 7fec5be00640 1 -- 172.21.15.46:0/1976564222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec5c0c3a70 con 0x7fec5c0cfe50 2024-02-19T06:58:12.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.273+0000 7fec52a00640 1 -- 172.21.15.46:0/1976564222 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fec48016020 con 0x7fec5c0cfe50 2024-02-19T06:58:12.275 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:12.276 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:56.828629+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:12.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.275+0000 7fec5be00640 1 -- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fec3c06b810 msgr2=0x7fec3c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:12.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.275+0000 7fec5be00640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fec3c06b810 0x7fec3c06dcd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fec4c036000 tx=0x7fec4c03c040 comp rx=0 tx=0).stop 2024-02-19T06:58:12.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.275+0000 7fec5be00640 1 -- 172.21.15.46:0/1976564222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec5c0cfe50 msgr2=0x7fec5c0c3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:12.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.275+0000 7fec5be00640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec5c0cfe50 0x7fec5c0c3dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec4800c7f0 tx=0x7fec4800ccb0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.276+0000 7fec5be00640 1 -- 172.21.15.46:0/1976564222 shutdown_connections 2024-02-19T06:58:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.276+0000 7fec5be00640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fec3c06b810 0x7fec3c06dcd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.276+0000 7fec5be00640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec5c15b540 0x7fec5c14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.276+0000 7fec5be00640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec5c0cfe50 0x7fec5c0c3dc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.276+0000 7fec5be00640 1 --2- 172.21.15.46:0/1976564222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec5c0cb150 0x7fec5c1f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.276+0000 7fec5be00640 1 -- 172.21.15.46:0/1976564222 >> 172.21.15.46:0/1976564222 conn(0x7fec5c06afa0 msgr2=0x7fec5c0cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.276+0000 7fec5be00640 1 -- 172.21.15.46:0/1976564222 shutdown_connections 2024-02-19T06:58:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.276+0000 7fec5be00640 1 -- 172.21.15.46:0/1976564222 wait complete. 2024-02-19T06:58:12.298 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T06:58:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.517+0000 7f9521000640 1 Processor -- start 2024-02-19T06:58:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.517+0000 7f9521000640 1 -- start start 2024-02-19T06:58:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.518+0000 7f9521000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f951c15a670 0x7f951c0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.518+0000 7f9521000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f951c06da30 0x7f951c0b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.518+0000 7f9521000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f951c0ce7b0 0x7f951c0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.518+0000 7f9521000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c0cdde0 con 0x7f951c15a670 2024-02-19T06:58:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.518+0000 7f9521000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c06df10 con 0x7f951c06da30 2024-02-19T06:58:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.518+0000 7f9521000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0cd4b0 con 0x7f951c0ce7b0 2024-02-19T06:58:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.519+0000 7f9519e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f951c15a670 0x7f951c0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.519+0000 7f9519e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f951c15a670 0x7f951c0ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41890/0 (socket says 172.21.15.46:41890) 2024-02-19T06:58:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.519+0000 7f9519e00640 1 -- 172.21.15.46:0/4116015263 learned_addr learned my addr 172.21.15.46:0/4116015263 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.519+0000 7f9519e00640 1 -- 172.21.15.46:0/4116015263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f951c0ce7b0 msgr2=0x7f951c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.519+0000 7f9511400640 1 --2- 172.21.15.46:0/4116015263 >> v2:172.21.15.142:3300/0 conn(0x7f951c06da30 0x7f951c0b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.519+0000 7f9519e00640 1 --2- 172.21.15.46:0/4116015263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f951c0ce7b0 0x7f951c0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.519+0000 7f9519e00640 1 -- 172.21.15.46:0/4116015263 >> v2:172.21.15.142:3300/0 conn(0x7f951c06da30 msgr2=0x7f951c0b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.519+0000 7f9519e00640 1 --2- 172.21.15.46:0/4116015263 >> v2:172.21.15.142:3300/0 conn(0x7f951c06da30 0x7f951c0b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.519+0000 7f9519e00640 1 -- 172.21.15.46:0/4116015263 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c0cd790 con 0x7f951c15a670 2024-02-19T06:58:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.519+0000 7f9511400640 1 --2- 172.21.15.46:0/4116015263 >> v2:172.21.15.142:3300/0 conn(0x7f951c06da30 0x7f951c0b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:12.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.520+0000 7f9519e00640 1 --2- 172.21.15.46:0/4116015263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f951c15a670 0x7f951c0ce270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f951c0b4b50 tx=0x7f950c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e7b01ba21a5904 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:12.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.521+0000 7f9519400640 1 -- 172.21.15.46:0/4116015263 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c031870 con 0x7f951c15a670 2024-02-19T06:58:12.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.521+0000 7f9519400640 1 -- 172.21.15.46:0/4116015263 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c0319d0 con 0x7f951c15a670 2024-02-19T06:58:12.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.521+0000 7f9519400640 1 -- 172.21.15.46:0/4116015263 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c031d60 con 0x7f951c15a670 2024-02-19T06:58:12.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.521+0000 7f9521000640 1 -- 172.21.15.46:0/4116015263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f951c15a670 msgr2=0x7f951c0ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:12.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.521+0000 7f9521000640 1 --2- 172.21.15.46:0/4116015263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f951c15a670 0x7f951c0ce270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f951c0b4b50 tx=0x7f950c02b910 comp rx=0 tx=0).stop 2024-02-19T06:58:12.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.522+0000 7f9521000640 1 -- 172.21.15.46:0/4116015263 shutdown_connections 2024-02-19T06:58:12.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.522+0000 7f9521000640 1 --2- 172.21.15.46:0/4116015263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f951c0ce7b0 0x7f951c0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.522+0000 7f9521000640 1 --2- 172.21.15.46:0/4116015263 >> v2:172.21.15.142:3300/0 conn(0x7f951c06da30 0x7f951c0b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.522+0000 7f9521000640 1 --2- 172.21.15.46:0/4116015263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f951c15a670 0x7f951c0ce270 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.522+0000 7f9521000640 1 -- 172.21.15.46:0/4116015263 >> 172.21.15.46:0/4116015263 conn(0x7f951c066f70 msgr2=0x7f951c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.522+0000 7f9521000640 1 -- 172.21.15.46:0/4116015263 shutdown_connections 2024-02-19T06:58:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.522+0000 7f9521000640 1 -- 172.21.15.46:0/4116015263 wait complete. 2024-02-19T06:58:12.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.524+0000 7f9521000640 1 Processor -- start 2024-02-19T06:58:12.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.524+0000 7f9521000640 1 -- start start 2024-02-19T06:58:12.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9521000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f951c06da30 0x7f951c14f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9521000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f951c0ce7b0 0x7f951c14bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9521000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f951c15a670 0x7f951c15bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9521000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c14c570 con 0x7f951c06da30 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9521000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c14c850 con 0x7f951c0ce7b0 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9521000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c14cb30 con 0x7f951c15a670 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9519e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f951c06da30 0x7f951c14f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9519e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f951c06da30 0x7f951c14f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41906/0 (socket says 172.21.15.46:41906) 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9519e00640 1 -- 172.21.15.46:0/1962685924 learned_addr learned my addr 172.21.15.46:0/1962685924 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f951a800640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f951c15a670 0x7f951c15bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9511400640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f951c0ce7b0 0x7f951c14bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9519e00640 1 -- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f951c15a670 msgr2=0x7f951c15bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9519e00640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f951c15a670 0x7f951c15bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9519e00640 1 -- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f951c0ce7b0 msgr2=0x7f951c14bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.525+0000 7f9519e00640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f951c0ce7b0 0x7f951c14bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.526+0000 7f9519e00640 1 -- 172.21.15.46:0/1962685924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950c0094d0 con 0x7f951c06da30 2024-02-19T06:58:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.526+0000 7f951a800640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f951c15a670 0x7f951c15bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.526+0000 7f9511400640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f951c0ce7b0 0x7f951c14bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.526+0000 7f9519e00640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f951c06da30 0x7f951c14f160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f950c000c00 tx=0x7f950c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.526+0000 7f9512a00640 1 -- 172.21.15.46:0/1962685924 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c03ad10 con 0x7f951c06da30 2024-02-19T06:58:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.526+0000 7f9512a00640 1 -- 172.21.15.46:0/1962685924 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c03ae70 con 0x7f951c06da30 2024-02-19T06:58:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.526+0000 7f9512a00640 1 -- 172.21.15.46:0/1962685924 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c044610 con 0x7f951c06da30 2024-02-19T06:58:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.526+0000 7f9521000640 1 -- 172.21.15.46:0/1962685924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c14ce10 con 0x7f951c06da30 2024-02-19T06:58:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.526+0000 7f9521000640 1 -- 172.21.15.46:0/1962685924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c1f38f0 con 0x7f951c06da30 2024-02-19T06:58:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.527+0000 7f9521000640 1 -- 172.21.15.46:0/1962685924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951c150380 con 0x7f951c06da30 2024-02-19T06:58:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.528+0000 7f9512a00640 1 -- 172.21.15.46:0/1962685924 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f950c04d450 con 0x7f951c06da30 2024-02-19T06:58:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.529+0000 7f9512a00640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f94f806b810 0x7f94f806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:12.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.529+0000 7f9512a00640 1 -- 172.21.15.46:0/1962685924 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f950c02d040 con 0x7f951c06da30 2024-02-19T06:58:12.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.530+0000 7f9511400640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f94f806b810 0x7f94f806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:12.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.531+0000 7f9511400640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f94f806b810 0x7f94f806dcd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f951c15d2b0 tx=0x7f9504008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:12.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.534+0000 7f9512a00640 1 -- 172.21.15.46:0/1962685924 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f950c0772e0 con 0x7f951c06da30 2024-02-19T06:58:12.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.772+0000 7f9521000640 1 -- 172.21.15.46:0/1962685924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f951c067ba0 con 0x7f951c06da30 2024-02-19T06:58:12.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.773+0000 7f9512a00640 1 -- 172.21.15.46:0/1962685924 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f950c07a9a0 con 0x7f951c06da30 2024-02-19T06:58:12.776 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:12.776 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/380368509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":380368509},{"type":"v1","addr":"172.21.15.46:6834","nonce":380368509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/957808004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":957808004},{"type":"v1","addr":"172.21.15.46:6835","nonce":957808004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1288321773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1288321773},{"type":"v1","addr":"172.21.15.142:6837","nonce":1288321773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:57:55.292605+0000","modified":"2024-02-19T06:57:58.373002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2651895852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2651895852},{"type":"v1","addr":"172.21.15.142:6836","nonce":2651895852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-19T06:58:12.776 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-02-19T06:58:12.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.775+0000 7f9521000640 1 -- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f94f806b810 msgr2=0x7f94f806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:12.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.775+0000 7f9521000640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f94f806b810 0x7f94f806dcd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f951c15d2b0 tx=0x7f9504008040 comp rx=0 tx=0).stop 2024-02-19T06:58:12.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.775+0000 7f9521000640 1 -- 172.21.15.46:0/1962685924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f951c06da30 msgr2=0x7f951c14f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:12.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.775+0000 7f9521000640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f951c06da30 0x7f951c14f160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f950c000c00 tx=0x7f950c0046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.776+0000 7f9521000640 1 -- 172.21.15.46:0/1962685924 shutdown_connections 2024-02-19T06:58:12.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.776+0000 7f9521000640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f94f806b810 0x7f94f806dcd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.776+0000 7f9521000640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f951c15a670 0x7f951c15bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.776+0000 7f9521000640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f951c0ce7b0 0x7f951c14bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.776+0000 7f9521000640 1 --2- 172.21.15.46:0/1962685924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f951c06da30 0x7f951c14f160 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:12.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.776+0000 7f9521000640 1 -- 172.21.15.46:0/1962685924 >> 172.21.15.46:0/1962685924 conn(0x7f951c066f70 msgr2=0x7f951c14fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:12.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.776+0000 7f9521000640 1 -- 172.21.15.46:0/1962685924 shutdown_connections 2024-02-19T06:58:12.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:12.776+0000 7f9521000640 1 -- 172.21.15.46:0/1962685924 wait complete. 2024-02-19T06:58:13.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-19T06:57:55.292605+0000', 'modified': '2024-02-19T06:57:58.373002+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4250}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4250': {'gid': 4250, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6836/2651895852', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6834', 'nonce': 2651895852}, {'type': 'v1', 'addr': '172.21.15.142:6836', 'nonce': 2651895852}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-19T06:58:13.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-19T06:58:13.201 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-02-19T06:58:13.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.429+0000 7fd5c9e00640 1 Processor -- start 2024-02-19T06:58:13.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.429+0000 7fd5c9e00640 1 -- start start 2024-02-19T06:58:13.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.430+0000 7fd5c9e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5c409ada0 0x7fd5c40ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.430+0000 7fd5c9e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c406d8a0 con 0x7fd5c409a140 2024-02-19T06:58:13.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.430+0000 7fd5c9e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c41617d0 con 0x7fd5c41613f0 2024-02-19T06:58:13.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.430+0000 7fd5c9e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40cbfe0 con 0x7fd5c409ada0 2024-02-19T06:58:13.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.431+0000 7fd5c2000640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd5c409a140 0x7fd5c40cc400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60016/0 (socket says 172.21.15.46:60016) 2024-02-19T06:58:13.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.431+0000 7fd5c2000640 1 -- 172.21.15.46:0/730770319 learned_addr learned my addr 172.21.15.46:0/730770319 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:13.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.431+0000 7fd5c3400640 1 --2- 172.21.15.46:0/730770319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5c409ada0 0x7fd5c40ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.431+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725609475 0 0) 0x7fd5c406d8a0 con 0x7fd5c409a140 2024-02-19T06:58:13.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.431+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5a8003520 con 0x7fd5c409a140 2024-02-19T06:58:13.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.431+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1386199923 0 0) 0x7fd5a8003520 con 0x7fd5c409a140 2024-02-19T06:58:13.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.431+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5c409ada0 msgr2=0x7fd5c40ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:13.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.431+0000 7fd5c1600640 1 --2- 172.21.15.46:0/730770319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5c409ada0 0x7fd5c40ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.431+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 >> v1:172.21.15.142:6789/0 conn(0x7fd5c41613f0 legacy=0x7fd5c4099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:13.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.431+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c406d000 con 0x7fd5c409a140 2024-02-19T06:58:13.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.431+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fd5ac001670 con 0x7fd5c409a140 2024-02-19T06:58:13.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.431+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 >> v1:172.21.15.46:6789/0 conn(0x7fd5c409a140 legacy=0x7fd5c40cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:13.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c1600640 1 --2- 172.21.15.46:0/730770319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a80039a0 0x7fd5a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c1600640 1 --2- 172.21.15.46:0/730770319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5c409ada0 0x7fd5a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c1600640 1 --2- 172.21.15.46:0/730770319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a8004d00 0x7fd5a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40cbfe0 con 0x7fd5a8004d00 2024-02-19T06:58:13.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a800bab0 con 0x7fd5a80039a0 2024-02-19T06:58:13.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a800bc70 con 0x7fd5c409ada0 2024-02-19T06:58:13.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c3400640 1 --2- 172.21.15.46:0/730770319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a8004d00 0x7fd5a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/730770319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a80039a0 0x7fd5a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c2000640 1 --2- 172.21.15.46:0/730770319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5c409ada0 0x7fd5a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c3400640 1 -- 172.21.15.46:0/730770319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5c409ada0 msgr2=0x7fd5a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:13.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c3400640 1 --2- 172.21.15.46:0/730770319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5c409ada0 0x7fd5a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c3400640 1 -- 172.21.15.46:0/730770319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a80039a0 msgr2=0x7fd5a8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:13.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c3400640 1 --2- 172.21.15.46:0/730770319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a80039a0 0x7fd5a8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c3400640 1 -- 172.21.15.46:0/730770319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a8003520 con 0x7fd5a8004d00 2024-02-19T06:58:13.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.432+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/730770319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a80039a0 0x7fd5a8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:13.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.434+0000 7fd5c3400640 1 --2- 172.21.15.46:0/730770319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a8004d00 0x7fd5a8005180 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009a90 tx=0x7fd5a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d207150a5985de server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:13.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.434+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc02c680 con 0x7fd5a8004d00 2024-02-19T06:58:13.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.434+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc02c7e0 con 0x7fd5a8004d00 2024-02-19T06:58:13.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.434+0000 7fd5c1600640 1 -- 172.21.15.46:0/730770319 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc02cb70 con 0x7fd5a8004d00 2024-02-19T06:58:13.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.434+0000 7fd5c9e00640 1 -- 172.21.15.46:0/730770319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a8004d00 msgr2=0x7fd5a8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:13.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.434+0000 7fd5c9e00640 1 --2- 172.21.15.46:0/730770319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a8004d00 0x7fd5a8005180 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009a90 tx=0x7fd5a80057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.434+0000 7fd5c3400640 1 -- 172.21.15.46:0/730770319 reap_dead start 2024-02-19T06:58:13.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.435+0000 7fd5c9e00640 1 -- 172.21.15.46:0/730770319 shutdown_connections 2024-02-19T06:58:13.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.435+0000 7fd5c9e00640 1 -- 172.21.15.46:0/730770319 >> 172.21.15.46:0/730770319 conn(0x7fd5c40b31e0 msgr2=0x7fd5c40b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:13.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.435+0000 7fd5c9e00640 1 -- 172.21.15.46:0/730770319 shutdown_connections 2024-02-19T06:58:13.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.435+0000 7fd5c9e00640 1 -- 172.21.15.46:0/730770319 wait complete. 2024-02-19T06:58:13.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.436+0000 7fd5c9e00640 1 Processor -- start 2024-02-19T06:58:13.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.437+0000 7fd5c9e00640 1 -- start start 2024-02-19T06:58:13.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.437+0000 7fd5c9e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a8004d00 0x7fd5c40b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.437+0000 7fd5c9e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5c40b7300 0x7fd5c40b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.437+0000 7fd5c9e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5c41f6b60 0x7fd5c41f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.437+0000 7fd5c9e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c41f7530 con 0x7fd5a8004d00 2024-02-19T06:58:13.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.437+0000 7fd5c9e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40b6770 con 0x7fd5c41f6b60 2024-02-19T06:58:13.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.437+0000 7fd5c9e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40b5190 con 0x7fd5c40b7300 2024-02-19T06:58:13.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.438+0000 7fd5c2a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a8004d00 0x7fd5c40b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.438+0000 7fd5c2a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a8004d00 0x7fd5c40b6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41916/0 (socket says 172.21.15.46:41916) 2024-02-19T06:58:13.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.438+0000 7fd5c2a00640 1 -- 172.21.15.46:0/1522066118 learned_addr learned my addr 172.21.15.46:0/1522066118 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.438+0000 7fd5c3400640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5c41f6b60 0x7fd5c41f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.438+0000 7fd5c2000640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5c40b7300 0x7fd5c40b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.438+0000 7fd5c2a00640 1 -- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5c40b7300 msgr2=0x7fd5c40b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.438+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5c40b7300 0x7fd5c40b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.438+0000 7fd5c2a00640 1 -- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5c41f6b60 msgr2=0x7fd5c41f6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.438+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5c41f6b60 0x7fd5c41f6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.438+0000 7fd5c2a00640 1 -- 172.21.15.46:0/1522066118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c40b5470 con 0x7fd5a8004d00 2024-02-19T06:58:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.439+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a8004d00 0x7fd5c40b6230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400e780 tx=0x7fd5b400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.439+0000 7fd5bb400640 1 -- 172.21.15.46:0/1522066118 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b400ee90 con 0x7fd5a8004d00 2024-02-19T06:58:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.439+0000 7fd5bb400640 1 -- 172.21.15.46:0/1522066118 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b4003b80 con 0x7fd5a8004d00 2024-02-19T06:58:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.439+0000 7fd5c9e00640 1 -- 172.21.15.46:0/1522066118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c40b5750 con 0x7fd5a8004d00 2024-02-19T06:58:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.439+0000 7fd5bb400640 1 -- 172.21.15.46:0/1522066118 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b40050d0 con 0x7fd5a8004d00 2024-02-19T06:58:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.439+0000 7fd5c9e00640 1 -- 172.21.15.46:0/1522066118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c40b5d10 con 0x7fd5a8004d00 2024-02-19T06:58:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.441+0000 7fd5bb400640 1 -- 172.21.15.46:0/1522066118 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd5b4005230 con 0x7fd5a8004d00 2024-02-19T06:58:13.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.442+0000 7fd5bb400640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5a006b810 0x7fd5a006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.442+0000 7fd5bb400640 1 -- 172.21.15.46:0/1522066118 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5b408a130 con 0x7fd5a8004d00 2024-02-19T06:58:13.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.443+0000 7fd5c2000640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5a006b810 0x7fd5a006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.443+0000 7fd5ccb9d740 1 Processor -- start 2024-02-19T06:58:13.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.443+0000 7fd5ccb9d740 1 -- start start 2024-02-19T06:58:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.444+0000 7fd5c2000640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5a006b810 0x7fd5a006dcd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40b7740 tx=0x7fd5ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.444+0000 7fd5ccb9d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10630 0x556911ce35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.444+0000 7fd5ccb9d740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10a10 0x556911d133c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.444+0000 7fd5ccb9d740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911ce3b10 0x556911d13900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.444+0000 7fd5ccb9d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x556911c57b30 con 0x556911d10630 2024-02-19T06:58:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.444+0000 7fd5ccb9d740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556911c55060 con 0x556911ce3b10 2024-02-19T06:58:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.444+0000 7fd5ccb9d740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556911c50840 con 0x556911d10a10 2024-02-19T06:58:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.444+0000 7fd5c2a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10630 0x556911ce35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.445+0000 7fd5c2a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10630 0x556911ce35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41924/0 (socket says 172.21.15.46:41924) 2024-02-19T06:58:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.445+0000 7fd5c2a00640 1 -- 172.21.15.46:0/2007151626 learned_addr learned my addr 172.21.15.46:0/2007151626 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.445+0000 7fd5c2000640 1 --2- 172.21.15.46:0/2007151626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10a10 0x556911d133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.445+0000 7fd5c3400640 1 --2- 172.21.15.46:0/2007151626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911ce3b10 0x556911d13900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.445+0000 7fd5c2a00640 1 -- 172.21.15.46:0/2007151626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10a10 msgr2=0x556911d133c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.445+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/2007151626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10a10 0x556911d133c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.445+0000 7fd5c2a00640 1 -- 172.21.15.46:0/2007151626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911ce3b10 msgr2=0x556911d13900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.445+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/2007151626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911ce3b10 0x556911d13900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.445+0000 7fd5c2a00640 1 -- 172.21.15.46:0/2007151626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556911c184c0 con 0x556911d10630 2024-02-19T06:58:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.445+0000 7fd5c3400640 1 --2- 172.21.15.46:0/2007151626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911ce3b10 0x556911d13900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.445+0000 7fd5c2000640 1 --2- 172.21.15.46:0/2007151626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10a10 0x556911d133c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.445+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/2007151626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10630 0x556911ce35d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40609f0 tx=0x7fd5b4001880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564e7b6d1bd9d3a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.445+0000 7fd5b3400640 1 -- 172.21.15.46:0/2007151626 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b405c960 con 0x556911d10630 2024-02-19T06:58:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.446+0000 7fd5b3400640 1 -- 172.21.15.46:0/2007151626 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b4060f20 con 0x556911d10630 2024-02-19T06:58:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.446+0000 7fd5b3400640 1 -- 172.21.15.46:0/2007151626 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4070210 con 0x556911d10630 2024-02-19T06:58:13.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.446+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/2007151626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10630 msgr2=0x556911ce35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.446+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/2007151626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10630 0x556911ce35d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40609f0 tx=0x7fd5b4001880 comp rx=0 tx=0).stop 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.446+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/2007151626 shutdown_connections 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.446+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/2007151626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911ce3b10 0x556911d13900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.446+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/2007151626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10a10 0x556911d133c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.446+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/2007151626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10630 0x556911ce35d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.446+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/2007151626 >> 172.21.15.46:0/2007151626 conn(0x556911ce5840 msgr2=0x556911d2e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.446+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/2007151626 shutdown_connections 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.446+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/2007151626 wait complete. 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.447+0000 7fd5ccb9d740 1 -- start start 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.447+0000 7fd5ccb9d740 1 Processor -- start 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.448+0000 7fd5ccb9d740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10630 0x556911d171a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.448+0000 7fd5ccb9d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10a10 0x556911cfe270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.448+0000 7fd5ccb9d740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d2ecf0 0x556911d14680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.448+0000 7fd5ccb9d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x556911bf5ea0 con 0x556911d10a10 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.448+0000 7fd5ccb9d740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556911bf5b40 con 0x556911d10630 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.448+0000 7fd5ccb9d740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556911998f20 con 0x556911d2ecf0 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.449+0000 7fd5ccb9d740 10 client.0 _ll_register_callbacks cb 0x556911c09950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.449+0000 7fd5c2000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10a10 0x556911cfe270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.449+0000 7fd5c2000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10a10 0x556911cfe270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41928/0 (socket says 172.21.15.46:41928) 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.449+0000 7fd5c2000640 1 -- 172.21.15.46:0/1029805006 learned_addr learned my addr 172.21.15.46:0/1029805006 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.449+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/1029805006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10630 0x556911d171a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.449+0000 7fd5c3400640 1 --2- 172.21.15.46:0/1029805006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d2ecf0 0x556911d14680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.449+0000 7fd5c2000640 1 -- 172.21.15.46:0/1029805006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d2ecf0 msgr2=0x556911d14680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.449+0000 7fd5c2000640 1 --2- 172.21.15.46:0/1029805006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d2ecf0 0x556911d14680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.449+0000 7fd5c2000640 1 -- 172.21.15.46:0/1029805006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10630 msgr2=0x556911d171a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.449+0000 7fd5c2000640 1 --2- 172.21.15.46:0/1029805006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10630 0x556911d171a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.449+0000 7fd5c2000640 1 -- 172.21.15.46:0/1029805006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c40b5d10 con 0x556911d10a10 2024-02-19T06:58:13.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.449+0000 7fd5c2000640 1 --2- 172.21.15.46:0/1029805006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10a10 0x556911cfe270 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac004b60 tx=0x7fd5ac001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e4526a782d07bc server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:13.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.449+0000 7fd5a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-02-19T06:58:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5a7e00640 1 -- 172.21.15.46:0/1029805006 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac014600 con 0x556911d10a10 2024-02-19T06:58:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5a7e00640 1 -- 172.21.15.46:0/1029805006 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5ac01c040 con 0x556911d10a10 2024-02-19T06:58:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/1029805006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556911c74c40 con 0x556911d10a10 2024-02-19T06:58:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5a7e00640 1 -- 172.21.15.46:0/1029805006 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5ac0057e0 con 0x556911d10a10 2024-02-19T06:58:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5ccb9d740 10 client.4641 fetch_fsmap learned FSMap version 8 2024-02-19T06:58:13.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/1029805006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x556911c4eec0 con 0x556911d10a10 2024-02-19T06:58:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5a7e00640 1 -- 172.21.15.46:0/1029805006 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556911c74c40 con 0x556911d10a10 2024-02-19T06:58:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5a7e00640 1 -- 172.21.15.46:0/1029805006 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd5ac014760 con 0x556911d10a10 2024-02-19T06:58:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5ccb9d740 10 client.4641 fetch_fsmap finished waiting for FSMap version 8 2024-02-19T06:58:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5ccb9d740 10 client.4641 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-19T06:58:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5ccb9d740 20 client.4641 populate_metadata read hostname 'smithi046' 2024-02-19T06:58:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/1029805006 >> [v2:172.21.15.142:6834/2651895852,v1:172.21.15.142:6836/2651895852] conn(0x556911d16670 0x556911d11800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5ccb9d740 4 client.4641 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-19T06:58:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.450+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/1029805006 --> [v2:172.21.15.142:6834/2651895852,v1:172.21.15.142:6836/2651895852] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5569119506c0 con 0x556911d16670 2024-02-19T06:58:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.451+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/1029805006 >> [v2:172.21.15.142:6834/2651895852,v1:172.21.15.142:6836/2651895852] conn(0x556911d16670 0x556911d11800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.452+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/1029805006 >> [v2:172.21.15.142:6834/2651895852,v1:172.21.15.142:6836/2651895852] conn(0x556911d16670 0x556911d11800 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c104ea64cf608507 server_cookie=46f9d33f5b519c9c in_seq=0 out_seq=0 2024-02-19T06:58:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.452+0000 7fd5a7e00640 10 client.4641 ms_handle_connect on v2:172.21.15.142:6834/2651895852 2024-02-19T06:58:13.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.453+0000 7fd5a7e00640 1 -- 172.21.15.46:0/1029805006 <== mds.0 v2:172.21.15.142:6834/2651895852 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5569119506c0 con 0x556911d16670 2024-02-19T06:58:13.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.453+0000 7fd5a7e00640 10 client.4641 handle_command_reply: tid=0 2024-02-19T06:58:13.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.453+0000 7fd5ccb9d740 1 client.4641 shutdown 2024-02-19T06:58:13.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.454+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/1029805006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10a10 msgr2=0x556911cfe270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:13.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.454+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/1029805006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10a10 0x556911cfe270 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac004b60 tx=0x7fd5ac001a00 comp rx=0 tx=0).stop 2024-02-19T06:58:13.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.454+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/1029805006 shutdown_connections 2024-02-19T06:58:13.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.454+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/1029805006 >> [v2:172.21.15.142:6834/2651895852,v1:172.21.15.142:6836/2651895852] conn(0x556911d16670 0x556911d11800 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.454+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/1029805006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d2ecf0 0x556911d14680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.454+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/1029805006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d10a10 0x556911cfe270 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.454+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/1029805006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10630 0x556911d171a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.454+0000 7fd5a7e00640 0 client.4641 ms_handle_reset on v2:172.21.15.142:6834/2651895852 2024-02-19T06:58:13.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.454+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/1029805006 >> 172.21.15.46:0/1029805006 conn(0x556911ce3b10 msgr2=0x556911d321f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:13.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.454+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/1029805006 shutdown_connections 2024-02-19T06:58:13.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.454+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/1029805006 wait complete. 2024-02-19T06:58:13.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.454+0000 7fd5ccb9d740 20 client.4641 trim_cache size 0 max 16384 2024-02-19T06:58:13.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.471+0000 7fd5ccb9d740 1 Processor -- start 2024-02-19T06:58:13.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.471+0000 7fd5ccb9d740 1 -- start start 2024-02-19T06:58:13.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.472+0000 7fd5ccb9d740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10630 0x556911d4ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.472+0000 7fd5ccb9d740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10a10 0x556911d0b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.472+0000 7fd5ccb9d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 0x556911d0b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.472+0000 7fd5ccb9d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x556911ce7640 con 0x556911d2ecf0 2024-02-19T06:58:13.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.472+0000 7fd5ccb9d740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556911d0fae0 con 0x556911d10a10 2024-02-19T06:58:13.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.472+0000 7fd5ccb9d740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556911d195b0 con 0x556911d10630 2024-02-19T06:58:13.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.473+0000 7fd5c3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 0x556911d0b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.473+0000 7fd5c3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 0x556911d0b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41934/0 (socket says 172.21.15.46:41934) 2024-02-19T06:58:13.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.473+0000 7fd5c3400640 1 -- 172.21.15.46:0/3866834026 learned_addr learned my addr 172.21.15.46:0/3866834026 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:13.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.473+0000 7fd5c2000640 1 --2- 172.21.15.46:0/3866834026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10a10 0x556911d0b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.473+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/3866834026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10630 0x556911d4ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.473+0000 7fd5c3400640 1 -- 172.21.15.46:0/3866834026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10630 msgr2=0x556911d4ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:13.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.473+0000 7fd5c3400640 1 --2- 172.21.15.46:0/3866834026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10630 0x556911d4ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.473+0000 7fd5c3400640 1 -- 172.21.15.46:0/3866834026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10a10 msgr2=0x556911d0b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:13.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.473+0000 7fd5c3400640 1 --2- 172.21.15.46:0/3866834026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10a10 0x556911d0b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.473+0000 7fd5c3400640 1 -- 172.21.15.46:0/3866834026 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556911beb8b0 con 0x556911d2ecf0 2024-02-19T06:58:13.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.474+0000 7fd5c3400640 1 --2- 172.21.15.46:0/3866834026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 0x556911d0b9c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009bb0 tx=0x7fd5bc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06b34c41b00f2ee server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:13.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.474+0000 7fd5b2a00640 1 -- 172.21.15.46:0/3866834026 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc004030 con 0x556911d2ecf0 2024-02-19T06:58:13.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.474+0000 7fd5b2a00640 1 -- 172.21.15.46:0/3866834026 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc004190 con 0x556911d2ecf0 2024-02-19T06:58:13.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.474+0000 7fd5b2a00640 1 -- 172.21.15.46:0/3866834026 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc004500 con 0x556911d2ecf0 2024-02-19T06:58:13.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.474+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/3866834026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 msgr2=0x556911d0b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:13.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.474+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/3866834026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 0x556911d0b9c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009bb0 tx=0x7fd5bc02e000 comp rx=0 tx=0).stop 2024-02-19T06:58:13.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.475+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/3866834026 shutdown_connections 2024-02-19T06:58:13.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.475+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/3866834026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 0x556911d0b9c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.475+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/3866834026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10a10 0x556911d0b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.475+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/3866834026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10630 0x556911d4ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.475+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/3866834026 >> 172.21.15.46:0/3866834026 conn(0x556911ce3b10 msgr2=0x556911d31120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:13.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.475+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/3866834026 shutdown_connections 2024-02-19T06:58:13.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.475+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/3866834026 wait complete. 2024-02-19T06:58:13.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.475+0000 7fd5ccb9d740 1 -- start start 2024-02-19T06:58:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.476+0000 7fd5ccb9d740 1 Processor -- start 2024-02-19T06:58:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5ccb9d740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10630 0x556911d16a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5ccb9d740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10a10 0x556911d16f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5ccb9d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 0x556911d9bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5ccb9d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x556911d408b0 con 0x556911d2ecf0 2024-02-19T06:58:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5ccb9d740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556911d0b850 con 0x556911d10630 2024-02-19T06:58:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5ccb9d740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556911ce6c40 con 0x556911d10a10 2024-02-19T06:58:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5ccb9d740 10 client.0 _ll_register_callbacks cb 0x7fd5ac0108d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-19T06:58:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5c3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 0x556911d9bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5c3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 0x556911d9bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41940/0 (socket says 172.21.15.46:41940) 2024-02-19T06:58:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5c3400640 1 -- 172.21.15.46:0/4208583625 learned_addr learned my addr 172.21.15.46:0/4208583625 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10630 0x556911d16a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5c2000640 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10a10 0x556911d16f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5c3400640 1 -- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10a10 msgr2=0x556911d16f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5c3400640 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10a10 0x556911d16f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5c3400640 1 -- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10630 msgr2=0x556911d16a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5c3400640 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10630 0x556911d16a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5c3400640 1 -- 172.21.15.46:0/4208583625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a8003520 con 0x556911d2ecf0 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10630 0x556911d16a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.477+0000 7fd5c2000640 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10a10 0x556911d16f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.478+0000 7fd5c3400640 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 0x556911d9bb40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0098e0 tx=0x7fd5bc02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50d03d09eba2662 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.478+0000 7fd5a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.478+0000 7fd5a7e00640 1 -- 172.21.15.46:0/4208583625 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc02ce20 con 0x556911d2ecf0 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.478+0000 7fd5a7e00640 1 -- 172.21.15.46:0/4208583625 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5bc000e40 con 0x556911d2ecf0 2024-02-19T06:58:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.478+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/4208583625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd5b4060f20 con 0x556911d2ecf0 2024-02-19T06:58:13.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.478+0000 7fd5a7e00640 1 -- 172.21.15.46:0/4208583625 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5bc005990 con 0x556911d2ecf0 2024-02-19T06:58:13.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.478+0000 7fd5ccb9d740 10 client.4647 fetch_fsmap learned FSMap version 8 2024-02-19T06:58:13.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.478+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/4208583625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x556911c11510 con 0x556911d2ecf0 2024-02-19T06:58:13.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.479+0000 7fd5a7e00640 1 -- 172.21.15.46:0/4208583625 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b4060f20 con 0x556911d2ecf0 2024-02-19T06:58:13.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.479+0000 7fd5a7e00640 1 -- 172.21.15.46:0/4208583625 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd5bc005af0 con 0x556911d2ecf0 2024-02-19T06:58:13.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.479+0000 7fd5ccb9d740 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2024-02-19T06:58:13.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.479+0000 7fd5ccb9d740 10 client.4647 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-19T06:58:13.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.479+0000 7fd5ccb9d740 20 client.4647 populate_metadata read hostname 'smithi046' 2024-02-19T06:58:13.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.479+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:6834/2651895852,v1:172.21.15.142:6836/2651895852] conn(0x556911d9c080 0x556911d97ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:13.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.479+0000 7fd5ccb9d740 4 client.4647 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-19T06:58:13.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.479+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/4208583625 --> [v2:172.21.15.142:6834/2651895852,v1:172.21.15.142:6836/2651895852] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5569119a1270 con 0x556911d9c080 2024-02-19T06:58:13.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.479+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:6834/2651895852,v1:172.21.15.142:6836/2651895852] conn(0x556911d9c080 0x556911d97ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:13.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.480+0000 7fd5c2a00640 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:6834/2651895852,v1:172.21.15.142:6836/2651895852] conn(0x556911d9c080 0x556911d97ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=931789321004a0e0 server_cookie=9ccbf589319cc2a0 in_seq=0 out_seq=0 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.480+0000 7fd5a7e00640 10 client.4647 ms_handle_connect on v2:172.21.15.142:6834/2651895852 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5a7e00640 1 -- 172.21.15.46:0/4208583625 <== mds.0 v2:172.21.15.142:6834/2651895852 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x5569119a1270 con 0x556911d9c080 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5a7e00640 10 client.4647 handle_command_reply: tid=0 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5ccb9d740 1 client.4647 shutdown 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/4208583625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 msgr2=0x556911d9bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 0x556911d9bb40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0098e0 tx=0x7fd5bc02e070 comp rx=0 tx=0).stop 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/4208583625 shutdown_connections 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:6834/2651895852,v1:172.21.15.142:6836/2651895852] conn(0x556911d9c080 0x556911d97ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556911d2ecf0 0x556911d9bb40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556911d10a10 0x556911d16f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5ccb9d740 1 --2- 172.21.15.46:0/4208583625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556911d10630 0x556911d16a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5a7e00640 0 client.4647 ms_handle_reset on v2:172.21.15.142:6834/2651895852 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/4208583625 >> 172.21.15.46:0/4208583625 conn(0x556911ce3b10 msgr2=0x556911d310d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:13.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/4208583625 shutdown_connections 2024-02-19T06:58:13.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5ccb9d740 1 -- 172.21.15.46:0/4208583625 wait complete. 2024-02-19T06:58:13.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.481+0000 7fd5ccb9d740 20 client.4647 trim_cache size 0 max 16384 2024-02-19T06:58:13.487 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T06:58:13.487 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "858a958e-c459-4ec6-89ff-1327e8665984", 2024-02-19T06:58:13.487 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-02-19T06:58:13.487 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4250, 2024-02-19T06:58:13.487 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-02-19T06:58:13.487 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-02-19T06:58:13.487 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-02-19T06:58:13.487 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 17.65035838, 2024-02-19T06:58:13.487 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 8, 2024-02-19T06:58:13.488 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 22, 2024-02-19T06:58:13.488 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 22, 2024-02-19T06:58:13.488 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 23.239629356999998 2024-02-19T06:58:13.488 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T06:58:13.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.482+0000 7fd5c9e00640 1 -- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5a006b810 msgr2=0x7fd5a006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:13.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.482+0000 7fd5c9e00640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5a006b810 0x7fd5a006dcd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40b7740 tx=0x7fd5ac009040 comp rx=0 tx=0).stop 2024-02-19T06:58:13.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.482+0000 7fd5c9e00640 1 -- 172.21.15.46:0/1522066118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a8004d00 msgr2=0x7fd5c40b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:13.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.482+0000 7fd5c9e00640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a8004d00 0x7fd5c40b6230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400e780 tx=0x7fd5b400ec40 comp rx=0 tx=0).stop 2024-02-19T06:58:13.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.482+0000 7fd5c9e00640 1 -- 172.21.15.46:0/1522066118 shutdown_connections 2024-02-19T06:58:13.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.482+0000 7fd5c9e00640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5a006b810 0x7fd5a006dcd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.482+0000 7fd5c9e00640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5c41f6b60 0x7fd5c41f6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.482+0000 7fd5c9e00640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5c40b7300 0x7fd5c40b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.482+0000 7fd5c9e00640 1 --2- 172.21.15.46:0/1522066118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a8004d00 0x7fd5c40b6230 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:13.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.482+0000 7fd5c9e00640 1 -- 172.21.15.46:0/1522066118 >> 172.21.15.46:0/1522066118 conn(0x7fd5c40b31e0 msgr2=0x7fd5c40ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:13.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.482+0000 7fd5c9e00640 1 -- 172.21.15.46:0/1522066118 shutdown_connections 2024-02-19T06:58:13.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:13.482+0000 7fd5c9e00640 1 -- 172.21.15.46:0/1522066118 wait complete. 2024-02-19T06:58:13.502 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-02-19T06:58:13.526 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-02-19T06:58:13.527 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-02-19T06:58:13.527 INFO:tasks.ceph_fuse:client.0 config is {} 2024-02-19T06:58:13.527 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-19T06:58:13.527 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-19T06:58:13.527 INFO:tasks.ceph_fuse:client.2 config is {} 2024-02-19T06:58:13.527 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-19T06:58:13.527 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-02-19T06:58:13.527 INFO:tasks.ceph_fuse:client.1 config is {} 2024-02-19T06:58:13.528 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-19T06:58:13.528 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-19T06:58:13.528 INFO:tasks.ceph_fuse:client.3 config is {} 2024-02-19T06:58:13.528 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-19T06:58:13.528 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-02-19T06:58:13.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:13.528 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-02-19T06:58:13.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:13.586 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-02-19T06:58:13.684 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-02-19T06:58:13.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T06:58:13.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:13.689 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-02-19T06:58:13.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:13.750 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-02-19T06:58:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-02-19T06:58:13.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T06:58:13.864 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-02-19T06:58:13.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-19T06:58:14.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.089+0000 7f836a000640 1 Processor -- start 2024-02-19T06:58:14.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.090+0000 7f836a000640 1 -- start start 2024-02-19T06:58:14.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.091+0000 7f836a000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f836415dc40 0x7f836406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:14.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.091+0000 7f836a000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83640d07e0 0x7f83640d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:14.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.091+0000 7f836a000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836406cae0 con 0x7f83640b6ad0 2024-02-19T06:58:14.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.091+0000 7f836a000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83640cf1a0 con 0x7f836415dc40 2024-02-19T06:58:14.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.091+0000 7f836a000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83640d1aa0 con 0x7f83640d07e0 2024-02-19T06:58:14.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.092+0000 7f8363400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f836415dc40 0x7f836406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:14.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.092+0000 7f8363400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f836415dc40 0x7f836406c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41942/0 (socket says 172.21.15.46:41942) 2024-02-19T06:58:14.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.092+0000 7f8363400640 1 -- 172.21.15.46:0/2396594053 learned_addr learned my addr 172.21.15.46:0/2396594053 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:14.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.092+0000 7f8363e00640 1 --2- 172.21.15.46:0/2396594053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83640d07e0 0x7f83640d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:14.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.092+0000 7f8363400640 1 -- 172.21.15.46:0/2396594053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83640d07e0 msgr2=0x7f83640d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:14.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.092+0000 7f8362a00640 1 -- 172.21.15.46:0/2396594053 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894465497 0 0) 0x7f836406cae0 con 0x7f83640b6ad0 2024-02-19T06:58:14.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.093+0000 7f8363400640 1 --2- 172.21.15.46:0/2396594053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83640d07e0 0x7f83640d2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:14.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.093+0000 7f8363400640 1 -- 172.21.15.46:0/2396594053 >> v1:172.21.15.142:6789/0 conn(0x7f83640b6ad0 legacy=0x7f83640d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:14.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.093+0000 7f8363400640 1 -- 172.21.15.46:0/2396594053 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83640ceec0 con 0x7f836415dc40 2024-02-19T06:58:14.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.094+0000 7f8363400640 1 --2- 172.21.15.46:0/2396594053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f836415dc40 0x7f836406c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8354009870 tx=0x7f835402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249889bca293eed3 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:14.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.095+0000 7f8362a00640 1 -- 172.21.15.46:0/2396594053 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354030840 con 0x7f836415dc40 2024-02-19T06:58:14.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.095+0000 7f8362a00640 1 -- 172.21.15.46:0/2396594053 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83540309a0 con 0x7f836415dc40 2024-02-19T06:58:14.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.095+0000 7f8362a00640 1 -- 172.21.15.46:0/2396594053 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354030d30 con 0x7f836415dc40 2024-02-19T06:58:14.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.095+0000 7f836a000640 1 -- 172.21.15.46:0/2396594053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f836415dc40 msgr2=0x7f836406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:14.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.095+0000 7f836a000640 1 --2- 172.21.15.46:0/2396594053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f836415dc40 0x7f836406c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8354009870 tx=0x7f835402b980 comp rx=0 tx=0).stop 2024-02-19T06:58:14.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.096+0000 7f836a000640 1 -- 172.21.15.46:0/2396594053 shutdown_connections 2024-02-19T06:58:14.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.096+0000 7f836a000640 1 --2- 172.21.15.46:0/2396594053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83640d07e0 0x7f83640d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:14.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.096+0000 7f836a000640 1 --2- 172.21.15.46:0/2396594053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f836415dc40 0x7f836406c5a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:14.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.096+0000 7f836a000640 1 -- 172.21.15.46:0/2396594053 >> 172.21.15.46:0/2396594053 conn(0x7f83640b53d0 msgr2=0x7f83640b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:14.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.096+0000 7f836a000640 1 -- 172.21.15.46:0/2396594053 shutdown_connections 2024-02-19T06:58:14.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.096+0000 7f836a000640 1 -- 172.21.15.46:0/2396594053 wait complete. 2024-02-19T06:58:14.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.098+0000 7f836a000640 1 Processor -- start 2024-02-19T06:58:14.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.098+0000 7f836a000640 1 -- start start 2024-02-19T06:58:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f836a000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83640b6ad0 0x7f8364159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f836a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83640d07e0 0x7f83640ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f836a000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f836415dc40 0x7f83640cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f836a000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836415f4b0 con 0x7f83640d07e0 2024-02-19T06:58:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f836a000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836415f1a0 con 0x7f83640b6ad0 2024-02-19T06:58:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f836a000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83640c97d0 con 0x7f836415dc40 2024-02-19T06:58:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f835be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83640d07e0 0x7f83640ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f835be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83640d07e0 0x7f83640ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41952/0 (socket says 172.21.15.46:41952) 2024-02-19T06:58:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f835be00640 1 -- 172.21.15.46:0/2311884036 learned_addr learned my addr 172.21.15.46:0/2311884036 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f8363400640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83640b6ad0 0x7f8364159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f8363e00640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f836415dc40 0x7f83640cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f835be00640 1 -- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f836415dc40 msgr2=0x7f83640cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f835be00640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f836415dc40 0x7f83640cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f835be00640 1 -- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83640b6ad0 msgr2=0x7f8364159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f835be00640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83640b6ad0 0x7f8364159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.099+0000 7f835be00640 1 -- 172.21.15.46:0/2311884036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83540094d0 con 0x7f83640d07e0 2024-02-19T06:58:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.100+0000 7f835be00640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83640d07e0 0x7f83640ccad0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c520 tx=0x7f834c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.100+0000 7f835b400640 1 -- 172.21.15.46:0/2311884036 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0035f0 con 0x7f83640d07e0 2024-02-19T06:58:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.100+0000 7f835b400640 1 -- 172.21.15.46:0/2311884036 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c003770 con 0x7f83640d07e0 2024-02-19T06:58:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.100+0000 7f835b400640 1 -- 172.21.15.46:0/2311884036 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c003b20 con 0x7f83640d07e0 2024-02-19T06:58:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.100+0000 7f836a000640 1 -- 172.21.15.46:0/2311884036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83640c9ab0 con 0x7f83640d07e0 2024-02-19T06:58:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.100+0000 7f836a000640 1 -- 172.21.15.46:0/2311884036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836415a470 con 0x7f83640d07e0 2024-02-19T06:58:14.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.102+0000 7f836a000640 1 -- 172.21.15.46:0/2311884036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836415f660 con 0x7f83640d07e0 2024-02-19T06:58:14.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.103+0000 7f835b400640 1 -- 172.21.15.46:0/2311884036 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f834c003c80 con 0x7f83640d07e0 2024-02-19T06:58:14.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.104+0000 7f835b400640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f834006b860 0x7f834006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:14.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.104+0000 7f835b400640 1 -- 172.21.15.46:0/2311884036 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f834c0896e0 con 0x7f83640d07e0 2024-02-19T06:58:14.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.104+0000 7f8363400640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f834006b860 0x7f834006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:14.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.106+0000 7f8363400640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f834006b860 0x7f834006dd20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8354036000 tx=0x7f8354008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.108+0000 7f835b400640 1 -- 172.21.15.46:0/2311884036 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f836415f660 con 0x7f83640d07e0 2024-02-19T06:58:14.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.346+0000 7f836a000640 1 -- 172.21.15.46:0/2311884036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f83640c9fd0 con 0x7f83640d07e0 2024-02-19T06:58:14.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.347+0000 7f835b400640 1 -- 172.21.15.46:0/2311884036 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f834c017070 con 0x7f83640d07e0 2024-02-19T06:58:14.349 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-19T06:58:14.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.349+0000 7f836a000640 1 -- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f834006b860 msgr2=0x7f834006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:14.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.350+0000 7f836a000640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f834006b860 0x7f834006dd20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8354036000 tx=0x7f8354008030 comp rx=0 tx=0).stop 2024-02-19T06:58:14.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.350+0000 7f836a000640 1 -- 172.21.15.46:0/2311884036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83640d07e0 msgr2=0x7f83640ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:14.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.350+0000 7f836a000640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83640d07e0 0x7f83640ccad0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c520 tx=0x7f834c00c9e0 comp rx=0 tx=0).stop 2024-02-19T06:58:14.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.350+0000 7f836a000640 1 -- 172.21.15.46:0/2311884036 shutdown_connections 2024-02-19T06:58:14.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.350+0000 7f836a000640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f834006b860 0x7f834006dd20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:14.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.350+0000 7f836a000640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f836415dc40 0x7f83640cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:14.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.350+0000 7f836a000640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83640d07e0 0x7f83640ccad0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:14.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.350+0000 7f836a000640 1 --2- 172.21.15.46:0/2311884036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83640b6ad0 0x7f8364159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:14.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.350+0000 7f836a000640 1 -- 172.21.15.46:0/2311884036 >> 172.21.15.46:0/2311884036 conn(0x7f83640b53d0 msgr2=0x7f83640d2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:14.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.350+0000 7f836a000640 1 -- 172.21.15.46:0/2311884036 shutdown_connections 2024-02-19T06:58:14.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:14.350+0000 7f836a000640 1 -- 172.21.15.46:0/2311884036 wait complete. 2024-02-19T06:58:14.370 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-19T06:58:14.370 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-19T06:58:14.370 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-02-19T06:58:14.370 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-19T06:58:14.371 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-19T06:58:14.371 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-19T06:58:14.371 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-19T06:58:14.371 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-19T06:58:14.371 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-19T06:58:14.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:14.371 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-02-19T06:58:14.426 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T06:58:14.427 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T06:58:14.427 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T06:58:14.427 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:14.427 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-02-19T06:58:14.427 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:14.427 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:58:14.427 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:14.427 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-02-19T06:58:14.427 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:58:14.427 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:14.427 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-02-19T06:58:14.428 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-19T06:58:14.428 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:14.428 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-02-19T06:58:14.428 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-19T06:58:14.428 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 41762sec preferred_lft 41762sec 2024-02-19T06:58:14.428 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-02-19T06:58:14.428 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:14.428 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:58:14.428 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:14.428 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-02-19T06:58:14.429 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-19T06:58:14.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:14.429 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T06:58:14.429 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T06:58:14.429 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-02-19T06:58:14.429 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-02-19T06:58:14.429 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-02-19T06:58:14.430 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-19T06:58:14.430 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T06:58:14.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:14.894 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-19T06:58:14.981 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-02-19T06:58:14.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:14.985 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-02-19T06:58:15.039 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-02-19T06:58:15.039 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-19T06:58:15.039 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-19T06:58:15.039 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-19T06:58:15.039 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-19T06:58:15.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:15.040 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T06:58:15.040 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T06:58:15.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-19T06:58:15.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-19T06:58:15.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-19T06:58:15.040 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T06:58:15.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:15.756 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-02-19T06:58:15.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:15.815 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-02-19T06:58:15.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:15.873 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T06:58:15.873 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T06:58:15.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:58:15.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-19T06:58:15.873 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T06:58:16.024 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-19T06:58:16.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:16.025 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T06:58:16.025 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T06:58:16.025 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-19T06:58:16.025 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-19T06:58:16.025 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-19T06:58:16.025 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-19T06:58:16.025 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-19T06:58:16.025 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T06:58:16.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:16.327 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T06:58:16.327 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T06:58:16.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-02-19T06:58:16.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-02-19T06:58:16.327 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T06:58:16.506 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-02-19T06:58:16.506 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T06:58:16.506 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-19T06:58:16.560 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-19T06:58:16.560 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T06:58:16.560 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-19T06:58:16.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-02-19T06:58:16.716 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-02-19T06:58:16.771 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-02-19T06:58:16.771 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-02-19T06:58:16.771 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-02-19T06:58:16.771 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-02-19T06:58:16.771 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-02-19T06:58:16.771 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-02-19T06:58:16.771 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-02-19T06:58:16.771 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-02-19T06:58:16.771 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-02-19T06:58:16.771 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-02-19T06:58:16.771 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-02-19T06:58:16.772 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-02-19T06:58:16.773 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-02-19T06:58:16.773 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-02-19T06:58:16.773 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-02-19T06:58:16.773 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-02-19T06:58:16.773 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:58:16.773 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:58:16.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:16.774 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-02-19T06:58:16.824 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-19T06:58:16.825 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-02-19T06:58:16.830 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-02-19T06:58:16.904 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-02-19T06:58:16.946 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-02-19T06:58:16.946 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-02-19T06:58:16.946 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-02-19T06:58:16.946 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-02-19T06:58:16.946 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-02-19T06:58:16.946 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-02-19T06:58:16.946 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-19T06:58:16.947 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-19T06:58:16.948 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-02-19T06:58:16.948 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-02-19T06:58:16.948 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-02-19T06:58:16.948 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-02-19T06:58:16.948 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-02-19T06:58:16.948 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-02-19T06:58:16.948 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-02-19T06:58:16.948 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-02-19T06:58:16.948 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:58:16.948 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:58:16.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:16.949 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-02-19T06:58:17.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:2024-02-19T06:58:17.020+0000 7f80fec3c480 -1 init, newargv = 0x55864ba4aed0 newargc=15 2024-02-19T06:58:17.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[44636]: starting ceph client 2024-02-19T06:58:17.035 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[44636]: starting fuse 2024-02-19T06:58:17.036 INFO:teuthology.orchestra.run.smithi046.stdout:40 2024-02-19T06:58:17.037 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-02-19T06:58:17.037 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2024-02-19T06:58:17.037 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2024-02-19T06:58:17.037 DEBUG:teuthology.orchestra.run.smithi046:> import re 2024-02-19T06:58:17.037 DEBUG:teuthology.orchestra.run.smithi046:> import os 2024-02-19T06:58:17.037 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2024-02-19T06:58:17.037 DEBUG:teuthology.orchestra.run.smithi046:> 2024-02-19T06:58:17.037 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2024-02-19T06:58:17.037 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-19T06:58:17.037 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2024-02-19T06:58:17.037 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> return f 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> 2024-02-19T06:58:17.038 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.0")) 2024-02-19T06:58:17.039 DEBUG:teuthology.orchestra.run.smithi046:> ' 2024-02-19T06:58:17.247 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.0.44636.asok 2024-02-19T06:58:17.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-19T06:58:17.264 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44636.asok 2024-02-19T06:58:17.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:17.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44636.asok status 2024-02-19T06:58:17.508 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T06:58:17.508 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2024-02-19T06:58:17.508 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "25296a8f176256aea5ed8b5850b25167dce0ae33", 2024-02-19T06:58:17.508 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.0.0-1514-g25296a8f (25296a8f176256aea5ed8b5850b25167dce0ae33) squid (dev)", 2024-02-19T06:58:17.508 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "0", 2024-02-19T06:58:17.508 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2024-02-19T06:58:17.508 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "44636", 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4659, 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 4659 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-02-19T06:58:17.509 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1506459880 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1506459880 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.4659 192.168.0.1:0/1506459880", 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.1:0/1506459880", 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 8, 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 22, 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2024-02-19T06:58:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2024-02-19T06:58:17.511 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2024-02-19T06:58:17.511 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T06:58:17.524 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-19T06:58:17.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.748+0000 7f7539400640 1 Processor -- start 2024-02-19T06:58:17.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.748+0000 7f7539400640 1 -- start start 2024-02-19T06:58:17.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.750+0000 7f7539400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f753415c4a0 0x7f7534165a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:17.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.750+0000 7f7539400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75341630f0 0x7f753406df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:17.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.750+0000 7f7539400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75341663d0 con 0x7f753406e4c0 2024-02-19T06:58:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.750+0000 7f7539400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7534166990 con 0x7f753415c4a0 2024-02-19T06:58:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.750+0000 7f7539400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75341666b0 con 0x7f75341630f0 2024-02-19T06:58:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.751+0000 7f7531e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75341630f0 0x7f753406df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.751+0000 7f7532800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f753415c4a0 0x7f7534165a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.751+0000 7f7531e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75341630f0 0x7f753406df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:53488/0 (socket says 172.21.15.46:53488) 2024-02-19T06:58:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.751+0000 7f7531e00640 1 -- 172.21.15.46:0/1460507348 learned_addr learned my addr 172.21.15.46:0/1460507348 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.752+0000 7f7531400640 1 -- 172.21.15.46:0/1460507348 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860260805 0 0) 0x7f75341663d0 con 0x7f753406e4c0 2024-02-19T06:58:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.752+0000 7f7531400640 1 -- 172.21.15.46:0/1460507348 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7518003520 con 0x7f753406e4c0 2024-02-19T06:58:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.752+0000 7f7531e00640 1 -- 172.21.15.46:0/1460507348 >> v2:172.21.15.142:3300/0 conn(0x7f753415c4a0 msgr2=0x7f7534165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.752+0000 7f7531e00640 1 --2- 172.21.15.46:0/1460507348 >> v2:172.21.15.142:3300/0 conn(0x7f753415c4a0 0x7f7534165a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.752+0000 7f7531e00640 1 -- 172.21.15.46:0/1460507348 >> v1:172.21.15.142:6789/0 conn(0x7f753406e4c0 legacy=0x7f75340b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.752+0000 7f7531e00640 1 -- 172.21.15.46:0/1460507348 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753406d780 con 0x7f75341630f0 2024-02-19T06:58:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.753+0000 7f7531e00640 1 --2- 172.21.15.46:0/1460507348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75341630f0 0x7f753406df80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7524009870 tx=0x7f752402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=788928f6079d7cfe server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:17.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.754+0000 7f7531400640 1 -- 172.21.15.46:0/1460507348 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524030840 con 0x7f75341630f0 2024-02-19T06:58:17.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.754+0000 7f7531400640 1 -- 172.21.15.46:0/1460507348 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75240309a0 con 0x7f75341630f0 2024-02-19T06:58:17.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.754+0000 7f7531400640 1 -- 172.21.15.46:0/1460507348 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524030d30 con 0x7f75341630f0 2024-02-19T06:58:17.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.754+0000 7f7539400640 1 -- 172.21.15.46:0/1460507348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75341630f0 msgr2=0x7f753406df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:17.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.754+0000 7f7539400640 1 --2- 172.21.15.46:0/1460507348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75341630f0 0x7f753406df80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7524009870 tx=0x7f752402b980 comp rx=0 tx=0).stop 2024-02-19T06:58:17.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.755+0000 7f7539400640 1 -- 172.21.15.46:0/1460507348 shutdown_connections 2024-02-19T06:58:17.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.755+0000 7f7539400640 1 --2- 172.21.15.46:0/1460507348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75341630f0 0x7f753406df80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:17.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.755+0000 7f7539400640 1 --2- 172.21.15.46:0/1460507348 >> v2:172.21.15.142:3300/0 conn(0x7f753415c4a0 0x7f7534165a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:17.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.755+0000 7f7539400640 1 -- 172.21.15.46:0/1460507348 >> 172.21.15.46:0/1460507348 conn(0x7f7534066f70 msgr2=0x7f753406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:17.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.755+0000 7f7539400640 1 -- 172.21.15.46:0/1460507348 shutdown_connections 2024-02-19T06:58:17.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.755+0000 7f7539400640 1 -- 172.21.15.46:0/1460507348 wait complete. 2024-02-19T06:58:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.756+0000 7f7539400640 1 Processor -- start 2024-02-19T06:58:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.757+0000 7f7539400640 1 -- start start 2024-02-19T06:58:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.758+0000 7f7539400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f753406e4c0 0x7f75341f7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.758+0000 7f7539400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753415c4a0 0x7f753415f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.758+0000 7f7539400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75341630f0 0x7f753415f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.758+0000 7f7539400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75341483a0 con 0x7f753415c4a0 2024-02-19T06:58:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.758+0000 7f7539400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75341f75a0 con 0x7f753406e4c0 2024-02-19T06:58:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.758+0000 7f7539400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340cf220 con 0x7f75341630f0 2024-02-19T06:58:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.758+0000 7f7531e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753415c4a0 0x7f753415f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.758+0000 7f7531e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753415c4a0 0x7f753415f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46610/0 (socket says 172.21.15.46:46610) 2024-02-19T06:58:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.758+0000 7f7531e00640 1 -- 172.21.15.46:0/3597634279 learned_addr learned my addr 172.21.15.46:0/3597634279 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.758+0000 7f7532800640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f753406e4c0 0x7f75341f7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.758+0000 7f7533200640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75341630f0 0x7f753415f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.759+0000 7f7531e00640 1 -- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75341630f0 msgr2=0x7f753415f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.759+0000 7f7531e00640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75341630f0 0x7f753415f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.759+0000 7f7531e00640 1 -- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f753406e4c0 msgr2=0x7f75341f7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.759+0000 7f7531e00640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f753406e4c0 0x7f75341f7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.759+0000 7f7531e00640 1 -- 172.21.15.46:0/3597634279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75240094d0 con 0x7f753415c4a0 2024-02-19T06:58:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.759+0000 7f7533200640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75341630f0 0x7f753415f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.759+0000 7f7531e00640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753415c4a0 0x7f753415f1c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f752402b9c0 tx=0x7f75240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.759+0000 7f752aa00640 1 -- 172.21.15.46:0/3597634279 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752403e070 con 0x7f753415c4a0 2024-02-19T06:58:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.759+0000 7f752aa00640 1 -- 172.21.15.46:0/3597634279 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524039a10 con 0x7f753415c4a0 2024-02-19T06:58:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.759+0000 7f7539400640 1 -- 172.21.15.46:0/3597634279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75340cf500 con 0x7f753415c4a0 2024-02-19T06:58:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.759+0000 7f752aa00640 1 -- 172.21.15.46:0/3597634279 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524039da0 con 0x7f753415c4a0 2024-02-19T06:58:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.760+0000 7f7539400640 1 -- 172.21.15.46:0/3597634279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75340cfac0 con 0x7f753415c4a0 2024-02-19T06:58:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.761+0000 7f7539400640 1 -- 172.21.15.46:0/3597634279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75341484e0 con 0x7f753415c4a0 2024-02-19T06:58:17.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.762+0000 7f752aa00640 1 -- 172.21.15.46:0/3597634279 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f752404b400 con 0x7f753415c4a0 2024-02-19T06:58:17.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.763+0000 7f752aa00640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f751006b810 0x7f751006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:17.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.763+0000 7f752aa00640 1 -- 172.21.15.46:0/3597634279 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75240ac7c0 con 0x7f753415c4a0 2024-02-19T06:58:17.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.764+0000 7f7532800640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f751006b810 0x7f751006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:17.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.765+0000 7f7532800640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f751006b810 0x7f751006dcd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7534161000 tx=0x7f751c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:17.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:17.769+0000 7f752aa00640 1 -- 172.21.15.46:0/3597634279 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f75341484e0 con 0x7f753415c4a0 2024-02-19T06:58:18.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.009+0000 7f7539400640 1 -- 172.21.15.46:0/3597634279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f75341484e0 con 0x7f753415c4a0 2024-02-19T06:58:18.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.010+0000 7f752aa00640 1 -- 172.21.15.46:0/3597634279 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f75341484e0 con 0x7f753415c4a0 2024-02-19T06:58:18.013 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-19T06:58:18.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.013+0000 7f7539400640 1 -- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f751006b810 msgr2=0x7f751006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:18.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.013+0000 7f7539400640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f751006b810 0x7f751006dcd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7534161000 tx=0x7f751c008040 comp rx=0 tx=0).stop 2024-02-19T06:58:18.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.013+0000 7f7539400640 1 -- 172.21.15.46:0/3597634279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753415c4a0 msgr2=0x7f753415f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:18.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.013+0000 7f7539400640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753415c4a0 0x7f753415f1c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f752402b9c0 tx=0x7f75240046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:18.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.013+0000 7f7539400640 1 -- 172.21.15.46:0/3597634279 shutdown_connections 2024-02-19T06:58:18.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.013+0000 7f7539400640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f751006b810 0x7f751006dcd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:18.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.013+0000 7f7539400640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75341630f0 0x7f753415f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:18.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.013+0000 7f7539400640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753415c4a0 0x7f753415f1c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:18.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.013+0000 7f7539400640 1 --2- 172.21.15.46:0/3597634279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f753406e4c0 0x7f75341f7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:18.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.013+0000 7f7539400640 1 -- 172.21.15.46:0/3597634279 >> 172.21.15.46:0/3597634279 conn(0x7f7534066f70 msgr2=0x7f7534163530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:18.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.013+0000 7f7539400640 1 -- 172.21.15.46:0/3597634279 shutdown_connections 2024-02-19T06:58:18.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:18.014+0000 7f7539400640 1 -- 172.21.15.46:0/3597634279 wait complete. 2024-02-19T06:58:18.035 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-19T06:58:18.035 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-19T06:58:18.035 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-02-19T06:58:18.036 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-02-19T06:58:18.036 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-02-19T06:58:18.036 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-19T06:58:18.036 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-19T06:58:18.036 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-19T06:58:18.036 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-02-19T06:58:18.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:18.036 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-02-19T06:58:18.090 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T06:58:18.090 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T06:58:18.090 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T06:58:18.090 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.090 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-02-19T06:58:18.090 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.090 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:58:18.090 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:18.090 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-02-19T06:58:18.090 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:58:18.090 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 41758sec preferred_lft 41758sec 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 4a:9e:dd:dc:2f:2a brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-19T06:58:18.091 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.092 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::506e:52ff:feda:bc5b/64 scope link proto kernel_ll 2024-02-19T06:58:18.092 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.092 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-19T06:58:18.092 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 4a:9e:dd:dc:2f:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:58:18.092 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::489e:ddff:fedc:2f2a/64 scope link proto kernel_ll 2024-02-19T06:58:18.092 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:18.093 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-19T06:58:18.187 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-02-19T06:58:18.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:18.192 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-02-19T06:58:18.247 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-02-19T06:58:18.247 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-19T06:58:18.247 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-19T06:58:18.247 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-19T06:58:18.247 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-19T06:58:18.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:18.248 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T06:58:18.248 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T06:58:18.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-19T06:58:18.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-19T06:58:18.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-19T06:58:18.249 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T06:58:18.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:18.443 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-02-19T06:58:18.499 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-19T06:58:18.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:18.500 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-02-19T06:58:18.558 INFO:teuthology.orchestra.run.smithi046.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-02-19T06:58:18.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:18.560 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T06:58:18.560 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T06:58:18.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-19T06:58:18.561 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-02-19T06:58:18.561 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T06:58:18.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:18.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-02-19T06:58:18.816 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T06:58:18.816 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T06:58:18.816 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T06:58:18.817 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.817 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host proto kernel_lo 2024-02-19T06:58:18.817 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.817 INFO:teuthology.orchestra.run.smithi046.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-19T06:58:18.817 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 32:06:c6:38:79:5f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-19T06:58:18.817 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-19T06:58:18.817 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.817 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::3006:c6ff:fe38:795f/64 scope link proto kernel_ll 2024-02-19T06:58:18.817 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:18.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-02-19T06:58:18.927 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T06:58:18.927 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T06:58:18.927 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T06:58:18.927 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.927 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host proto kernel_lo 2024-02-19T06:58:18.927 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.927 INFO:teuthology.orchestra.run.smithi046.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-19T06:58:18.927 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 32:06:c6:38:79:5f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-19T06:58:18.927 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-19T06:58:18.928 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.928 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::3006:c6ff:fe38:795f/64 scope link proto kernel_ll 2024-02-19T06:58:18.928 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:18.932 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-02-19T06:58:18.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:18.933 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T06:58:18.933 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T06:58:18.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-02-19T06:58:18.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-02-19T06:58:18.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-02-19T06:58:18.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-02-19T06:58:18.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-02-19T06:58:18.933 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T06:58:19.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:19.230 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T06:58:19.230 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T06:58:19.231 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.1 up 2024-02-19T06:58:19.231 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.1 master ceph-brx 2024-02-19T06:58:19.231 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T06:58:19.412 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-02-19T06:58:19.412 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T06:58:19.413 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-02-19T06:58:19.466 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-02-19T06:58:19.467 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T06:58:19.467 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-02-19T06:58:19.526 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-02-19T06:58:19.630 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-02-19T06:58:19.689 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-02-19T06:58:19.689 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-02-19T06:58:19.689 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-02-19T06:58:19.689 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-02-19T06:58:19.689 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-02-19T06:58:19.689 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-02-19T06:58:19.689 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-02-19T06:58:19.689 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-19T06:58:19.690 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-02-19T06:58:19.691 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-02-19T06:58:19.691 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-02-19T06:58:19.691 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-02-19T06:58:19.691 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-02-19T06:58:19.691 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-02-19T06:58:19.691 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-02-19T06:58:19.691 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-02-19T06:58:19.691 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:58:19.691 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:58:19.691 INFO:teuthology.orchestra.run.smithi046.stdout:/home/ubuntu/cephtest/mnt.0 2024-02-19T06:58:19.691 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-19T06:58:19.691 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-19T06:58:19.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:19.692 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-02-19T06:58:19.744 INFO:teuthology.orchestra.run.smithi046.stdout:40 2024-02-19T06:58:19.745 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [40] 2024-02-19T06:58:19.745 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-02-19T06:58:19.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-02-19T06:58:19.831 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-02-19T06:58:19.878 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-02-19T06:58:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-02-19T06:58:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-02-19T06:58:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-02-19T06:58:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-02-19T06:58:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-02-19T06:58:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-19T06:58:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-19T06:58:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-02-19T06:58:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-02-19T06:58:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-02-19T06:58:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-02-19T06:58:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-02-19T06:58:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-02-19T06:58:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-02-19T06:58:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-02-19T06:58:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:58:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:58:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:/home/ubuntu/cephtest/mnt.0 2024-02-19T06:58:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-19T06:58:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-19T06:58:19.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:19.882 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-02-19T06:58:19.945 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi046.stderr:2024-02-19T06:58:19.943+0000 7f7d2a60c480 -1 init, newargv = 0x56209bc8ed10 newargc=15 2024-02-19T06:58:19.945 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi046.stderr:ceph-fuse[45130]: starting ceph client 2024-02-19T06:58:19.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi046.stderr:ceph-fuse[45130]: starting fuse 2024-02-19T06:58:19.966 INFO:teuthology.orchestra.run.smithi046.stdout:40 2024-02-19T06:58:19.966 INFO:teuthology.orchestra.run.smithi046.stdout:42 2024-02-19T06:58:19.967 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40, 42] 2024-02-19T06:58:19.967 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2024-02-19T06:58:19.967 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2024-02-19T06:58:19.967 DEBUG:teuthology.orchestra.run.smithi046:> import re 2024-02-19T06:58:19.967 DEBUG:teuthology.orchestra.run.smithi046:> import os 2024-02-19T06:58:19.967 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2024-02-19T06:58:19.967 DEBUG:teuthology.orchestra.run.smithi046:> 2024-02-19T06:58:19.967 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2024-02-19T06:58:19.967 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2024-02-19T06:58:19.968 DEBUG:teuthology.orchestra.run.smithi046:> return f 2024-02-19T06:58:19.969 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-19T06:58:19.969 DEBUG:teuthology.orchestra.run.smithi046:> 2024-02-19T06:58:19.969 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.2")) 2024-02-19T06:58:19.969 DEBUG:teuthology.orchestra.run.smithi046:> ' 2024-02-19T06:58:20.184 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.2.45130.asok 2024-02-19T06:58:20.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-19T06:58:20.202 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.45130.asok 2024-02-19T06:58:20.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:20.202 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.45130.asok status 2024-02-19T06:58:20.451 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T06:58:20.452 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2024-02-19T06:58:20.452 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "25296a8f176256aea5ed8b5850b25167dce0ae33", 2024-02-19T06:58:20.452 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.0.0-1514-g25296a8f (25296a8f176256aea5ed8b5850b25167dce0ae33) squid (dev)", 2024-02-19T06:58:20.452 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "2", 2024-02-19T06:58:20.452 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2024-02-19T06:58:20.452 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-02-19T06:58:20.452 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "45130", 2024-02-19T06:58:20.452 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2024-02-19T06:58:20.452 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:58:20.452 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2024-02-19T06:58:20.452 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2024-02-19T06:58:20.452 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4671, 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 4671 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.2:0", 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1609744653 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.2:0", 2024-02-19T06:58:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1609744653 2024-02-19T06:58:20.454 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:58:20.454 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.4671 192.168.0.2:0/1609744653", 2024-02-19T06:58:20.454 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.2:0/1609744653", 2024-02-19T06:58:20.454 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2024-02-19T06:58:20.454 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 8, 2024-02-19T06:58:20.454 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 22, 2024-02-19T06:58:20.454 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2024-02-19T06:58:20.454 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2024-02-19T06:58:20.454 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2024-02-19T06:58:20.454 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T06:58:20.467 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-19T06:58:20.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.685+0000 7f1b33200640 1 Processor -- start 2024-02-19T06:58:20.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.685+0000 7f1b33200640 1 -- start start 2024-02-19T06:58:20.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.687+0000 7f1b33200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2c145260 0x7f1b2c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:20.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.687+0000 7f1b33200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1b2c06e500 0x7f1b2c071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:20.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.687+0000 7f1b33200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c15ce10 con 0x7f1b2c071000 2024-02-19T06:58:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.687+0000 7f1b33200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2c0719c0 con 0x7f1b2c06e500 2024-02-19T06:58:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.687+0000 7f1b33200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0cbde0 con 0x7f1b2c145260 2024-02-19T06:58:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.687+0000 7f1b2b400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1b2c071000 0x7f1b2c15f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48934/0 (socket says 172.21.15.46:48934) 2024-02-19T06:58:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.687+0000 7f1b2b400640 1 -- 172.21.15.46:0/2837958965 learned_addr learned my addr 172.21.15.46:0/2837958965 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.687+0000 7f1b31200640 1 --2- 172.21.15.46:0/2837958965 >> v2:172.21.15.46:3300/0 conn(0x7f1b2c06e500 0x7f1b2c071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.687+0000 7f1b2be00640 1 --2- 172.21.15.46:0/2837958965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2c145260 0x7f1b2c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.688+0000 7f1b31200640 1 -- 172.21.15.46:0/2837958965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2c145260 msgr2=0x7f1b2c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.688+0000 7f1b31200640 1 --2- 172.21.15.46:0/2837958965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2c145260 0x7f1b2c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.688+0000 7f1b31200640 1 -- 172.21.15.46:0/2837958965 >> v1:172.21.15.46:6789/0 conn(0x7f1b2c071000 legacy=0x7f1b2c15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.688+0000 7f1b31200640 1 -- 172.21.15.46:0/2837958965 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0cc080 con 0x7f1b2c06e500 2024-02-19T06:58:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.688+0000 7f1b2aa00640 1 -- 172.21.15.46:0/2837958965 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027871296 0 0) 0x7f1b2c15ce10 con 0x7f1b2c071000 2024-02-19T06:58:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.688+0000 7f1b2be00640 1 --2- 172.21.15.46:0/2837958965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2c145260 0x7f1b2c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.689+0000 7f1b31200640 1 --2- 172.21.15.46:0/2837958965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b2c06e500 0x7f1b2c071480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009d90 tx=0x7f1b2402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1374eed6763d0a8 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.689+0000 7f1b2aa00640 1 -- 172.21.15.46:0/2837958965 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2402cbc0 con 0x7f1b2c06e500 2024-02-19T06:58:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.689+0000 7f1b2aa00640 1 -- 172.21.15.46:0/2837958965 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2402cd20 con 0x7f1b2c06e500 2024-02-19T06:58:20.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.689+0000 7f1b2aa00640 1 -- 172.21.15.46:0/2837958965 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24034660 con 0x7f1b2c06e500 2024-02-19T06:58:20.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.690+0000 7f1b33200640 1 -- 172.21.15.46:0/2837958965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b2c06e500 msgr2=0x7f1b2c071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:20.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.690+0000 7f1b33200640 1 --2- 172.21.15.46:0/2837958965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b2c06e500 0x7f1b2c071480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009d90 tx=0x7f1b2402be10 comp rx=0 tx=0).stop 2024-02-19T06:58:20.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.690+0000 7f1b33200640 1 -- 172.21.15.46:0/2837958965 shutdown_connections 2024-02-19T06:58:20.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.690+0000 7f1b33200640 1 --2- 172.21.15.46:0/2837958965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b2c06e500 0x7f1b2c071480 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:20.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.690+0000 7f1b33200640 1 --2- 172.21.15.46:0/2837958965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2c145260 0x7f1b2c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:20.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.690+0000 7f1b33200640 1 -- 172.21.15.46:0/2837958965 >> 172.21.15.46:0/2837958965 conn(0x7f1b2c066f70 msgr2=0x7f1b2c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:20.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.690+0000 7f1b33200640 1 -- 172.21.15.46:0/2837958965 shutdown_connections 2024-02-19T06:58:20.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.690+0000 7f1b33200640 1 -- 172.21.15.46:0/2837958965 wait complete. 2024-02-19T06:58:20.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.693+0000 7f1b33200640 1 Processor -- start 2024-02-19T06:58:20.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.693+0000 7f1b33200640 1 -- start start 2024-02-19T06:58:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b33200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2c06e500 0x7f1b2c13ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b33200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b2c071000 0x7f1b2c0b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b33200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b2c145260 0x7f1b2c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b33200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0b3710 con 0x7f1b2c071000 2024-02-19T06:58:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b33200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0b3940 con 0x7f1b2c145260 2024-02-19T06:58:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b33200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0b3c20 con 0x7f1b2c06e500 2024-02-19T06:58:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b2b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b2c071000 0x7f1b2c0b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b2b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b2c071000 0x7f1b2c0b31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46634/0 (socket says 172.21.15.46:46634) 2024-02-19T06:58:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b2b400640 1 -- 172.21.15.46:0/1843168175 learned_addr learned my addr 172.21.15.46:0/1843168175 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b2be00640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2c06e500 0x7f1b2c13ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b31200640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b2c145260 0x7f1b2c15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b2b400640 1 -- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2c06e500 msgr2=0x7f1b2c13ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b2b400640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2c06e500 0x7f1b2c13ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b2b400640 1 -- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b2c145260 msgr2=0x7f1b2c15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b2b400640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b2c145260 0x7f1b2c15aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b2b400640 1 -- 172.21.15.46:0/1843168175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24009a70 con 0x7f1b2c071000 2024-02-19T06:58:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b2b400640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b2c071000 0x7f1b2c0b31d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800c4d0 tx=0x7f1b1800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b23e00640 1 -- 172.21.15.46:0/1843168175 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b180074e0 con 0x7f1b2c071000 2024-02-19T06:58:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b23e00640 1 -- 172.21.15.46:0/1843168175 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b18007660 con 0x7f1b2c071000 2024-02-19T06:58:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.694+0000 7f1b23e00640 1 -- 172.21.15.46:0/1843168175 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18004a20 con 0x7f1b2c071000 2024-02-19T06:58:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.695+0000 7f1b33200640 1 -- 172.21.15.46:0/1843168175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c0aefd0 con 0x7f1b2c071000 2024-02-19T06:58:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.695+0000 7f1b33200640 1 -- 172.21.15.46:0/1843168175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c0af590 con 0x7f1b2c071000 2024-02-19T06:58:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.697+0000 7f1b33200640 1 -- 172.21.15.46:0/1843168175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2c067ba0 con 0x7f1b2c071000 2024-02-19T06:58:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.698+0000 7f1b23e00640 1 -- 172.21.15.46:0/1843168175 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1b18004b80 con 0x7f1b2c071000 2024-02-19T06:58:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.699+0000 7f1b23e00640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b0c06b810 0x7f1b0c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.699+0000 7f1b23e00640 1 -- 172.21.15.46:0/1843168175 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b18089370 con 0x7f1b2c071000 2024-02-19T06:58:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.699+0000 7f1b2be00640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b0c06b810 0x7f1b0c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:20.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.700+0000 7f1b2be00640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b0c06b810 0x7f1b0c06dcd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c06b260 tx=0x7f1b1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.704+0000 7f1b23e00640 1 -- 172.21.15.46:0/1843168175 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b18053da0 con 0x7f1b2c071000 2024-02-19T06:58:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.944+0000 7f1b33200640 1 -- 172.21.15.46:0/1843168175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1b2c0d0290 con 0x7f1b2c071000 2024-02-19T06:58:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.945+0000 7f1b23e00640 1 -- 172.21.15.46:0/1843168175 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1b18057460 con 0x7f1b2c071000 2024-02-19T06:58:20.948 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-19T06:58:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.948+0000 7f1b33200640 1 -- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b0c06b810 msgr2=0x7f1b0c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.948+0000 7f1b33200640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b0c06b810 0x7f1b0c06dcd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c06b260 tx=0x7f1b1c008040 comp rx=0 tx=0).stop 2024-02-19T06:58:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.948+0000 7f1b33200640 1 -- 172.21.15.46:0/1843168175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b2c071000 msgr2=0x7f1b2c0b31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.948+0000 7f1b33200640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b2c071000 0x7f1b2c0b31d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800c4d0 tx=0x7f1b1800c990 comp rx=0 tx=0).stop 2024-02-19T06:58:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.948+0000 7f1b33200640 1 -- 172.21.15.46:0/1843168175 shutdown_connections 2024-02-19T06:58:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.948+0000 7f1b33200640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b0c06b810 0x7f1b0c06dcd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.948+0000 7f1b33200640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b2c145260 0x7f1b2c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.948+0000 7f1b33200640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b2c071000 0x7f1b2c0b31d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.948+0000 7f1b33200640 1 --2- 172.21.15.46:0/1843168175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2c06e500 0x7f1b2c13ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.948+0000 7f1b33200640 1 -- 172.21.15.46:0/1843168175 >> 172.21.15.46:0/1843168175 conn(0x7f1b2c066f70 msgr2=0x7f1b2c1437a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.948+0000 7f1b33200640 1 -- 172.21.15.46:0/1843168175 shutdown_connections 2024-02-19T06:58:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:20.948+0000 7f1b33200640 1 -- 172.21.15.46:0/1843168175 wait complete. 2024-02-19T06:58:20.971 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-19T06:58:20.971 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-19T06:58:20.971 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-02-19T06:58:20.971 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-19T06:58:20.971 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-19T06:58:20.971 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-19T06:58:20.971 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-19T06:58:20.972 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-19T06:58:20.972 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-19T06:58:20.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:20.972 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-02-19T06:58:21.031 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T06:58:21.031 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T06:58:21.031 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T06:58:21.031 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-19T06:58:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42368sec preferred_lft 42368sec 2024-02-19T06:58:21.033 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link proto kernel_ll 2024-02-19T06:58:21.033 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:21.033 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-19T06:58:21.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:21.033 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T06:58:21.033 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T06:58:21.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2024-02-19T06:58:21.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2024-02-19T06:58:21.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2024-02-19T06:58:21.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-19T06:58:21.034 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T06:58:21.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:21.467 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-19T06:58:21.539 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-02-19T06:58:21.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:21.543 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-02-19T06:58:21.596 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-02-19T06:58:21.596 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-19T06:58:21.596 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-19T06:58:21.596 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-19T06:58:21.596 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-19T06:58:21.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:21.597 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T06:58:21.597 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T06:58:21.597 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-19T06:58:21.597 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-19T06:58:21.597 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-19T06:58:21.597 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T06:58:22.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:22.337 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-02-19T06:58:22.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:22.382 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-02-19T06:58:22.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:22.471 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T06:58:22.471 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T06:58:22.472 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T06:58:22.472 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-19T06:58:22.472 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T06:58:22.602 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-19T06:58:22.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:22.603 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T06:58:22.603 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T06:58:22.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-19T06:58:22.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-19T06:58:22.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-19T06:58:22.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-19T06:58:22.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-19T06:58:22.603 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T06:58:22.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:22.867 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T06:58:22.867 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T06:58:22.867 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2024-02-19T06:58:22.867 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2024-02-19T06:58:22.867 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T06:58:23.016 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-02-19T06:58:23.016 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T06:58:23.017 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-19T06:58:23.056 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-19T06:58:23.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T06:58:23.056 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-19T06:58:23.146 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-02-19T06:58:23.239 DEBUG:teuthology.orchestra.run.smithi142:> cat /proc/self/mounts | awk '{print $2}' 2024-02-19T06:58:23.292 INFO:teuthology.orchestra.run.smithi142.stdout:/proc 2024-02-19T06:58:23.292 INFO:teuthology.orchestra.run.smithi142.stdout:/sys 2024-02-19T06:58:23.292 INFO:teuthology.orchestra.run.smithi142.stdout:/dev 2024-02-19T06:58:23.292 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/security 2024-02-19T06:58:23.292 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/shm 2024-02-19T06:58:23.292 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/pts 2024-02-19T06:58:23.292 INFO:teuthology.orchestra.run.smithi142.stdout:/run 2024-02-19T06:58:23.292 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/cgroup 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/pstore 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/ 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/selinux 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/mqueue 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/hugepages 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/debug 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/tracing 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/fuse/connections 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/config 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-sysctl.service 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-19T06:58:23.293 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/nfs/rpc_pipefs 2024-02-19T06:58:23.294 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/1000 2024-02-19T06:58:23.294 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph 2024-02-19T06:58:23.294 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-4 2024-02-19T06:58:23.294 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-5 2024-02-19T06:58:23.294 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-6 2024-02-19T06:58:23.294 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-7 2024-02-19T06:58:23.294 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns 2024-02-19T06:58:23.294 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T06:58:23.294 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T06:58:23.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:23.295 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-02-19T06:58:23.339 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-19T06:58:23.339 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-02-19T06:58:23.387 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-02-19T06:58:23.461 DEBUG:teuthology.orchestra.run.smithi142:> cat /proc/self/mounts | awk '{print $2}' 2024-02-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/proc 2024-02-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/sys 2024-02-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/dev 2024-02-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/security 2024-02-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/shm 2024-02-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/pts 2024-02-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/run 2024-02-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/cgroup 2024-02-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/pstore 2024-02-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/ 2024-02-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/selinux 2024-02-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-02-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/mqueue 2024-02-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/hugepages 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/debug 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/tracing 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/fuse/connections 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/config 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-sysctl.service 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/nfs/rpc_pipefs 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/1000 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-4 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-5 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-6 2024-02-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-7 2024-02-19T06:58:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns 2024-02-19T06:58:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T06:58:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T06:58:23.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:23.503 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-02-19T06:58:23.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi142.stderr:2024-02-19T06:58:23.564+0000 7fdb3383e480 -1 init, newargv = 0x56302b089fb0 newargc=15 2024-02-19T06:58:23.565 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi142.stderr:ceph-fuse[73405]: starting ceph client 2024-02-19T06:58:23.575 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi142.stderr:ceph-fuse[73405]: starting fuse 2024-02-19T06:58:23.586 INFO:teuthology.orchestra.run.smithi142.stdout:39 2024-02-19T06:58:23.586 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> sudo stdin-killer -- python3 -c ' 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> import glob 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> import re 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> import os 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> def _find_admin_socket(client_name): 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> files = glob.glob(asok_path) 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> # Given a non-glob path, it better be there 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> if "*" not in asok_path: 2024-02-19T06:58:23.587 DEBUG:teuthology.orchestra.run.smithi142:> assert(len(files) == 1) 2024-02-19T06:58:23.588 DEBUG:teuthology.orchestra.run.smithi142:> return files[0] 2024-02-19T06:58:23.588 DEBUG:teuthology.orchestra.run.smithi142:> 2024-02-19T06:58:23.588 DEBUG:teuthology.orchestra.run.smithi142:> for f in files: 2024-02-19T06:58:23.588 DEBUG:teuthology.orchestra.run.smithi142:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-19T06:58:23.588 DEBUG:teuthology.orchestra.run.smithi142:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-19T06:58:23.588 DEBUG:teuthology.orchestra.run.smithi142:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-19T06:58:23.588 DEBUG:teuthology.orchestra.run.smithi142:> contents = proc_f.read() 2024-02-19T06:58:23.588 DEBUG:teuthology.orchestra.run.smithi142:> if mountpoint in contents: 2024-02-19T06:58:23.588 DEBUG:teuthology.orchestra.run.smithi142:> return f 2024-02-19T06:58:23.588 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-19T06:58:23.588 DEBUG:teuthology.orchestra.run.smithi142:> 2024-02-19T06:58:23.588 DEBUG:teuthology.orchestra.run.smithi142:> print(_find_admin_socket("client.1")) 2024-02-19T06:58:23.588 DEBUG:teuthology.orchestra.run.smithi142:> ' 2024-02-19T06:58:23.778 INFO:teuthology.orchestra.run.smithi142.stdout:/var/run/ceph/ceph-client.1.73405.asok 2024-02-19T06:58:23.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:58:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-19T06:58:23.796 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.73405.asok 2024-02-19T06:58:23.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:23.796 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.73405.asok status 2024-02-19T06:58:24.030 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-02-19T06:58:24.030 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": { 2024-02-19T06:58:24.030 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_sha1": "25296a8f176256aea5ed8b5850b25167dce0ae33", 2024-02-19T06:58:24.030 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 19.0.0-1514-g25296a8f (25296a8f176256aea5ed8b5850b25167dce0ae33) squid (dev)", 2024-02-19T06:58:24.030 INFO:teuthology.orchestra.run.smithi142.stdout: "entity_id": "1", 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: "hostname": "smithi142", 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: "pid": "73405", 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: "root": "/" 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_count": 0, 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_pinned_count": 0, 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 4588, 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: "inst": { 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: "name": { 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "client", 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: "num": 4588 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-19T06:58:24.031 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.1:0", 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 2181640163 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.1:0", 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 2181640163 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: "inst_str": "client.4588 192.168.0.1:0/2181640163", 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: "addr_str": "192.168.0.1:0/2181640163", 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: "inode_count": 1, 2024-02-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_epoch": 8, 2024-02-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch": 22, 2024-02-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch_barrier": 0, 2024-02-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklisted": false, 2024-02-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs" 2024-02-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-02-19T06:58:24.045 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-19T06:58:24.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.277+0000 7f0c41600640 1 Processor -- start 2024-02-19T06:58:24.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.277+0000 7f0c41600640 1 -- start start 2024-02-19T06:58:24.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.278+0000 7f0c41600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c3c15b580 0x7f0c3c0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:24.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.278+0000 7f0c41600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0c3c0d3670 0x7f0c3c0d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:24.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.279+0000 7f0c41600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c0cecb0 con 0x7f0c3c0d0100 2024-02-19T06:58:24.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.279+0000 7f0c41600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c0d4040 con 0x7f0c3c0d3670 2024-02-19T06:58:24.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.279+0000 7f0c41600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c15ee30 con 0x7f0c3c15b580 2024-02-19T06:58:24.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.279+0000 7f0c40c00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0c3c0d0100 0x7f0c3c0d0570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48944/0 (socket says 172.21.15.46:48944) 2024-02-19T06:58:24.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.279+0000 7f0c40c00640 1 -- 172.21.15.46:0/1565295727 learned_addr learned my addr 172.21.15.46:0/1565295727 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:24.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.279+0000 7f0c3b400640 1 --2- 172.21.15.46:0/1565295727 >> v2:172.21.15.46:3300/0 conn(0x7f0c3c0d3670 0x7f0c3c0d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:24.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.279+0000 7f0c3be00640 1 --2- 172.21.15.46:0/1565295727 >> v2:172.21.15.142:3300/0 conn(0x7f0c3c15b580 0x7f0c3c0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:24.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.279+0000 7f0c3b400640 1 -- 172.21.15.46:0/1565295727 >> v2:172.21.15.142:3300/0 conn(0x7f0c3c15b580 msgr2=0x7f0c3c0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:24.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.279+0000 7f0c3aa00640 1 -- 172.21.15.46:0/1565295727 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587683078 0 0) 0x7f0c3c0cecb0 con 0x7f0c3c0d0100 2024-02-19T06:58:24.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.279+0000 7f0c3b400640 1 --2- 172.21.15.46:0/1565295727 >> v2:172.21.15.142:3300/0 conn(0x7f0c3c15b580 0x7f0c3c0cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:24.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.280+0000 7f0c3b400640 1 -- 172.21.15.46:0/1565295727 >> v1:172.21.15.46:6789/0 conn(0x7f0c3c0d0100 legacy=0x7f0c3c0d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:24.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.280+0000 7f0c3b400640 1 -- 172.21.15.46:0/1565295727 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0cf680 con 0x7f0c3c0d3670 2024-02-19T06:58:24.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.281+0000 7f0c3b400640 1 --2- 172.21.15.46:0/1565295727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c3c0d3670 0x7f0c3c0d3b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c08b7e0 tx=0x7f0c2402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f9261a0084adcf server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:24.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.281+0000 7f0c3aa00640 1 -- 172.21.15.46:0/1565295727 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24031830 con 0x7f0c3c0d3670 2024-02-19T06:58:24.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.281+0000 7f0c3aa00640 1 -- 172.21.15.46:0/1565295727 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c24031990 con 0x7f0c3c0d3670 2024-02-19T06:58:24.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.281+0000 7f0c3aa00640 1 -- 172.21.15.46:0/1565295727 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24031d20 con 0x7f0c3c0d3670 2024-02-19T06:58:24.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.281+0000 7f0c41600640 1 -- 172.21.15.46:0/1565295727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c3c0d3670 msgr2=0x7f0c3c0d3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:24.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.281+0000 7f0c41600640 1 --2- 172.21.15.46:0/1565295727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c3c0d3670 0x7f0c3c0d3b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c08b7e0 tx=0x7f0c2402b8d0 comp rx=0 tx=0).stop 2024-02-19T06:58:24.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.282+0000 7f0c41600640 1 -- 172.21.15.46:0/1565295727 shutdown_connections 2024-02-19T06:58:24.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.282+0000 7f0c41600640 1 --2- 172.21.15.46:0/1565295727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c3c0d3670 0x7f0c3c0d3b00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:24.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.282+0000 7f0c41600640 1 --2- 172.21.15.46:0/1565295727 >> v2:172.21.15.142:3300/0 conn(0x7f0c3c15b580 0x7f0c3c0cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:24.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.282+0000 7f0c41600640 1 -- 172.21.15.46:0/1565295727 >> 172.21.15.46:0/1565295727 conn(0x7f0c3c09c9e0 msgr2=0x7f0c3c08afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:24.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.282+0000 7f0c41600640 1 -- 172.21.15.46:0/1565295727 shutdown_connections 2024-02-19T06:58:24.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.282+0000 7f0c41600640 1 -- 172.21.15.46:0/1565295727 wait complete. 2024-02-19T06:58:24.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.283+0000 7f0c41600640 1 Processor -- start 2024-02-19T06:58:24.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.284+0000 7f0c41600640 1 -- start start 2024-02-19T06:58:24.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c41600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c3c0d0100 0x7f0c3c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:24.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c41600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c3c0d3670 0x7f0c3c159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:24.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c41600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c3c15b580 0x7f0c3c14b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:24.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c41600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0b62c0 con 0x7f0c3c15b580 2024-02-19T06:58:24.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c41600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0b8eb0 con 0x7f0c3c0d0100 2024-02-19T06:58:24.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c41600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0b6510 con 0x7f0c3c0d3670 2024-02-19T06:58:24.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c40c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c3c15b580 0x7f0c3c14b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:24.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c40c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c3c15b580 0x7f0c3c14b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46656/0 (socket says 172.21.15.46:46656) 2024-02-19T06:58:24.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c40c00640 1 -- 172.21.15.46:0/1606579113 learned_addr learned my addr 172.21.15.46:0/1606579113 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:24.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c3be00640 1 --2- 172.21.15.46:0/1606579113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c3c0d0100 0x7f0c3c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:24.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c40c00640 1 -- 172.21.15.46:0/1606579113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c3c0d3670 msgr2=0x7f0c3c159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:24.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c40c00640 1 --2- 172.21.15.46:0/1606579113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c3c0d3670 0x7f0c3c159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:24.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c40c00640 1 -- 172.21.15.46:0/1606579113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c3c0d0100 msgr2=0x7f0c3c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:24.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c40c00640 1 --2- 172.21.15.46:0/1606579113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c3c0d0100 0x7f0c3c0c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:24.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.285+0000 7f0c40c00640 1 -- 172.21.15.46:0/1606579113 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c24009400 con 0x7f0c3c15b580 2024-02-19T06:58:24.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.286+0000 7f0c40c00640 1 --2- 172.21.15.46:0/1606579113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c3c15b580 0x7f0c3c14b310 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400c410 tx=0x7f0c3400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:24.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.286+0000 7f0c33e00640 1 -- 172.21.15.46:0/1606579113 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340074e0 con 0x7f0c3c15b580 2024-02-19T06:58:24.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.286+0000 7f0c33e00640 1 -- 172.21.15.46:0/1606579113 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c34007640 con 0x7f0c3c15b580 2024-02-19T06:58:24.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.286+0000 7f0c41600640 1 -- 172.21.15.46:0/1606579113 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c0b67f0 con 0x7f0c3c15b580 2024-02-19T06:58:24.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.286+0000 7f0c33e00640 1 -- 172.21.15.46:0/1606579113 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c34004a20 con 0x7f0c3c15b580 2024-02-19T06:58:24.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.286+0000 7f0c41600640 1 -- 172.21.15.46:0/1606579113 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c159fa0 con 0x7f0c3c15b580 2024-02-19T06:58:24.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.288+0000 7f0c41600640 1 -- 172.21.15.46:0/1606579113 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c15a190 con 0x7f0c3c15b580 2024-02-19T06:58:24.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.288+0000 7f0c33e00640 1 -- 172.21.15.46:0/1606579113 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0c34004b80 con 0x7f0c3c15b580 2024-02-19T06:58:24.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.289+0000 7f0c33e00640 1 --2- 172.21.15.46:0/1606579113 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0c1806b840 0x7f0c1806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:24.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.289+0000 7f0c33e00640 1 -- 172.21.15.46:0/1606579113 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c34089f90 con 0x7f0c3c15b580 2024-02-19T06:58:24.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.290+0000 7f0c3be00640 1 --2- 172.21.15.46:0/1606579113 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0c1806b840 0x7f0c1806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:24.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.292+0000 7f0c3be00640 1 --2- 172.21.15.46:0/1606579113 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0c1806b840 0x7f0c1806dd00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009f30 tx=0x7f0c2c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:24.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.294+0000 7f0c33e00640 1 -- 172.21.15.46:0/1606579113 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0c340bd8c0 con 0x7f0c3c15b580 2024-02-19T06:58:24.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.533+0000 7f0c41600640 1 -- 172.21.15.46:0/1606579113 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0c3c0b6d10 con 0x7f0c3c15b580 2024-02-19T06:58:24.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.534+0000 7f0c33e00640 1 -- 172.21.15.46:0/1606579113 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0c3c0b6d10 con 0x7f0c3c15b580 2024-02-19T06:58:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-19T06:58:24.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.536+0000 7f0c41600640 1 -- 172.21.15.46:0/1606579113 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0c1806b840 msgr2=0x7f0c1806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:24.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.536+0000 7f0c41600640 1 --2- 172.21.15.46:0/1606579113 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0c1806b840 0x7f0c1806dd00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009f30 tx=0x7f0c2c00b040 comp rx=0 tx=0).stop 2024-02-19T06:58:24.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.537+0000 7f0c41600640 1 -- 172.21.15.46:0/1606579113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c3c15b580 msgr2=0x7f0c3c14b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:24.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.537+0000 7f0c41600640 1 --2- 172.21.15.46:0/1606579113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c3c15b580 0x7f0c3c14b310 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400c410 tx=0x7f0c3400c8d0 comp rx=0 tx=0).stop 2024-02-19T06:58:24.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.537+0000 7f0c41600640 1 -- 172.21.15.46:0/1606579113 shutdown_connections 2024-02-19T06:58:24.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.537+0000 7f0c41600640 1 --2- 172.21.15.46:0/1606579113 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0c1806b840 0x7f0c1806dd00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:24.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.537+0000 7f0c41600640 1 --2- 172.21.15.46:0/1606579113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c3c15b580 0x7f0c3c14b310 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:24.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.537+0000 7f0c41600640 1 --2- 172.21.15.46:0/1606579113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c3c0d3670 0x7f0c3c159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:24.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.537+0000 7f0c41600640 1 --2- 172.21.15.46:0/1606579113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c3c0d0100 0x7f0c3c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:24.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.537+0000 7f0c41600640 1 -- 172.21.15.46:0/1606579113 >> 172.21.15.46:0/1606579113 conn(0x7f0c3c09c9e0 msgr2=0x7f0c3c073cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:24.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.537+0000 7f0c41600640 1 -- 172.21.15.46:0/1606579113 shutdown_connections 2024-02-19T06:58:24.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:24.537+0000 7f0c41600640 1 -- 172.21.15.46:0/1606579113 wait complete. 2024-02-19T06:58:24.556 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-19T06:58:24.556 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-19T06:58:24.556 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-02-19T06:58:24.556 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-02-19T06:58:24.556 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-02-19T06:58:24.556 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-19T06:58:24.556 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-19T06:58:24.556 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-19T06:58:24.556 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-02-19T06:58:24.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:24.556 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-02-19T06:58:24.613 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T06:58:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T06:58:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-19T06:58:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42364sec preferred_lft 42364sec 2024-02-19T06:58:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link proto kernel_ll 2024-02-19T06:58:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:24.615 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-19T06:58:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:ac:a5:60:16:f7 brd ff:ff:ff:ff:ff:ff 2024-02-19T06:58:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-19T06:58:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::988f:d8ff:fe32:1293/64 scope link proto kernel_ll 2024-02-19T06:58:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:24.615 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-19T06:58:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:ac:a5:60:16:f7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T06:58:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::b4ac:a5ff:fe60:16f7/64 scope link proto kernel_ll 2024-02-19T06:58:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:24.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:24.616 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-19T06:58:24.703 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-02-19T06:58:24.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:24.708 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-02-19T06:58:24.760 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-02-19T06:58:24.760 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-19T06:58:24.760 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-19T06:58:24.760 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-19T06:58:24.761 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-19T06:58:24.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:24.761 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T06:58:24.761 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T06:58:24.761 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-19T06:58:24.761 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-19T06:58:24.761 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-19T06:58:24.761 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T06:58:24.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:24.946 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-02-19T06:58:24.995 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-19T06:58:24.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:24.997 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-02-19T06:58:25.052 INFO:teuthology.orchestra.run.smithi142.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-02-19T06:58:25.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:25.053 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T06:58:25.053 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T06:58:25.053 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-02-19T06:58:25.053 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-02-19T06:58:25.053 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T06:58:25.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:25.193 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-02-19T06:58:25.278 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T06:58:25.278 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T06:58:25.278 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T06:58:25.278 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:25.278 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host proto kernel_lo 2024-02-19T06:58:25.278 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:25.278 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-19T06:58:25.278 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ca:10:8b:d7:43:b8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-19T06:58:25.278 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-19T06:58:25.279 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:25.279 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::c810:8bff:fed7:43b8/64 scope link proto kernel_ll 2024-02-19T06:58:25.279 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:25.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:25.282 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-02-19T06:58:25.371 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T06:58:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T06:58:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T06:58:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host proto kernel_lo 2024-02-19T06:58:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:25.372 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-19T06:58:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ca:10:8b:d7:43:b8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-19T06:58:25.373 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-19T06:58:25.373 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:25.373 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::c810:8bff:fed7:43b8/64 scope link proto kernel_ll 2024-02-19T06:58:25.373 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:58:25.376 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-02-19T06:58:25.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:25.376 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T06:58:25.377 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T06:58:25.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-02-19T06:58:25.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-02-19T06:58:25.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-02-19T06:58:25.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-02-19T06:58:25.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-02-19T06:58:25.377 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T06:58:25.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:25.643 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T06:58:25.643 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T06:58:25.643 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.1 up 2024-02-19T06:58:25.643 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.1 master ceph-brx 2024-02-19T06:58:25.643 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T06:58:25.807 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-02-19T06:58:25.807 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T06:58:25.807 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-02-19T06:58:25.855 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-02-19T06:58:25.855 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T06:58:25.855 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-02-19T06:58:25.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-02-19T06:58:25.994 DEBUG:teuthology.orchestra.run.smithi142:> cat /proc/self/mounts | awk '{print $2}' 2024-02-19T06:58:26.047 INFO:teuthology.orchestra.run.smithi142.stdout:/proc 2024-02-19T06:58:26.047 INFO:teuthology.orchestra.run.smithi142.stdout:/sys 2024-02-19T06:58:26.047 INFO:teuthology.orchestra.run.smithi142.stdout:/dev 2024-02-19T06:58:26.047 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/security 2024-02-19T06:58:26.047 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/shm 2024-02-19T06:58:26.047 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/pts 2024-02-19T06:58:26.047 INFO:teuthology.orchestra.run.smithi142.stdout:/run 2024-02-19T06:58:26.047 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/cgroup 2024-02-19T06:58:26.047 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/pstore 2024-02-19T06:58:26.047 INFO:teuthology.orchestra.run.smithi142.stdout:/ 2024-02-19T06:58:26.047 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/selinux 2024-02-19T06:58:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-02-19T06:58:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/mqueue 2024-02-19T06:58:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/hugepages 2024-02-19T06:58:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/debug 2024-02-19T06:58:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/tracing 2024-02-19T06:58:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/fuse/connections 2024-02-19T06:58:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/config 2024-02-19T06:58:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-sysctl.service 2024-02-19T06:58:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-19T06:58:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-19T06:58:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/nfs/rpc_pipefs 2024-02-19T06:58:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/1000 2024-02-19T06:58:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph 2024-02-19T06:58:26.049 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-4 2024-02-19T06:58:26.049 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-5 2024-02-19T06:58:26.049 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-6 2024-02-19T06:58:26.049 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-7 2024-02-19T06:58:26.049 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns 2024-02-19T06:58:26.049 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T06:58:26.049 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T06:58:26.049 INFO:teuthology.orchestra.run.smithi142.stdout:/home/ubuntu/cephtest/mnt.1 2024-02-19T06:58:26.049 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-02-19T06:58:26.049 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-02-19T06:58:26.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:26.050 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-02-19T06:58:26.099 INFO:teuthology.orchestra.run.smithi142.stdout:39 2024-02-19T06:58:26.099 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [39] 2024-02-19T06:58:26.099 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-02-19T06:58:26.104 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-02-19T06:58:26.181 DEBUG:teuthology.orchestra.run.smithi142:> cat /proc/self/mounts | awk '{print $2}' 2024-02-19T06:58:26.223 INFO:teuthology.orchestra.run.smithi142.stdout:/proc 2024-02-19T06:58:26.224 INFO:teuthology.orchestra.run.smithi142.stdout:/sys 2024-02-19T06:58:26.224 INFO:teuthology.orchestra.run.smithi142.stdout:/dev 2024-02-19T06:58:26.224 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/security 2024-02-19T06:58:26.224 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/shm 2024-02-19T06:58:26.224 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/pts 2024-02-19T06:58:26.224 INFO:teuthology.orchestra.run.smithi142.stdout:/run 2024-02-19T06:58:26.224 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/cgroup 2024-02-19T06:58:26.224 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/pstore 2024-02-19T06:58:26.224 INFO:teuthology.orchestra.run.smithi142.stdout:/ 2024-02-19T06:58:26.224 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/selinux 2024-02-19T06:58:26.224 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-02-19T06:58:26.224 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/mqueue 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/hugepages 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/debug 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/tracing 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/fuse/connections 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/config 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-sysctl.service 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/nfs/rpc_pipefs 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/1000 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-4 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-5 2024-02-19T06:58:26.225 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-6 2024-02-19T06:58:26.226 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph/osd/ceph-7 2024-02-19T06:58:26.226 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns 2024-02-19T06:58:26.226 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T06:58:26.226 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T06:58:26.226 INFO:teuthology.orchestra.run.smithi142.stdout:/home/ubuntu/cephtest/mnt.1 2024-02-19T06:58:26.226 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-02-19T06:58:26.226 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-02-19T06:58:26.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:26.227 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-02-19T06:58:26.293 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi142.stderr:2024-02-19T06:58:26.292+0000 7fef29c42480 -1 init, newargv = 0x560c7cd28860 newargc=15 2024-02-19T06:58:26.293 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi142.stderr:ceph-fuse[73857]: starting ceph client 2024-02-19T06:58:26.303 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi142.stderr:ceph-fuse[73857]: starting fuse 2024-02-19T06:58:26.313 INFO:teuthology.orchestra.run.smithi142.stdout:39 2024-02-19T06:58:26.313 INFO:teuthology.orchestra.run.smithi142.stdout:42 2024-02-19T06:58:26.313 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39, 42] 2024-02-19T06:58:26.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo stdin-killer -- python3 -c ' 2024-02-19T06:58:26.314 DEBUG:teuthology.orchestra.run.smithi142:> import glob 2024-02-19T06:58:26.314 DEBUG:teuthology.orchestra.run.smithi142:> import re 2024-02-19T06:58:26.314 DEBUG:teuthology.orchestra.run.smithi142:> import os 2024-02-19T06:58:26.314 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2024-02-19T06:58:26.314 DEBUG:teuthology.orchestra.run.smithi142:> 2024-02-19T06:58:26.314 DEBUG:teuthology.orchestra.run.smithi142:> def _find_admin_socket(client_name): 2024-02-19T06:58:26.314 DEBUG:teuthology.orchestra.run.smithi142:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-02-19T06:58:26.314 DEBUG:teuthology.orchestra.run.smithi142:> files = glob.glob(asok_path) 2024-02-19T06:58:26.314 DEBUG:teuthology.orchestra.run.smithi142:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-02-19T06:58:26.314 DEBUG:teuthology.orchestra.run.smithi142:> 2024-02-19T06:58:26.314 DEBUG:teuthology.orchestra.run.smithi142:> # Given a non-glob path, it better be there 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> if "*" not in asok_path: 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> assert(len(files) == 1) 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> return files[0] 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> for f in files: 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> contents = proc_f.read() 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> if mountpoint in contents: 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> return f 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> print(_find_admin_socket("client.3")) 2024-02-19T06:58:26.315 DEBUG:teuthology.orchestra.run.smithi142:> ' 2024-02-19T06:58:26.520 INFO:teuthology.orchestra.run.smithi142.stdout:/var/run/ceph/ceph-client.3.73857.asok 2024-02-19T06:58:26.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T06:58:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-19T06:58:26.541 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.73857.asok 2024-02-19T06:58:26.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:26.542 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.73857.asok status 2024-02-19T06:58:26.777 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-02-19T06:58:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": { 2024-02-19T06:58:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_sha1": "25296a8f176256aea5ed8b5850b25167dce0ae33", 2024-02-19T06:58:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 19.0.0-1514-g25296a8f (25296a8f176256aea5ed8b5850b25167dce0ae33) squid (dev)", 2024-02-19T06:58:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "entity_id": "3", 2024-02-19T06:58:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "hostname": "smithi142", 2024-02-19T06:58:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-02-19T06:58:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "pid": "73857", 2024-02-19T06:58:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "root": "/" 2024-02-19T06:58:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-19T06:58:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_count": 0, 2024-02-19T06:58:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_pinned_count": 0, 2024-02-19T06:58:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 4597, 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "inst": { 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "name": { 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "client", 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "num": 4597 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.2:0", 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 3264318426 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.2:0", 2024-02-19T06:58:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 3264318426 2024-02-19T06:58:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-19T06:58:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "inst_str": "client.4597 192.168.0.2:0/3264318426", 2024-02-19T06:58:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "addr_str": "192.168.0.2:0/3264318426", 2024-02-19T06:58:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "inode_count": 1, 2024-02-19T06:58:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_epoch": 8, 2024-02-19T06:58:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch": 22, 2024-02-19T06:58:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch_barrier": 0, 2024-02-19T06:58:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklisted": false, 2024-02-19T06:58:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs" 2024-02-19T06:58:26.780 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-02-19T06:58:26.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:26.792 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2024-02-19T06:58:26.792 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.0 2024-02-19T06:58:26.855 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2024-02-19T06:58:26.856 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-02-19T06:58:26.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:26.856 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-19T06:58:26.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:26.956 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2024-02-19T06:58:26.956 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.2 2024-02-19T06:58:27.012 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2024-02-19T06:58:27.013 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-02-19T06:58:27.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:27.013 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-02-19T06:58:27.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:27.116 DEBUG:teuthology.orchestra.run.smithi142:> stat --file-system '--printf=%T 2024-02-19T06:58:27.116 DEBUG:teuthology.orchestra.run.smithi142:> ' -- /home/ubuntu/cephtest/mnt.1 2024-02-19T06:58:27.173 INFO:teuthology.orchestra.run.smithi142.stdout:fuseblk 2024-02-19T06:58:27.173 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-02-19T06:58:27.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:27.174 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-19T06:58:27.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:27.263 DEBUG:teuthology.orchestra.run.smithi142:> stat --file-system '--printf=%T 2024-02-19T06:58:27.264 DEBUG:teuthology.orchestra.run.smithi142:> ' -- /home/ubuntu/cephtest/mnt.3 2024-02-19T06:58:27.317 INFO:teuthology.orchestra.run.smithi142.stdout:fuseblk 2024-02-19T06:58:27.317 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-02-19T06:58:27.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:27.318 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-02-19T06:58:27.405 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-02-19T06:58:27.422 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:27.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.654+0000 7f9e0be00640 1 Processor -- start 2024-02-19T06:58:27.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.654+0000 7f9e0be00640 1 -- start start 2024-02-19T06:58:27.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.655+0000 7f9e0be00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9e0c15d7f0 0x7f9e0c0d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:27.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.655+0000 7f9e0be00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9e0c162230 0x7f9e0c0cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:27.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.655+0000 7f9e0be00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c0cf770 con 0x7f9e0c15dbd0 2024-02-19T06:58:27.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.655+0000 7f9e0be00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c0d1400 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.655+0000 7f9e0be00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c0d16e0 con 0x7f9e0c162230 2024-02-19T06:58:27.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.655+0000 7f9e0aa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9e0c15d7f0 0x7f9e0c0d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:27.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.655+0000 7f9e0aa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9e0c15d7f0 0x7f9e0c0d21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35218/0 (socket says 172.21.15.46:35218) 2024-02-19T06:58:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.655+0000 7f9e0aa00640 1 -- 172.21.15.46:0/3595379681 learned_addr learned my addr 172.21.15.46:0/3595379681 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.656+0000 7f9e0a000640 1 --2- 172.21.15.46:0/3595379681 >> v2:172.21.15.142:3300/0 conn(0x7f9e0c162230 0x7f9e0c0cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.656+0000 7f9e0aa00640 1 -- 172.21.15.46:0/3595379681 >> v2:172.21.15.142:3300/0 conn(0x7f9e0c162230 msgr2=0x7f9e0c0cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.656+0000 7f9e0aa00640 1 --2- 172.21.15.46:0/3595379681 >> v2:172.21.15.142:3300/0 conn(0x7f9e0c162230 0x7f9e0c0cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.656+0000 7f9e0aa00640 1 -- 172.21.15.46:0/3595379681 >> v1:172.21.15.142:6789/0 conn(0x7f9e0c15dbd0 legacy=0x7f9e0c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.656+0000 7f9e0aa00640 1 -- 172.21.15.46:0/3595379681 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0d19c0 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.657+0000 7f9e0aa00640 1 --2- 172.21.15.46:0/3595379681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e0c15d7f0 0x7f9e0c0d21c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0b6280 tx=0x7f9dfc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6a3eb2beceda4a server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.658+0000 7f9e09600640 1 -- 172.21.15.46:0/3595379681 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc0317e0 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.658+0000 7f9e09600640 1 -- 172.21.15.46:0/3595379681 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc031940 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.658+0000 7f9e09600640 1 -- 172.21.15.46:0/3595379681 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc031cd0 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.658+0000 7f9e0be00640 1 -- 172.21.15.46:0/3595379681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e0c15d7f0 msgr2=0x7f9e0c0d21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.658+0000 7f9e0be00640 1 --2- 172.21.15.46:0/3595379681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e0c15d7f0 0x7f9e0c0d21c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0b6280 tx=0x7f9dfc02b880 comp rx=0 tx=0).stop 2024-02-19T06:58:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.658+0000 7f9e0be00640 1 -- 172.21.15.46:0/3595379681 shutdown_connections 2024-02-19T06:58:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.658+0000 7f9e0be00640 1 --2- 172.21.15.46:0/3595379681 >> v2:172.21.15.142:3300/0 conn(0x7f9e0c162230 0x7f9e0c0cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.658+0000 7f9e0be00640 1 --2- 172.21.15.46:0/3595379681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e0c15d7f0 0x7f9e0c0d21c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.658+0000 7f9e0be00640 1 -- 172.21.15.46:0/3595379681 >> 172.21.15.46:0/3595379681 conn(0x7f9e0c09ca70 msgr2=0x7f9e0c08afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.659+0000 7f9e0be00640 1 -- 172.21.15.46:0/3595379681 shutdown_connections 2024-02-19T06:58:27.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.659+0000 7f9e0be00640 1 -- 172.21.15.46:0/3595379681 wait complete. 2024-02-19T06:58:27.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.660+0000 7f9e0be00640 1 Processor -- start 2024-02-19T06:58:27.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.660+0000 7f9e0be00640 1 -- start start 2024-02-19T06:58:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.661+0000 7f9e0be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e0c15d7f0 0x7f9e0c1518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.661+0000 7f9e0be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e0c15dbd0 0x7f9e0c0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.661+0000 7f9e0be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e0c162230 0x7f9e0c0b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.661+0000 7f9e0be00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0b7090 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.661+0000 7f9e0be00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0b2f00 con 0x7f9e0c162230 2024-02-19T06:58:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.661+0000 7f9e0be00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c151e00 con 0x7f9e0c15dbd0 2024-02-19T06:58:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.662+0000 7f9e0aa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e0c15d7f0 0x7f9e0c1518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.662+0000 7f9e0aa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e0c15d7f0 0x7f9e0c1518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35220/0 (socket says 172.21.15.46:35220) 2024-02-19T06:58:27.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.662+0000 7f9e0aa00640 1 -- 172.21.15.46:0/4265425512 learned_addr learned my addr 172.21.15.46:0/4265425512 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.662+0000 7f9e0a000640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e0c15dbd0 0x7f9e0c0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.662+0000 7f9e0aa00640 1 -- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e0c15dbd0 msgr2=0x7f9e0c0b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.662+0000 7f9e0aa00640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e0c15dbd0 0x7f9e0c0b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.662+0000 7f9e0aa00640 1 -- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e0c162230 msgr2=0x7f9e0c0b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.662+0000 7f9e0b400640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e0c162230 0x7f9e0c0b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.662+0000 7f9e0aa00640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e0c162230 0x7f9e0c0b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.662+0000 7f9e0aa00640 1 -- 172.21.15.46:0/4265425512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc0094d0 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.663+0000 7f9e0aa00640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e0c15d7f0 0x7f9e0c1518c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc02b8c0 tx=0x7f9dfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.663+0000 7f9e02a00640 1 -- 172.21.15.46:0/4265425512 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc032880 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.663+0000 7f9e02a00640 1 -- 172.21.15.46:0/4265425512 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc0329e0 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.663+0000 7f9e02a00640 1 -- 172.21.15.46:0/4265425512 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc032d90 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.663+0000 7f9e0be00640 1 -- 172.21.15.46:0/4265425512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c0d2880 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.663+0000 7f9e0be00640 1 -- 172.21.15.46:0/4265425512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c0b6760 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.665+0000 7f9e0be00640 1 -- 172.21.15.46:0/4265425512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c04eee0 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.665+0000 7f9e02a00640 1 -- 172.21.15.46:0/4265425512 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9dfc04e450 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.666+0000 7f9e02a00640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9dec06b890 0x7f9dec06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:27.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.667+0000 7f9e02a00640 1 -- 172.21.15.46:0/4265425512 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9dfc0ac270 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.667+0000 7f9e0a000640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9dec06b890 0x7f9dec06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:27.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.668+0000 7f9e0a000640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9dec06b890 0x7f9dec06dd50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9df8006fd0 tx=0x7f9df8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:27.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.671+0000 7f9e02a00640 1 -- 172.21.15.46:0/4265425512 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9dfc076e20 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.878+0000 7f9e0be00640 1 -- 172.21.15.46:0/4265425512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e0c0b3310 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.880+0000 7f9e02a00640 1 -- 172.21.15.46:0/4265425512 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f9dfc07a4e0 con 0x7f9e0c15d7f0 2024-02-19T06:58:27.882 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:27.882 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:56.828629+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:27.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.883+0000 7f9e0be00640 1 -- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9dec06b890 msgr2=0x7f9dec06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:27.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.883+0000 7f9e0be00640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9dec06b890 0x7f9dec06dd50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9df8006fd0 tx=0x7f9df8008040 comp rx=0 tx=0).stop 2024-02-19T06:58:27.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.883+0000 7f9e0be00640 1 -- 172.21.15.46:0/4265425512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e0c15d7f0 msgr2=0x7f9e0c1518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:27.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.883+0000 7f9e0be00640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e0c15d7f0 0x7f9e0c1518c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc02b8c0 tx=0x7f9dfc0046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:27.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.884+0000 7f9e0be00640 1 -- 172.21.15.46:0/4265425512 shutdown_connections 2024-02-19T06:58:27.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.884+0000 7f9e0be00640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9dec06b890 0x7f9dec06dd50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:27.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.884+0000 7f9e0be00640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e0c162230 0x7f9e0c0b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:27.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.884+0000 7f9e0be00640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e0c15dbd0 0x7f9e0c0b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:27.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.884+0000 7f9e0be00640 1 --2- 172.21.15.46:0/4265425512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e0c15d7f0 0x7f9e0c1518c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:27.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.884+0000 7f9e0be00640 1 -- 172.21.15.46:0/4265425512 >> 172.21.15.46:0/4265425512 conn(0x7f9e0c09ca70 msgr2=0x7f9e0c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:27.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.884+0000 7f9e0be00640 1 -- 172.21.15.46:0/4265425512 shutdown_connections 2024-02-19T06:58:27.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:27.884+0000 7f9e0be00640 1 -- 172.21.15.46:0/4265425512 wait complete. 2024-02-19T06:58:27.905 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:27.906 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.131+0000 7fd8ce800640 1 Processor -- start 2024-02-19T06:58:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.131+0000 7fd8ce800640 1 -- start start 2024-02-19T06:58:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.133+0000 7fd8ce800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8145050 0x7fd8c80cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.133+0000 7fd8ce800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8c80ccce0 0x7fd8c80cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.133+0000 7fd8ce800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c8071e80 con 0x7fd8c80cf910 2024-02-19T06:58:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.133+0000 7fd8ce800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c80cfda0 con 0x7fd8c80ccce0 2024-02-19T06:58:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.133+0000 7fd8ce800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c8071020 con 0x7fd8c8145050 2024-02-19T06:58:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.134+0000 7fd8c7e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd8c80cf910 0x7fd8c815f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49114/0 (socket says 172.21.15.46:49114) 2024-02-19T06:58:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.134+0000 7fd8c7e00640 1 -- 172.21.15.46:0/395503645 learned_addr learned my addr 172.21.15.46:0/395503645 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.134+0000 7fd8c7400640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8145050 0x7fd8c80cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.134+0000 7fd8c6a00640 1 --2- 172.21.15.46:0/395503645 >> v2:172.21.15.142:3300/0 conn(0x7fd8c80ccce0 0x7fd8c80cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.134+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715358821 0 0) 0x7fd8c8071e80 con 0x7fd8c80cf910 2024-02-19T06:58:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.134+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8ac003520 con 0x7fd8c80cf910 2024-02-19T06:58:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.134+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2362508351 0 0) 0x7fd8ac003520 con 0x7fd8c80cf910 2024-02-19T06:58:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.134+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8145050 msgr2=0x7fd8c80cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.134+0000 7fd8c6000640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8145050 0x7fd8c80cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.134+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 >> v2:172.21.15.142:3300/0 conn(0x7fd8c80ccce0 msgr2=0x7fd8c80cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.134+0000 7fd8c6000640 1 --2- 172.21.15.46:0/395503645 >> v2:172.21.15.142:3300/0 conn(0x7fd8c80ccce0 0x7fd8c80cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.135+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c80aef70 con 0x7fd8c80cf910 2024-02-19T06:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.135+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fd8c0001a10 con 0x7fd8c80cf910 2024-02-19T06:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.135+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 >> v1:172.21.15.46:6789/0 conn(0x7fd8c80cf910 legacy=0x7fd8c815f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.135+0000 7fd8c6000640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8145050 0x7fd8ac003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.135+0000 7fd8c6000640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8ac003f40 0x7fd8ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.135+0000 7fd8c6000640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8ac004d00 0x7fd8ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.135+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80cfda0 con 0x7fd8ac004d00 2024-02-19T06:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.135+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c8071020 con 0x7fd8ac003f40 2024-02-19T06:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.135+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac00b980 con 0x7fd8c8145050 2024-02-19T06:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.135+0000 7fd8c7e00640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8ac004d00 0x7fd8ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.135+0000 7fd8c6a00640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8ac003f40 0x7fd8ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.135+0000 7fd8c7400640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8145050 0x7fd8ac003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.136+0000 7fd8c7e00640 1 -- 172.21.15.46:0/395503645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8145050 msgr2=0x7fd8ac003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.136+0000 7fd8c7e00640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8145050 0x7fd8ac003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.136+0000 7fd8c7e00640 1 -- 172.21.15.46:0/395503645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8ac003f40 msgr2=0x7fd8ac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.136+0000 7fd8c7e00640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8ac003f40 0x7fd8ac0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.136+0000 7fd8c7e00640 1 -- 172.21.15.46:0/395503645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac003520 con 0x7fd8ac004d00 2024-02-19T06:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.136+0000 7fd8c7400640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8145050 0x7fd8ac003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.136+0000 7fd8c6a00640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8ac003f40 0x7fd8ac0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.137+0000 7fd8c7e00640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8ac004d00 0x7fd8ac005180 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000a7b0 tx=0x7fd8ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6d57c8df89fb36 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.137+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0034630 con 0x7fd8ac004d00 2024-02-19T06:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.137+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c002f070 con 0x7fd8ac004d00 2024-02-19T06:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.137+0000 7fd8c6000640 1 -- 172.21.15.46:0/395503645 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00349d0 con 0x7fd8ac004d00 2024-02-19T06:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.138+0000 7fd8ce800640 1 -- 172.21.15.46:0/395503645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8ac004d00 msgr2=0x7fd8ac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.138+0000 7fd8ce800640 1 --2- 172.21.15.46:0/395503645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8ac004d00 0x7fd8ac005180 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000a7b0 tx=0x7fd8ac0057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.138+0000 7fd8c7e00640 1 -- 172.21.15.46:0/395503645 reap_dead start 2024-02-19T06:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.138+0000 7fd8ce800640 1 -- 172.21.15.46:0/395503645 shutdown_connections 2024-02-19T06:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.138+0000 7fd8ce800640 1 -- 172.21.15.46:0/395503645 >> 172.21.15.46:0/395503645 conn(0x7fd8c8066fc0 msgr2=0x7fd8c806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.138+0000 7fd8ce800640 1 -- 172.21.15.46:0/395503645 shutdown_connections 2024-02-19T06:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.138+0000 7fd8ce800640 1 -- 172.21.15.46:0/395503645 wait complete. 2024-02-19T06:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.140+0000 7fd8ce800640 1 Processor -- start 2024-02-19T06:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.140+0000 7fd8ce800640 1 -- start start 2024-02-19T06:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.141+0000 7fd8ce800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8152b70 0x7fd8c80ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.141+0000 7fd8ce800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c80adfd0 0x7fd8c8152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.141+0000 7fd8ce800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8c815d6c0 0x7fd8c815db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.141+0000 7fd8ce800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80adbb0 con 0x7fd8c815d6c0 2024-02-19T06:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.141+0000 7fd8ce800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c8153490 con 0x7fd8c80adfd0 2024-02-19T06:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.141+0000 7fd8ce800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c815e090 con 0x7fd8c8152b70 2024-02-19T06:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.141+0000 7fd8c7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8c815d6c0 0x7fd8c815db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.141+0000 7fd8c7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8c815d6c0 0x7fd8c815db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35248/0 (socket says 172.21.15.46:35248) 2024-02-19T06:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.141+0000 7fd8c7e00640 1 -- 172.21.15.46:0/663759594 learned_addr learned my addr 172.21.15.46:0/663759594 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.141+0000 7fd8c6a00640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c80adfd0 0x7fd8c8152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.141+0000 7fd8c7400640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8152b70 0x7fd8c80ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.142+0000 7fd8c7e00640 1 -- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8152b70 msgr2=0x7fd8c80ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.142+0000 7fd8c7e00640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8152b70 0x7fd8c80ac8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.142+0000 7fd8c7e00640 1 -- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c80adfd0 msgr2=0x7fd8c8152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.142+0000 7fd8c7e00640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c80adfd0 0x7fd8c8152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.142+0000 7fd8c7e00640 1 -- 172.21.15.46:0/663759594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c80acf30 con 0x7fd8c815d6c0 2024-02-19T06:58:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.142+0000 7fd8c7e00640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8c815d6c0 0x7fd8c815db50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000a8d0 tx=0x7fd8c0001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.142+0000 7fd8bf400640 1 -- 172.21.15.46:0/663759594 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0034840 con 0x7fd8c815d6c0 2024-02-19T06:58:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.142+0000 7fd8bf400640 1 -- 172.21.15.46:0/663759594 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c00349a0 con 0x7fd8c815d6c0 2024-02-19T06:58:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.142+0000 7fd8bf400640 1 -- 172.21.15.46:0/663759594 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0034d50 con 0x7fd8c815d6c0 2024-02-19T06:58:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.142+0000 7fd8ce800640 1 -- 172.21.15.46:0/663759594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c80ad210 con 0x7fd8c815d6c0 2024-02-19T06:58:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.143+0000 7fd8ce800640 1 -- 172.21.15.46:0/663759594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c80ad7d0 con 0x7fd8c815d6c0 2024-02-19T06:58:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.144+0000 7fd8ce800640 1 -- 172.21.15.46:0/663759594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c80adcf0 con 0x7fd8c815d6c0 2024-02-19T06:58:28.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.144+0000 7fd8bf400640 1 -- 172.21.15.46:0/663759594 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd8c0031030 con 0x7fd8c815d6c0 2024-02-19T06:58:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.145+0000 7fd8bf400640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd8a806b810 0x7fd8a806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.146+0000 7fd8bf400640 1 -- 172.21.15.46:0/663759594 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8c00ac5d0 con 0x7fd8c815d6c0 2024-02-19T06:58:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.146+0000 7fd8c7400640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd8a806b810 0x7fd8a806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.147+0000 7fd8c7400640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd8a806b810 0x7fd8a806dcd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd8c813ca10 tx=0x7fd8b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:28.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.150+0000 7fd8bf400640 1 -- 172.21.15.46:0/663759594 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd8c80adcf0 con 0x7fd8c815d6c0 2024-02-19T06:58:28.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.347+0000 7fd8ce800640 1 -- 172.21.15.46:0/663759594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8c80adcf0 con 0x7fd8c815d6c0 2024-02-19T06:58:28.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.348+0000 7fd8bf400640 1 -- 172.21.15.46:0/663759594 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8c80adcf0 con 0x7fd8c815d6c0 2024-02-19T06:58:28.350 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:28.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.351+0000 7fd8ce800640 1 -- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd8a806b810 msgr2=0x7fd8a806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:28.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.351+0000 7fd8ce800640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd8a806b810 0x7fd8a806dcd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd8c813ca10 tx=0x7fd8b8008040 comp rx=0 tx=0).stop 2024-02-19T06:58:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.351+0000 7fd8ce800640 1 -- 172.21.15.46:0/663759594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8c815d6c0 msgr2=0x7fd8c815db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.351+0000 7fd8ce800640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8c815d6c0 0x7fd8c815db50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000a8d0 tx=0x7fd8c0001cd0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.351+0000 7fd8ce800640 1 -- 172.21.15.46:0/663759594 shutdown_connections 2024-02-19T06:58:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.351+0000 7fd8ce800640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd8a806b810 0x7fd8a806dcd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.351+0000 7fd8ce800640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8c815d6c0 0x7fd8c815db50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.351+0000 7fd8ce800640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c80adfd0 0x7fd8c8152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.351+0000 7fd8ce800640 1 --2- 172.21.15.46:0/663759594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8152b70 0x7fd8c80ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.351+0000 7fd8ce800640 1 -- 172.21.15.46:0/663759594 >> 172.21.15.46:0/663759594 conn(0x7fd8c8066fc0 msgr2=0x7fd8c80b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.351+0000 7fd8ce800640 1 -- 172.21.15.46:0/663759594 shutdown_connections 2024-02-19T06:58:28.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.351+0000 7fd8ce800640 1 -- 172.21.15.46:0/663759594 wait complete. 2024-02-19T06:58:28.372 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:28.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.595+0000 7f2975200640 1 Processor -- start 2024-02-19T06:58:28.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.595+0000 7f2975200640 1 -- start start 2024-02-19T06:58:28.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.596+0000 7f2975200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29700d0240 0x7f297009aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.596+0000 7f2975200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29700b3b50 0x7f29700b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.596+0000 7f2975200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297006cea0 con 0x7f297015ddc0 2024-02-19T06:58:28.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.596+0000 7f2975200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29700b0c40 con 0x7f29700b3b50 2024-02-19T06:58:28.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.596+0000 7f2975200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297006d990 con 0x7f29700d0240 2024-02-19T06:58:28.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.597+0000 7f296f400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f297015ddc0 0x7f29700cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49116/0 (socket says 172.21.15.46:49116) 2024-02-19T06:58:28.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.597+0000 7f296f400640 1 -- 172.21.15.46:0/1483952812 learned_addr learned my addr 172.21.15.46:0/1483952812 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:28.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.597+0000 7f296fe00640 1 --2- 172.21.15.46:0/1483952812 >> v2:172.21.15.46:3300/0 conn(0x7f29700b3b50 0x7f29700b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.597+0000 7f296fe00640 1 -- 172.21.15.46:0/1483952812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29700d0240 msgr2=0x7f297009aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:28.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.597+0000 7f296fe00640 1 --2- 172.21.15.46:0/1483952812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29700d0240 0x7f297009aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.597+0000 7f296fe00640 1 -- 172.21.15.46:0/1483952812 >> v1:172.21.15.46:6789/0 conn(0x7f297015ddc0 legacy=0x7f29700cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:28.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.597+0000 7f296fe00640 1 -- 172.21.15.46:0/1483952812 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297006d0f0 con 0x7f29700b3b50 2024-02-19T06:58:28.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.598+0000 7f296fe00640 1 --2- 172.21.15.46:0/1483952812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29700b3b50 0x7f29700b10d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2968009d90 tx=0x7f296802bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827437412de08d25 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:28.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.599+0000 7f296e000640 1 -- 172.21.15.46:0/1483952812 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296802cb40 con 0x7f29700b3b50 2024-02-19T06:58:28.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.599+0000 7f296e000640 1 -- 172.21.15.46:0/1483952812 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296802cca0 con 0x7f29700b3b50 2024-02-19T06:58:28.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.599+0000 7f296e000640 1 -- 172.21.15.46:0/1483952812 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968034660 con 0x7f29700b3b50 2024-02-19T06:58:28.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.599+0000 7f2975200640 1 -- 172.21.15.46:0/1483952812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29700b3b50 msgr2=0x7f29700b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:28.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.599+0000 7f2975200640 1 --2- 172.21.15.46:0/1483952812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29700b3b50 0x7f29700b10d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2968009d90 tx=0x7f296802bd90 comp rx=0 tx=0).stop 2024-02-19T06:58:28.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.600+0000 7f2975200640 1 -- 172.21.15.46:0/1483952812 shutdown_connections 2024-02-19T06:58:28.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.600+0000 7f2975200640 1 --2- 172.21.15.46:0/1483952812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29700b3b50 0x7f29700b10d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.600+0000 7f2975200640 1 --2- 172.21.15.46:0/1483952812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29700d0240 0x7f297009aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.600+0000 7f2975200640 1 -- 172.21.15.46:0/1483952812 >> 172.21.15.46:0/1483952812 conn(0x7f29700b3030 msgr2=0x7f29700b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:28.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.600+0000 7f2975200640 1 -- 172.21.15.46:0/1483952812 shutdown_connections 2024-02-19T06:58:28.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.600+0000 7f2975200640 1 -- 172.21.15.46:0/1483952812 wait complete. 2024-02-19T06:58:28.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.601+0000 7f2975200640 1 Processor -- start 2024-02-19T06:58:28.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.602+0000 7f2975200640 1 -- start start 2024-02-19T06:58:28.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.602+0000 7f2975200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29700b3b50 0x7f2970150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.602+0000 7f2975200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29700d0240 0x7f29700c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.602+0000 7f2975200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f297015ddc0 0x7f29700ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f2975200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700c6290 con 0x7f297015ddc0 2024-02-19T06:58:28.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f2975200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700c6e10 con 0x7f29700b3b50 2024-02-19T06:58:28.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f2975200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2970151110 con 0x7f29700d0240 2024-02-19T06:58:28.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f296fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f297015ddc0 0x7f29700ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f296fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f297015ddc0 0x7f29700ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35264/0 (socket says 172.21.15.46:35264) 2024-02-19T06:58:28.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f296fe00640 1 -- 172.21.15.46:0/2410067065 learned_addr learned my addr 172.21.15.46:0/2410067065 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:28.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f296ea00640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29700d0240 0x7f29700c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f296fe00640 1 -- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29700d0240 msgr2=0x7f29700c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:28.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f296f400640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29700b3b50 0x7f2970150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f296fe00640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29700d0240 0x7f29700c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f296fe00640 1 -- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29700b3b50 msgr2=0x7f2970150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:28.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f296fe00640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29700b3b50 0x7f2970150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f296fe00640 1 -- 172.21.15.46:0/2410067065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2968009a70 con 0x7f297015ddc0 2024-02-19T06:58:28.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f296ea00640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29700d0240 0x7f29700c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:28.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.603+0000 7f296f400640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29700b3b50 0x7f2970150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:28.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.604+0000 7f296fe00640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f297015ddc0 0x7f29700ccbc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2968009d90 tx=0x7f2968004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:28.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.604+0000 7f2967400640 1 -- 172.21.15.46:0/2410067065 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296803e610 con 0x7f297015ddc0 2024-02-19T06:58:28.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.604+0000 7f2967400640 1 -- 172.21.15.46:0/2410067065 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296803e770 con 0x7f297015ddc0 2024-02-19T06:58:28.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.604+0000 7f2967400640 1 -- 172.21.15.46:0/2410067065 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296803eb20 con 0x7f297015ddc0 2024-02-19T06:58:28.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.604+0000 7f2975200640 1 -- 172.21.15.46:0/2410067065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29700c6470 con 0x7f297015ddc0 2024-02-19T06:58:28.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.604+0000 7f2975200640 1 -- 172.21.15.46:0/2410067065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29700c6a30 con 0x7f297015ddc0 2024-02-19T06:58:28.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.606+0000 7f2975200640 1 -- 172.21.15.46:0/2410067065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29700c6f50 con 0x7f297015ddc0 2024-02-19T06:58:28.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.606+0000 7f2967400640 1 -- 172.21.15.46:0/2410067065 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f296803b050 con 0x7f297015ddc0 2024-02-19T06:58:28.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.607+0000 7f2967400640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f294c06b890 0x7f294c06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:28.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.608+0000 7f2967400640 1 -- 172.21.15.46:0/2410067065 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29680ac910 con 0x7f297015ddc0 2024-02-19T06:58:28.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.608+0000 7f296f400640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f294c06b890 0x7f294c06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:28.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.609+0000 7f296f400640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f294c06b890 0x7f294c06dd50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2970154a70 tx=0x7f2960009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:28.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.612+0000 7f2967400640 1 -- 172.21.15.46:0/2410067065 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f29700c6f50 con 0x7f297015ddc0 2024-02-19T06:58:28.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.810+0000 7f2975200640 1 -- 172.21.15.46:0/2410067065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29700c6f50 con 0x7f297015ddc0 2024-02-19T06:58:28.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.811+0000 7f2967400640 1 -- 172.21.15.46:0/2410067065 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2968039020 con 0x7f297015ddc0 2024-02-19T06:58:28.813 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.814+0000 7f2975200640 1 -- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f294c06b890 msgr2=0x7f294c06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.814+0000 7f2975200640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f294c06b890 0x7f294c06dd50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2970154a70 tx=0x7f2960009040 comp rx=0 tx=0).stop 2024-02-19T06:58:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.814+0000 7f2975200640 1 -- 172.21.15.46:0/2410067065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f297015ddc0 msgr2=0x7f29700ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.814+0000 7f2975200640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f297015ddc0 0x7f29700ccbc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2968009d90 tx=0x7f2968004a40 comp rx=0 tx=0).stop 2024-02-19T06:58:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.814+0000 7f2975200640 1 -- 172.21.15.46:0/2410067065 shutdown_connections 2024-02-19T06:58:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.814+0000 7f2975200640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f294c06b890 0x7f294c06dd50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.814+0000 7f2975200640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f297015ddc0 0x7f29700ccbc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.814+0000 7f2975200640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29700d0240 0x7f29700c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.814+0000 7f2975200640 1 --2- 172.21.15.46:0/2410067065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29700b3b50 0x7f2970150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.814+0000 7f2975200640 1 -- 172.21.15.46:0/2410067065 >> 172.21.15.46:0/2410067065 conn(0x7f29700b3030 msgr2=0x7f297006ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:28.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.814+0000 7f2975200640 1 -- 172.21.15.46:0/2410067065 shutdown_connections 2024-02-19T06:58:28.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:28.814+0000 7f2975200640 1 -- 172.21.15.46:0/2410067065 wait complete. 2024-02-19T06:58:28.836 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:29.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.067+0000 7f282da00640 1 Processor -- start 2024-02-19T06:58:29.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.067+0000 7f282da00640 1 -- start start 2024-02-19T06:58:29.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.068+0000 7f282da00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28280d0b30 0x7f28280cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:29.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.068+0000 7f282da00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28280ceed0 con 0x7f28280d2330 2024-02-19T06:58:29.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.068+0000 7f282da00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28280ce5e0 con 0x7f2828160f50 2024-02-19T06:58:29.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.068+0000 7f282da00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2828161330 con 0x7f28280d0b30 2024-02-19T06:58:29.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.069+0000 7f281fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28280d0b30 0x7f28280cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:29.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.069+0000 7f281fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28280d0b30 0x7f28280cf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35278/0 (socket says 172.21.15.46:35278) 2024-02-19T06:58:29.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.069+0000 7f281fe00640 1 -- 172.21.15.46:0/2829661491 learned_addr learned my addr 172.21.15.46:0/2829661491 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:29.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.069+0000 7f281fe00640 1 -- 172.21.15.46:0/2829661491 >> v1:172.21.15.142:6789/0 conn(0x7f2828160f50 legacy=0x7f28280d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:29.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.069+0000 7f281fe00640 1 -- 172.21.15.46:0/2829661491 >> v1:172.21.15.46:6789/0 conn(0x7f28280d2330 legacy=0x7f28280b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:29.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.069+0000 7f281fe00640 1 -- 172.21.15.46:0/2829661491 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28280ce880 con 0x7f28280d0b30 2024-02-19T06:58:29.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.070+0000 7f281fe00640 1 --2- 172.21.15.46:0/2829661491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28280d0b30 0x7f28280cf360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2810009870 tx=0x7f281002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a54c1cd9bdede2 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:29.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.071+0000 7f2826000640 1 -- 172.21.15.46:0/2829661491 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810030850 con 0x7f28280d0b30 2024-02-19T06:58:29.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.071+0000 7f2826000640 1 -- 172.21.15.46:0/2829661491 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28100309b0 con 0x7f28280d0b30 2024-02-19T06:58:29.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.071+0000 7f2826000640 1 -- 172.21.15.46:0/2829661491 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810030d40 con 0x7f28280d0b30 2024-02-19T06:58:29.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.072+0000 7f282da00640 1 -- 172.21.15.46:0/2829661491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28280d0b30 msgr2=0x7f28280cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:29.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.072+0000 7f282da00640 1 --2- 172.21.15.46:0/2829661491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28280d0b30 0x7f28280cf360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2810009870 tx=0x7f281002b990 comp rx=0 tx=0).stop 2024-02-19T06:58:29.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.072+0000 7f282da00640 1 -- 172.21.15.46:0/2829661491 shutdown_connections 2024-02-19T06:58:29.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.072+0000 7f282da00640 1 --2- 172.21.15.46:0/2829661491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28280d0b30 0x7f28280cf360 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.072+0000 7f282da00640 1 -- 172.21.15.46:0/2829661491 >> 172.21.15.46:0/2829661491 conn(0x7f282808afc0 msgr2=0x7f28280d38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:29.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.072+0000 7f282da00640 1 -- 172.21.15.46:0/2829661491 shutdown_connections 2024-02-19T06:58:29.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.072+0000 7f282da00640 1 -- 172.21.15.46:0/2829661491 wait complete. 2024-02-19T06:58:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.073+0000 7f282da00640 1 Processor -- start 2024-02-19T06:58:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.074+0000 7f282da00640 1 -- start start 2024-02-19T06:58:29.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.074+0000 7f282da00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28280d0b30 0x7f28280cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:29.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f282da00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28280d2330 0x7f28280ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:29.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f282da00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2828160f50 0x7f28280cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f282da00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28280cbb80 con 0x7f28280d0b30 2024-02-19T06:58:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f282da00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28280ca350 con 0x7f28280d2330 2024-02-19T06:58:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f282da00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28280cbe40 con 0x7f2828160f50 2024-02-19T06:58:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f2826a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28280d0b30 0x7f28280cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f2826a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28280d0b30 0x7f28280cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35290/0 (socket says 172.21.15.46:35290) 2024-02-19T06:58:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f2826a00640 1 -- 172.21.15.46:0/1751260616 learned_addr learned my addr 172.21.15.46:0/1751260616 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f2826a00640 1 -- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2828160f50 msgr2=0x7f28280cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f281fe00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28280d2330 0x7f28280ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f2826a00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2828160f50 0x7f28280cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f2826a00640 1 -- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28280d2330 msgr2=0x7f28280ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f2826a00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28280d2330 0x7f28280ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f2826a00640 1 -- 172.21.15.46:0/1751260616 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28100094d0 con 0x7f28280d0b30 2024-02-19T06:58:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.075+0000 7f281fe00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28280d2330 0x7f28280ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:29.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.076+0000 7f2826a00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28280d0b30 0x7f28280cc640 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f281800b3f0 tx=0x7f281800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:29.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.076+0000 7f281ea00640 1 -- 172.21.15.46:0/1751260616 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818011830 con 0x7f28280d0b30 2024-02-19T06:58:29.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.076+0000 7f281ea00640 1 -- 172.21.15.46:0/1751260616 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2818011990 con 0x7f28280d0b30 2024-02-19T06:58:29.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.076+0000 7f282da00640 1 -- 172.21.15.46:0/1751260616 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28280cc120 con 0x7f28280d0b30 2024-02-19T06:58:29.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.076+0000 7f281ea00640 1 -- 172.21.15.46:0/1751260616 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818011d40 con 0x7f28280d0b30 2024-02-19T06:58:29.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.076+0000 7f282da00640 1 -- 172.21.15.46:0/1751260616 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282814dbd0 con 0x7f28280d0b30 2024-02-19T06:58:29.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.077+0000 7f282da00640 1 -- 172.21.15.46:0/1751260616 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28280cc360 con 0x7f28280d0b30 2024-02-19T06:58:29.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.078+0000 7f281ea00640 1 -- 172.21.15.46:0/1751260616 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f281801a400 con 0x7f28280d0b30 2024-02-19T06:58:29.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.080+0000 7f281ea00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f280406b810 0x7f280406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:29.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.080+0000 7f281ea00640 1 -- 172.21.15.46:0/1751260616 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f281808a000 con 0x7f28280d0b30 2024-02-19T06:58:29.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.080+0000 7f281fe00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f280406b810 0x7f280406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:29.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.082+0000 7f281fe00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f280406b810 0x7f280406dcd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2810036000 tx=0x7f281003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:29.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.085+0000 7f281ea00640 1 -- 172.21.15.46:0/1751260616 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f28280cc360 con 0x7f28280d0b30 2024-02-19T06:58:29.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.283+0000 7f282da00640 1 -- 172.21.15.46:0/1751260616 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f282814de20 con 0x7f28280d0b30 2024-02-19T06:58:29.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.284+0000 7f281ea00640 1 -- 172.21.15.46:0/1751260616 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2818054a20 con 0x7f28280d0b30 2024-02-19T06:58:29.286 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:29.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.286+0000 7f282da00640 1 -- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f280406b810 msgr2=0x7f280406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:29.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.286+0000 7f282da00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f280406b810 0x7f280406dcd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2810036000 tx=0x7f281003b040 comp rx=0 tx=0).stop 2024-02-19T06:58:29.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.286+0000 7f282da00640 1 -- 172.21.15.46:0/1751260616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28280d0b30 msgr2=0x7f28280cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:29.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.286+0000 7f282da00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28280d0b30 0x7f28280cc640 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f281800b3f0 tx=0x7f281800b8b0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.287+0000 7f282da00640 1 -- 172.21.15.46:0/1751260616 shutdown_connections 2024-02-19T06:58:29.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.287+0000 7f282da00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f280406b810 0x7f280406dcd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.287+0000 7f282da00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2828160f50 0x7f28280cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.287+0000 7f282da00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28280d2330 0x7f28280ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.287+0000 7f282da00640 1 --2- 172.21.15.46:0/1751260616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28280d0b30 0x7f28280cc640 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.287+0000 7f282da00640 1 -- 172.21.15.46:0/1751260616 >> 172.21.15.46:0/1751260616 conn(0x7f282808afc0 msgr2=0x7f28280d1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:29.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.287+0000 7f282da00640 1 -- 172.21.15.46:0/1751260616 shutdown_connections 2024-02-19T06:58:29.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.287+0000 7f282da00640 1 -- 172.21.15.46:0/1751260616 wait complete. 2024-02-19T06:58:29.309 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:29.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.531+0000 7f97ed800640 1 Processor -- start 2024-02-19T06:58:29.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.531+0000 7f97ed800640 1 -- start start 2024-02-19T06:58:29.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.532+0000 7f97ed800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f97e80d22f0 0x7f97e81620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:29.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.532+0000 7f97ed800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e80ce250 0x7f97e80ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:29.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.532+0000 7f97ed800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e80d1710 con 0x7f97e80d0640 2024-02-19T06:58:29.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.532+0000 7f97ed800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e80d0a20 con 0x7f97e80d22f0 2024-02-19T06:58:29.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.532+0000 7f97ed800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e815eec0 con 0x7f97e80ce250 2024-02-19T06:58:29.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.533+0000 7f97e7400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f97e80d22f0 0x7f97e81620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:29.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.533+0000 7f97e7400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f97e80d22f0 0x7f97e81620c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35300/0 (socket says 172.21.15.46:35300) 2024-02-19T06:58:29.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.533+0000 7f97e7400640 1 -- 172.21.15.46:0/3600313959 learned_addr learned my addr 172.21.15.46:0/3600313959 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:29.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.533+0000 7f97ece00640 1 --2- 172.21.15.46:0/3600313959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e80ce250 0x7f97e80ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:29.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.533+0000 7f97e7400640 1 -- 172.21.15.46:0/3600313959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e80ce250 msgr2=0x7f97e80ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:29.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.533+0000 7f97e7400640 1 --2- 172.21.15.46:0/3600313959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e80ce250 0x7f97e80ce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.533+0000 7f97e7400640 1 -- 172.21.15.46:0/3600313959 >> v1:172.21.15.142:6789/0 conn(0x7f97e80d0640 legacy=0x7f97e80d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:29.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.533+0000 7f97e7400640 1 -- 172.21.15.46:0/3600313959 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e815ebe0 con 0x7f97e80d22f0 2024-02-19T06:58:29.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.534+0000 7f97e7400640 1 --2- 172.21.15.46:0/3600313959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e80d22f0 0x7f97e81620c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009ea0 tx=0x7f97d002bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e052163e591fe027 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:29.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.535+0000 7f97e6a00640 1 -- 172.21.15.46:0/3600313959 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d002cab0 con 0x7f97e80d22f0 2024-02-19T06:58:29.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.535+0000 7f97e6a00640 1 -- 172.21.15.46:0/3600313959 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d002cc10 con 0x7f97e80d22f0 2024-02-19T06:58:29.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.535+0000 7f97e6a00640 1 -- 172.21.15.46:0/3600313959 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d00343f0 con 0x7f97e80d22f0 2024-02-19T06:58:29.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.535+0000 7f97ed800640 1 -- 172.21.15.46:0/3600313959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e80d22f0 msgr2=0x7f97e81620c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:29.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.535+0000 7f97ed800640 1 --2- 172.21.15.46:0/3600313959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e80d22f0 0x7f97e81620c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009ea0 tx=0x7f97d002bf10 comp rx=0 tx=0).stop 2024-02-19T06:58:29.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.535+0000 7f97ed800640 1 -- 172.21.15.46:0/3600313959 shutdown_connections 2024-02-19T06:58:29.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.535+0000 7f97ed800640 1 --2- 172.21.15.46:0/3600313959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e80ce250 0x7f97e80ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.535+0000 7f97ed800640 1 --2- 172.21.15.46:0/3600313959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e80d22f0 0x7f97e81620c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.535+0000 7f97ed800640 1 -- 172.21.15.46:0/3600313959 >> 172.21.15.46:0/3600313959 conn(0x7f97e809ca80 msgr2=0x7f97e808afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:29.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.536+0000 7f97ed800640 1 -- 172.21.15.46:0/3600313959 shutdown_connections 2024-02-19T06:58:29.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.536+0000 7f97ed800640 1 -- 172.21.15.46:0/3600313959 wait complete. 2024-02-19T06:58:29.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.537+0000 7f97ed800640 1 Processor -- start 2024-02-19T06:58:29.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.538+0000 7f97ed800640 1 -- start start 2024-02-19T06:58:29.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97ed800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e80ce250 0x7f97e81574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:29.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97ed800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e80d0640 0x7f97e815b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:29.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97ed800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e80d22f0 0x7f97e806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:29.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97ed800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80ca800 con 0x7f97e80ce250 2024-02-19T06:58:29.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97ed800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80caae0 con 0x7f97e80d22f0 2024-02-19T06:58:29.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97ed800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80cadc0 con 0x7f97e80d0640 2024-02-19T06:58:29.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97e7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e80ce250 0x7f97e81574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:29.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97e7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e80ce250 0x7f97e81574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35306/0 (socket says 172.21.15.46:35306) 2024-02-19T06:58:29.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97e7e00640 1 -- 172.21.15.46:0/3611664007 learned_addr learned my addr 172.21.15.46:0/3611664007 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:29.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97e7e00640 1 -- 172.21.15.46:0/3611664007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e80d0640 msgr2=0x7f97e815b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:29.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97e7e00640 1 --2- 172.21.15.46:0/3611664007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e80d0640 0x7f97e815b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97e7e00640 1 -- 172.21.15.46:0/3611664007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e80d22f0 msgr2=0x7f97e806d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:29.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97e7e00640 1 --2- 172.21.15.46:0/3611664007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e80d22f0 0x7f97e806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.539+0000 7f97e7e00640 1 -- 172.21.15.46:0/3611664007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d0009b30 con 0x7f97e80ce250 2024-02-19T06:58:29.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.540+0000 7f97e7e00640 1 --2- 172.21.15.46:0/3611664007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e80ce250 0x7f97e81574f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f97d800c430 tx=0x7f97d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:29.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.540+0000 7f97dfe00640 1 -- 172.21.15.46:0/3611664007 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8011790 con 0x7f97e80ce250 2024-02-19T06:58:29.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.540+0000 7f97dfe00640 1 -- 172.21.15.46:0/3611664007 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d80118f0 con 0x7f97e80ce250 2024-02-19T06:58:29.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.540+0000 7f97ed800640 1 -- 172.21.15.46:0/3611664007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e80cb0a0 con 0x7f97e80ce250 2024-02-19T06:58:29.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.540+0000 7f97dfe00640 1 -- 172.21.15.46:0/3611664007 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8011ce0 con 0x7f97e80ce250 2024-02-19T06:58:29.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.540+0000 7f97ed800640 1 -- 172.21.15.46:0/3611664007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e815ba20 con 0x7f97e80ce250 2024-02-19T06:58:29.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.541+0000 7f97ed800640 1 -- 172.21.15.46:0/3611664007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e808b6d0 con 0x7f97e80ce250 2024-02-19T06:58:29.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.542+0000 7f97dfe00640 1 -- 172.21.15.46:0/3611664007 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f97d801c460 con 0x7f97e80ce250 2024-02-19T06:58:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.543+0000 7f97dfe00640 1 --2- 172.21.15.46:0/3611664007 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f97c406b810 0x7f97c406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.543+0000 7f97dfe00640 1 -- 172.21.15.46:0/3611664007 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97d808a1d0 con 0x7f97e80ce250 2024-02-19T06:58:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.544+0000 7f97e7400640 1 --2- 172.21.15.46:0/3611664007 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f97c406b810 0x7f97c406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.545+0000 7f97e7400640 1 --2- 172.21.15.46:0/3611664007 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f97c406b810 0x7f97c406dcd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f97d0035000 tx=0x7f97d002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:29.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.547+0000 7f97dfe00640 1 -- 172.21.15.46:0/3611664007 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f97d8054be0 con 0x7f97e80ce250 2024-02-19T06:58:29.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.747+0000 7f97ed800640 1 -- 172.21.15.46:0/3611664007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97e8067c50 con 0x7f97e80ce250 2024-02-19T06:58:29.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.749+0000 7f97dfe00640 1 -- 172.21.15.46:0/3611664007 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f97d80582a0 con 0x7f97e80ce250 2024-02-19T06:58:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:29.752 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:56.828629+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:29.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.753+0000 7f97ed800640 1 -- 172.21.15.46:0/3611664007 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f97c406b810 msgr2=0x7f97c406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:29.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.753+0000 7f97ed800640 1 --2- 172.21.15.46:0/3611664007 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f97c406b810 0x7f97c406dcd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f97d0035000 tx=0x7f97d002e000 comp rx=0 tx=0).stop 2024-02-19T06:58:29.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.753+0000 7f97ed800640 1 -- 172.21.15.46:0/3611664007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e80ce250 msgr2=0x7f97e81574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:29.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.753+0000 7f97ed800640 1 --2- 172.21.15.46:0/3611664007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e80ce250 0x7f97e81574f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f97d800c430 tx=0x7f97d800c8f0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.753+0000 7f97ed800640 1 -- 172.21.15.46:0/3611664007 shutdown_connections 2024-02-19T06:58:29.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.753+0000 7f97ed800640 1 --2- 172.21.15.46:0/3611664007 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f97c406b810 0x7f97c406dcd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.753+0000 7f97ed800640 1 --2- 172.21.15.46:0/3611664007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e80d22f0 0x7f97e806d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.753+0000 7f97ed800640 1 --2- 172.21.15.46:0/3611664007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97e80d0640 0x7f97e815b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.753+0000 7f97ed800640 1 --2- 172.21.15.46:0/3611664007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e80ce250 0x7f97e81574f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:29.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.753+0000 7f97ed800640 1 -- 172.21.15.46:0/3611664007 >> 172.21.15.46:0/3611664007 conn(0x7f97e809ca80 msgr2=0x7f97e808afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:29.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.753+0000 7f97ed800640 1 -- 172.21.15.46:0/3611664007 shutdown_connections 2024-02-19T06:58:29.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:29.753+0000 7f97ed800640 1 -- 172.21.15.46:0/3611664007 wait complete. 2024-02-19T06:58:29.775 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:29.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:30.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.000+0000 7f633cc00640 1 Processor -- start 2024-02-19T06:58:30.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.001+0000 7f633cc00640 1 -- start start 2024-02-19T06:58:30.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.002+0000 7f633cc00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f633815a770 0x7f63380b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.002+0000 7f633cc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f63380b27d0 0x7f633806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.002+0000 7f633cc00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63380b4290 con 0x7f63380cf530 2024-02-19T06:58:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.002+0000 7f633cc00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63380b38c0 con 0x7f633815a770 2024-02-19T06:58:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.002+0000 7f633cc00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63380b2cb0 con 0x7f63380b27d0 2024-02-19T06:58:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.002+0000 7f6336a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f633815a770 0x7f63380b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.002+0000 7f6336a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f633815a770 0x7f63380b3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35320/0 (socket says 172.21.15.46:35320) 2024-02-19T06:58:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.002+0000 7f6336a00640 1 -- 172.21.15.46:0/4027334050 learned_addr learned my addr 172.21.15.46:0/4027334050 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.002+0000 7f6337400640 1 --1- 172.21.15.46:0/4027334050 >> v1:172.21.15.46:6789/0 conn(0x7f63380cf530 0x7f63380cf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49142/0 (socket says 172.21.15.46:49142) 2024-02-19T06:58:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.003+0000 7f6337e00640 1 --2- 172.21.15.46:0/4027334050 >> v2:172.21.15.142:3300/0 conn(0x7f63380b27d0 0x7f633806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.003+0000 7f6336a00640 1 -- 172.21.15.46:0/4027334050 >> v2:172.21.15.142:3300/0 conn(0x7f63380b27d0 msgr2=0x7f633806e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.003+0000 7f6336a00640 1 --2- 172.21.15.46:0/4027334050 >> v2:172.21.15.142:3300/0 conn(0x7f63380b27d0 0x7f633806e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.003+0000 7f6336a00640 1 -- 172.21.15.46:0/4027334050 >> v1:172.21.15.46:6789/0 conn(0x7f63380cf530 legacy=0x7f63380cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.003+0000 7f6336000640 1 -- 172.21.15.46:0/4027334050 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622086736 0 0) 0x7f6328001490 con 0x7f63380cf530 2024-02-19T06:58:30.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.003+0000 7f6336a00640 1 -- 172.21.15.46:0/4027334050 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63380b2f90 con 0x7f633815a770 2024-02-19T06:58:30.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.004+0000 7f6336a00640 1 --2- 172.21.15.46:0/4027334050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f633815a770 0x7f63380b3d50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f63380ae170 tx=0x7f632002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec93efc19677173d server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:30.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.004+0000 7f6336000640 1 -- 172.21.15.46:0/4027334050 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320030860 con 0x7f633815a770 2024-02-19T06:58:30.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.005+0000 7f6336000640 1 -- 172.21.15.46:0/4027334050 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63200309c0 con 0x7f633815a770 2024-02-19T06:58:30.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.005+0000 7f6336000640 1 -- 172.21.15.46:0/4027334050 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320030d50 con 0x7f633815a770 2024-02-19T06:58:30.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.005+0000 7f633cc00640 1 -- 172.21.15.46:0/4027334050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f633815a770 msgr2=0x7f63380b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.005+0000 7f633cc00640 1 --2- 172.21.15.46:0/4027334050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f633815a770 0x7f63380b3d50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f63380ae170 tx=0x7f632002b9a0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.005+0000 7f633cc00640 1 -- 172.21.15.46:0/4027334050 shutdown_connections 2024-02-19T06:58:30.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.005+0000 7f633cc00640 1 --2- 172.21.15.46:0/4027334050 >> v2:172.21.15.142:3300/0 conn(0x7f63380b27d0 0x7f633806e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.005+0000 7f633cc00640 1 --2- 172.21.15.46:0/4027334050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f633815a770 0x7f63380b3d50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.005+0000 7f633cc00640 1 -- 172.21.15.46:0/4027334050 >> 172.21.15.46:0/4027334050 conn(0x7f633806ad60 msgr2=0x7f633806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:30.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.005+0000 7f633cc00640 1 -- 172.21.15.46:0/4027334050 shutdown_connections 2024-02-19T06:58:30.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.005+0000 7f633cc00640 1 -- 172.21.15.46:0/4027334050 wait complete. 2024-02-19T06:58:30.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.007+0000 7f633cc00640 1 Processor -- start 2024-02-19T06:58:30.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.007+0000 7f633cc00640 1 -- start start 2024-02-19T06:58:30.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.008+0000 7f633cc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63380b27d0 0x7f63381f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.008+0000 7f633cc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63380cf530 0x7f63380c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.008+0000 7f633cc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f633815a770 0x7f63380ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.008+0000 7f633cc00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63381f44a0 con 0x7f63380cf530 2024-02-19T06:58:30.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.008+0000 7f633cc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63380af580 con 0x7f63380b27d0 2024-02-19T06:58:30.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.008+0000 7f633cc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63380c2e60 con 0x7f633815a770 2024-02-19T06:58:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.009+0000 7f6336a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63380cf530 0x7f63380c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.009+0000 7f6336a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63380cf530 0x7f63380c3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35332/0 (socket says 172.21.15.46:35332) 2024-02-19T06:58:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.009+0000 7f6336a00640 1 -- 172.21.15.46:0/2990232423 learned_addr learned my addr 172.21.15.46:0/2990232423 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.009+0000 7f6337e00640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f633815a770 0x7f63380ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.009+0000 7f6337400640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63380b27d0 0x7f63381f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.009+0000 7f6336a00640 1 -- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f633815a770 msgr2=0x7f63380ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.009+0000 7f6336a00640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f633815a770 0x7f63380ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.009+0000 7f6336a00640 1 -- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63380b27d0 msgr2=0x7f63381f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.009+0000 7f6336a00640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63380b27d0 0x7f63381f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.009+0000 7f6336a00640 1 -- 172.21.15.46:0/2990232423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63200094d0 con 0x7f63380cf530 2024-02-19T06:58:30.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.010+0000 7f6336a00640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63380cf530 0x7f63380c3f00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f632002b9e0 tx=0x7f63200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:30.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.010+0000 7f632f400640 1 -- 172.21.15.46:0/2990232423 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632003e070 con 0x7f63380cf530 2024-02-19T06:58:30.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.010+0000 7f632f400640 1 -- 172.21.15.46:0/2990232423 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6320039800 con 0x7f63380cf530 2024-02-19T06:58:30.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.010+0000 7f632f400640 1 -- 172.21.15.46:0/2990232423 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320039b90 con 0x7f63380cf530 2024-02-19T06:58:30.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.010+0000 7f633cc00640 1 -- 172.21.15.46:0/2990232423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63380c3140 con 0x7f63380cf530 2024-02-19T06:58:30.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.010+0000 7f633cc00640 1 -- 172.21.15.46:0/2990232423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63380c3700 con 0x7f63380cf530 2024-02-19T06:58:30.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.012+0000 7f633cc00640 1 -- 172.21.15.46:0/2990232423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6338072fe0 con 0x7f63380cf530 2024-02-19T06:58:30.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.012+0000 7f632f400640 1 -- 172.21.15.46:0/2990232423 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6320042070 con 0x7f63380cf530 2024-02-19T06:58:30.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.013+0000 7f632f400640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f631406b840 0x7f631406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.013+0000 7f632f400640 1 -- 172.21.15.46:0/2990232423 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63200abe40 con 0x7f63380cf530 2024-02-19T06:58:30.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.014+0000 7f6337400640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f631406b840 0x7f631406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.015+0000 7f6337400640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f631406b840 0x7f631406dd00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f63280012e0 tx=0x7f6328007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:30.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.018+0000 7f632f400640 1 -- 172.21.15.46:0/2990232423 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6320076910 con 0x7f63380cf530 2024-02-19T06:58:30.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.220+0000 7f633cc00640 1 -- 172.21.15.46:0/2990232423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f633804eee0 con 0x7f63380cf530 2024-02-19T06:58:30.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.221+0000 7f632f400640 1 -- 172.21.15.46:0/2990232423 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63200490a0 con 0x7f63380cf530 2024-02-19T06:58:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:30.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.224+0000 7f633cc00640 1 -- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f631406b840 msgr2=0x7f631406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.224+0000 7f633cc00640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f631406b840 0x7f631406dd00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f63280012e0 tx=0x7f6328007d30 comp rx=0 tx=0).stop 2024-02-19T06:58:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.224+0000 7f633cc00640 1 -- 172.21.15.46:0/2990232423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63380cf530 msgr2=0x7f63380c3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.224+0000 7f633cc00640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63380cf530 0x7f63380c3f00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f632002b9e0 tx=0x7f63200046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.224+0000 7f633cc00640 1 -- 172.21.15.46:0/2990232423 shutdown_connections 2024-02-19T06:58:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.224+0000 7f633cc00640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f631406b840 0x7f631406dd00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.224+0000 7f633cc00640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f633815a770 0x7f63380ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.224+0000 7f633cc00640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63380cf530 0x7f63380c3f00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.224+0000 7f633cc00640 1 --2- 172.21.15.46:0/2990232423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63380b27d0 0x7f63381f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.224+0000 7f633cc00640 1 -- 172.21.15.46:0/2990232423 >> 172.21.15.46:0/2990232423 conn(0x7f633806ad60 msgr2=0x7f63380af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.224+0000 7f633cc00640 1 -- 172.21.15.46:0/2990232423 shutdown_connections 2024-02-19T06:58:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.224+0000 7f633cc00640 1 -- 172.21.15.46:0/2990232423 wait complete. 2024-02-19T06:58:30.246 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:30.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.479+0000 7f3a3ec00640 1 Processor -- start 2024-02-19T06:58:30.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.479+0000 7f3a3ec00640 1 -- start start 2024-02-19T06:58:30.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.480+0000 7f3a3ec00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3a380b2bf0 0x7f3a381662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.480+0000 7f3a3ec00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a3815be60 con 0x7f3a380cfc40 2024-02-19T06:58:30.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.480+0000 7f3a3ec00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a3815c140 con 0x7f3a38155b20 2024-02-19T06:58:30.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.480+0000 7f3a3ec00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a3815c420 con 0x7f3a380b2bf0 2024-02-19T06:58:30.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.481+0000 7f3a3e200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3a380b2bf0 0x7f3a381662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.481+0000 7f3a3e200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3a380b2bf0 0x7f3a381662f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35344/0 (socket says 172.21.15.46:35344) 2024-02-19T06:58:30.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.481+0000 7f3a3e200640 1 -- 172.21.15.46:0/3649993742 learned_addr learned my addr 172.21.15.46:0/3649993742 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:30.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.481+0000 7f3a3e200640 1 -- 172.21.15.46:0/3649993742 >> v1:172.21.15.142:6789/0 conn(0x7f3a38155b20 legacy=0x7f3a380cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:30.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.481+0000 7f3a3e200640 1 -- 172.21.15.46:0/3649993742 >> v1:172.21.15.46:6789/0 conn(0x7f3a380cfc40 legacy=0x7f3a380b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.481+0000 7f3a3e200640 1 -- 172.21.15.46:0/3649993742 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3815c700 con 0x7f3a380b2bf0 2024-02-19T06:58:30.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.481+0000 7f3a37e00640 1 -- 172.21.15.46:0/3649993742 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004405480 0 0) 0x7f3a3815be60 con 0x7f3a380cfc40 2024-02-19T06:58:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.482+0000 7f3a3e200640 1 --2- 172.21.15.46:0/3649993742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a380b2bf0 0x7f3a381662f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009e50 tx=0x7f3a3002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fde635783202860 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.482+0000 7f3a37e00640 1 -- 172.21.15.46:0/3649993742 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3002ca80 con 0x7f3a380b2bf0 2024-02-19T06:58:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.483+0000 7f3a37e00640 1 -- 172.21.15.46:0/3649993742 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3002cbe0 con 0x7f3a380b2bf0 2024-02-19T06:58:30.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.483+0000 7f3a37e00640 1 -- 172.21.15.46:0/3649993742 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a300343f0 con 0x7f3a380b2bf0 2024-02-19T06:58:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.483+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3649993742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a380b2bf0 msgr2=0x7f3a381662f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.483+0000 7f3a3ec00640 1 --2- 172.21.15.46:0/3649993742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a380b2bf0 0x7f3a381662f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009e50 tx=0x7f3a3002bee0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.483+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3649993742 shutdown_connections 2024-02-19T06:58:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.483+0000 7f3a3ec00640 1 --2- 172.21.15.46:0/3649993742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a380b2bf0 0x7f3a381662f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.483+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3649993742 >> 172.21.15.46:0/3649993742 conn(0x7f3a3806ad60 msgr2=0x7f3a3806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.483+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3649993742 shutdown_connections 2024-02-19T06:58:30.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.483+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3649993742 wait complete. 2024-02-19T06:58:30.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.485+0000 7f3a3ec00640 1 Processor -- start 2024-02-19T06:58:30.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.485+0000 7f3a3ec00640 1 -- start start 2024-02-19T06:58:30.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.486+0000 7f3a3ec00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a380b2bf0 0x7f3a380cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.486+0000 7f3a3ec00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a380cfc40 0x7f3a380cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.486+0000 7f3a3ec00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a38155b20 0x7f3a380ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.486+0000 7f3a3ec00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a381537f0 con 0x7f3a38155b20 2024-02-19T06:58:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.486+0000 7f3a3ec00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a380c2310 con 0x7f3a380cfc40 2024-02-19T06:58:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.486+0000 7f3a3ec00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a380cc360 con 0x7f3a380b2bf0 2024-02-19T06:58:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.487+0000 7f3a3e200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a38155b20 0x7f3a380ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.487+0000 7f3a3e200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a38155b20 0x7f3a380ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35352/0 (socket says 172.21.15.46:35352) 2024-02-19T06:58:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.487+0000 7f3a3e200640 1 -- 172.21.15.46:0/3030837506 learned_addr learned my addr 172.21.15.46:0/3030837506 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.487+0000 7f3a3ce00640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a380cfc40 0x7f3a380cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.487+0000 7f3a3d800640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a380b2bf0 0x7f3a380cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.487+0000 7f3a3e200640 1 -- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a380b2bf0 msgr2=0x7f3a380cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.487+0000 7f3a3e200640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a380b2bf0 0x7f3a380cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.487+0000 7f3a3e200640 1 -- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a380cfc40 msgr2=0x7f3a380cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.487+0000 7f3a3e200640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a380cfc40 0x7f3a380cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.487+0000 7f3a3e200640 1 -- 172.21.15.46:0/3030837506 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a30009b30 con 0x7f3a38155b20 2024-02-19T06:58:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.488+0000 7f3a3e200640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a38155b20 0x7f3a380ccec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a30036040 tx=0x7f3a30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.488+0000 7f3a35600640 1 -- 172.21.15.46:0/3030837506 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3003e450 con 0x7f3a38155b20 2024-02-19T06:58:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.488+0000 7f3a35600640 1 -- 172.21.15.46:0/3030837506 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3003e5d0 con 0x7f3a38155b20 2024-02-19T06:58:30.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.488+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3030837506 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a380cc640 con 0x7f3a38155b20 2024-02-19T06:58:30.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.488+0000 7f3a35600640 1 -- 172.21.15.46:0/3030837506 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3003e980 con 0x7f3a38155b20 2024-02-19T06:58:30.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.488+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3030837506 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a380cc010 con 0x7f3a38155b20 2024-02-19T06:58:30.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.489+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3030837506 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3804eee0 con 0x7f3a38155b20 2024-02-19T06:58:30.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.490+0000 7f3a35600640 1 -- 172.21.15.46:0/3030837506 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3a3002cd50 con 0x7f3a38155b20 2024-02-19T06:58:30.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.491+0000 7f3a35600640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3a1c06b810 0x7f3a1c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.492+0000 7f3a35600640 1 -- 172.21.15.46:0/3030837506 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a300acde0 con 0x7f3a38155b20 2024-02-19T06:58:30.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.492+0000 7f3a3d800640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3a1c06b810 0x7f3a1c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.493+0000 7f3a3d800640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3a1c06b810 0x7f3a1c06dcd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c004ea0 tx=0x7f3a2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:30.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.495+0000 7f3a35600640 1 -- 172.21.15.46:0/3030837506 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3a30077880 con 0x7f3a38155b20 2024-02-19T06:58:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.697+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3030837506 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a380b1810 con 0x7f3a38155b20 2024-02-19T06:58:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.698+0000 7f3a35600640 1 -- 172.21.15.46:0/3030837506 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a3007af40 con 0x7f3a38155b20 2024-02-19T06:58:30.700 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.701+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3a1c06b810 msgr2=0x7f3a1c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.701+0000 7f3a3ec00640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3a1c06b810 0x7f3a1c06dcd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c004ea0 tx=0x7f3a2c009040 comp rx=0 tx=0).stop 2024-02-19T06:58:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.701+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3030837506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a38155b20 msgr2=0x7f3a380ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.701+0000 7f3a3ec00640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a38155b20 0x7f3a380ccec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a30036040 tx=0x7f3a30004a40 comp rx=0 tx=0).stop 2024-02-19T06:58:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.701+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3030837506 shutdown_connections 2024-02-19T06:58:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.701+0000 7f3a3ec00640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3a1c06b810 0x7f3a1c06dcd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.701+0000 7f3a3ec00640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a38155b20 0x7f3a380ccec0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.701+0000 7f3a3ec00640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a380cfc40 0x7f3a380cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.701+0000 7f3a3ec00640 1 --2- 172.21.15.46:0/3030837506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a380b2bf0 0x7f3a380cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.701+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3030837506 >> 172.21.15.46:0/3030837506 conn(0x7f3a3806ad60 msgr2=0x7f3a3815e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.701+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3030837506 shutdown_connections 2024-02-19T06:58:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.702+0000 7f3a3ec00640 1 -- 172.21.15.46:0/3030837506 wait complete. 2024-02-19T06:58:30.723 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:30.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.949+0000 7fbb9d800640 1 Processor -- start 2024-02-19T06:58:30.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.950+0000 7fbb9d800640 1 -- start start 2024-02-19T06:58:30.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.951+0000 7fbb9d800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9815dcd0 0x7fbb980ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.951+0000 7fbb9d800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb980b7250 con 0x7fbb980cee40 2024-02-19T06:58:30.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.951+0000 7fbb9d800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb980d2990 con 0x7fbb980d2370 2024-02-19T06:58:30.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.951+0000 7fbb9d800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980cf2c0 con 0x7fbb9815dcd0 2024-02-19T06:58:30.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.952+0000 7fbb8e000640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbb980cee40 0x7fbb980d1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49166/0 (socket says 172.21.15.46:49166) 2024-02-19T06:58:30.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.952+0000 7fbb8e000640 1 -- 172.21.15.46:0/1908510535 learned_addr learned my addr 172.21.15.46:0/1908510535 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:30.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.952+0000 7fbb96a00640 1 --2- 172.21.15.46:0/1908510535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9815dcd0 0x7fbb980ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.952+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499519184 0 0) 0x7fbb980b7250 con 0x7fbb980cee40 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.952+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb78003520 con 0x7fbb980cee40 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3176833044 0 0) 0x7fbb78003520 con 0x7fbb980cee40 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9815dcd0 msgr2=0x7fbb980ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb96000640 1 --2- 172.21.15.46:0/1908510535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9815dcd0 0x7fbb980ce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 >> v1:172.21.15.142:6789/0 conn(0x7fbb980d2370 legacy=0x7fbb980b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb980d2c70 con 0x7fbb980cee40 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fbb80001670 con 0x7fbb980cee40 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 >> v1:172.21.15.46:6789/0 conn(0x7fbb980cee40 legacy=0x7fbb980d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb96000640 1 --2- 172.21.15.46:0/1908510535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb780039a0 0x7fbb78003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb96000640 1 --2- 172.21.15.46:0/1908510535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb780047c0 0x7fbb78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb96000640 1 --2- 172.21.15.46:0/1908510535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9815dcd0 0x7fbb78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980cf2c0 con 0x7fbb780047c0 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7800ba60 con 0x7fbb780039a0 2024-02-19T06:58:30.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7800bc20 con 0x7fbb9815dcd0 2024-02-19T06:58:30.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.953+0000 7fbb8e000640 1 --2- 172.21.15.46:0/1908510535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb780047c0 0x7fbb78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.954+0000 7fbb96a00640 1 --2- 172.21.15.46:0/1908510535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb780039a0 0x7fbb78003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.954+0000 7fbb97400640 1 --2- 172.21.15.46:0/1908510535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9815dcd0 0x7fbb78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.954+0000 7fbb8e000640 1 -- 172.21.15.46:0/1908510535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9815dcd0 msgr2=0x7fbb78005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:30.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.954+0000 7fbb8e000640 1 --2- 172.21.15.46:0/1908510535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9815dcd0 0x7fbb78005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.954+0000 7fbb8e000640 1 -- 172.21.15.46:0/1908510535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb780039a0 msgr2=0x7fbb78003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:30.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.954+0000 7fbb8e000640 1 --2- 172.21.15.46:0/1908510535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb780039a0 0x7fbb78003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.954+0000 7fbb8e000640 1 -- 172.21.15.46:0/1908510535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb78003520 con 0x7fbb780047c0 2024-02-19T06:58:30.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.954+0000 7fbb96a00640 1 --2- 172.21.15.46:0/1908510535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb780039a0 0x7fbb78003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:30.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.955+0000 7fbb8e000640 1 --2- 172.21.15.46:0/1908510535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb780047c0 0x7fbb78004c40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbb80001eb0 tx=0x7fbb780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2bda490b613418 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:30.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.956+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80005ad0 con 0x7fbb780047c0 2024-02-19T06:58:30.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.956+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb80005c30 con 0x7fbb780047c0 2024-02-19T06:58:30.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.956+0000 7fbb96000640 1 -- 172.21.15.46:0/1908510535 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8002ca00 con 0x7fbb780047c0 2024-02-19T06:58:30.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.956+0000 7fbb9d800640 1 -- 172.21.15.46:0/1908510535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb780047c0 msgr2=0x7fbb78004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.956+0000 7fbb9d800640 1 --2- 172.21.15.46:0/1908510535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb780047c0 0x7fbb78004c40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbb80001eb0 tx=0x7fbb780057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.956+0000 7fbb97400640 1 -- 172.21.15.46:0/1908510535 reap_dead start 2024-02-19T06:58:30.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.957+0000 7fbb9d800640 1 -- 172.21.15.46:0/1908510535 shutdown_connections 2024-02-19T06:58:30.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.957+0000 7fbb9d800640 1 -- 172.21.15.46:0/1908510535 >> 172.21.15.46:0/1908510535 conn(0x7fbb980b53d0 msgr2=0x7fbb980b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:30.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.957+0000 7fbb9d800640 1 -- 172.21.15.46:0/1908510535 shutdown_connections 2024-02-19T06:58:30.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.957+0000 7fbb9d800640 1 -- 172.21.15.46:0/1908510535 wait complete. 2024-02-19T06:58:30.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.959+0000 7fbb9d800640 1 Processor -- start 2024-02-19T06:58:30.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.959+0000 7fbb9d800640 1 -- start start 2024-02-19T06:58:30.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb9d800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb780047c0 0x7fbb980c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb9d800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb981518f0 0x7fbb98160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb9d800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb980c8390 0x7fbb98154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb9d800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980c73f0 con 0x7fbb780047c0 2024-02-19T06:58:30.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb9d800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98161030 con 0x7fbb980c8390 2024-02-19T06:58:30.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb9d800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980c75d0 con 0x7fbb981518f0 2024-02-19T06:58:30.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb96a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb780047c0 0x7fbb980c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb96a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb780047c0 0x7fbb980c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35372/0 (socket says 172.21.15.46:35372) 2024-02-19T06:58:30.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb96a00640 1 -- 172.21.15.46:0/2659522395 learned_addr learned my addr 172.21.15.46:0/2659522395 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:30.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb96a00640 1 -- 172.21.15.46:0/2659522395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb981518f0 msgr2=0x7fbb98160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb96a00640 1 --2- 172.21.15.46:0/2659522395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb981518f0 0x7fbb98160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb96a00640 1 -- 172.21.15.46:0/2659522395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb980c8390 msgr2=0x7fbb98154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:30.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb96a00640 1 --2- 172.21.15.46:0/2659522395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb980c8390 0x7fbb98154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:30.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.960+0000 7fbb96a00640 1 -- 172.21.15.46:0/2659522395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb980c78b0 con 0x7fbb780047c0 2024-02-19T06:58:30.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.961+0000 7fbb96a00640 1 --2- 172.21.15.46:0/2659522395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb780047c0 0x7fbb980c9ce0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbb880115b0 tx=0x7fbb88011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:30.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.961+0000 7fbb8f400640 1 -- 172.21.15.46:0/2659522395 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88015870 con 0x7fbb780047c0 2024-02-19T06:58:30.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.961+0000 7fbb8f400640 1 -- 172.21.15.46:0/2659522395 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb880159d0 con 0x7fbb780047c0 2024-02-19T06:58:30.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.961+0000 7fbb8f400640 1 -- 172.21.15.46:0/2659522395 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88015d60 con 0x7fbb780047c0 2024-02-19T06:58:30.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.961+0000 7fbb9d800640 1 -- 172.21.15.46:0/2659522395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb980c7b90 con 0x7fbb780047c0 2024-02-19T06:58:30.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.961+0000 7fbb9d800640 1 -- 172.21.15.46:0/2659522395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb980c8810 con 0x7fbb780047c0 2024-02-19T06:58:30.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.962+0000 7fbb9d800640 1 -- 172.21.15.46:0/2659522395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb98067ba0 con 0x7fbb780047c0 2024-02-19T06:58:30.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.963+0000 7fbb8f400640 1 -- 172.21.15.46:0/2659522395 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbb8801d400 con 0x7fbb780047c0 2024-02-19T06:58:30.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.964+0000 7fbb8f400640 1 --2- 172.21.15.46:0/2659522395 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbb7406b840 0x7fbb7406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:30.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.964+0000 7fbb8f400640 1 -- 172.21.15.46:0/2659522395 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb8808a9c0 con 0x7fbb780047c0 2024-02-19T06:58:30.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.965+0000 7fbb8e000640 1 --2- 172.21.15.46:0/2659522395 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbb7406b840 0x7fbb7406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:30.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.966+0000 7fbb8e000640 1 --2- 172.21.15.46:0/2659522395 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbb7406b840 0x7fbb7406dd00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb80034000 tx=0x7fbb80007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:30.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:30.970+0000 7fbb8f400640 1 -- 172.21.15.46:0/2659522395 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbb88055340 con 0x7fbb780047c0 2024-02-19T06:58:31.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.171+0000 7fbb9d800640 1 -- 172.21.15.46:0/2659522395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb981522d0 con 0x7fbb780047c0 2024-02-19T06:58:31.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.172+0000 7fbb8f400640 1 -- 172.21.15.46:0/2659522395 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb880220a0 con 0x7fbb780047c0 2024-02-19T06:58:31.173 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:31.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.175+0000 7fbb9d800640 1 -- 172.21.15.46:0/2659522395 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbb7406b840 msgr2=0x7fbb7406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:31.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.175+0000 7fbb9d800640 1 --2- 172.21.15.46:0/2659522395 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbb7406b840 0x7fbb7406dd00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb80034000 tx=0x7fbb80007000 comp rx=0 tx=0).stop 2024-02-19T06:58:31.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.175+0000 7fbb9d800640 1 -- 172.21.15.46:0/2659522395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb780047c0 msgr2=0x7fbb980c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:31.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.175+0000 7fbb9d800640 1 --2- 172.21.15.46:0/2659522395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb780047c0 0x7fbb980c9ce0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbb880115b0 tx=0x7fbb88011a70 comp rx=0 tx=0).stop 2024-02-19T06:58:31.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.175+0000 7fbb9d800640 1 -- 172.21.15.46:0/2659522395 shutdown_connections 2024-02-19T06:58:31.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.175+0000 7fbb9d800640 1 --2- 172.21.15.46:0/2659522395 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbb7406b840 0x7fbb7406dd00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.175+0000 7fbb9d800640 1 --2- 172.21.15.46:0/2659522395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb980c8390 0x7fbb98154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.175+0000 7fbb9d800640 1 --2- 172.21.15.46:0/2659522395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb981518f0 0x7fbb98160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.175+0000 7fbb9d800640 1 --2- 172.21.15.46:0/2659522395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb780047c0 0x7fbb980c9ce0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.175+0000 7fbb9d800640 1 -- 172.21.15.46:0/2659522395 >> 172.21.15.46:0/2659522395 conn(0x7fbb980b53d0 msgr2=0x7fbb980d1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:31.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.175+0000 7fbb9d800640 1 -- 172.21.15.46:0/2659522395 shutdown_connections 2024-02-19T06:58:31.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.175+0000 7fbb9d800640 1 -- 172.21.15.46:0/2659522395 wait complete. 2024-02-19T06:58:31.196 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:31.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.419+0000 7fb2fca00640 1 Processor -- start 2024-02-19T06:58:31.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.419+0000 7fb2fca00640 1 -- start start 2024-02-19T06:58:31.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.421+0000 7fb2fca00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb2f80ae3f0 0x7fb2f80acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:31.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.421+0000 7fb2fca00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb2f80ae7d0 0x7fb2f815ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:31.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.421+0000 7fb2fca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2f8071000 0x7fb2f80714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:31.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.421+0000 7fb2fca00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f80adee0 con 0x7fb2f80ae3f0 2024-02-19T06:58:31.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.421+0000 7fb2fca00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f815efc0 con 0x7fb2f80ae7d0 2024-02-19T06:58:31.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.421+0000 7fb2fca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80ad260 con 0x7fb2f8071000 2024-02-19T06:58:31.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.421+0000 7fb2f5e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb2f80ae3f0 0x7fb2f80acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.421+0000 7fb2f5e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb2f80ae3f0 0x7fb2f80acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35388/0 (socket says 172.21.15.46:35388) 2024-02-19T06:58:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.421+0000 7fb2f5e00640 1 -- 172.21.15.46:0/220198474 learned_addr learned my addr 172.21.15.46:0/220198474 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.422+0000 7fb2f6800640 1 --2- 172.21.15.46:0/220198474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2f8071000 0x7fb2f80714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.422+0000 7fb2efe00640 1 --2- 172.21.15.46:0/220198474 >> v2:172.21.15.142:3300/0 conn(0x7fb2f80ae7d0 0x7fb2f815ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.422+0000 7fb2f5e00640 1 -- 172.21.15.46:0/220198474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2f8071000 msgr2=0x7fb2f80714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.422+0000 7fb2f5e00640 1 --2- 172.21.15.46:0/220198474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2f8071000 0x7fb2f80714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.422+0000 7fb2f5e00640 1 -- 172.21.15.46:0/220198474 >> v2:172.21.15.142:3300/0 conn(0x7fb2f80ae7d0 msgr2=0x7fb2f815ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.422+0000 7fb2f5e00640 1 --2- 172.21.15.46:0/220198474 >> v2:172.21.15.142:3300/0 conn(0x7fb2f80ae7d0 0x7fb2f815ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.422+0000 7fb2f5e00640 1 -- 172.21.15.46:0/220198474 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f80ad540 con 0x7fb2f80ae3f0 2024-02-19T06:58:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.422+0000 7fb2efe00640 1 --2- 172.21.15.46:0/220198474 >> v2:172.21.15.142:3300/0 conn(0x7fb2f80ae7d0 0x7fb2f815ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:31.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.423+0000 7fb2f5e00640 1 --2- 172.21.15.46:0/220198474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2f80ae3f0 0x7fb2f80acb80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2f806f350 tx=0x7fb2e802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff02701bf63cc97 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:31.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.423+0000 7fb2f5400640 1 -- 172.21.15.46:0/220198474 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8031860 con 0x7fb2f80ae3f0 2024-02-19T06:58:31.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.424+0000 7fb2f5400640 1 -- 172.21.15.46:0/220198474 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e80319c0 con 0x7fb2f80ae3f0 2024-02-19T06:58:31.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.424+0000 7fb2f5400640 1 -- 172.21.15.46:0/220198474 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8031d50 con 0x7fb2f80ae3f0 2024-02-19T06:58:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.424+0000 7fb2fca00640 1 -- 172.21.15.46:0/220198474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2f80ae3f0 msgr2=0x7fb2f80acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.424+0000 7fb2fca00640 1 --2- 172.21.15.46:0/220198474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2f80ae3f0 0x7fb2f80acb80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2f806f350 tx=0x7fb2e802b900 comp rx=0 tx=0).stop 2024-02-19T06:58:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.424+0000 7fb2fca00640 1 -- 172.21.15.46:0/220198474 shutdown_connections 2024-02-19T06:58:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.424+0000 7fb2fca00640 1 --2- 172.21.15.46:0/220198474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2f8071000 0x7fb2f80714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.424+0000 7fb2fca00640 1 --2- 172.21.15.46:0/220198474 >> v2:172.21.15.142:3300/0 conn(0x7fb2f80ae7d0 0x7fb2f815ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.424+0000 7fb2fca00640 1 --2- 172.21.15.46:0/220198474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2f80ae3f0 0x7fb2f80acb80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.424+0000 7fb2fca00640 1 -- 172.21.15.46:0/220198474 >> 172.21.15.46:0/220198474 conn(0x7fb2f8066f70 msgr2=0x7fb2f806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.424+0000 7fb2fca00640 1 -- 172.21.15.46:0/220198474 shutdown_connections 2024-02-19T06:58:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.424+0000 7fb2fca00640 1 -- 172.21.15.46:0/220198474 wait complete. 2024-02-19T06:58:31.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.426+0000 7fb2fca00640 1 Processor -- start 2024-02-19T06:58:31.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.426+0000 7fb2fca00640 1 -- start start 2024-02-19T06:58:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.427+0000 7fb2fca00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2f8071000 0x7fb2f80af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.427+0000 7fb2fca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2f80ae3f0 0x7fb2f81f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.427+0000 7fb2fca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2f80ae7d0 0x7fb2f80cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.427+0000 7fb2fca00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80af9d0 con 0x7fb2f8071000 2024-02-19T06:58:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.427+0000 7fb2fca00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80afcb0 con 0x7fb2f80ae7d0 2024-02-19T06:58:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.427+0000 7fb2fca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80aff90 con 0x7fb2f80ae3f0 2024-02-19T06:58:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.428+0000 7fb2f5e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2f8071000 0x7fb2f80af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.428+0000 7fb2f5e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2f8071000 0x7fb2f80af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35398/0 (socket says 172.21.15.46:35398) 2024-02-19T06:58:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.428+0000 7fb2f5e00640 1 -- 172.21.15.46:0/2299429847 learned_addr learned my addr 172.21.15.46:0/2299429847 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:31.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.428+0000 7fb2f5e00640 1 -- 172.21.15.46:0/2299429847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2f80ae3f0 msgr2=0x7fb2f81f3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:31.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.428+0000 7fb2f5e00640 1 --2- 172.21.15.46:0/2299429847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2f80ae3f0 0x7fb2f81f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.428+0000 7fb2f5e00640 1 -- 172.21.15.46:0/2299429847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2f80ae7d0 msgr2=0x7fb2f80cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:31.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.428+0000 7fb2f5e00640 1 --2- 172.21.15.46:0/2299429847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2f80ae7d0 0x7fb2f80cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.428+0000 7fb2f5e00640 1 -- 172.21.15.46:0/2299429847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e80094d0 con 0x7fb2f8071000 2024-02-19T06:58:31.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.429+0000 7fb2f5e00640 1 --2- 172.21.15.46:0/2299429847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2f8071000 0x7fb2f80af310 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb2e802b940 tx=0x7fb2e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:31.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.429+0000 7fb2ee000640 1 -- 172.21.15.46:0/2299429847 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e803ac60 con 0x7fb2f8071000 2024-02-19T06:58:31.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.429+0000 7fb2ee000640 1 -- 172.21.15.46:0/2299429847 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e803adc0 con 0x7fb2f8071000 2024-02-19T06:58:31.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.429+0000 7fb2ee000640 1 -- 172.21.15.46:0/2299429847 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80445f0 con 0x7fb2f8071000 2024-02-19T06:58:31.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.429+0000 7fb2fca00640 1 -- 172.21.15.46:0/2299429847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f80b0270 con 0x7fb2f8071000 2024-02-19T06:58:31.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.429+0000 7fb2fca00640 1 -- 172.21.15.46:0/2299429847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f81f4320 con 0x7fb2f8071000 2024-02-19T06:58:31.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.430+0000 7fb2fca00640 1 -- 172.21.15.46:0/2299429847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f81f44b0 con 0x7fb2f8071000 2024-02-19T06:58:31.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.431+0000 7fb2ee000640 1 -- 172.21.15.46:0/2299429847 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb2e804d450 con 0x7fb2f8071000 2024-02-19T06:58:31.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.432+0000 7fb2ee000640 1 --2- 172.21.15.46:0/2299429847 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb2d406b860 0x7fb2d406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:31.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.432+0000 7fb2ee000640 1 -- 172.21.15.46:0/2299429847 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2e80ac700 con 0x7fb2f8071000 2024-02-19T06:58:31.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.433+0000 7fb2efe00640 1 --2- 172.21.15.46:0/2299429847 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb2d406b860 0x7fb2d406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:31.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.434+0000 7fb2efe00640 1 --2- 172.21.15.46:0/2299429847 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb2d406b860 0x7fb2d406dd20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0006fd0 tx=0x7fb2e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:31.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.437+0000 7fb2ee000640 1 -- 172.21.15.46:0/2299429847 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb2e8077200 con 0x7fb2f8071000 2024-02-19T06:58:31.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.634+0000 7fb2fca00640 1 -- 172.21.15.46:0/2299429847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2f8067ba0 con 0x7fb2f8071000 2024-02-19T06:58:31.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.637+0000 7fb2ee000640 1 -- 172.21.15.46:0/2299429847 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fb2e807a8c0 con 0x7fb2f8071000 2024-02-19T06:58:31.639 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:31.639 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:56.828629+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:31.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.640+0000 7fb2fca00640 1 -- 172.21.15.46:0/2299429847 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb2d406b860 msgr2=0x7fb2d406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:31.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.640+0000 7fb2fca00640 1 --2- 172.21.15.46:0/2299429847 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb2d406b860 0x7fb2d406dd20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0006fd0 tx=0x7fb2e0008040 comp rx=0 tx=0).stop 2024-02-19T06:58:31.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.640+0000 7fb2fca00640 1 -- 172.21.15.46:0/2299429847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2f8071000 msgr2=0x7fb2f80af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:31.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.640+0000 7fb2fca00640 1 --2- 172.21.15.46:0/2299429847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2f8071000 0x7fb2f80af310 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb2e802b940 tx=0x7fb2e80046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.640+0000 7fb2fca00640 1 -- 172.21.15.46:0/2299429847 shutdown_connections 2024-02-19T06:58:31.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.640+0000 7fb2fca00640 1 --2- 172.21.15.46:0/2299429847 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb2d406b860 0x7fb2d406dd20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.640+0000 7fb2fca00640 1 --2- 172.21.15.46:0/2299429847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2f80ae7d0 0x7fb2f80cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.640+0000 7fb2fca00640 1 --2- 172.21.15.46:0/2299429847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2f80ae3f0 0x7fb2f81f3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.640+0000 7fb2fca00640 1 --2- 172.21.15.46:0/2299429847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2f8071000 0x7fb2f80af310 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.640+0000 7fb2fca00640 1 -- 172.21.15.46:0/2299429847 >> 172.21.15.46:0/2299429847 conn(0x7fb2f8066f70 msgr2=0x7fb2f806e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:31.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.640+0000 7fb2fca00640 1 -- 172.21.15.46:0/2299429847 shutdown_connections 2024-02-19T06:58:31.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.640+0000 7fb2fca00640 1 -- 172.21.15.46:0/2299429847 wait complete. 2024-02-19T06:58:31.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:31.660 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:31.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.885+0000 7fb7ffe00640 1 Processor -- start 2024-02-19T06:58:31.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.885+0000 7fb7ffe00640 1 -- start start 2024-02-19T06:58:31.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.886+0000 7fb7ffe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8000b19a0 0x7fb8000d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:31.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.886+0000 7fb7ffe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb8000d3530 0x7fb8000d39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:31.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.886+0000 7fb7ffe00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8000b0500 con 0x7fb80015d980 2024-02-19T06:58:31.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.887+0000 7fb7ffe00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80006d2d0 con 0x7fb8000d3530 2024-02-19T06:58:31.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.887+0000 7fb7ffe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80015dd60 con 0x7fb8000b19a0 2024-02-19T06:58:31.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.887+0000 7fb7ff400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb8000d3530 0x7fb8000d39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:31.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.887+0000 7fb7ff400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb8000d3530 0x7fb8000d39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35412/0 (socket says 172.21.15.46:35412) 2024-02-19T06:58:31.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.887+0000 7fb7ff400640 1 -- 172.21.15.46:0/2700810092 learned_addr learned my addr 172.21.15.46:0/2700810092 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:31.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.887+0000 7fb7fe000640 1 --2- 172.21.15.46:0/2700810092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8000b19a0 0x7fb8000d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:31.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.887+0000 7fb7ff400640 1 -- 172.21.15.46:0/2700810092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8000b19a0 msgr2=0x7fb8000d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:31.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.887+0000 7fb7ff400640 1 --2- 172.21.15.46:0/2700810092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8000b19a0 0x7fb8000d2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.888+0000 7fb7ff400640 1 -- 172.21.15.46:0/2700810092 >> v1:172.21.15.142:6789/0 conn(0x7fb80015d980 legacy=0x7fb80006cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:31.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.888+0000 7fb7ff400640 1 -- 172.21.15.46:0/2700810092 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8000d3f00 con 0x7fb8000d3530 2024-02-19T06:58:31.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.889+0000 7fb7ff400640 1 --2- 172.21.15.46:0/2700810092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000d3530 0x7fb8000d39c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009870 tx=0x7fb7f802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd11c493febe0208 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.890+0000 7fb7fd600640 1 -- 172.21.15.46:0/2700810092 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8030840 con 0x7fb8000d3530 2024-02-19T06:58:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.890+0000 7fb7fd600640 1 -- 172.21.15.46:0/2700810092 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f80309a0 con 0x7fb8000d3530 2024-02-19T06:58:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.890+0000 7fb7fd600640 1 -- 172.21.15.46:0/2700810092 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8030d30 con 0x7fb8000d3530 2024-02-19T06:58:31.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.890+0000 7fb7ffe00640 1 -- 172.21.15.46:0/2700810092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000d3530 msgr2=0x7fb8000d39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:31.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.890+0000 7fb7ffe00640 1 --2- 172.21.15.46:0/2700810092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000d3530 0x7fb8000d39c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009870 tx=0x7fb7f802b980 comp rx=0 tx=0).stop 2024-02-19T06:58:31.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.891+0000 7fb7ffe00640 1 -- 172.21.15.46:0/2700810092 shutdown_connections 2024-02-19T06:58:31.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.891+0000 7fb7ffe00640 1 --2- 172.21.15.46:0/2700810092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000d3530 0x7fb8000d39c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.891+0000 7fb7ffe00640 1 --2- 172.21.15.46:0/2700810092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8000b19a0 0x7fb8000d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.891+0000 7fb7ffe00640 1 -- 172.21.15.46:0/2700810092 >> 172.21.15.46:0/2700810092 conn(0x7fb80009ca60 msgr2=0x7fb80008afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:31.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.891+0000 7fb7ffe00640 1 -- 172.21.15.46:0/2700810092 shutdown_connections 2024-02-19T06:58:31.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.891+0000 7fb7ffe00640 1 -- 172.21.15.46:0/2700810092 wait complete. 2024-02-19T06:58:31.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.892+0000 7fb7ffe00640 1 Processor -- start 2024-02-19T06:58:31.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.893+0000 7fb7ffe00640 1 -- start start 2024-02-19T06:58:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7ffe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000b19a0 0x7fb800156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7ffe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8000d3530 0x7fb80015b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7ffe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb80015d980 0x7fb80015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7ffe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb800160e70 con 0x7fb8000b19a0 2024-02-19T06:58:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7ffe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8001602f0 con 0x7fb80015d980 2024-02-19T06:58:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7ffe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8001605d0 con 0x7fb8000d3530 2024-02-19T06:58:31.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7fea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000b19a0 0x7fb800156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:31.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7fea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000b19a0 0x7fb800156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35420/0 (socket says 172.21.15.46:35420) 2024-02-19T06:58:31.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7fea00640 1 -- 172.21.15.46:0/3192108533 learned_addr learned my addr 172.21.15.46:0/3192108533 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:31.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7fea00640 1 -- 172.21.15.46:0/3192108533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8000d3530 msgr2=0x7fb80015b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:31.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7fea00640 1 --2- 172.21.15.46:0/3192108533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8000d3530 0x7fb80015b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7fea00640 1 -- 172.21.15.46:0/3192108533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb80015d980 msgr2=0x7fb80015b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:31.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7fea00640 1 --2- 172.21.15.46:0/3192108533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb80015d980 0x7fb80015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:31.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.894+0000 7fb7fea00640 1 -- 172.21.15.46:0/3192108533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f80094d0 con 0x7fb8000b19a0 2024-02-19T06:58:31.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.895+0000 7fb7fea00640 1 --2- 172.21.15.46:0/3192108533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000b19a0 0x7fb800156780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000c3c0 tx=0x7fb7f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:31.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.895+0000 7fb7f6a00640 1 -- 172.21.15.46:0/3192108533 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f00052d0 con 0x7fb8000b19a0 2024-02-19T06:58:31.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.895+0000 7fb7f6a00640 1 -- 172.21.15.46:0/3192108533 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f0005470 con 0x7fb8000b19a0 2024-02-19T06:58:31.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.895+0000 7fb7f6a00640 1 -- 172.21.15.46:0/3192108533 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0006a60 con 0x7fb8000b19a0 2024-02-19T06:58:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.895+0000 7fb7ffe00640 1 -- 172.21.15.46:0/3192108533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8001608b0 con 0x7fb8000b19a0 2024-02-19T06:58:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.895+0000 7fb7ffe00640 1 -- 172.21.15.46:0/3192108533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb800156cc0 con 0x7fb8000b19a0 2024-02-19T06:58:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.897+0000 7fb7ffe00640 1 -- 172.21.15.46:0/3192108533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8000ca7e0 con 0x7fb8000b19a0 2024-02-19T06:58:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.897+0000 7fb7f6a00640 1 -- 172.21.15.46:0/3192108533 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb7f0006bc0 con 0x7fb8000b19a0 2024-02-19T06:58:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.898+0000 7fb7f6a00640 1 --2- 172.21.15.46:0/3192108533 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb7dc06b810 0x7fb7dc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.898+0000 7fb7f6a00640 1 -- 172.21.15.46:0/3192108533 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7f00895b0 con 0x7fb8000b19a0 2024-02-19T06:58:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.899+0000 7fb7fe000640 1 --2- 172.21.15.46:0/3192108533 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb7dc06b810 0x7fb7dc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:31.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.900+0000 7fb7fe000640 1 --2- 172.21.15.46:0/3192108533 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb7dc06b810 0x7fb7dc06dcd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80070b0 tx=0x7fb7e8007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:31.902+0000 7fb7f6a00640 1 -- 172.21.15.46:0/3192108533 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8000ca7e0 con 0x7fb8000b19a0 2024-02-19T06:58:32.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.102+0000 7fb7ffe00640 1 -- 172.21.15.46:0/3192108533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8000ca7e0 con 0x7fb8000b19a0 2024-02-19T06:58:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.103+0000 7fb7f6a00640 1 -- 172.21.15.46:0/3192108533 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8000ca7e0 con 0x7fb8000b19a0 2024-02-19T06:58:32.105 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.106+0000 7fb7ffe00640 1 -- 172.21.15.46:0/3192108533 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb7dc06b810 msgr2=0x7fb7dc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.106+0000 7fb7ffe00640 1 --2- 172.21.15.46:0/3192108533 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb7dc06b810 0x7fb7dc06dcd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80070b0 tx=0x7fb7e8007040 comp rx=0 tx=0).stop 2024-02-19T06:58:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.106+0000 7fb7ffe00640 1 -- 172.21.15.46:0/3192108533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000b19a0 msgr2=0x7fb800156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.106+0000 7fb7ffe00640 1 --2- 172.21.15.46:0/3192108533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000b19a0 0x7fb800156780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000c3c0 tx=0x7fb7f000c880 comp rx=0 tx=0).stop 2024-02-19T06:58:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.106+0000 7fb7ffe00640 1 -- 172.21.15.46:0/3192108533 shutdown_connections 2024-02-19T06:58:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.106+0000 7fb7ffe00640 1 --2- 172.21.15.46:0/3192108533 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb7dc06b810 0x7fb7dc06dcd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.106+0000 7fb7ffe00640 1 --2- 172.21.15.46:0/3192108533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb80015d980 0x7fb80015b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.106+0000 7fb7ffe00640 1 --2- 172.21.15.46:0/3192108533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8000d3530 0x7fb80015b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.106+0000 7fb7ffe00640 1 --2- 172.21.15.46:0/3192108533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000b19a0 0x7fb800156780 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.106+0000 7fb7ffe00640 1 -- 172.21.15.46:0/3192108533 >> 172.21.15.46:0/3192108533 conn(0x7fb80009ca60 msgr2=0x7fb8000cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.106+0000 7fb7ffe00640 1 -- 172.21.15.46:0/3192108533 shutdown_connections 2024-02-19T06:58:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.106+0000 7fb7ffe00640 1 -- 172.21.15.46:0/3192108533 wait complete. 2024-02-19T06:58:32.128 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:32.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.357+0000 7f3185a00640 1 Processor -- start 2024-02-19T06:58:32.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.357+0000 7f3185a00640 1 -- start start 2024-02-19T06:58:32.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.358+0000 7f3185a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3180160f50 0x7f31800cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:32.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.358+0000 7f3185a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31800d2330 0x7f31800d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:32.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.358+0000 7f3185a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31800d19f0 con 0x7f31800d0b30 2024-02-19T06:58:32.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.358+0000 7f3185a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31800ceed0 con 0x7f3180160f50 2024-02-19T06:58:32.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.358+0000 7f3185a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31800ce5e0 con 0x7f31800d2330 2024-02-19T06:58:32.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.358+0000 7f317ea00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3180160f50 0x7f31800cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:32.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.358+0000 7f317e000640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f31800d0b30 0x7f31800d1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49182/0 (socket says 172.21.15.46:49182) 2024-02-19T06:58:32.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.358+0000 7f317e000640 1 -- 172.21.15.46:0/967560470 learned_addr learned my addr 172.21.15.46:0/967560470 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:32.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.359+0000 7f317f400640 1 --2- 172.21.15.46:0/967560470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31800d2330 0x7f31800d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:32.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.359+0000 7f317ea00640 1 -- 172.21.15.46:0/967560470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31800d2330 msgr2=0x7f31800d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:32.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.359+0000 7f317ea00640 1 --2- 172.21.15.46:0/967560470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31800d2330 0x7f31800d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.359+0000 7f317ea00640 1 -- 172.21.15.46:0/967560470 >> v1:172.21.15.46:6789/0 conn(0x7f31800d0b30 legacy=0x7f31800d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:32.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.359+0000 7f317ea00640 1 -- 172.21.15.46:0/967560470 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31800d27c0 con 0x7f3180160f50 2024-02-19T06:58:32.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.359+0000 7f317d600640 1 -- 172.21.15.46:0/967560470 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078948120 0 0) 0x7f31800d19f0 con 0x7f31800d0b30 2024-02-19T06:58:32.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.359+0000 7f317f400640 1 --2- 172.21.15.46:0/967560470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31800d2330 0x7f31800d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.360+0000 7f317ea00640 1 --2- 172.21.15.46:0/967560470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3180160f50 0x7f31800cf360 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f31700097a0 tx=0x7f317002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a685b5ad0ea0c302 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.360+0000 7f317d600640 1 -- 172.21.15.46:0/967560470 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170031830 con 0x7f3180160f50 2024-02-19T06:58:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.361+0000 7f317d600640 1 -- 172.21.15.46:0/967560470 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3170031990 con 0x7f3180160f50 2024-02-19T06:58:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.361+0000 7f317d600640 1 -- 172.21.15.46:0/967560470 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170031d20 con 0x7f3180160f50 2024-02-19T06:58:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.361+0000 7f3185a00640 1 -- 172.21.15.46:0/967560470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3180160f50 msgr2=0x7f31800cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.361+0000 7f3185a00640 1 --2- 172.21.15.46:0/967560470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3180160f50 0x7f31800cf360 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f31700097a0 tx=0x7f317002b8d0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.361+0000 7f3185a00640 1 -- 172.21.15.46:0/967560470 shutdown_connections 2024-02-19T06:58:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.361+0000 7f3185a00640 1 --2- 172.21.15.46:0/967560470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31800d2330 0x7f31800d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.361+0000 7f3185a00640 1 --2- 172.21.15.46:0/967560470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3180160f50 0x7f31800cf360 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.361+0000 7f3185a00640 1 -- 172.21.15.46:0/967560470 >> 172.21.15.46:0/967560470 conn(0x7f318008afc0 msgr2=0x7f31800d38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.361+0000 7f3185a00640 1 -- 172.21.15.46:0/967560470 shutdown_connections 2024-02-19T06:58:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.361+0000 7f3185a00640 1 -- 172.21.15.46:0/967560470 wait complete. 2024-02-19T06:58:32.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.363+0000 7f3185a00640 1 Processor -- start 2024-02-19T06:58:32.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.363+0000 7f3185a00640 1 -- start start 2024-02-19T06:58:32.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.364+0000 7f3185a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31800d0b30 0x7f3180154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:32.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.364+0000 7f3185a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31800d2330 0x7f31800b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:32.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.364+0000 7f3185a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3180160f50 0x7f31800b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:32.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.364+0000 7f3185a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3180155360 con 0x7f31800d0b30 2024-02-19T06:58:32.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.364+0000 7f3185a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31800b7fa0 con 0x7f3180160f50 2024-02-19T06:58:32.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.364+0000 7f3185a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31800b8280 con 0x7f31800d2330 2024-02-19T06:58:32.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.365+0000 7f317ea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31800d0b30 0x7f3180154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:32.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.365+0000 7f317ea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31800d0b30 0x7f3180154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35450/0 (socket says 172.21.15.46:35450) 2024-02-19T06:58:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.365+0000 7f317ea00640 1 -- 172.21.15.46:0/260864634 learned_addr learned my addr 172.21.15.46:0/260864634 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.365+0000 7f317e000640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31800d2330 0x7f31800b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.365+0000 7f317f400640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3180160f50 0x7f31800b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.365+0000 7f317ea00640 1 -- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31800d2330 msgr2=0x7f31800b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.365+0000 7f317ea00640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31800d2330 0x7f31800b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.365+0000 7f317ea00640 1 -- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3180160f50 msgr2=0x7f31800b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.365+0000 7f317ea00640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3180160f50 0x7f31800b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.365+0000 7f317ea00640 1 -- 172.21.15.46:0/260864634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3170009400 con 0x7f31800d0b30 2024-02-19T06:58:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.365+0000 7f317ea00640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31800d0b30 0x7f3180154e20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3170034040 tx=0x7f31700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.366+0000 7f3176a00640 1 -- 172.21.15.46:0/260864634 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317003aa60 con 0x7f31800d0b30 2024-02-19T06:58:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.366+0000 7f3176a00640 1 -- 172.21.15.46:0/260864634 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317003abe0 con 0x7f31800d0b30 2024-02-19T06:58:32.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.366+0000 7f3176a00640 1 -- 172.21.15.46:0/260864634 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170044400 con 0x7f31800d0b30 2024-02-19T06:58:32.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.366+0000 7f3185a00640 1 -- 172.21.15.46:0/260864634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31800b8560 con 0x7f31800d0b30 2024-02-19T06:58:32.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.366+0000 7f3185a00640 1 -- 172.21.15.46:0/260864634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31800b8b20 con 0x7f31800d0b30 2024-02-19T06:58:32.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.367+0000 7f3185a00640 1 -- 172.21.15.46:0/260864634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3180067ba0 con 0x7f31800d0b30 2024-02-19T06:58:32.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.368+0000 7f3176a00640 1 -- 172.21.15.46:0/260864634 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f317004d440 con 0x7f31800d0b30 2024-02-19T06:58:32.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.369+0000 7f3176a00640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f316006b860 0x7f316006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:32.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.369+0000 7f3176a00640 1 -- 172.21.15.46:0/260864634 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31700ac2b0 con 0x7f31800d0b30 2024-02-19T06:58:32.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.370+0000 7f317e000640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f316006b860 0x7f316006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:32.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.371+0000 7f317e000640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f316006b860 0x7f316006dd20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f31800b96c0 tx=0x7f316c007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:32.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.380+0000 7f3176a00640 1 -- 172.21.15.46:0/260864634 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3170076d40 con 0x7f31800d0b30 2024-02-19T06:58:32.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.581+0000 7f3185a00640 1 -- 172.21.15.46:0/260864634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31800682b0 con 0x7f31800d0b30 2024-02-19T06:58:32.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.582+0000 7f3176a00640 1 -- 172.21.15.46:0/260864634 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f317007a400 con 0x7f31800d0b30 2024-02-19T06:58:32.583 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:32.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.584+0000 7f3185a00640 1 -- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f316006b860 msgr2=0x7f316006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:32.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.584+0000 7f3185a00640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f316006b860 0x7f316006dd20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f31800b96c0 tx=0x7f316c007d50 comp rx=0 tx=0).stop 2024-02-19T06:58:32.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.584+0000 7f3185a00640 1 -- 172.21.15.46:0/260864634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31800d0b30 msgr2=0x7f3180154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:32.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.584+0000 7f3185a00640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31800d0b30 0x7f3180154e20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3170034040 tx=0x7f31700046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.584+0000 7f3185a00640 1 -- 172.21.15.46:0/260864634 shutdown_connections 2024-02-19T06:58:32.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.584+0000 7f3185a00640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f316006b860 0x7f316006dd20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.584+0000 7f3185a00640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3180160f50 0x7f31800b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.584+0000 7f3185a00640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31800d2330 0x7f31800b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.584+0000 7f3185a00640 1 --2- 172.21.15.46:0/260864634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31800d0b30 0x7f3180154e20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.584+0000 7f3185a00640 1 -- 172.21.15.46:0/260864634 >> 172.21.15.46:0/260864634 conn(0x7f318008afc0 msgr2=0x7f318015eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:32.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.585+0000 7f3185a00640 1 -- 172.21.15.46:0/260864634 shutdown_connections 2024-02-19T06:58:32.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.585+0000 7f3185a00640 1 -- 172.21.15.46:0/260864634 wait complete. 2024-02-19T06:58:32.609 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.833+0000 7f9882200640 1 Processor -- start 2024-02-19T06:58:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.834+0000 7f9882200640 1 -- start start 2024-02-19T06:58:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.835+0000 7f9882200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f987c161600 0x7f987c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.835+0000 7f9882200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c15dcb0 0x7f987c0b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.835+0000 7f9882200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987c0b3bd0 con 0x7f987c0d4120 2024-02-19T06:58:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.835+0000 7f9882200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987c0b3eb0 con 0x7f987c161600 2024-02-19T06:58:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.835+0000 7f9882200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c0b4190 con 0x7f987c15dcb0 2024-02-19T06:58:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.836+0000 7f9880e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f987c161600 0x7f987c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.836+0000 7f9880e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f987c161600 0x7f987c0b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35452/0 (socket says 172.21.15.46:35452) 2024-02-19T06:58:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.836+0000 7f9880e00640 1 -- 172.21.15.46:0/2896391329 learned_addr learned my addr 172.21.15.46:0/2896391329 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:32.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.836+0000 7f987be00640 1 --2- 172.21.15.46:0/2896391329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c15dcb0 0x7f987c0b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:32.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.836+0000 7f9880e00640 1 -- 172.21.15.46:0/2896391329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c15dcb0 msgr2=0x7f987c0b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:32.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.836+0000 7f9880e00640 1 --2- 172.21.15.46:0/2896391329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c15dcb0 0x7f987c0b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.836+0000 7f9880e00640 1 -- 172.21.15.46:0/2896391329 >> v1:172.21.15.46:6789/0 conn(0x7f987c0d4120 legacy=0x7f987c1619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:32.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.836+0000 7f9880e00640 1 -- 172.21.15.46:0/2896391329 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c0b4470 con 0x7f987c161600 2024-02-19T06:58:32.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.836+0000 7f987b400640 1 -- 172.21.15.46:0/2896391329 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820938192 0 0) 0x7f987c0b3bd0 con 0x7f987c0d4120 2024-02-19T06:58:32.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.838+0000 7f9880e00640 1 --2- 172.21.15.46:0/2896391329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f987c161600 0x7f987c0b4c70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f986c009850 tx=0x7f986c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdaaa636c66552b4 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:32.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.838+0000 7f987b400640 1 -- 172.21.15.46:0/2896391329 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c004230 con 0x7f987c161600 2024-02-19T06:58:32.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.838+0000 7f987b400640 1 -- 172.21.15.46:0/2896391329 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c004390 con 0x7f987c161600 2024-02-19T06:58:32.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.838+0000 7f987b400640 1 -- 172.21.15.46:0/2896391329 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c003810 con 0x7f987c161600 2024-02-19T06:58:32.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.838+0000 7f9882200640 1 -- 172.21.15.46:0/2896391329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f987c161600 msgr2=0x7f987c0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:32.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.838+0000 7f9882200640 1 --2- 172.21.15.46:0/2896391329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f987c161600 0x7f987c0b4c70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f986c009850 tx=0x7f986c02b960 comp rx=0 tx=0).stop 2024-02-19T06:58:32.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.839+0000 7f9882200640 1 -- 172.21.15.46:0/2896391329 shutdown_connections 2024-02-19T06:58:32.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.839+0000 7f9882200640 1 --2- 172.21.15.46:0/2896391329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c15dcb0 0x7f987c0b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.839+0000 7f9882200640 1 --2- 172.21.15.46:0/2896391329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f987c161600 0x7f987c0b4c70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.839+0000 7f9882200640 1 -- 172.21.15.46:0/2896391329 >> 172.21.15.46:0/2896391329 conn(0x7f987c08afc0 msgr2=0x7f987c0d36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:32.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.839+0000 7f9882200640 1 -- 172.21.15.46:0/2896391329 shutdown_connections 2024-02-19T06:58:32.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.839+0000 7f9882200640 1 -- 172.21.15.46:0/2896391329 wait complete. 2024-02-19T06:58:32.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.840+0000 7f9882200640 1 Processor -- start 2024-02-19T06:58:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.841+0000 7f9882200640 1 -- start start 2024-02-19T06:58:32.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.841+0000 7f9882200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987c0d4120 0x7f987c0caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:32.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f9882200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f987c15dcb0 0x7f987c154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:32.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f9882200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c161600 0x7f987c0b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:32.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f9882200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c155380 con 0x7f987c15dcb0 2024-02-19T06:58:32.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f9882200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c0cb760 con 0x7f987c0d4120 2024-02-19T06:58:32.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f9882200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c0b91b0 con 0x7f987c161600 2024-02-19T06:58:32.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f987be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f987c15dcb0 0x7f987c154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f987be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f987c15dcb0 0x7f987c154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35460/0 (socket says 172.21.15.46:35460) 2024-02-19T06:58:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f987be00640 1 -- 172.21.15.46:0/2185849856 learned_addr learned my addr 172.21.15.46:0/2185849856 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f987be00640 1 -- 172.21.15.46:0/2185849856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c161600 msgr2=0x7f987c0b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f987be00640 1 --2- 172.21.15.46:0/2185849856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c161600 0x7f987c0b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f987be00640 1 -- 172.21.15.46:0/2185849856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987c0d4120 msgr2=0x7f987c0caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f9880e00640 1 --2- 172.21.15.46:0/2185849856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987c0d4120 0x7f987c0caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f987be00640 1 --2- 172.21.15.46:0/2185849856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987c0d4120 0x7f987c0caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.842+0000 7f987be00640 1 -- 172.21.15.46:0/2185849856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c009460 con 0x7f987c15dcb0 2024-02-19T06:58:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.843+0000 7f987be00640 1 --2- 172.21.15.46:0/2185849856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f987c15dcb0 0x7f987c154e40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f986800d7d0 tx=0x7f986800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.843+0000 7f9878c00640 1 -- 172.21.15.46:0/2185849856 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986800b6c0 con 0x7f987c15dcb0 2024-02-19T06:58:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.843+0000 7f9878c00640 1 -- 172.21.15.46:0/2185849856 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986800b820 con 0x7f987c15dcb0 2024-02-19T06:58:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.843+0000 7f9878c00640 1 -- 172.21.15.46:0/2185849856 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986800bbb0 con 0x7f987c15dcb0 2024-02-19T06:58:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.843+0000 7f9882200640 1 -- 172.21.15.46:0/2185849856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987c0cb480 con 0x7f987c15dcb0 2024-02-19T06:58:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.843+0000 7f9882200640 1 -- 172.21.15.46:0/2185849856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987c0b16e0 con 0x7f987c15dcb0 2024-02-19T06:58:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.844+0000 7f9882200640 1 -- 172.21.15.46:0/2185849856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987c0d3170 con 0x7f987c15dcb0 2024-02-19T06:58:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.845+0000 7f9878c00640 1 -- 172.21.15.46:0/2185849856 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f986800bd10 con 0x7f987c15dcb0 2024-02-19T06:58:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.846+0000 7f9878c00640 1 --2- 172.21.15.46:0/2185849856 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f985c06b810 0x7f985c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.846+0000 7f9878c00640 1 -- 172.21.15.46:0/2185849856 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f986808a650 con 0x7f987c15dcb0 2024-02-19T06:58:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.847+0000 7f9880e00640 1 --2- 172.21.15.46:0/2185849856 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f985c06b810 0x7f985c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:32.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.848+0000 7f9880e00640 1 --2- 172.21.15.46:0/2185849856 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f985c06b810 0x7f985c06dcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f986c035000 tx=0x7f986c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:32.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:32.850+0000 7f9878c00640 1 -- 172.21.15.46:0/2185849856 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9868055100 con 0x7f987c15dcb0 2024-02-19T06:58:33.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.048+0000 7f9882200640 1 -- 172.21.15.46:0/2185849856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f987c08b8e0 con 0x7f987c15dcb0 2024-02-19T06:58:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.049+0000 7f9878c00640 1 -- 172.21.15.46:0/2185849856 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f98680587c0 con 0x7f987c15dcb0 2024-02-19T06:58:33.050 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:33.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.051+0000 7f9882200640 1 -- 172.21.15.46:0/2185849856 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f985c06b810 msgr2=0x7f985c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:33.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.051+0000 7f9882200640 1 --2- 172.21.15.46:0/2185849856 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f985c06b810 0x7f985c06dcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f986c035000 tx=0x7f986c008030 comp rx=0 tx=0).stop 2024-02-19T06:58:33.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.051+0000 7f9882200640 1 -- 172.21.15.46:0/2185849856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f987c15dcb0 msgr2=0x7f987c154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:33.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.051+0000 7f9882200640 1 --2- 172.21.15.46:0/2185849856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f987c15dcb0 0x7f987c154e40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f986800d7d0 tx=0x7f986800dc90 comp rx=0 tx=0).stop 2024-02-19T06:58:33.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.051+0000 7f9882200640 1 -- 172.21.15.46:0/2185849856 shutdown_connections 2024-02-19T06:58:33.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.051+0000 7f9882200640 1 --2- 172.21.15.46:0/2185849856 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f985c06b810 0x7f985c06dcd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.051+0000 7f9882200640 1 --2- 172.21.15.46:0/2185849856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c161600 0x7f987c0b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.051+0000 7f9882200640 1 --2- 172.21.15.46:0/2185849856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f987c15dcb0 0x7f987c154e40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.051+0000 7f9882200640 1 --2- 172.21.15.46:0/2185849856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987c0d4120 0x7f987c0caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.051+0000 7f9882200640 1 -- 172.21.15.46:0/2185849856 >> 172.21.15.46:0/2185849856 conn(0x7f987c08afc0 msgr2=0x7f987c15cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:33.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.051+0000 7f9882200640 1 -- 172.21.15.46:0/2185849856 shutdown_connections 2024-02-19T06:58:33.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.052+0000 7f9882200640 1 -- 172.21.15.46:0/2185849856 wait complete. 2024-02-19T06:58:33.073 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:33.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.289+0000 7fdc9fe00640 1 Processor -- start 2024-02-19T06:58:33.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.290+0000 7fdc9fe00640 1 -- start start 2024-02-19T06:58:33.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.291+0000 7fdc9fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdc98145260 0x7fdc9815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:33.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.291+0000 7fdc9fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdc98071000 0x7fdc980714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:33.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.291+0000 7fdc9fe00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9815ce10 con 0x7fdc9815f440 2024-02-19T06:58:33.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.291+0000 7fdc9fe00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc980719f0 con 0x7fdc98145260 2024-02-19T06:58:33.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.291+0000 7fdc9fe00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc980cbde0 con 0x7fdc98071000 2024-02-19T06:58:33.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.291+0000 7fdc9d400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdc98145260 0x7fdc9815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:33.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.292+0000 7fdc9d400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdc98145260 0x7fdc9815c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35472/0 (socket says 172.21.15.46:35472) 2024-02-19T06:58:33.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.292+0000 7fdc9d400640 1 -- 172.21.15.46:0/135687178 learned_addr learned my addr 172.21.15.46:0/135687178 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.292+0000 7fdc9ca00640 1 --2- 172.21.15.46:0/135687178 >> v2:172.21.15.142:3300/0 conn(0x7fdc98071000 0x7fdc980714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.292+0000 7fdc9d400640 1 -- 172.21.15.46:0/135687178 >> v2:172.21.15.142:3300/0 conn(0x7fdc98071000 msgr2=0x7fdc980714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.292+0000 7fdc9d400640 1 --2- 172.21.15.46:0/135687178 >> v2:172.21.15.142:3300/0 conn(0x7fdc98071000 0x7fdc980714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.292+0000 7fdc9d400640 1 -- 172.21.15.46:0/135687178 >> v1:172.21.15.142:6789/0 conn(0x7fdc9815f440 legacy=0x7fdc9815f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.292+0000 7fdc9d400640 1 -- 172.21.15.46:0/135687178 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc980cc080 con 0x7fdc98145260 2024-02-19T06:58:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.293+0000 7fdc9d400640 1 --2- 172.21.15.46:0/135687178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc98145260 0x7fdc9815c8d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdc980d0260 tx=0x7fdc8c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50efba3991989abd server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.293+0000 7fdc97e00640 1 -- 172.21.15.46:0/135687178 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0317e0 con 0x7fdc98145260 2024-02-19T06:58:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.293+0000 7fdc97e00640 1 -- 172.21.15.46:0/135687178 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c031940 con 0x7fdc98145260 2024-02-19T06:58:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.293+0000 7fdc97e00640 1 -- 172.21.15.46:0/135687178 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c031cd0 con 0x7fdc98145260 2024-02-19T06:58:33.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.294+0000 7fdc9fe00640 1 -- 172.21.15.46:0/135687178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc98145260 msgr2=0x7fdc9815c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:33.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.294+0000 7fdc9fe00640 1 --2- 172.21.15.46:0/135687178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc98145260 0x7fdc9815c8d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdc980d0260 tx=0x7fdc8c02b880 comp rx=0 tx=0).stop 2024-02-19T06:58:33.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.294+0000 7fdc9fe00640 1 -- 172.21.15.46:0/135687178 shutdown_connections 2024-02-19T06:58:33.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.294+0000 7fdc9fe00640 1 --2- 172.21.15.46:0/135687178 >> v2:172.21.15.142:3300/0 conn(0x7fdc98071000 0x7fdc980714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.294+0000 7fdc9fe00640 1 --2- 172.21.15.46:0/135687178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc98145260 0x7fdc9815c8d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.294+0000 7fdc9fe00640 1 -- 172.21.15.46:0/135687178 >> 172.21.15.46:0/135687178 conn(0x7fdc98066f70 msgr2=0x7fdc9806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:33.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.294+0000 7fdc9fe00640 1 -- 172.21.15.46:0/135687178 shutdown_connections 2024-02-19T06:58:33.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.294+0000 7fdc9fe00640 1 -- 172.21.15.46:0/135687178 wait complete. 2024-02-19T06:58:33.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.296+0000 7fdc9fe00640 1 Processor -- start 2024-02-19T06:58:33.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.296+0000 7fdc9fe00640 1 -- start start 2024-02-19T06:58:33.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.297+0000 7fdc9fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc98071000 0x7fdc9813cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:33.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.297+0000 7fdc9fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc98145260 0x7fdc9813d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:33.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.297+0000 7fdc9fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc9815f440 0x7fdc981f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:33.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.297+0000 7fdc9fe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980aefd0 con 0x7fdc9815f440 2024-02-19T06:58:33.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.297+0000 7fdc9fe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980adcd0 con 0x7fdc98145260 2024-02-19T06:58:33.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.297+0000 7fdc9fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980adfb0 con 0x7fdc98071000 2024-02-19T06:58:33.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.297+0000 7fdc9de00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc9815f440 0x7fdc981f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:33.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.297+0000 7fdc9de00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc9815f440 0x7fdc981f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35488/0 (socket says 172.21.15.46:35488) 2024-02-19T06:58:33.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.297+0000 7fdc9de00640 1 -- 172.21.15.46:0/2302957642 learned_addr learned my addr 172.21.15.46:0/2302957642 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:33.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.298+0000 7fdc9d400640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc98071000 0x7fdc9813cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:33.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.298+0000 7fdc9ca00640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc98145260 0x7fdc9813d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.298+0000 7fdc9de00640 1 -- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc98071000 msgr2=0x7fdc9813cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.298+0000 7fdc9de00640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc98071000 0x7fdc9813cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.298+0000 7fdc9de00640 1 -- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc98145260 msgr2=0x7fdc9813d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.298+0000 7fdc9de00640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc98145260 0x7fdc9813d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.298+0000 7fdc9de00640 1 -- 172.21.15.46:0/2302957642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c0094d0 con 0x7fdc9815f440 2024-02-19T06:58:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.298+0000 7fdc9ca00640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc98145260 0x7fdc9813d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.298+0000 7fdc9de00640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc9815f440 0x7fdc981f6ee0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000b990 tx=0x7fdc9000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.298+0000 7fdc95600640 1 -- 172.21.15.46:0/2302957642 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9000cba0 con 0x7fdc9815f440 2024-02-19T06:58:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.298+0000 7fdc95600640 1 -- 172.21.15.46:0/2302957642 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9000cd00 con 0x7fdc9815f440 2024-02-19T06:58:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.298+0000 7fdc95600640 1 -- 172.21.15.46:0/2302957642 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90014680 con 0x7fdc9815f440 2024-02-19T06:58:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.299+0000 7fdc9fe00640 1 -- 172.21.15.46:0/2302957642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc980ae290 con 0x7fdc9815f440 2024-02-19T06:58:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.299+0000 7fdc9fe00640 1 -- 172.21.15.46:0/2302957642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc980ad960 con 0x7fdc9815f440 2024-02-19T06:58:33.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.300+0000 7fdc9fe00640 1 -- 172.21.15.46:0/2302957642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc980af140 con 0x7fdc9815f440 2024-02-19T06:58:33.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.301+0000 7fdc95600640 1 -- 172.21.15.46:0/2302957642 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fdc9001d3b0 con 0x7fdc9815f440 2024-02-19T06:58:33.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.302+0000 7fdc95600640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdc7806b810 0x7fdc7806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:33.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.302+0000 7fdc95600640 1 -- 172.21.15.46:0/2302957642 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc9008a140 con 0x7fdc9815f440 2024-02-19T06:58:33.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.303+0000 7fdc9d400640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdc7806b810 0x7fdc7806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:33.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.304+0000 7fdc9d400640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdc7806b810 0x7fdc7806dcd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c036000 tx=0x7fdc8c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:33.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.307+0000 7fdc95600640 1 -- 172.21.15.46:0/2302957642 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdc980af140 con 0x7fdc9815f440 2024-02-19T06:58:33.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.507+0000 7fdc9fe00640 1 -- 172.21.15.46:0/2302957642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc980af110 con 0x7fdc9815f440 2024-02-19T06:58:33.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.510+0000 7fdc95600640 1 -- 172.21.15.46:0/2302957642 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fdc90054b50 con 0x7fdc9815f440 2024-02-19T06:58:33.512 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:33.512 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:56.828629+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:33.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.513+0000 7fdc9fe00640 1 -- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdc7806b810 msgr2=0x7fdc7806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:33.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.513+0000 7fdc9fe00640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdc7806b810 0x7fdc7806dcd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c036000 tx=0x7fdc8c03d040 comp rx=0 tx=0).stop 2024-02-19T06:58:33.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.513+0000 7fdc9fe00640 1 -- 172.21.15.46:0/2302957642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc9815f440 msgr2=0x7fdc981f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:33.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.513+0000 7fdc9fe00640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc9815f440 0x7fdc981f6ee0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000b990 tx=0x7fdc9000be50 comp rx=0 tx=0).stop 2024-02-19T06:58:33.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.513+0000 7fdc9fe00640 1 -- 172.21.15.46:0/2302957642 shutdown_connections 2024-02-19T06:58:33.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.513+0000 7fdc9fe00640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdc7806b810 0x7fdc7806dcd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.513+0000 7fdc9fe00640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc9815f440 0x7fdc981f6ee0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.513+0000 7fdc9fe00640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc98145260 0x7fdc9813d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.513+0000 7fdc9fe00640 1 --2- 172.21.15.46:0/2302957642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc98071000 0x7fdc9813cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.513+0000 7fdc9fe00640 1 -- 172.21.15.46:0/2302957642 >> 172.21.15.46:0/2302957642 conn(0x7fdc98066f70 msgr2=0x7fdc980cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:33.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.513+0000 7fdc9fe00640 1 -- 172.21.15.46:0/2302957642 shutdown_connections 2024-02-19T06:58:33.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.513+0000 7fdc9fe00640 1 -- 172.21.15.46:0/2302957642 wait complete. 2024-02-19T06:58:33.536 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:33.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:33.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.771+0000 7f0c7bc00640 1 Processor -- start 2024-02-19T06:58:33.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.772+0000 7f0c7bc00640 1 -- start start 2024-02-19T06:58:33.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.773+0000 7f0c7bc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c740cf3d0 0x7f0c740cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:33.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.773+0000 7f0c7bc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7406d680 0x7f0c7406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:33.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.773+0000 7f0c7bc00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c74071e80 con 0x7f0c74145050 2024-02-19T06:58:33.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.773+0000 7f0c7bc00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c74071020 con 0x7f0c740cf3d0 2024-02-19T06:58:33.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.773+0000 7f0c7bc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c740aef70 con 0x7f0c7406d680 2024-02-19T06:58:33.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.774+0000 7f0c73e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c740cf3d0 0x7f0c740cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:33.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.774+0000 7f0c79c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7406d680 0x7f0c7406daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:33.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.774+0000 7f0c79c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7406d680 0x7f0c7406daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:50002/0 (socket says 172.21.15.46:50002) 2024-02-19T06:58:33.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.774+0000 7f0c73e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c740cf3d0 0x7f0c740cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:60646/0 (socket says 172.21.15.46:60646) 2024-02-19T06:58:33.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.774+0000 7f0c79200640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0c74145050 0x7f0c740cc7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:42444/0 (socket says 172.21.15.46:42444) 2024-02-19T06:58:33.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.774+0000 7f0c73e00640 1 -- 172.21.15.46:0/2529641957 learned_addr learned my addr 172.21.15.46:0/2529641957 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:33.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.775+0000 7f0c79c00640 1 -- 172.21.15.46:0/2529641957 >> v2:172.21.15.142:3300/0 conn(0x7f0c740cf3d0 msgr2=0x7f0c740cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:33.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.775+0000 7f0c79c00640 1 --2- 172.21.15.46:0/2529641957 >> v2:172.21.15.142:3300/0 conn(0x7f0c740cf3d0 0x7f0c740cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.775+0000 7f0c79c00640 1 -- 172.21.15.46:0/2529641957 >> v1:172.21.15.142:6789/0 conn(0x7f0c74145050 legacy=0x7f0c740cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:33.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.775+0000 7f0c79c00640 1 -- 172.21.15.46:0/2529641957 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c740cfd70 con 0x7f0c7406d680 2024-02-19T06:58:33.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.777+0000 7f0c79c00640 1 --2- 172.21.15.46:0/2529641957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7406d680 0x7f0c7406daf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009d90 tx=0x7f0c6c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52149deac6c641b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:33.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.777+0000 7f0c73400640 1 -- 172.21.15.46:0/2529641957 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c02cc50 con 0x7f0c7406d680 2024-02-19T06:58:33.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.777+0000 7f0c73400640 1 -- 172.21.15.46:0/2529641957 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c02cdb0 con 0x7f0c7406d680 2024-02-19T06:58:33.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.777+0000 7f0c73400640 1 -- 172.21.15.46:0/2529641957 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c034660 con 0x7f0c7406d680 2024-02-19T06:58:33.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.778+0000 7f0c7bc00640 1 -- 172.21.15.46:0/2529641957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7406d680 msgr2=0x7f0c7406daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:33.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.778+0000 7f0c7bc00640 1 --2- 172.21.15.46:0/2529641957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7406d680 0x7f0c7406daf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009d90 tx=0x7f0c6c02bea0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.778+0000 7f0c7bc00640 1 -- 172.21.15.46:0/2529641957 shutdown_connections 2024-02-19T06:58:33.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.778+0000 7f0c7bc00640 1 --2- 172.21.15.46:0/2529641957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7406d680 0x7f0c7406daf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.778+0000 7f0c7bc00640 1 --2- 172.21.15.46:0/2529641957 >> v2:172.21.15.142:3300/0 conn(0x7f0c740cf3d0 0x7f0c740cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.778+0000 7f0c7bc00640 1 -- 172.21.15.46:0/2529641957 >> 172.21.15.46:0/2529641957 conn(0x7f0c74066fc0 msgr2=0x7f0c7406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:33.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.778+0000 7f0c7bc00640 1 -- 172.21.15.46:0/2529641957 shutdown_connections 2024-02-19T06:58:33.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.778+0000 7f0c7bc00640 1 -- 172.21.15.46:0/2529641957 wait complete. 2024-02-19T06:58:33.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.780+0000 7f0c7bc00640 1 Processor -- start 2024-02-19T06:58:33.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.780+0000 7f0c7bc00640 1 -- start start 2024-02-19T06:58:33.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.781+0000 7f0c7bc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7406d680 0x7f0c740cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:33.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.781+0000 7f0c7bc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c740cf3d0 0x7f0c7415d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:33.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.781+0000 7f0c7bc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c74145050 0x7f0c7415d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:33.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.781+0000 7f0c7bc00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c740ad3c0 con 0x7f0c74145050 2024-02-19T06:58:33.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.781+0000 7f0c7bc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c741305c0 con 0x7f0c7406d680 2024-02-19T06:58:33.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.781+0000 7f0c7bc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c740a9110 con 0x7f0c740cf3d0 2024-02-19T06:58:33.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.782+0000 7f0c79c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c74145050 0x7f0c7415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:33.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.782+0000 7f0c79c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c74145050 0x7f0c7415d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35490/0 (socket says 172.21.15.46:35490) 2024-02-19T06:58:33.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.782+0000 7f0c79c00640 1 -- 172.21.15.46:0/1881625053 learned_addr learned my addr 172.21.15.46:0/1881625053 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:33.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.782+0000 7f0c79200640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7406d680 0x7f0c740cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:33.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.782+0000 7f0c73e00640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c740cf3d0 0x7f0c7415d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:33.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.782+0000 7f0c79c00640 1 -- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c740cf3d0 msgr2=0x7f0c7415d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:33.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.782+0000 7f0c79c00640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c740cf3d0 0x7f0c7415d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.782+0000 7f0c79c00640 1 -- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7406d680 msgr2=0x7f0c740cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:33.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.782+0000 7f0c79c00640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7406d680 0x7f0c740cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.782+0000 7f0c79c00640 1 -- 172.21.15.46:0/1881625053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c009a70 con 0x7f0c74145050 2024-02-19T06:58:33.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.782+0000 7f0c79200640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7406d680 0x7f0c740cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:33.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.783+0000 7f0c79c00640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c74145050 0x7f0c7415d890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009d90 tx=0x7f0c6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:33.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.783+0000 7f0c70c00640 1 -- 172.21.15.46:0/1881625053 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c040650 con 0x7f0c74145050 2024-02-19T06:58:33.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.783+0000 7f0c70c00640 1 -- 172.21.15.46:0/1881625053 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c0407b0 con 0x7f0c74145050 2024-02-19T06:58:33.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.783+0000 7f0c70c00640 1 -- 172.21.15.46:0/1881625053 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c040b60 con 0x7f0c74145050 2024-02-19T06:58:33.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.783+0000 7f0c7bc00640 1 -- 172.21.15.46:0/1881625053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c740a93f0 con 0x7f0c74145050 2024-02-19T06:58:33.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.783+0000 7f0c7bc00640 1 -- 172.21.15.46:0/1881625053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c74130250 con 0x7f0c74145050 2024-02-19T06:58:33.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.784+0000 7f0c7bc00640 1 -- 172.21.15.46:0/1881625053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c74130730 con 0x7f0c74145050 2024-02-19T06:58:33.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.785+0000 7f0c70c00640 1 -- 172.21.15.46:0/1881625053 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0c6c040cc0 con 0x7f0c74145050 2024-02-19T06:58:33.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.786+0000 7f0c70c00640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0c5406b810 0x7f0c5406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:33.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.786+0000 7f0c70c00640 1 -- 172.21.15.46:0/1881625053 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c6c0acfd0 con 0x7f0c74145050 2024-02-19T06:58:33.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.787+0000 7f0c79200640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0c5406b810 0x7f0c5406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:33.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.788+0000 7f0c79200640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0c5406b810 0x7f0c5406dcd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0c68000f60 tx=0x7f0c68007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:33.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.793+0000 7f0c70c00640 1 -- 172.21.15.46:0/1881625053 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0c6c077a80 con 0x7f0c74145050 2024-02-19T06:58:33.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.992+0000 7f0c7bc00640 1 -- 172.21.15.46:0/1881625053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c74067ba0 con 0x7f0c74145050 2024-02-19T06:58:33.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.993+0000 7f0c70c00640 1 -- 172.21.15.46:0/1881625053 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c6c039020 con 0x7f0c74145050 2024-02-19T06:58:33.994 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:33.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.995+0000 7f0c7bc00640 1 -- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0c5406b810 msgr2=0x7f0c5406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:33.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.995+0000 7f0c7bc00640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0c5406b810 0x7f0c5406dcd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0c68000f60 tx=0x7f0c68007ce0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.995+0000 7f0c7bc00640 1 -- 172.21.15.46:0/1881625053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c74145050 msgr2=0x7f0c7415d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:33.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.995+0000 7f0c7bc00640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c74145050 0x7f0c7415d890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009d90 tx=0x7f0c6c004a40 comp rx=0 tx=0).stop 2024-02-19T06:58:33.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.995+0000 7f0c7bc00640 1 -- 172.21.15.46:0/1881625053 shutdown_connections 2024-02-19T06:58:33.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.995+0000 7f0c7bc00640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f0c5406b810 0x7f0c5406dcd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.995+0000 7f0c7bc00640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c74145050 0x7f0c7415d890 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.995+0000 7f0c7bc00640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c740cf3d0 0x7f0c7415d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.995+0000 7f0c7bc00640 1 --2- 172.21.15.46:0/1881625053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7406d680 0x7f0c740cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:33.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.995+0000 7f0c7bc00640 1 -- 172.21.15.46:0/1881625053 >> 172.21.15.46:0/1881625053 conn(0x7f0c74066fc0 msgr2=0x7f0c740afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:33.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.995+0000 7f0c7bc00640 1 -- 172.21.15.46:0/1881625053 shutdown_connections 2024-02-19T06:58:33.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:33.996+0000 7f0c7bc00640 1 -- 172.21.15.46:0/1881625053 wait complete. 2024-02-19T06:58:34.016 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:34.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.250+0000 7fba98a00640 1 Processor -- start 2024-02-19T06:58:34.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.251+0000 7fba98a00640 1 -- start start 2024-02-19T06:58:34.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.252+0000 7fba98a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fba94155b20 0x7fba940cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.252+0000 7fba98a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba940b2bf0 0x7fba9406d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.252+0000 7fba98a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9415be60 con 0x7fba940cfa70 2024-02-19T06:58:34.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.252+0000 7fba98a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba940cff00 con 0x7fba94155b20 2024-02-19T06:58:34.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.252+0000 7fba98a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9415c140 con 0x7fba940b2bf0 2024-02-19T06:58:34.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.252+0000 7fba92a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fba940cfa70 0x7fba940b24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49204/0 (socket says 172.21.15.46:49204) 2024-02-19T06:58:34.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.252+0000 7fba92a00640 1 -- 172.21.15.46:0/1550496098 learned_addr learned my addr 172.21.15.46:0/1550496098 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.253+0000 7fba93e00640 1 --2- 172.21.15.46:0/1550496098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba940b2bf0 0x7fba9406d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.253+0000 7fba93400640 1 --2- 172.21.15.46:0/1550496098 >> v2:172.21.15.142:3300/0 conn(0x7fba94155b20 0x7fba940cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.253+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196239807 0 0) 0x7fba9415be60 con 0x7fba940cfa70 2024-02-19T06:58:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.253+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba78003520 con 0x7fba940cfa70 2024-02-19T06:58:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.253+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3049457183 0 0) 0x7fba78003520 con 0x7fba940cfa70 2024-02-19T06:58:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.253+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba940b2bf0 msgr2=0x7fba9406d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.253+0000 7fba92000640 1 --2- 172.21.15.46:0/1550496098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba940b2bf0 0x7fba9406d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.253+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 >> v2:172.21.15.142:3300/0 conn(0x7fba94155b20 msgr2=0x7fba940cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.253+0000 7fba92000640 1 --2- 172.21.15.46:0/1550496098 >> v2:172.21.15.142:3300/0 conn(0x7fba94155b20 0x7fba940cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.253+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9415c420 con 0x7fba940cfa70 2024-02-19T06:58:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.253+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fba7c001670 con 0x7fba940cfa70 2024-02-19T06:58:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.254+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 >> v1:172.21.15.46:6789/0 conn(0x7fba940cfa70 legacy=0x7fba940b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.254+0000 7fba92000640 1 --2- 172.21.15.46:0/1550496098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba78003970 0x7fba78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.254+0000 7fba92000640 1 --2- 172.21.15.46:0/1550496098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba940b2bf0 0x7fba780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.254+0000 7fba92000640 1 --2- 172.21.15.46:0/1550496098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba78004d00 0x7fba78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.254+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba940cff00 con 0x7fba78004d00 2024-02-19T06:58:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.254+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9415c140 con 0x7fba78003970 2024-02-19T06:58:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.254+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7800b9b0 con 0x7fba940b2bf0 2024-02-19T06:58:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.254+0000 7fba93e00640 1 --2- 172.21.15.46:0/1550496098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba78004d00 0x7fba78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.254+0000 7fba92a00640 1 --2- 172.21.15.46:0/1550496098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba940b2bf0 0x7fba780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.254+0000 7fba93400640 1 --2- 172.21.15.46:0/1550496098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba78003970 0x7fba78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.255+0000 7fba93e00640 1 -- 172.21.15.46:0/1550496098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba940b2bf0 msgr2=0x7fba780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.255+0000 7fba93e00640 1 --2- 172.21.15.46:0/1550496098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba940b2bf0 0x7fba780047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.255+0000 7fba93e00640 1 -- 172.21.15.46:0/1550496098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba78003970 msgr2=0x7fba78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.255+0000 7fba93e00640 1 --2- 172.21.15.46:0/1550496098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba78003970 0x7fba78003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.255+0000 7fba93e00640 1 -- 172.21.15.46:0/1550496098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78003520 con 0x7fba78004d00 2024-02-19T06:58:34.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.256+0000 7fba93e00640 1 --2- 172.21.15.46:0/1550496098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba78004d00 0x7fba78005180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009ac0 tx=0x7fba780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38564e7bf31ce0ee server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:34.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.256+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c02c6b0 con 0x7fba78004d00 2024-02-19T06:58:34.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.256+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c02c810 con 0x7fba78004d00 2024-02-19T06:58:34.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.256+0000 7fba92000640 1 -- 172.21.15.46:0/1550496098 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c02cba0 con 0x7fba78004d00 2024-02-19T06:58:34.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.256+0000 7fba98a00640 1 -- 172.21.15.46:0/1550496098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba78004d00 msgr2=0x7fba78005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:34.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.256+0000 7fba98a00640 1 --2- 172.21.15.46:0/1550496098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba78004d00 0x7fba78005180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009ac0 tx=0x7fba780057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.257+0000 7fba93e00640 1 -- 172.21.15.46:0/1550496098 reap_dead start 2024-02-19T06:58:34.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.257+0000 7fba98a00640 1 -- 172.21.15.46:0/1550496098 shutdown_connections 2024-02-19T06:58:34.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.257+0000 7fba98a00640 1 -- 172.21.15.46:0/1550496098 >> 172.21.15.46:0/1550496098 conn(0x7fba9406ad60 msgr2=0x7fba9406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:34.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.257+0000 7fba98a00640 1 -- 172.21.15.46:0/1550496098 shutdown_connections 2024-02-19T06:58:34.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.257+0000 7fba98a00640 1 -- 172.21.15.46:0/1550496098 wait complete. 2024-02-19T06:58:34.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.259+0000 7fba98a00640 1 Processor -- start 2024-02-19T06:58:34.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.259+0000 7fba98a00640 1 -- start start 2024-02-19T06:58:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.260+0000 7fba98a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba78004d00 0x7fba940cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.260+0000 7fba98a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba94098760 0x7fba940adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.260+0000 7fba98a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba940ca990 0x7fba940cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.260+0000 7fba98a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba941f4be0 con 0x7fba940ca990 2024-02-19T06:58:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.260+0000 7fba98a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba941f4ec0 con 0x7fba78004d00 2024-02-19T06:58:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.260+0000 7fba98a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba941f51a0 con 0x7fba94098760 2024-02-19T06:58:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.261+0000 7fba93e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba940ca990 0x7fba940cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.261+0000 7fba93e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba940ca990 0x7fba940cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35508/0 (socket says 172.21.15.46:35508) 2024-02-19T06:58:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.261+0000 7fba93e00640 1 -- 172.21.15.46:0/1469466200 learned_addr learned my addr 172.21.15.46:0/1469466200 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.261+0000 7fba92a00640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba94098760 0x7fba940adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.261+0000 7fba93400640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba78004d00 0x7fba940cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.261+0000 7fba93e00640 1 -- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba94098760 msgr2=0x7fba940adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.261+0000 7fba93e00640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba94098760 0x7fba940adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.261+0000 7fba93e00640 1 -- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba78004d00 msgr2=0x7fba940cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.261+0000 7fba93e00640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba78004d00 0x7fba940cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.261+0000 7fba93e00640 1 -- 172.21.15.46:0/1469466200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba941f5480 con 0x7fba940ca990 2024-02-19T06:58:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.261+0000 7fba93e00640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba940ca990 0x7fba940cae10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009ac0 tx=0x7fba8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.262+0000 7fba8b400640 1 -- 172.21.15.46:0/1469466200 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c003810 con 0x7fba940ca990 2024-02-19T06:58:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.262+0000 7fba8b400640 1 -- 172.21.15.46:0/1469466200 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c003990 con 0x7fba940ca990 2024-02-19T06:58:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.262+0000 7fba8b400640 1 -- 172.21.15.46:0/1469466200 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c003d40 con 0x7fba940ca990 2024-02-19T06:58:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.262+0000 7fba98a00640 1 -- 172.21.15.46:0/1469466200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba941f5760 con 0x7fba940ca990 2024-02-19T06:58:34.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.262+0000 7fba98a00640 1 -- 172.21.15.46:0/1469466200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba940cb350 con 0x7fba940ca990 2024-02-19T06:58:34.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.263+0000 7fba98a00640 1 -- 172.21.15.46:0/1469466200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9404eee0 con 0x7fba940ca990 2024-02-19T06:58:34.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.264+0000 7fba8b400640 1 -- 172.21.15.46:0/1469466200 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fba8c03e440 con 0x7fba940ca990 2024-02-19T06:58:34.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.265+0000 7fba8b400640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fba7006b840 0x7fba7006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.265+0000 7fba8b400640 1 -- 172.21.15.46:0/1469466200 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba8c0ab1c0 con 0x7fba940ca990 2024-02-19T06:58:34.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.266+0000 7fba93400640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fba7006b840 0x7fba7006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.267+0000 7fba93400640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fba7006b840 0x7fba7006dd00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fba840074a0 tx=0x7fba8400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:34.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.270+0000 7fba8b400640 1 -- 172.21.15.46:0/1469466200 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fba8c075bd0 con 0x7fba940ca990 2024-02-19T06:58:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.467+0000 7fba98a00640 1 -- 172.21.15.46:0/1469466200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba941528a0 con 0x7fba940ca990 2024-02-19T06:58:34.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.467+0000 7fba8b400640 1 -- 172.21.15.46:0/1469466200 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba8c079290 con 0x7fba940ca990 2024-02-19T06:58:34.686 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.470+0000 7fba98a00640 1 -- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fba7006b840 msgr2=0x7fba7006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.470+0000 7fba98a00640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fba7006b840 0x7fba7006dd00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fba840074a0 tx=0x7fba8400b040 comp rx=0 tx=0).stop 2024-02-19T06:58:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.470+0000 7fba98a00640 1 -- 172.21.15.46:0/1469466200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba940ca990 msgr2=0x7fba940cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.470+0000 7fba98a00640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba940ca990 0x7fba940cae10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009ac0 tx=0x7fba8c004730 comp rx=0 tx=0).stop 2024-02-19T06:58:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.470+0000 7fba98a00640 1 -- 172.21.15.46:0/1469466200 shutdown_connections 2024-02-19T06:58:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.470+0000 7fba98a00640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fba7006b840 0x7fba7006dd00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.470+0000 7fba98a00640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba940ca990 0x7fba940cae10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.470+0000 7fba98a00640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba94098760 0x7fba940adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.470+0000 7fba98a00640 1 --2- 172.21.15.46:0/1469466200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba78004d00 0x7fba940cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.470+0000 7fba98a00640 1 -- 172.21.15.46:0/1469466200 >> 172.21.15.46:0/1469466200 conn(0x7fba9406ad60 msgr2=0x7fba9415e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.470+0000 7fba98a00640 1 -- 172.21.15.46:0/1469466200 shutdown_connections 2024-02-19T06:58:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.470+0000 7fba98a00640 1 -- 172.21.15.46:0/1469466200 wait complete. 2024-02-19T06:58:34.688 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:34.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.920+0000 7f1f90e00640 1 Processor -- start 2024-02-19T06:58:34.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.921+0000 7f1f90e00640 1 -- start start 2024-02-19T06:58:34.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.922+0000 7f1f90e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f8c0c22e0 0x7f1f8c0c2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.922+0000 7f1f90e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f8c0cd340 0x7f1f8c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.922+0000 7f1f90e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8c06cef0 con 0x7f1f8c161c20 2024-02-19T06:58:34.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.922+0000 7f1f90e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8c06dd50 con 0x7f1f8c0cd340 2024-02-19T06:58:34.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.922+0000 7f1f90e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0c2c60 con 0x7f1f8c0c22e0 2024-02-19T06:58:34.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.922+0000 7f1f8b400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1f8c161c20 0x7f1f8c0b2bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49210/0 (socket says 172.21.15.46:49210) 2024-02-19T06:58:34.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.922+0000 7f1f8b400640 1 -- 172.21.15.46:0/334978277 learned_addr learned my addr 172.21.15.46:0/334978277 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:34.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.922+0000 7f1f8be00640 1 --2- 172.21.15.46:0/334978277 >> v2:172.21.15.46:3300/0 conn(0x7f1f8c0cd340 0x7f1f8c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.923+0000 7f1f83e00640 1 --2- 172.21.15.46:0/334978277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f8c0c22e0 0x7f1f8c0c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.923+0000 7f1f8aa00640 1 -- 172.21.15.46:0/334978277 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507587375 0 0) 0x7f1f8c06cef0 con 0x7f1f8c161c20 2024-02-19T06:58:34.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.923+0000 7f1f8aa00640 1 -- 172.21.15.46:0/334978277 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f70003520 con 0x7f1f8c161c20 2024-02-19T06:58:34.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.923+0000 7f1f8be00640 1 -- 172.21.15.46:0/334978277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f8c0c22e0 msgr2=0x7f1f8c0c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:34.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.923+0000 7f1f8be00640 1 --2- 172.21.15.46:0/334978277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f8c0c22e0 0x7f1f8c0c2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.923+0000 7f1f8be00640 1 -- 172.21.15.46:0/334978277 >> v1:172.21.15.46:6789/0 conn(0x7f1f8c161c20 legacy=0x7f1f8c0b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:34.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.923+0000 7f1f8be00640 1 -- 172.21.15.46:0/334978277 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c0cefd0 con 0x7f1f8c0cd340 2024-02-19T06:58:34.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.923+0000 7f1f83e00640 1 --2- 172.21.15.46:0/334978277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f8c0c22e0 0x7f1f8c0c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:34.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.924+0000 7f1f8be00640 1 --2- 172.21.15.46:0/334978277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8c0cd340 0x7f1f8c0cd7d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009d90 tx=0x7f1f8402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6161591976bd385b server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:34.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.924+0000 7f1f8aa00640 1 -- 172.21.15.46:0/334978277 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8402cce0 con 0x7f1f8c0cd340 2024-02-19T06:58:34.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.925+0000 7f1f8aa00640 1 -- 172.21.15.46:0/334978277 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8402ce40 con 0x7f1f8c0cd340 2024-02-19T06:58:34.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.925+0000 7f1f8aa00640 1 -- 172.21.15.46:0/334978277 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84034640 con 0x7f1f8c0cd340 2024-02-19T06:58:34.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.925+0000 7f1f90e00640 1 -- 172.21.15.46:0/334978277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8c0cd340 msgr2=0x7f1f8c0cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.925+0000 7f1f90e00640 1 --2- 172.21.15.46:0/334978277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8c0cd340 0x7f1f8c0cd7d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009d90 tx=0x7f1f8402bf30 comp rx=0 tx=0).stop 2024-02-19T06:58:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.925+0000 7f1f90e00640 1 -- 172.21.15.46:0/334978277 shutdown_connections 2024-02-19T06:58:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.925+0000 7f1f90e00640 1 --2- 172.21.15.46:0/334978277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8c0cd340 0x7f1f8c0cd7d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.925+0000 7f1f90e00640 1 --2- 172.21.15.46:0/334978277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f8c0c22e0 0x7f1f8c0c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.925+0000 7f1f90e00640 1 -- 172.21.15.46:0/334978277 >> 172.21.15.46:0/334978277 conn(0x7f1f8c06ad60 msgr2=0x7f1f8c06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.925+0000 7f1f90e00640 1 -- 172.21.15.46:0/334978277 shutdown_connections 2024-02-19T06:58:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.925+0000 7f1f90e00640 1 -- 172.21.15.46:0/334978277 wait complete. 2024-02-19T06:58:34.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.927+0000 7f1f90e00640 1 Processor -- start 2024-02-19T06:58:34.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.927+0000 7f1f90e00640 1 -- start start 2024-02-19T06:58:34.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.928+0000 7f1f90e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8c0c22e0 0x7f1f8c164630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.928+0000 7f1f90e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f8c0cd340 0x7f1f8c0c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.928+0000 7f1f90e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f8c161c20 0x7f1f8c0ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.928+0000 7f1f90e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0c5da0 con 0x7f1f8c0c22e0 2024-02-19T06:58:34.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.928+0000 7f1f90e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0c6e90 con 0x7f1f8c0cd340 2024-02-19T06:58:34.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.928+0000 7f1f90e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0cb5a0 con 0x7f1f8c161c20 2024-02-19T06:58:34.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.928+0000 7f1f8b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8c0c22e0 0x7f1f8c164630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.929+0000 7f1f8b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8c0c22e0 0x7f1f8c164630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35522/0 (socket says 172.21.15.46:35522) 2024-02-19T06:58:34.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.929+0000 7f1f8b400640 1 -- 172.21.15.46:0/3027332288 learned_addr learned my addr 172.21.15.46:0/3027332288 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:34.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.929+0000 7f1f8be00640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f8c161c20 0x7f1f8c0ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.929+0000 7f1f83e00640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f8c0cd340 0x7f1f8c0c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.929+0000 7f1f8b400640 1 -- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f8c161c20 msgr2=0x7f1f8c0ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:34.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.929+0000 7f1f8b400640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f8c161c20 0x7f1f8c0ca650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.929+0000 7f1f8b400640 1 -- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f8c0cd340 msgr2=0x7f1f8c0c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:34.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.929+0000 7f1f8b400640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f8c0cd340 0x7f1f8c0c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:34.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.929+0000 7f1f8b400640 1 -- 172.21.15.46:0/3027332288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f84009a70 con 0x7f1f8c0c22e0 2024-02-19T06:58:34.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.929+0000 7f1f8b400640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8c0c22e0 0x7f1f8c164630 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00c390 tx=0x7f1f7c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:34.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.930+0000 7f1f83400640 1 -- 172.21.15.46:0/3027332288 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c005ce0 con 0x7f1f8c0c22e0 2024-02-19T06:58:34.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.930+0000 7f1f83400640 1 -- 172.21.15.46:0/3027332288 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c005e40 con 0x7f1f8c0c22e0 2024-02-19T06:58:34.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.930+0000 7f1f83400640 1 -- 172.21.15.46:0/3027332288 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0072f0 con 0x7f1f8c0c22e0 2024-02-19T06:58:34.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.930+0000 7f1f90e00640 1 -- 172.21.15.46:0/3027332288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8c0c7320 con 0x7f1f8c0c22e0 2024-02-19T06:58:34.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.930+0000 7f1f90e00640 1 -- 172.21.15.46:0/3027332288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8c0c6560 con 0x7f1f8c0c22e0 2024-02-19T06:58:34.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.931+0000 7f1f90e00640 1 -- 172.21.15.46:0/3027332288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8c04eee0 con 0x7f1f8c0c22e0 2024-02-19T06:58:34.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.932+0000 7f1f83400640 1 -- 172.21.15.46:0/3027332288 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1f7c007450 con 0x7f1f8c0c22e0 2024-02-19T06:58:34.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.933+0000 7f1f83400640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1f6806b810 0x7f1f6806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:34.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.933+0000 7f1f83400640 1 -- 172.21.15.46:0/3027332288 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f7c089790 con 0x7f1f8c0c22e0 2024-02-19T06:58:34.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.933+0000 7f1f83e00640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1f6806b810 0x7f1f6806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:34.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.935+0000 7f1f83e00640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1f6806b810 0x7f1f6806dcd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1f74006fd0 tx=0x7f1f74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:34.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:34.938+0000 7f1f83400640 1 -- 172.21.15.46:0/3027332288 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1f7c0541a0 con 0x7f1f8c0c22e0 2024-02-19T06:58:35.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.135+0000 7f1f90e00640 1 -- 172.21.15.46:0/3027332288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f8c0ae1b0 con 0x7f1f8c0c22e0 2024-02-19T06:58:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.136+0000 7f1f83400640 1 -- 172.21.15.46:0/3027332288 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f7c017020 con 0x7f1f8c0c22e0 2024-02-19T06:58:35.138 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.139+0000 7f1f90e00640 1 -- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1f6806b810 msgr2=0x7f1f6806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.139+0000 7f1f90e00640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1f6806b810 0x7f1f6806dcd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1f74006fd0 tx=0x7f1f74008040 comp rx=0 tx=0).stop 2024-02-19T06:58:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.139+0000 7f1f90e00640 1 -- 172.21.15.46:0/3027332288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8c0c22e0 msgr2=0x7f1f8c164630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.139+0000 7f1f90e00640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8c0c22e0 0x7f1f8c164630 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00c390 tx=0x7f1f7c00c850 comp rx=0 tx=0).stop 2024-02-19T06:58:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.139+0000 7f1f90e00640 1 -- 172.21.15.46:0/3027332288 shutdown_connections 2024-02-19T06:58:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.139+0000 7f1f90e00640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1f6806b810 0x7f1f6806dcd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.139+0000 7f1f90e00640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f8c161c20 0x7f1f8c0ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.139+0000 7f1f90e00640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f8c0cd340 0x7f1f8c0c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.139+0000 7f1f90e00640 1 --2- 172.21.15.46:0/3027332288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f8c0c22e0 0x7f1f8c164630 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.139+0000 7f1f90e00640 1 -- 172.21.15.46:0/3027332288 >> 172.21.15.46:0/3027332288 conn(0x7f1f8c06ad60 msgr2=0x7f1f8c0b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.139+0000 7f1f90e00640 1 -- 172.21.15.46:0/3027332288 shutdown_connections 2024-02-19T06:58:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.139+0000 7f1f90e00640 1 -- 172.21.15.46:0/3027332288 wait complete. 2024-02-19T06:58:35.172 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-19T06:58:35.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:35.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.397+0000 7f92aac00640 1 Processor -- start 2024-02-19T06:58:35.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.397+0000 7f92aac00640 1 -- start start 2024-02-19T06:58:35.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.398+0000 7f92aac00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f92a4166550 0x7f92a406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.398+0000 7f92aac00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a41660c0 con 0x7f92a40c4560 2024-02-19T06:58:35.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.398+0000 7f92aac00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a406c350 con 0x7f92a4162df0 2024-02-19T06:58:35.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.398+0000 7f92aac00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a4165a70 con 0x7f92a4166550 2024-02-19T06:58:35.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.399+0000 7f92a9800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f92a40c4560 0x7f92a40c4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54878/0 (socket says 172.21.15.46:54878) 2024-02-19T06:58:35.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.399+0000 7f92a9800640 1 -- 172.21.15.46:0/4247512386 learned_addr learned my addr 172.21.15.46:0/4247512386 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:35.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.399+0000 7f92a8e00640 1 --2- 172.21.15.46:0/4247512386 >> v2:172.21.15.142:3300/0 conn(0x7f92a4166550 0x7f92a406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.399+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497257057 0 0) 0x7f92a41660c0 con 0x7f92a40c4560 2024-02-19T06:58:35.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.399+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f928c003520 con 0x7f92a40c4560 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2562047617 0 0) 0x7f928c003520 con 0x7f92a40c4560 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 >> v2:172.21.15.142:3300/0 conn(0x7f92a4166550 msgr2=0x7f92a406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a3e00640 1 --2- 172.21.15.46:0/4247512386 >> v2:172.21.15.142:3300/0 conn(0x7f92a4166550 0x7f92a406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 >> v1:172.21.15.142:6789/0 conn(0x7f92a4162df0 legacy=0x7f92a40cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a4165d50 con 0x7f92a40c4560 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f9298001670 con 0x7f92a40c4560 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 >> v1:172.21.15.46:6789/0 conn(0x7f92a40c4560 legacy=0x7f92a40c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a3e00640 1 --2- 172.21.15.46:0/4247512386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f928c0039c0 0x7f928c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a3e00640 1 --2- 172.21.15.46:0/4247512386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928c0047c0 0x7f928c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a3e00640 1 --2- 172.21.15.46:0/4247512386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928c0051d0 0x7f928c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a4165a70 con 0x7f928c0047c0 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c00c120 con 0x7f928c0051d0 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c00c2e0 con 0x7f928c0039c0 2024-02-19T06:58:35.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.400+0000 7f92a8e00640 1 --2- 172.21.15.46:0/4247512386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928c0047c0 0x7f928c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.401+0000 7f92aa200640 1 --2- 172.21.15.46:0/4247512386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928c0051d0 0x7f928c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.401+0000 7f92a9800640 1 --2- 172.21.15.46:0/4247512386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f928c0039c0 0x7f928c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.401+0000 7f92a8e00640 1 -- 172.21.15.46:0/4247512386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f928c0039c0 msgr2=0x7f928c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:35.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.401+0000 7f92a8e00640 1 --2- 172.21.15.46:0/4247512386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f928c0039c0 0x7f928c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.401+0000 7f92a8e00640 1 -- 172.21.15.46:0/4247512386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928c0051d0 msgr2=0x7f928c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:35.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.401+0000 7f92a8e00640 1 --2- 172.21.15.46:0/4247512386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928c0051d0 0x7f928c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.401+0000 7f92a8e00640 1 -- 172.21.15.46:0/4247512386 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c003520 con 0x7f928c0047c0 2024-02-19T06:58:35.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.401+0000 7f92aa200640 1 -- 172.21.15.46:0/4247512386 reap_dead start 2024-02-19T06:58:35.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.401+0000 7f92a9800640 1 --2- 172.21.15.46:0/4247512386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f928c0039c0 0x7f928c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:35.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.402+0000 7f92a8e00640 1 --2- 172.21.15.46:0/4247512386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928c0047c0 0x7f928c004c40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9294009a90 tx=0x7f928c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d225ae4607182ad server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:35.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.402+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929402c680 con 0x7f928c0047c0 2024-02-19T06:58:35.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.402+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929402c7e0 con 0x7f928c0047c0 2024-02-19T06:58:35.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.402+0000 7f92a3e00640 1 -- 172.21.15.46:0/4247512386 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929402cb70 con 0x7f928c0047c0 2024-02-19T06:58:35.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.403+0000 7f92aac00640 1 -- 172.21.15.46:0/4247512386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928c0047c0 msgr2=0x7f928c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.403+0000 7f92aac00640 1 --2- 172.21.15.46:0/4247512386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928c0047c0 0x7f928c004c40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9294009a90 tx=0x7f928c0057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.403+0000 7f92aac00640 1 -- 172.21.15.46:0/4247512386 shutdown_connections 2024-02-19T06:58:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.403+0000 7f92aac00640 1 --2- 172.21.15.46:0/4247512386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928c0047c0 0x7f928c004c40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.403+0000 7f92aac00640 1 -- 172.21.15.46:0/4247512386 >> 172.21.15.46:0/4247512386 conn(0x7f92a40b3080 msgr2=0x7f92a40b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.403+0000 7f92aac00640 1 -- 172.21.15.46:0/4247512386 shutdown_connections 2024-02-19T06:58:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.403+0000 7f92aac00640 1 -- 172.21.15.46:0/4247512386 wait complete. 2024-02-19T06:58:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.405+0000 7f92aac00640 1 Processor -- start 2024-02-19T06:58:35.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.405+0000 7f92aac00640 1 -- start start 2024-02-19T06:58:35.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.406+0000 7f92aac00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928c0047c0 0x7f92a40c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.406+0000 7f92aac00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92a415ade0 0x7f92a40cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.406+0000 7f92aac00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92a40cf5a0 0x7f92a406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.406+0000 7f92aac00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a415bcc0 con 0x7f928c0047c0 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.406+0000 7f92aac00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a415b260 con 0x7f92a415ade0 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.406+0000 7f92aac00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a40cfbd0 con 0x7f92a40cf5a0 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.406+0000 7f92a9800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928c0047c0 0x7f92a40c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.407+0000 7f92a9800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928c0047c0 0x7f92a40c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60286/0 (socket says 172.21.15.46:60286) 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.407+0000 7f92a9800640 1 -- 172.21.15.46:0/4141428781 learned_addr learned my addr 172.21.15.46:0/4141428781 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.407+0000 7f92a8e00640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92a415ade0 0x7f92a40cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.407+0000 7f92aa200640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92a40cf5a0 0x7f92a406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.407+0000 7f92a9800640 1 -- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92a40cf5a0 msgr2=0x7f92a406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.407+0000 7f92a9800640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92a40cf5a0 0x7f92a406f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.407+0000 7f92a9800640 1 -- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92a415ade0 msgr2=0x7f92a40cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.407+0000 7f92a9800640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92a415ade0 0x7f92a40cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.407+0000 7f92a9800640 1 -- 172.21.15.46:0/4141428781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a40cfeb0 con 0x7f928c0047c0 2024-02-19T06:58:35.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.407+0000 7f92a9800640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928c0047c0 0x7f92a40c62e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f929800d770 tx=0x7f929800db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:35.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.408+0000 7f92a1600640 1 -- 172.21.15.46:0/4141428781 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980072d0 con 0x7f928c0047c0 2024-02-19T06:58:35.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.408+0000 7f92a1600640 1 -- 172.21.15.46:0/4141428781 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9298007430 con 0x7f928c0047c0 2024-02-19T06:58:35.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.408+0000 7f92a1600640 1 -- 172.21.15.46:0/4141428781 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980047e0 con 0x7f928c0047c0 2024-02-19T06:58:35.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.408+0000 7f92aac00640 1 -- 172.21.15.46:0/4141428781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a40c98a0 con 0x7f928c0047c0 2024-02-19T06:58:35.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.408+0000 7f92aac00640 1 -- 172.21.15.46:0/4141428781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a40c94c0 con 0x7f928c0047c0 2024-02-19T06:58:35.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.409+0000 7f92aac00640 1 -- 172.21.15.46:0/4141428781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a40d1390 con 0x7f928c0047c0 2024-02-19T06:58:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.411+0000 7f92a1600640 1 -- 172.21.15.46:0/4141428781 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9298004940 con 0x7f928c0047c0 2024-02-19T06:58:35.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.412+0000 7f92a1600640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f928806b840 0x7f928806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.412+0000 7f92a1600640 1 -- 172.21.15.46:0/4141428781 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9298089e00 con 0x7f928c0047c0 2024-02-19T06:58:35.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.412+0000 7f92a8e00640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f928806b840 0x7f928806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.413+0000 7f92a8e00640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f928806b840 0x7f928806dd00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9294036000 tx=0x7f9294030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:35.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.416+0000 7f92a1600640 1 -- 172.21.15.46:0/4141428781 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9298058350 con 0x7f928c0047c0 2024-02-19T06:58:35.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.613+0000 7f92aac00640 1 -- 172.21.15.46:0/4141428781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92a40c96b0 con 0x7f928c0047c0 2024-02-19T06:58:35.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.615+0000 7f92a1600640 1 -- 172.21.15.46:0/4141428781 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f9298019020 con 0x7f928c0047c0 2024-02-19T06:58:35.617 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:35.617 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:57:56.828629+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:35.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.618+0000 7f92aac00640 1 -- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f928806b840 msgr2=0x7f928806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.618+0000 7f92aac00640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f928806b840 0x7f928806dd00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9294036000 tx=0x7f9294030000 comp rx=0 tx=0).stop 2024-02-19T06:58:35.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.618+0000 7f92aac00640 1 -- 172.21.15.46:0/4141428781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928c0047c0 msgr2=0x7f92a40c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.618+0000 7f92aac00640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928c0047c0 0x7f92a40c62e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f929800d770 tx=0x7f929800db70 comp rx=0 tx=0).stop 2024-02-19T06:58:35.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.618+0000 7f92aac00640 1 -- 172.21.15.46:0/4141428781 shutdown_connections 2024-02-19T06:58:35.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.618+0000 7f92aac00640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f928806b840 0x7f928806dd00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.618+0000 7f92aac00640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92a40cf5a0 0x7f92a406f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.618+0000 7f92aac00640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92a415ade0 0x7f92a40cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.618+0000 7f92aac00640 1 --2- 172.21.15.46:0/4141428781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f928c0047c0 0x7f92a40c62e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.618+0000 7f92aac00640 1 -- 172.21.15.46:0/4141428781 >> 172.21.15.46:0/4141428781 conn(0x7f92a40b3080 msgr2=0x7f92a40b1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:35.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.619+0000 7f92aac00640 1 -- 172.21.15.46:0/4141428781 shutdown_connections 2024-02-19T06:58:35.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.619+0000 7f92aac00640 1 -- 172.21.15.46:0/4141428781 wait complete. 2024-02-19T06:58:35.641 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:35.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.869+0000 7fd541400640 1 Processor -- start 2024-02-19T06:58:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.869+0000 7fd541400640 1 -- start start 2024-02-19T06:58:35.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.871+0000 7fd541400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd53c0b24e0 0x7fd53c09a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.871+0000 7fd541400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c09adb0 con 0x7fd53c09a140 2024-02-19T06:58:35.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.871+0000 7fd541400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c15f3f0 con 0x7fd53c15f010 2024-02-19T06:58:35.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.871+0000 7fd541400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c0cc200 con 0x7fd53c0b24e0 2024-02-19T06:58:35.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.872+0000 7fd539e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd53c09a140 0x7fd53c0cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54890/0 (socket says 172.21.15.46:54890) 2024-02-19T06:58:35.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.872+0000 7fd539e00640 1 -- 172.21.15.46:0/3397152530 learned_addr learned my addr 172.21.15.46:0/3397152530 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:35.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.872+0000 7fd53b200640 1 --2- 172.21.15.46:0/3397152530 >> v2:172.21.15.142:3300/0 conn(0x7fd53c0b24e0 0x7fd53c09a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.872+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960069463 0 0) 0x7fd53c09adb0 con 0x7fd53c09a140 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.872+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd520003520 con 0x7fd53c09a140 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2542472518 0 0) 0x7fd520003520 con 0x7fd53c09a140 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 >> v2:172.21.15.142:3300/0 conn(0x7fd53c0b24e0 msgr2=0x7fd53c09a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd539400640 1 --2- 172.21.15.46:0/3397152530 >> v2:172.21.15.142:3300/0 conn(0x7fd53c0b24e0 0x7fd53c09a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 >> v1:172.21.15.142:6789/0 conn(0x7fd53c15f010 legacy=0x7fd53c099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0d06c0 con 0x7fd53c09a140 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fd528001670 con 0x7fd53c09a140 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 >> v1:172.21.15.46:6789/0 conn(0x7fd53c09a140 legacy=0x7fd53c0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd539400640 1 --2- 172.21.15.46:0/3397152530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5200039c0 0x7fd520003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd539400640 1 --2- 172.21.15.46:0/3397152530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5200047c0 0x7fd520004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd539400640 1 --2- 172.21.15.46:0/3397152530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5200051d0 0x7fd52000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0cc200 con 0x7fd5200039c0 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52000c120 con 0x7fd5200051d0 2024-02-19T06:58:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52000c2e0 con 0x7fd5200047c0 2024-02-19T06:58:35.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.873+0000 7fd53a800640 1 --2- 172.21.15.46:0/3397152530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5200039c0 0x7fd520003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.874+0000 7fd53a800640 1 -- 172.21.15.46:0/3397152530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5200047c0 msgr2=0x7fd520004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.874+0000 7fd53a800640 1 --2- 172.21.15.46:0/3397152530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5200047c0 0x7fd520004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.874+0000 7fd53a800640 1 -- 172.21.15.46:0/3397152530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5200051d0 msgr2=0x7fd52000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.874+0000 7fd53a800640 1 --2- 172.21.15.46:0/3397152530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5200051d0 0x7fd52000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.874+0000 7fd53a800640 1 -- 172.21.15.46:0/3397152530 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd520003520 con 0x7fd5200039c0 2024-02-19T06:58:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.874+0000 7fd53b200640 1 -- 172.21.15.46:0/3397152530 reap_dead start 2024-02-19T06:58:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.875+0000 7fd53a800640 1 --2- 172.21.15.46:0/3397152530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5200039c0 0x7fd520003de0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd52c001e20 tx=0x7fd5200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc89b74778a417d server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.875+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c003b70 con 0x7fd5200039c0 2024-02-19T06:58:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.875+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c003cd0 con 0x7fd5200039c0 2024-02-19T06:58:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.875+0000 7fd539400640 1 -- 172.21.15.46:0/3397152530 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c005310 con 0x7fd5200039c0 2024-02-19T06:58:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.876+0000 7fd541400640 1 -- 172.21.15.46:0/3397152530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5200039c0 msgr2=0x7fd520003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.876+0000 7fd541400640 1 --2- 172.21.15.46:0/3397152530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5200039c0 0x7fd520003de0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd52c001e20 tx=0x7fd5200057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.876+0000 7fd541400640 1 -- 172.21.15.46:0/3397152530 shutdown_connections 2024-02-19T06:58:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.876+0000 7fd541400640 1 --2- 172.21.15.46:0/3397152530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5200039c0 0x7fd520003de0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.876+0000 7fd541400640 1 -- 172.21.15.46:0/3397152530 >> 172.21.15.46:0/3397152530 conn(0x7fd53c0b3200 msgr2=0x7fd53c0b3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.876+0000 7fd541400640 1 -- 172.21.15.46:0/3397152530 shutdown_connections 2024-02-19T06:58:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.876+0000 7fd541400640 1 -- 172.21.15.46:0/3397152530 wait complete. 2024-02-19T06:58:35.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.878+0000 7fd541400640 1 Processor -- start 2024-02-19T06:58:35.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.878+0000 7fd541400640 1 -- start start 2024-02-19T06:58:35.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.879+0000 7fd541400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5200039c0 0x7fd53c149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.879+0000 7fd541400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c14a510 0x7fd53c1eb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.879+0000 7fd541400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53c147790 0x7fd53c149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.879+0000 7fd541400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c148cd0 con 0x7fd53c14a510 2024-02-19T06:58:35.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.879+0000 7fd541400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c1480c0 con 0x7fd5200039c0 2024-02-19T06:58:35.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.879+0000 7fd541400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c1483a0 con 0x7fd53c147790 2024-02-19T06:58:35.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.879+0000 7fd539e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c14a510 0x7fd53c1eb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.879+0000 7fd539e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c14a510 0x7fd53c1eb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60298/0 (socket says 172.21.15.46:60298) 2024-02-19T06:58:35.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.880+0000 7fd539e00640 1 -- 172.21.15.46:0/3574838156 learned_addr learned my addr 172.21.15.46:0/3574838156 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.880+0000 7fd53a800640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5200039c0 0x7fd53c149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.880+0000 7fd53b200640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53c147790 0x7fd53c149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.880+0000 7fd539e00640 1 -- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53c147790 msgr2=0x7fd53c149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.880+0000 7fd539e00640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53c147790 0x7fd53c149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.880+0000 7fd539e00640 1 -- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5200039c0 msgr2=0x7fd53c149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.880+0000 7fd539e00640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5200039c0 0x7fd53c149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.880+0000 7fd539e00640 1 -- 172.21.15.46:0/3574838156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c148680 con 0x7fd53c14a510 2024-02-19T06:58:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.880+0000 7fd539e00640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c14a510 0x7fd53c1eb7d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd52800c730 tx=0x7fd52800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.881+0000 7fd532a00640 1 -- 172.21.15.46:0/3574838156 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5280072d0 con 0x7fd53c14a510 2024-02-19T06:58:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.881+0000 7fd532a00640 1 -- 172.21.15.46:0/3574838156 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd528007430 con 0x7fd53c14a510 2024-02-19T06:58:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.881+0000 7fd532a00640 1 -- 172.21.15.46:0/3574838156 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5280047e0 con 0x7fd53c14a510 2024-02-19T06:58:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.881+0000 7fd541400640 1 -- 172.21.15.46:0/3574838156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c148960 con 0x7fd53c14a510 2024-02-19T06:58:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.881+0000 7fd541400640 1 -- 172.21.15.46:0/3574838156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c147c40 con 0x7fd53c14a510 2024-02-19T06:58:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.882+0000 7fd541400640 1 -- 172.21.15.46:0/3574838156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c148b20 con 0x7fd53c14a510 2024-02-19T06:58:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.883+0000 7fd532a00640 1 -- 172.21.15.46:0/3574838156 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd528004940 con 0x7fd53c14a510 2024-02-19T06:58:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.885+0000 7fd532a00640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd51c06b840 0x7fd51c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.885+0000 7fd532a00640 1 -- 172.21.15.46:0/3574838156 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd528089970 con 0x7fd53c14a510 2024-02-19T06:58:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.885+0000 7fd53a800640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd51c06b840 0x7fd51c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.887+0000 7fd53a800640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd51c06b840 0x7fd51c06dd00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd52c034000 tx=0x7fd52c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:35.890+0000 7fd532a00640 1 -- 172.21.15.46:0/3574838156 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd528054380 con 0x7fd53c14a510 2024-02-19T06:58:36.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.100+0000 7fd541400640 1 -- 172.21.15.46:0/3574838156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd53c0682b0 con 0x7fd53c14a510 2024-02-19T06:58:36.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.100+0000 7fd532a00640 1 -- 172.21.15.46:0/3574838156 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd528018070 con 0x7fd53c14a510 2024-02-19T06:58:36.103 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.104+0000 7fd541400640 1 -- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd51c06b840 msgr2=0x7fd51c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.104+0000 7fd541400640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd51c06b840 0x7fd51c06dd00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd52c034000 tx=0x7fd52c009030 comp rx=0 tx=0).stop 2024-02-19T06:58:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.104+0000 7fd541400640 1 -- 172.21.15.46:0/3574838156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c14a510 msgr2=0x7fd53c1eb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.104+0000 7fd541400640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c14a510 0x7fd53c1eb7d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd52800c730 tx=0x7fd52800cbf0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.104+0000 7fd541400640 1 -- 172.21.15.46:0/3574838156 shutdown_connections 2024-02-19T06:58:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.104+0000 7fd541400640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd51c06b840 0x7fd51c06dd00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.104+0000 7fd541400640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53c147790 0x7fd53c149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.104+0000 7fd541400640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c14a510 0x7fd53c1eb7d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.104+0000 7fd541400640 1 --2- 172.21.15.46:0/3574838156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5200039c0 0x7fd53c149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.104+0000 7fd541400640 1 -- 172.21.15.46:0/3574838156 >> 172.21.15.46:0/3574838156 conn(0x7fd53c0b3200 msgr2=0x7fd53c0706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:36.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.105+0000 7fd541400640 1 -- 172.21.15.46:0/3574838156 shutdown_connections 2024-02-19T06:58:36.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.105+0000 7fd541400640 1 -- 172.21.15.46:0/3574838156 wait complete. 2024-02-19T06:58:36.124 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:36.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.334+0000 7fa7bfe00640 1 Processor -- start 2024-02-19T06:58:36.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.334+0000 7fa7bfe00640 1 -- start start 2024-02-19T06:58:36.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.336+0000 7fa7bfe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c015db20 0x7fa7c00cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:36.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.336+0000 7fa7bfe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa7c00cdec0 0x7fa7c00cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:36.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.336+0000 7fa7bfe00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c0161580 con 0x7fa7c00b33e0 2024-02-19T06:58:36.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.336+0000 7fa7bfe00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c0162200 con 0x7fa7c00cdec0 2024-02-19T06:58:36.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.336+0000 7fa7bfe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c0161860 con 0x7fa7c015db20 2024-02-19T06:58:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.337+0000 7fa7bf400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa7c00b33e0 0x7fa7c00b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54902/0 (socket says 172.21.15.46:54902) 2024-02-19T06:58:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.337+0000 7fa7bf400640 1 -- 172.21.15.46:0/1895910643 learned_addr learned my addr 172.21.15.46:0/1895910643 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.337+0000 7fa7b7e00640 1 --2- 172.21.15.46:0/1895910643 >> v2:172.21.15.142:3300/0 conn(0x7fa7c00cdec0 0x7fa7c00cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.337+0000 7fa7bea00640 1 --2- 172.21.15.46:0/1895910643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c015db20 0x7fa7c00cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.337+0000 7fa7be000640 1 -- 172.21.15.46:0/1895910643 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915543812 0 0) 0x7fa7c0161580 con 0x7fa7c00b33e0 2024-02-19T06:58:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.337+0000 7fa7be000640 1 -- 172.21.15.46:0/1895910643 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a4003520 con 0x7fa7c00b33e0 2024-02-19T06:58:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.337+0000 7fa7bea00640 1 -- 172.21.15.46:0/1895910643 >> v2:172.21.15.142:3300/0 conn(0x7fa7c00cdec0 msgr2=0x7fa7c00cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.337+0000 7fa7bea00640 1 --2- 172.21.15.46:0/1895910643 >> v2:172.21.15.142:3300/0 conn(0x7fa7c00cdec0 0x7fa7c00cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.337+0000 7fa7bea00640 1 -- 172.21.15.46:0/1895910643 >> v1:172.21.15.46:6789/0 conn(0x7fa7c00b33e0 legacy=0x7fa7c00b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.338+0000 7fa7bea00640 1 -- 172.21.15.46:0/1895910643 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c0161b40 con 0x7fa7c015db20 2024-02-19T06:58:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.338+0000 7fa7b7e00640 1 --2- 172.21.15.46:0/1895910643 >> v2:172.21.15.142:3300/0 conn(0x7fa7c00cdec0 0x7fa7c00cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:58:36.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.339+0000 7fa7bea00640 1 --2- 172.21.15.46:0/1895910643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c015db20 0x7fa7c00cf530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00097a0 tx=0x7fa7b002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a124c9c3e7e40f7e server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:36.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.339+0000 7fa7be000640 1 -- 172.21.15.46:0/1895910643 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0031780 con 0x7fa7c015db20 2024-02-19T06:58:36.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.340+0000 7fa7be000640 1 -- 172.21.15.46:0/1895910643 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b00318e0 con 0x7fa7c015db20 2024-02-19T06:58:36.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.340+0000 7fa7be000640 1 -- 172.21.15.46:0/1895910643 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0031c70 con 0x7fa7c015db20 2024-02-19T06:58:36.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.340+0000 7fa7bfe00640 1 -- 172.21.15.46:0/1895910643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c015db20 msgr2=0x7fa7c00cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:36.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.340+0000 7fa7bfe00640 1 --2- 172.21.15.46:0/1895910643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c015db20 0x7fa7c00cf530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00097a0 tx=0x7fa7b002b820 comp rx=0 tx=0).stop 2024-02-19T06:58:36.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.340+0000 7fa7bfe00640 1 -- 172.21.15.46:0/1895910643 shutdown_connections 2024-02-19T06:58:36.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.340+0000 7fa7bfe00640 1 --2- 172.21.15.46:0/1895910643 >> v2:172.21.15.142:3300/0 conn(0x7fa7c00cdec0 0x7fa7c00cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.340+0000 7fa7bfe00640 1 --2- 172.21.15.46:0/1895910643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c015db20 0x7fa7c00cf530 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.340+0000 7fa7bfe00640 1 -- 172.21.15.46:0/1895910643 >> 172.21.15.46:0/1895910643 conn(0x7fa7c006ad60 msgr2=0x7fa7c006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:36.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.340+0000 7fa7bfe00640 1 -- 172.21.15.46:0/1895910643 shutdown_connections 2024-02-19T06:58:36.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.340+0000 7fa7bfe00640 1 -- 172.21.15.46:0/1895910643 wait complete. 2024-02-19T06:58:36.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.342+0000 7fa7bfe00640 1 Processor -- start 2024-02-19T06:58:36.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.342+0000 7fa7bfe00640 1 -- start start 2024-02-19T06:58:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.343+0000 7fa7bfe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c00b33e0 0x7fa7c01f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.343+0000 7fa7bfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c00cdec0 0x7fa7c015df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.343+0000 7fa7bfe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c015db20 0x7fa7c00c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.343+0000 7fa7bfe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c015e9c0 con 0x7fa7c00cdec0 2024-02-19T06:58:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.343+0000 7fa7bfe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c015eca0 con 0x7fa7c00b33e0 2024-02-19T06:58:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.343+0000 7fa7bfe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c015ef80 con 0x7fa7c015db20 2024-02-19T06:58:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.344+0000 7fa7b7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c00cdec0 0x7fa7c015df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.344+0000 7fa7b7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c00cdec0 0x7fa7c015df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60314/0 (socket says 172.21.15.46:60314) 2024-02-19T06:58:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.344+0000 7fa7b7e00640 1 -- 172.21.15.46:0/3700921103 learned_addr learned my addr 172.21.15.46:0/3700921103 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.344+0000 7fa7bea00640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c00b33e0 0x7fa7c01f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.344+0000 7fa7bf400640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c015db20 0x7fa7c00c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.344+0000 7fa7b7e00640 1 -- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c015db20 msgr2=0x7fa7c00c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.344+0000 7fa7b7e00640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c015db20 0x7fa7c00c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.344+0000 7fa7b7e00640 1 -- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c00b33e0 msgr2=0x7fa7c01f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.344+0000 7fa7b7e00640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c00b33e0 0x7fa7c01f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.344+0000 7fa7b7e00640 1 -- 172.21.15.46:0/3700921103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a8009400 con 0x7fa7c00cdec0 2024-02-19T06:58:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.344+0000 7fa7bf400640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c015db20 0x7fa7c00c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.345+0000 7fa7b7e00640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c00cdec0 0x7fa7c015df00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800ebe0 tx=0x7fa7a800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.345+0000 7fa7b7400640 1 -- 172.21.15.46:0/3700921103 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8009760 con 0x7fa7c00cdec0 2024-02-19T06:58:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.345+0000 7fa7b7400640 1 -- 172.21.15.46:0/3700921103 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a800cc30 con 0x7fa7c00cdec0 2024-02-19T06:58:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.345+0000 7fa7b7400640 1 -- 172.21.15.46:0/3700921103 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a800eee0 con 0x7fa7c00cdec0 2024-02-19T06:58:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.345+0000 7fa7bfe00640 1 -- 172.21.15.46:0/3700921103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b0009400 con 0x7fa7c00cdec0 2024-02-19T06:58:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.345+0000 7fa7bfe00640 1 -- 172.21.15.46:0/3700921103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c00c3100 con 0x7fa7c00cdec0 2024-02-19T06:58:36.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.346+0000 7fa7bfe00640 1 -- 172.21.15.46:0/3700921103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c00c32c0 con 0x7fa7c00cdec0 2024-02-19T06:58:36.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.347+0000 7fa7b7400640 1 -- 172.21.15.46:0/3700921103 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa7a8013470 con 0x7fa7c00cdec0 2024-02-19T06:58:36.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.348+0000 7fa7b7400640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa79c06b810 0x7fa79c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:36.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.348+0000 7fa7b7400640 1 -- 172.21.15.46:0/3700921103 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa7a808a5b0 con 0x7fa7c00cdec0 2024-02-19T06:58:36.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.349+0000 7fa7bea00640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa79c06b810 0x7fa79c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:36.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.350+0000 7fa7bea00640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa79c06b810 0x7fa79c06dcd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0036000 tx=0x7fa7b003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:36.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.353+0000 7fa7b7400640 1 -- 172.21.15.46:0/3700921103 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa7a8054eb0 con 0x7fa7c00cdec0 2024-02-19T06:58:36.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.556+0000 7fa7bfe00640 1 -- 172.21.15.46:0/3700921103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa7c004eee0 con 0x7fa7c00cdec0 2024-02-19T06:58:36.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.557+0000 7fa7b7400640 1 -- 172.21.15.46:0/3700921103 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa7a8058570 con 0x7fa7c00cdec0 2024-02-19T06:58:36.558 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:36.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.559+0000 7fa7bfe00640 1 -- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa79c06b810 msgr2=0x7fa79c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:36.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.559+0000 7fa7bfe00640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa79c06b810 0x7fa79c06dcd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0036000 tx=0x7fa7b003d040 comp rx=0 tx=0).stop 2024-02-19T06:58:36.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.559+0000 7fa7bfe00640 1 -- 172.21.15.46:0/3700921103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c00cdec0 msgr2=0x7fa7c015df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:36.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.559+0000 7fa7bfe00640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c00cdec0 0x7fa7c015df00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800ebe0 tx=0x7fa7a800c520 comp rx=0 tx=0).stop 2024-02-19T06:58:36.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.560+0000 7fa7bfe00640 1 -- 172.21.15.46:0/3700921103 shutdown_connections 2024-02-19T06:58:36.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.560+0000 7fa7bfe00640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa79c06b810 0x7fa79c06dcd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.560+0000 7fa7bfe00640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c015db20 0x7fa7c00c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.560+0000 7fa7bfe00640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c00cdec0 0x7fa7c015df00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.560+0000 7fa7bfe00640 1 --2- 172.21.15.46:0/3700921103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c00b33e0 0x7fa7c01f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.560+0000 7fa7bfe00640 1 -- 172.21.15.46:0/3700921103 >> 172.21.15.46:0/3700921103 conn(0x7fa7c006ad60 msgr2=0x7fa7c00ac910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:36.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.560+0000 7fa7bfe00640 1 -- 172.21.15.46:0/3700921103 shutdown_connections 2024-02-19T06:58:36.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.560+0000 7fa7bfe00640 1 -- 172.21.15.46:0/3700921103 wait complete. 2024-02-19T06:58:36.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:36.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.801+0000 7f377be00640 1 Processor -- start 2024-02-19T06:58:36.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.801+0000 7f377be00640 1 -- start start 2024-02-19T06:58:36.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.803+0000 7f377be00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f377c155b20 0x7f377c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:36.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.803+0000 7f377be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f377c0b2bf0 0x7f377c06d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:36.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.803+0000 7f377be00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c15be60 con 0x7f377c0cfa70 2024-02-19T06:58:36.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.803+0000 7f377be00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0cff00 con 0x7f377c155b20 2024-02-19T06:58:36.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.803+0000 7f377be00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c15c140 con 0x7f377c0b2bf0 2024-02-19T06:58:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.803+0000 7f377aa00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f377c155b20 0x7f377c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.804+0000 7f377aa00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f377c155b20 0x7f377c0cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:44988/0 (socket says 172.21.15.46:44988) 2024-02-19T06:58:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.804+0000 7f377b400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f377c0b2bf0 0x7f377c06d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.804+0000 7f377aa00640 1 -- 172.21.15.46:0/1933602338 learned_addr learned my addr 172.21.15.46:0/1933602338 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.804+0000 7f377aa00640 1 -- 172.21.15.46:0/1933602338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f377c0b2bf0 msgr2=0x7f377c06d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.804+0000 7f377aa00640 1 --2- 172.21.15.46:0/1933602338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f377c0b2bf0 0x7f377c06d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.804+0000 7f377aa00640 1 -- 172.21.15.46:0/1933602338 >> v1:172.21.15.142:6789/0 conn(0x7f377c0cfa70 legacy=0x7f377c0b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.805+0000 7f377aa00640 1 -- 172.21.15.46:0/1933602338 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c15c420 con 0x7f377c155b20 2024-02-19T06:58:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.805+0000 7f377b400640 1 --2- 172.21.15.46:0/1933602338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f377c0b2bf0 0x7f377c06d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:58:36.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.804+0000 7f3779600640 1 -- 172.21.15.46:0/1933602338 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660936910 0 0) 0x7f377c15be60 con 0x7f377c0cfa70 2024-02-19T06:58:36.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.806+0000 7f377aa00640 1 --2- 172.21.15.46:0/1933602338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f377c155b20 0x7f377c0cf530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f376c009870 tx=0x7f376c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0ab552bbe1ee521 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.807+0000 7f3779600640 1 -- 172.21.15.46:0/1933602338 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c031640 con 0x7f377c155b20 2024-02-19T06:58:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.807+0000 7f3779600640 1 -- 172.21.15.46:0/1933602338 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c0317a0 con 0x7f377c155b20 2024-02-19T06:58:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.807+0000 7f3779600640 1 -- 172.21.15.46:0/1933602338 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c031b30 con 0x7f377c155b20 2024-02-19T06:58:36.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.807+0000 7f377be00640 1 -- 172.21.15.46:0/1933602338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f377c155b20 msgr2=0x7f377c0cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:36.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.807+0000 7f377be00640 1 --2- 172.21.15.46:0/1933602338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f377c155b20 0x7f377c0cf530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f376c009870 tx=0x7f376c02b8f0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.807+0000 7f377be00640 1 -- 172.21.15.46:0/1933602338 shutdown_connections 2024-02-19T06:58:36.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.807+0000 7f377be00640 1 --2- 172.21.15.46:0/1933602338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f377c0b2bf0 0x7f377c06d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.807+0000 7f377be00640 1 --2- 172.21.15.46:0/1933602338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f377c155b20 0x7f377c0cf530 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.807+0000 7f377be00640 1 -- 172.21.15.46:0/1933602338 >> 172.21.15.46:0/1933602338 conn(0x7f377c06ad60 msgr2=0x7f377c06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:36.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.808+0000 7f377be00640 1 -- 172.21.15.46:0/1933602338 shutdown_connections 2024-02-19T06:58:36.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.808+0000 7f377be00640 1 -- 172.21.15.46:0/1933602338 wait complete. 2024-02-19T06:58:36.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.810+0000 7f377be00640 1 Processor -- start 2024-02-19T06:58:36.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.810+0000 7f377be00640 1 -- start start 2024-02-19T06:58:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.811+0000 7f377be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f377c0b2bf0 0x7f377c0cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:36.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.811+0000 7f377be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f377c0cfa70 0x7f377c0cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.811+0000 7f377be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f377c155b20 0x7f377c158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.811+0000 7f377be00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0cef50 con 0x7f377c155b20 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.811+0000 7f377be00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0ce580 con 0x7f377c0cfa70 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.811+0000 7f377be00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0cd970 con 0x7f377c0b2bf0 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.812+0000 7f377b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f377c155b20 0x7f377c158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.812+0000 7f377b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f377c155b20 0x7f377c158920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60322/0 (socket says 172.21.15.46:60322) 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.812+0000 7f377b400640 1 -- 172.21.15.46:0/3593530537 learned_addr learned my addr 172.21.15.46:0/3593530537 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.812+0000 7f377aa00640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f377c0b2bf0 0x7f377c0cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.812+0000 7f377a000640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f377c0cfa70 0x7f377c0cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.812+0000 7f377b400640 1 -- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f377c0b2bf0 msgr2=0x7f377c0cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.812+0000 7f377b400640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f377c0b2bf0 0x7f377c0cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.812+0000 7f377b400640 1 -- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f377c0cfa70 msgr2=0x7f377c0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.812+0000 7f377b400640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f377c0cfa70 0x7f377c0cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.812+0000 7f377b400640 1 -- 172.21.15.46:0/3593530537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3774009a70 con 0x7f377c155b20 2024-02-19T06:58:36.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.812+0000 7f377a000640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f377c0cfa70 0x7f377c0cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:36.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.813+0000 7f377b400640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f377c155b20 0x7f377c158920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f377400efc0 tx=0x7f377400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:36.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.813+0000 7f3772a00640 1 -- 172.21.15.46:0/3593530537 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774009cd0 con 0x7f377c155b20 2024-02-19T06:58:36.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.813+0000 7f3772a00640 1 -- 172.21.15.46:0/3593530537 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377400f040 con 0x7f377c155b20 2024-02-19T06:58:36.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.813+0000 7f3772a00640 1 -- 172.21.15.46:0/3593530537 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774003990 con 0x7f377c155b20 2024-02-19T06:58:36.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.813+0000 7f377be00640 1 -- 172.21.15.46:0/3593530537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c0094d0 con 0x7f377c155b20 2024-02-19T06:58:36.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.813+0000 7f377be00640 1 -- 172.21.15.46:0/3593530537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c0cdf30 con 0x7f377c155b20 2024-02-19T06:58:36.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.814+0000 7f377be00640 1 -- 172.21.15.46:0/3593530537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c0ce730 con 0x7f377c155b20 2024-02-19T06:58:36.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.815+0000 7f3772a00640 1 -- 172.21.15.46:0/3593530537 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3774014480 con 0x7f377c155b20 2024-02-19T06:58:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.816+0000 7f3772a00640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f375806b810 0x7f375806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.817+0000 7f3772a00640 1 -- 172.21.15.46:0/3593530537 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f377408ad50 con 0x7f377c155b20 2024-02-19T06:58:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.817+0000 7f377aa00640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f375806b810 0x7f375806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:36.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.818+0000 7f377aa00640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f375806b810 0x7f375806dcd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f376c036000 tx=0x7f376c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:36.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:36.821+0000 7f3772a00640 1 -- 172.21.15.46:0/3593530537 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f377c0ce730 con 0x7f377c155b20 2024-02-19T06:58:37.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.021+0000 7f377be00640 1 -- 172.21.15.46:0/3593530537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f377c0ce730 con 0x7f377c155b20 2024-02-19T06:58:37.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.022+0000 7f3772a00640 1 -- 172.21.15.46:0/3593530537 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f377c0ce730 con 0x7f377c155b20 2024-02-19T06:58:37.023 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.024+0000 7f377be00640 1 -- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f375806b810 msgr2=0x7f375806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.024+0000 7f377be00640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f375806b810 0x7f375806dcd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f376c036000 tx=0x7f376c03c040 comp rx=0 tx=0).stop 2024-02-19T06:58:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.024+0000 7f377be00640 1 -- 172.21.15.46:0/3593530537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f377c155b20 msgr2=0x7f377c158920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.024+0000 7f377be00640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f377c155b20 0x7f377c158920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f377400efc0 tx=0x7f377400c490 comp rx=0 tx=0).stop 2024-02-19T06:58:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.024+0000 7f377be00640 1 -- 172.21.15.46:0/3593530537 shutdown_connections 2024-02-19T06:58:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.024+0000 7f377be00640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f375806b810 0x7f375806dcd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.024+0000 7f377be00640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f377c155b20 0x7f377c158920 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.024+0000 7f377be00640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f377c0cfa70 0x7f377c0cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.024+0000 7f377be00640 1 --2- 172.21.15.46:0/3593530537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f377c0b2bf0 0x7f377c0cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.024+0000 7f377be00640 1 -- 172.21.15.46:0/3593530537 >> 172.21.15.46:0/3593530537 conn(0x7f377c06ad60 msgr2=0x7f377c15e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.024+0000 7f377be00640 1 -- 172.21.15.46:0/3593530537 shutdown_connections 2024-02-19T06:58:37.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.025+0000 7f377be00640 1 -- 172.21.15.46:0/3593530537 wait complete. 2024-02-19T06:58:37.043 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-02-19T06:58:37.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.266+0000 7f3ba9200640 1 Processor -- start 2024-02-19T06:58:37.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.266+0000 7f3ba9200640 1 -- start start 2024-02-19T06:58:37.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.268+0000 7f3ba9200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3ba415d7f0 0x7f3ba40d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:37.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.268+0000 7f3ba9200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba40cf770 con 0x7f3ba415dbd0 2024-02-19T06:58:37.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.268+0000 7f3ba9200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba40cf4e0 con 0x7f3ba4162230 2024-02-19T06:58:37.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.268+0000 7f3ba9200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba40d1400 con 0x7f3ba415d7f0 2024-02-19T06:58:37.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.268+0000 7f3ba3e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3ba415dbd0 0x7f3ba40d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54910/0 (socket says 172.21.15.46:54910) 2024-02-19T06:58:37.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.268+0000 7f3ba3e00640 1 -- 172.21.15.46:0/4215098767 learned_addr learned my addr 172.21.15.46:0/4215098767 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:37.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba3400640 1 --2- 172.21.15.46:0/4215098767 >> v2:172.21.15.142:3300/0 conn(0x7f3ba415d7f0 0x7f3ba40d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:37.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831649293 0 0) 0x7f3ba40cf770 con 0x7f3ba415dbd0 2024-02-19T06:58:37.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b88003520 con 0x7f3ba415dbd0 2024-02-19T06:58:37.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1801477200 0 0) 0x7f3b88003520 con 0x7f3ba415dbd0 2024-02-19T06:58:37.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 >> v2:172.21.15.142:3300/0 conn(0x7f3ba415d7f0 msgr2=0x7f3ba40d21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:37.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 --2- 172.21.15.46:0/4215098767 >> v2:172.21.15.142:3300/0 conn(0x7f3ba415d7f0 0x7f3ba40d21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:37.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 >> v1:172.21.15.142:6789/0 conn(0x7f3ba4162230 legacy=0x7f3ba40cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:37.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba40d16e0 con 0x7f3ba415dbd0 2024-02-19T06:58:37.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f3b9c0019f0 con 0x7f3ba415dbd0 2024-02-19T06:58:37.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 >> v1:172.21.15.46:6789/0 conn(0x7f3ba415dbd0 legacy=0x7f3ba40d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:37.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 --2- 172.21.15.46:0/4215098767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b88003970 0x7f3b88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:37.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 --2- 172.21.15.46:0/4215098767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b880047c0 0x7f3b88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:37.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 --2- 172.21.15.46:0/4215098767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b88005180 0x7f3b8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:37.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40d1400 con 0x7f3b880047c0 2024-02-19T06:58:37.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8800c120 con 0x7f3b88003970 2024-02-19T06:58:37.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.269+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8800c2e0 con 0x7f3b88005180 2024-02-19T06:58:37.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.270+0000 7f3b9be00640 1 --2- 172.21.15.46:0/4215098767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b880047c0 0x7f3b88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:37.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.270+0000 7f3ba3400640 1 --2- 172.21.15.46:0/4215098767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b88003970 0x7f3b88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:37.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.270+0000 7f3ba3e00640 1 --2- 172.21.15.46:0/4215098767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b88005180 0x7f3b8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:37.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.270+0000 7f3b9be00640 1 -- 172.21.15.46:0/4215098767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b88005180 msgr2=0x7f3b8800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:37.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.270+0000 7f3b9be00640 1 --2- 172.21.15.46:0/4215098767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b88005180 0x7f3b8800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:37.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.270+0000 7f3b9be00640 1 -- 172.21.15.46:0/4215098767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b88003970 msgr2=0x7f3b88003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:37.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.270+0000 7f3b9be00640 1 --2- 172.21.15.46:0/4215098767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b88003970 0x7f3b88003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:37.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.270+0000 7f3b9be00640 1 -- 172.21.15.46:0/4215098767 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b88003520 con 0x7f3b880047c0 2024-02-19T06:58:37.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.270+0000 7f3ba3e00640 1 -- 172.21.15.46:0/4215098767 reap_dead start 2024-02-19T06:58:37.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.271+0000 7f3b9be00640 1 --2- 172.21.15.46:0/4215098767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b880047c0 0x7f3b88004c40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c001750 tx=0x7f3b880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ded25b620d9bb04 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:37.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.272+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0052d0 con 0x7f3b880047c0 2024-02-19T06:58:37.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.272+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c02e050 con 0x7f3b880047c0 2024-02-19T06:58:37.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.272+0000 7f3ba2a00640 1 -- 172.21.15.46:0/4215098767 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c003830 con 0x7f3b880047c0 2024-02-19T06:58:37.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.272+0000 7f3ba9200640 1 -- 172.21.15.46:0/4215098767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b880047c0 msgr2=0x7f3b88004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:37.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.272+0000 7f3ba9200640 1 --2- 172.21.15.46:0/4215098767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b880047c0 0x7f3b88004c40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c001750 tx=0x7f3b880057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:37.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.272+0000 7f3ba9200640 1 -- 172.21.15.46:0/4215098767 shutdown_connections 2024-02-19T06:58:37.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.272+0000 7f3ba9200640 1 --2- 172.21.15.46:0/4215098767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b880047c0 0x7f3b88004c40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:37.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.272+0000 7f3ba9200640 1 -- 172.21.15.46:0/4215098767 >> 172.21.15.46:0/4215098767 conn(0x7f3ba409ca70 msgr2=0x7f3ba408afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:37.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.272+0000 7f3ba9200640 1 -- 172.21.15.46:0/4215098767 shutdown_connections 2024-02-19T06:58:37.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.272+0000 7f3ba9200640 1 -- 172.21.15.46:0/4215098767 wait complete. 2024-02-19T06:58:37.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.274+0000 7f3ba9200640 1 Processor -- start 2024-02-19T06:58:37.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.274+0000 7f3ba9200640 1 -- start start 2024-02-19T06:58:37.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.275+0000 7f3ba9200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b880047c0 0x7f3ba414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:37.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.275+0000 7f3ba9200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ba40b0600 0x7f3ba415e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:37.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.275+0000 7f3ba9200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ba40b0a80 0x7f3ba40cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:37.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.275+0000 7f3ba9200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4161000 con 0x7f3ba40b0600 2024-02-19T06:58:37.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.275+0000 7f3ba9200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40b2420 con 0x7f3b880047c0 2024-02-19T06:58:37.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.275+0000 7f3ba9200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4160a40 con 0x7f3ba40b0a80 2024-02-19T06:58:37.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.276+0000 7f3b9be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ba40b0600 0x7f3ba415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:37.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.276+0000 7f3b9be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ba40b0600 0x7f3ba415e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60342/0 (socket says 172.21.15.46:60342) 2024-02-19T06:58:37.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.276+0000 7f3b9be00640 1 -- 172.21.15.46:0/2125482580 learned_addr learned my addr 172.21.15.46:0/2125482580 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:37.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.276+0000 7f3ba3400640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b880047c0 0x7f3ba414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:37.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.276+0000 7f3ba3e00640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ba40b0a80 0x7f3ba40cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:37.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.276+0000 7f3b9be00640 1 -- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ba40b0a80 msgr2=0x7f3ba40cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:37.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.276+0000 7f3b9be00640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ba40b0a80 0x7f3ba40cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:37.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.276+0000 7f3b9be00640 1 -- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b880047c0 msgr2=0x7f3ba414ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:37.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.276+0000 7f3b9be00640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b880047c0 0x7f3ba414ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:37.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.276+0000 7f3b9be00640 1 -- 172.21.15.46:0/2125482580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba4160d20 con 0x7f3ba40b0600 2024-02-19T06:58:37.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.276+0000 7f3ba3400640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b880047c0 0x7f3ba414ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:58:37.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.277+0000 7f3b9be00640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ba40b0600 0x7f3ba415e070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c000c00 tx=0x7f3b8c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:37.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.277+0000 7f3b9b400640 1 -- 172.21.15.46:0/2125482580 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0076c0 con 0x7f3ba40b0600 2024-02-19T06:58:37.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.277+0000 7f3b9b400640 1 -- 172.21.15.46:0/2125482580 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c007a30 con 0x7f3ba40b0600 2024-02-19T06:58:37.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.277+0000 7f3b9b400640 1 -- 172.21.15.46:0/2125482580 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c006be0 con 0x7f3ba40b0600 2024-02-19T06:58:37.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.277+0000 7f3ba9200640 1 -- 172.21.15.46:0/2125482580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba40b20b0 con 0x7f3ba40b0600 2024-02-19T06:58:37.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.277+0000 7f3ba9200640 1 -- 172.21.15.46:0/2125482580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba415e5b0 con 0x7f3ba40b0600 2024-02-19T06:58:37.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.278+0000 7f3ba9200640 1 -- 172.21.15.46:0/2125482580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba40b2240 con 0x7f3ba40b0600 2024-02-19T06:58:37.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.279+0000 7f3b9b400640 1 -- 172.21.15.46:0/2125482580 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3b8c006d40 con 0x7f3ba40b0600 2024-02-19T06:58:37.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.280+0000 7f3b9b400640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3b8006b860 0x7f3b8006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:37.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.280+0000 7f3b9b400640 1 -- 172.21.15.46:0/2125482580 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3b8c0abf10 con 0x7f3ba40b0600 2024-02-19T06:58:37.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.281+0000 7f3ba3400640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3b8006b860 0x7f3b8006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:37.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.282+0000 7f3ba3400640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3b8006b860 0x7f3b8006dd20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009c40 tx=0x7f3b94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:37.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.284+0000 7f3b9b400640 1 -- 172.21.15.46:0/2125482580 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3b8c076800 con 0x7f3ba40b0600 2024-02-19T06:58:37.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:37.560+0000 7f3ba9200640 1 -- 172.21.15.46:0/2125482580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f3ba404eee0 con 0x7f3ba40b0600 2024-02-19T06:58:38.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.108+0000 7f3b9b400640 1 -- 172.21.15.46:0/2125482580 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v61) v1 ==== 147+0+0 (secure 0 0 0) 0x7f3b8c0410d0 con 0x7f3ba40b0600 2024-02-19T06:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.111+0000 7f3ba9200640 1 -- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3b8006b860 msgr2=0x7f3b8006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.111+0000 7f3ba9200640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3b8006b860 0x7f3b8006dd20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009c40 tx=0x7f3b94008040 comp rx=0 tx=0).stop 2024-02-19T06:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.111+0000 7f3ba9200640 1 -- 172.21.15.46:0/2125482580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ba40b0600 msgr2=0x7f3ba415e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.111+0000 7f3ba9200640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ba40b0600 0x7f3ba415e070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c000c00 tx=0x7f3b8c001120 comp rx=0 tx=0).stop 2024-02-19T06:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.112+0000 7f3ba9200640 1 -- 172.21.15.46:0/2125482580 shutdown_connections 2024-02-19T06:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.112+0000 7f3ba9200640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3b8006b860 0x7f3b8006dd20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.112+0000 7f3ba9200640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ba40b0a80 0x7f3ba40cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.112+0000 7f3ba9200640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ba40b0600 0x7f3ba415e070 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.112+0000 7f3ba9200640 1 --2- 172.21.15.46:0/2125482580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b880047c0 0x7f3ba414ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.112+0000 7f3ba9200640 1 -- 172.21.15.46:0/2125482580 >> 172.21.15.46:0/2125482580 conn(0x7f3ba409ca70 msgr2=0x7f3ba406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:38.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.112+0000 7f3ba9200640 1 -- 172.21.15.46:0/2125482580 shutdown_connections 2024-02-19T06:58:38.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.112+0000 7f3ba9200640 1 -- 172.21.15.46:0/2125482580 wait complete. 2024-02-19T06:58:38.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-02-19T06:58:38.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.360+0000 7f1b93800640 1 Processor -- start 2024-02-19T06:58:38.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.360+0000 7f1b93800640 1 -- start start 2024-02-19T06:58:38.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.362+0000 7f1b93800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b8c0b3e70 0x7f1b8c0b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:38.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.362+0000 7f1b93800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8c0b49f0 con 0x7f1b8c15dde0 2024-02-19T06:58:38.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.362+0000 7f1b93800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8c0b4430 con 0x7f1b8c0b2a10 2024-02-19T06:58:38.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.362+0000 7f1b93800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c0cd340 con 0x7f1b8c0b3e70 2024-02-19T06:58:38.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.362+0000 7f1b90e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1b8c15dde0 0x7f1b8c06dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54922/0 (socket says 172.21.15.46:54922) 2024-02-19T06:58:38.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.362+0000 7f1b90e00640 1 -- 172.21.15.46:0/2176996738 learned_addr learned my addr 172.21.15.46:0/2176996738 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:38.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182263807 0 0) 0x7f1b8c0b49f0 con 0x7f1b8c15dde0 2024-02-19T06:58:38.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b70003520 con 0x7f1b8c15dde0 2024-02-19T06:58:38.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8be00640 1 --2- 172.21.15.46:0/2176996738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b8c0b3e70 0x7f1b8c0b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1687015458 0 0) 0x7f1b70003520 con 0x7f1b8c15dde0 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b8c0b3e70 msgr2=0x7f1b8c0b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 --2- 172.21.15.46:0/2176996738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b8c0b3e70 0x7f1b8c0b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 >> v1:172.21.15.142:6789/0 conn(0x7f1b8c0b2a10 legacy=0x7f1b8c0cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c0b4710 con 0x7f1b8c15dde0 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f1b7c001670 con 0x7f1b8c15dde0 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 >> v1:172.21.15.46:6789/0 conn(0x7f1b8c15dde0 legacy=0x7f1b8c06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 --2- 172.21.15.46:0/2176996738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b8c0b3e70 0x7f1b700039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 --2- 172.21.15.46:0/2176996738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b70003fd0 0x7f1b700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 --2- 172.21.15.46:0/2176996738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b70004d00 0x7f1b70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c0cd340 con 0x7f1b70003fd0 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7000bb40 con 0x7f1b70004d00 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7000df10 con 0x7f1b8c0b3e70 2024-02-19T06:58:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.363+0000 7f1b8be00640 1 --2- 172.21.15.46:0/2176996738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b70003fd0 0x7f1b700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.364+0000 7f1b90e00640 1 --2- 172.21.15.46:0/2176996738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b8c0b3e70 0x7f1b700039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.364+0000 7f1b91800640 1 --2- 172.21.15.46:0/2176996738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b70004d00 0x7f1b70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.364+0000 7f1b8be00640 1 -- 172.21.15.46:0/2176996738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b8c0b3e70 msgr2=0x7f1b700039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.364+0000 7f1b8be00640 1 --2- 172.21.15.46:0/2176996738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b8c0b3e70 0x7f1b700039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.364+0000 7f1b8be00640 1 -- 172.21.15.46:0/2176996738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b70004d00 msgr2=0x7f1b70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.364+0000 7f1b8be00640 1 --2- 172.21.15.46:0/2176996738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b70004d00 0x7f1b70005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.364+0000 7f1b8be00640 1 -- 172.21.15.46:0/2176996738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b70003520 con 0x7f1b70003fd0 2024-02-19T06:58:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.365+0000 7f1b8be00640 1 --2- 172.21.15.46:0/2176996738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b70003fd0 0x7f1b700047c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800ba30 tx=0x7f1b700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7edbf2253c31c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.365+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78032640 con 0x7f1b70003fd0 2024-02-19T06:58:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.365+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b780327a0 con 0x7f1b70003fd0 2024-02-19T06:58:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.365+0000 7f1b8b400640 1 -- 172.21.15.46:0/2176996738 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78032b30 con 0x7f1b70003fd0 2024-02-19T06:58:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.366+0000 7f1b93800640 1 -- 172.21.15.46:0/2176996738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b70003fd0 msgr2=0x7f1b700047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.366+0000 7f1b93800640 1 --2- 172.21.15.46:0/2176996738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b70003fd0 0x7f1b700047c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800ba30 tx=0x7f1b700057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.366+0000 7f1b91800640 1 -- 172.21.15.46:0/2176996738 reap_dead start 2024-02-19T06:58:38.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.366+0000 7f1b93800640 1 -- 172.21.15.46:0/2176996738 shutdown_connections 2024-02-19T06:58:38.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.366+0000 7f1b93800640 1 -- 172.21.15.46:0/2176996738 >> 172.21.15.46:0/2176996738 conn(0x7f1b8c066fc0 msgr2=0x7f1b8c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:38.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.366+0000 7f1b93800640 1 -- 172.21.15.46:0/2176996738 shutdown_connections 2024-02-19T06:58:38.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.366+0000 7f1b93800640 1 -- 172.21.15.46:0/2176996738 wait complete. 2024-02-19T06:58:38.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.368+0000 7f1b93800640 1 Processor -- start 2024-02-19T06:58:38.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.368+0000 7f1b93800640 1 -- start start 2024-02-19T06:58:38.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.369+0000 7f1b93800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b70003fd0 0x7f1b8c0a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:38.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.369+0000 7f1b93800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b8c0a9700 0x7f1b8c14ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.369+0000 7f1b93800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b8c149ea0 0x7f1b8c158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.369+0000 7f1b93800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c15bac0 con 0x7f1b70003fd0 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.369+0000 7f1b93800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c0aa180 con 0x7f1b8c149ea0 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.369+0000 7f1b93800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c0a9ea0 con 0x7f1b8c0a9700 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.370+0000 7f1b90e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b70003fd0 0x7f1b8c0a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.370+0000 7f1b90e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b70003fd0 0x7f1b8c0a90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60348/0 (socket says 172.21.15.46:60348) 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.370+0000 7f1b90e00640 1 -- 172.21.15.46:0/2363078998 learned_addr learned my addr 172.21.15.46:0/2363078998 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.370+0000 7f1b91800640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b8c149ea0 0x7f1b8c158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.370+0000 7f1b8be00640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b8c0a9700 0x7f1b8c14ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.370+0000 7f1b90e00640 1 -- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b8c0a9700 msgr2=0x7f1b8c14ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.370+0000 7f1b90e00640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b8c0a9700 0x7f1b8c14ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.370+0000 7f1b90e00640 1 -- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b8c149ea0 msgr2=0x7f1b8c158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.370+0000 7f1b90e00640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b8c149ea0 0x7f1b8c158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.370+0000 7f1b90e00640 1 -- 172.21.15.46:0/2363078998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c15b470 con 0x7f1b70003fd0 2024-02-19T06:58:38.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.370+0000 7f1b90e00640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b70003fd0 0x7f1b8c0a90d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00e7b0 tx=0x7f1b7c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:38.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.371+0000 7f1b88c00640 1 -- 172.21.15.46:0/2363078998 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00c8d0 con 0x7f1b70003fd0 2024-02-19T06:58:38.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.371+0000 7f1b88c00640 1 -- 172.21.15.46:0/2363078998 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c00ca50 con 0x7f1b70003fd0 2024-02-19T06:58:38.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.371+0000 7f1b88c00640 1 -- 172.21.15.46:0/2363078998 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00ce00 con 0x7f1b70003fd0 2024-02-19T06:58:38.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.371+0000 7f1b93800640 1 -- 172.21.15.46:0/2363078998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8c15b750 con 0x7f1b70003fd0 2024-02-19T06:58:38.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.371+0000 7f1b93800640 1 -- 172.21.15.46:0/2363078998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8c0a9b80 con 0x7f1b70003fd0 2024-02-19T06:58:38.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.372+0000 7f1b93800640 1 -- 172.21.15.46:0/2363078998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8c067ba0 con 0x7f1b70003fd0 2024-02-19T06:58:38.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.373+0000 7f1b88c00640 1 -- 172.21.15.46:0/2363078998 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1b7c01d460 con 0x7f1b70003fd0 2024-02-19T06:58:38.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.375+0000 7f1b88c00640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b6c06b810 0x7f1b6c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:38.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.375+0000 7f1b88c00640 1 -- 172.21.15.46:0/2363078998 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1b7c08a2d0 con 0x7f1b70003fd0 2024-02-19T06:58:38.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.375+0000 7f1b8be00640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b6c06b810 0x7f1b6c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:38.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.376+0000 7f1b8be00640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b6c06b810 0x7f1b6c06dcd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800ba00 tx=0x7f1b7803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:38.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.379+0000 7f1b88c00640 1 -- 172.21.15.46:0/2363078998 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b7c054bd0 con 0x7f1b70003fd0 2024-02-19T06:58:38.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.583+0000 7f1b93800640 1 -- 172.21.15.46:0/2363078998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1b8c1545d0 con 0x7f1b70003fd0 2024-02-19T06:58:38.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.590+0000 7f1b88c00640 1 -- 172.21.15.46:0/2363078998 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1b7c058290 con 0x7f1b70003fd0 2024-02-19T06:58:38.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.592+0000 7f1b93800640 1 -- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b6c06b810 msgr2=0x7f1b6c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:38.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.592+0000 7f1b93800640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b6c06b810 0x7f1b6c06dcd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800ba00 tx=0x7f1b7803d040 comp rx=0 tx=0).stop 2024-02-19T06:58:38.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.592+0000 7f1b93800640 1 -- 172.21.15.46:0/2363078998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b70003fd0 msgr2=0x7f1b8c0a90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:38.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.592+0000 7f1b93800640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b70003fd0 0x7f1b8c0a90d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00e7b0 tx=0x7f1b7c00ec70 comp rx=0 tx=0).stop 2024-02-19T06:58:38.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.593+0000 7f1b93800640 1 -- 172.21.15.46:0/2363078998 shutdown_connections 2024-02-19T06:58:38.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.593+0000 7f1b93800640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1b6c06b810 0x7f1b6c06dcd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.593+0000 7f1b93800640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b8c149ea0 0x7f1b8c158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.593+0000 7f1b93800640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b8c0a9700 0x7f1b8c14ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.593+0000 7f1b93800640 1 --2- 172.21.15.46:0/2363078998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b70003fd0 0x7f1b8c0a90d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:38.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.593+0000 7f1b93800640 1 -- 172.21.15.46:0/2363078998 >> 172.21.15.46:0/2363078998 conn(0x7f1b8c066fc0 msgr2=0x7f1b8c0718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:38.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.593+0000 7f1b93800640 1 -- 172.21.15.46:0/2363078998 shutdown_connections 2024-02-19T06:58:38.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:38.593+0000 7f1b93800640 1 -- 172.21.15.46:0/2363078998 wait complete. 2024-02-19T06:58:38.612 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-19T06:58:38.613 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-19T06:58:38.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-19T06:58:38.843 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-19T06:58:38.843 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:58:38.843 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T06:58:38.903 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:58:38.904 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T06:58:38.960 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:39.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.178+0000 7f7a97e00640 1 Processor -- start 2024-02-19T06:58:39.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.179+0000 7f7a97e00640 1 -- start start 2024-02-19T06:58:39.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.180+0000 7f7a97e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7a9815d7f0 0x7f7a980d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.180+0000 7f7a97e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a98162230 0x7f7a980cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.180+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9815dbd0 0x7f7a980d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.180+0000 7f7a97e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a980cf770 con 0x7f7a9815d7f0 2024-02-19T06:58:39.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.180+0000 7f7a97e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a980d1400 con 0x7f7a98162230 2024-02-19T06:58:39.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.180+0000 7f7a97e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980d16e0 con 0x7f7a9815dbd0 2024-02-19T06:58:39.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.180+0000 7f7a96a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7a9815d7f0 0x7f7a980d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.181+0000 7f7a96a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7a9815d7f0 0x7f7a980d21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60352/0 (socket says 172.21.15.46:60352) 2024-02-19T06:58:39.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.181+0000 7f7a96a00640 1 -- 172.21.15.46:0/3557251331 learned_addr learned my addr 172.21.15.46:0/3557251331 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:39.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.181+0000 7f7a97400640 1 --2- 172.21.15.46:0/3557251331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9815dbd0 0x7f7a980d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.181+0000 7f7a8fe00640 1 --2- 172.21.15.46:0/3557251331 >> v2:172.21.15.142:3300/0 conn(0x7f7a98162230 0x7f7a980cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.181+0000 7f7a96a00640 1 -- 172.21.15.46:0/3557251331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9815dbd0 msgr2=0x7f7a980d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:39.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.181+0000 7f7a96a00640 1 --2- 172.21.15.46:0/3557251331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9815dbd0 0x7f7a980d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.181+0000 7f7a96a00640 1 -- 172.21.15.46:0/3557251331 >> v2:172.21.15.142:3300/0 conn(0x7f7a98162230 msgr2=0x7f7a980cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:39.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.181+0000 7f7a96a00640 1 --2- 172.21.15.46:0/3557251331 >> v2:172.21.15.142:3300/0 conn(0x7f7a98162230 0x7f7a980cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.181+0000 7f7a96a00640 1 -- 172.21.15.46:0/3557251331 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a980d19c0 con 0x7f7a9815d7f0 2024-02-19T06:58:39.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.183+0000 7f7a96a00640 1 --2- 172.21.15.46:0/3557251331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a9815d7f0 0x7f7a980d21c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7a980b6280 tx=0x7f7a8802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d0750586275fe8 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:39.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.183+0000 7f7a96000640 1 -- 172.21.15.46:0/3557251331 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a880317e0 con 0x7f7a9815d7f0 2024-02-19T06:58:39.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.183+0000 7f7a96000640 1 -- 172.21.15.46:0/3557251331 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a88031940 con 0x7f7a9815d7f0 2024-02-19T06:58:39.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.183+0000 7f7a96000640 1 -- 172.21.15.46:0/3557251331 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88031cd0 con 0x7f7a9815d7f0 2024-02-19T06:58:39.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.184+0000 7f7a97e00640 1 -- 172.21.15.46:0/3557251331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a9815d7f0 msgr2=0x7f7a980d21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:39.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.184+0000 7f7a97e00640 1 --2- 172.21.15.46:0/3557251331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a9815d7f0 0x7f7a980d21c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7a980b6280 tx=0x7f7a8802b880 comp rx=0 tx=0).stop 2024-02-19T06:58:39.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.184+0000 7f7a97e00640 1 -- 172.21.15.46:0/3557251331 shutdown_connections 2024-02-19T06:58:39.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.184+0000 7f7a97e00640 1 --2- 172.21.15.46:0/3557251331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9815dbd0 0x7f7a980d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.184+0000 7f7a97e00640 1 --2- 172.21.15.46:0/3557251331 >> v2:172.21.15.142:3300/0 conn(0x7f7a98162230 0x7f7a980cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.184+0000 7f7a97e00640 1 --2- 172.21.15.46:0/3557251331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a9815d7f0 0x7f7a980d21c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.184+0000 7f7a97e00640 1 -- 172.21.15.46:0/3557251331 >> 172.21.15.46:0/3557251331 conn(0x7f7a9809ca70 msgr2=0x7f7a9808afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:39.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.184+0000 7f7a97e00640 1 -- 172.21.15.46:0/3557251331 shutdown_connections 2024-02-19T06:58:39.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.184+0000 7f7a97e00640 1 -- 172.21.15.46:0/3557251331 wait complete. 2024-02-19T06:58:39.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.186+0000 7f7a97e00640 1 Processor -- start 2024-02-19T06:58:39.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.186+0000 7f7a97e00640 1 -- start start 2024-02-19T06:58:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.187+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a9815d7f0 0x7f7a980b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.187+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9815dbd0 0x7f7a980b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.187+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a98162230 0x7f7a980cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.187+0000 7f7a97e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980b2cf0 con 0x7f7a9815d7f0 2024-02-19T06:58:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.187+0000 7f7a97e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980b2fd0 con 0x7f7a98162230 2024-02-19T06:58:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.187+0000 7f7a97e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980cb820 con 0x7f7a9815dbd0 2024-02-19T06:58:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.187+0000 7f7a96a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a9815d7f0 0x7f7a980b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.187+0000 7f7a96a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a9815d7f0 0x7f7a980b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60368/0 (socket says 172.21.15.46:60368) 2024-02-19T06:58:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.187+0000 7f7a96a00640 1 -- 172.21.15.46:0/2579189136 learned_addr learned my addr 172.21.15.46:0/2579189136 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.187+0000 7f7a97400640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a98162230 0x7f7a980cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.187+0000 7f7a96a00640 1 -- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9815dbd0 msgr2=0x7f7a980b8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.187+0000 7f7a8fe00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9815dbd0 0x7f7a980b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.187+0000 7f7a96a00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9815dbd0 0x7f7a980b8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.188+0000 7f7a96a00640 1 -- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a98162230 msgr2=0x7f7a980cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.188+0000 7f7a96a00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a98162230 0x7f7a980cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.188+0000 7f7a96a00640 1 -- 172.21.15.46:0/2579189136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a880094d0 con 0x7f7a9815d7f0 2024-02-19T06:58:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.188+0000 7f7a8fe00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9815dbd0 0x7f7a980b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.188+0000 7f7a96a00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a9815d7f0 0x7f7a980b2630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7a8802b8c0 tx=0x7f7a880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.188+0000 7f7a8ea00640 1 -- 172.21.15.46:0/2579189136 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88032880 con 0x7f7a9815d7f0 2024-02-19T06:58:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.188+0000 7f7a8ea00640 1 -- 172.21.15.46:0/2579189136 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a88032a00 con 0x7f7a9815d7f0 2024-02-19T06:58:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.188+0000 7f7a8ea00640 1 -- 172.21.15.46:0/2579189136 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88032db0 con 0x7f7a9815d7f0 2024-02-19T06:58:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.188+0000 7f7a97e00640 1 -- 172.21.15.46:0/2579189136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a980d2880 con 0x7f7a9815d7f0 2024-02-19T06:58:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.188+0000 7f7a97e00640 1 -- 172.21.15.46:0/2579189136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a980cbde0 con 0x7f7a9815d7f0 2024-02-19T06:58:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.190+0000 7f7a97e00640 1 -- 172.21.15.46:0/2579189136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9804eee0 con 0x7f7a9815d7f0 2024-02-19T06:58:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.190+0000 7f7a8ea00640 1 -- 172.21.15.46:0/2579189136 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7a8804d3f0 con 0x7f7a9815d7f0 2024-02-19T06:58:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.191+0000 7f7a8ea00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7a7406b810 0x7f7a7406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.192+0000 7f7a8ea00640 1 -- 172.21.15.46:0/2579189136 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7a880ac0c0 con 0x7f7a9815d7f0 2024-02-19T06:58:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.192+0000 7f7a8fe00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7a7406b810 0x7f7a7406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.193+0000 7f7a8fe00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7a7406b810 0x7f7a7406dcd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a80006fd0 tx=0x7f7a80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:39.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.196+0000 7f7a8ea00640 1 -- 172.21.15.46:0/2579189136 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a88076a70 con 0x7f7a9815d7f0 2024-02-19T06:58:39.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.396+0000 7f7a97e00640 1 -- 172.21.15.46:0/2579189136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a980b3310 con 0x7f7a9815d7f0 2024-02-19T06:58:39.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.399+0000 7f7a8ea00640 1 -- 172.21.15.46:0/2579189136 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16855 (secure 0 0 0) 0x7f7a8807a130 con 0x7f7a9815d7f0 2024-02-19T06:58:39.401 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:39.401 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:58:37.086581+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:39.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.402+0000 7f7a97e00640 1 -- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7a7406b810 msgr2=0x7f7a7406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:39.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.402+0000 7f7a97e00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7a7406b810 0x7f7a7406dcd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a80006fd0 tx=0x7f7a80008040 comp rx=0 tx=0).stop 2024-02-19T06:58:39.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.402+0000 7f7a97e00640 1 -- 172.21.15.46:0/2579189136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a9815d7f0 msgr2=0x7f7a980b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:39.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.402+0000 7f7a97e00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a9815d7f0 0x7f7a980b2630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7a8802b8c0 tx=0x7f7a880046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.402+0000 7f7a97e00640 1 -- 172.21.15.46:0/2579189136 shutdown_connections 2024-02-19T06:58:39.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.402+0000 7f7a97e00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7a7406b810 0x7f7a7406dcd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.402+0000 7f7a97e00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a98162230 0x7f7a980cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.402+0000 7f7a97e00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9815dbd0 0x7f7a980b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.402+0000 7f7a97e00640 1 --2- 172.21.15.46:0/2579189136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a9815d7f0 0x7f7a980b2630 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.402+0000 7f7a97e00640 1 -- 172.21.15.46:0/2579189136 >> 172.21.15.46:0/2579189136 conn(0x7f7a9809ca70 msgr2=0x7f7a9806bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:39.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.402+0000 7f7a97e00640 1 -- 172.21.15.46:0/2579189136 shutdown_connections 2024-02-19T06:58:39.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.402+0000 7f7a97e00640 1 -- 172.21.15.46:0/2579189136 wait complete. 2024-02-19T06:58:39.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:39.424 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:39.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.647+0000 7ff751600640 1 Processor -- start 2024-02-19T06:58:39.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.647+0000 7ff751600640 1 -- start start 2024-02-19T06:58:39.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.649+0000 7ff751600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff74c15a770 0x7ff74c0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.649+0000 7ff751600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74c0b4290 con 0x7ff74c0b27d0 2024-02-19T06:58:39.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.649+0000 7ff751600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74c0b38c0 con 0x7ff74c0cf530 2024-02-19T06:58:39.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.649+0000 7ff751600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74c0b2cb0 con 0x7ff74c15a770 2024-02-19T06:58:39.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.649+0000 7ff750c00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff74c0b27d0 0x7ff74c06e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54938/0 (socket says 172.21.15.46:54938) 2024-02-19T06:58:39.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.649+0000 7ff750c00640 1 -- 172.21.15.46:0/3583238597 learned_addr learned my addr 172.21.15.46:0/3583238597 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:39.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.649+0000 7ff743400640 1 --2- 172.21.15.46:0/3583238597 >> v2:172.21.15.142:3300/0 conn(0x7ff74c15a770 0x7ff74c0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000725397 0 0) 0x7ff744001110 con 0x7ff74c0b27d0 2024-02-19T06:58:39.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff730003520 con 0x7ff74c0b27d0 2024-02-19T06:58:39.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3836703776 0 0) 0x7ff730003520 con 0x7ff74c0b27d0 2024-02-19T06:58:39.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 >> v2:172.21.15.142:3300/0 conn(0x7ff74c15a770 msgr2=0x7ff74c0b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:39.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 --2- 172.21.15.46:0/3583238597 >> v2:172.21.15.142:3300/0 conn(0x7ff74c15a770 0x7ff74c0b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 >> v1:172.21.15.142:6789/0 conn(0x7ff74c0cf530 legacy=0x7ff74c0cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:39.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c0b2f90 con 0x7ff74c0b27d0 2024-02-19T06:58:39.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7ff744001800 con 0x7ff74c0b27d0 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 >> v1:172.21.15.46:6789/0 conn(0x7ff74c0b27d0 legacy=0x7ff74c06e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 --2- 172.21.15.46:0/3583238597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff730003970 0x7ff730003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 --2- 172.21.15.46:0/3583238597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7300047c0 0x7ff730004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 --2- 172.21.15.46:0/3583238597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff730005180 0x7ff73000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0b2cb0 con 0x7ff730003970 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73000c020 con 0x7ff7300047c0 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.650+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73000c1e0 con 0x7ff730005180 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.651+0000 7ff74be00640 1 --2- 172.21.15.46:0/3583238597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff730003970 0x7ff730003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.651+0000 7ff743400640 1 --2- 172.21.15.46:0/3583238597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7300047c0 0x7ff730004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.651+0000 7ff750c00640 1 --2- 172.21.15.46:0/3583238597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff730005180 0x7ff73000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.651+0000 7ff74be00640 1 -- 172.21.15.46:0/3583238597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff730005180 msgr2=0x7ff73000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.651+0000 7ff74be00640 1 --2- 172.21.15.46:0/3583238597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff730005180 0x7ff73000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.651+0000 7ff74be00640 1 -- 172.21.15.46:0/3583238597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7300047c0 msgr2=0x7ff730004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:39.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.651+0000 7ff74be00640 1 --2- 172.21.15.46:0/3583238597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7300047c0 0x7ff730004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.651+0000 7ff750c00640 1 -- 172.21.15.46:0/3583238597 reap_dead start 2024-02-19T06:58:39.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.651+0000 7ff74be00640 1 -- 172.21.15.46:0/3583238597 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730003520 con 0x7ff730003970 2024-02-19T06:58:39.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.652+0000 7ff74be00640 1 --2- 172.21.15.46:0/3583238597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff730003970 0x7ff730003d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff73c001750 tx=0x7ff7300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861844b5ae2f120e server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:39.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.653+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0052d0 con 0x7ff730003970 2024-02-19T06:58:39.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.653+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c02e050 con 0x7ff730003970 2024-02-19T06:58:39.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.653+0000 7ff74b400640 1 -- 172.21.15.46:0/3583238597 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c003830 con 0x7ff730003970 2024-02-19T06:58:39.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.653+0000 7ff751600640 1 -- 172.21.15.46:0/3583238597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff730003970 msgr2=0x7ff730003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:39.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.653+0000 7ff751600640 1 --2- 172.21.15.46:0/3583238597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff730003970 0x7ff730003d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff73c001750 tx=0x7ff7300057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.653+0000 7ff751600640 1 -- 172.21.15.46:0/3583238597 shutdown_connections 2024-02-19T06:58:39.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.653+0000 7ff751600640 1 --2- 172.21.15.46:0/3583238597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff730003970 0x7ff730003d90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.653+0000 7ff751600640 1 -- 172.21.15.46:0/3583238597 >> 172.21.15.46:0/3583238597 conn(0x7ff74c06ad60 msgr2=0x7ff74c06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:39.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.654+0000 7ff751600640 1 -- 172.21.15.46:0/3583238597 shutdown_connections 2024-02-19T06:58:39.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.654+0000 7ff751600640 1 -- 172.21.15.46:0/3583238597 wait complete. 2024-02-19T06:58:39.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.655+0000 7ff751600640 1 Processor -- start 2024-02-19T06:58:39.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.656+0000 7ff751600640 1 -- start start 2024-02-19T06:58:39.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.656+0000 7ff751600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff730003970 0x7ff74c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.656+0000 7ff751600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0c5a20 0x7ff74c1f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.656+0000 7ff751600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff74c0c2f10 0x7ff74c0c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.656+0000 7ff751600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c1568a0 con 0x7ff74c0c5a20 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.656+0000 7ff751600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c15b1e0 con 0x7ff74c0c2f10 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.656+0000 7ff751600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c15b4c0 con 0x7ff730003970 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.657+0000 7ff743400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0c5a20 0x7ff74c1f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.657+0000 7ff743400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0c5a20 0x7ff74c1f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60384/0 (socket says 172.21.15.46:60384) 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.657+0000 7ff743400640 1 -- 172.21.15.46:0/544996979 learned_addr learned my addr 172.21.15.46:0/544996979 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.657+0000 7ff74be00640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff730003970 0x7ff74c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.657+0000 7ff750c00640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff74c0c2f10 0x7ff74c0c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.657+0000 7ff743400640 1 -- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff730003970 msgr2=0x7ff74c15ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.657+0000 7ff743400640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff730003970 0x7ff74c15ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.657+0000 7ff743400640 1 -- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff74c0c2f10 msgr2=0x7ff74c0c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.657+0000 7ff743400640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff74c0c2f10 0x7ff74c0c3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.657+0000 7ff743400640 1 -- 172.21.15.46:0/544996979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c15b7a0 con 0x7ff74c0c5a20 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.657+0000 7ff750c00640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff74c0c2f10 0x7ff74c0c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:39.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.658+0000 7ff743400640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0c5a20 0x7ff74c1f30a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff734009f20 tx=0x7ff7340115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:39.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.658+0000 7ff748c00640 1 -- 172.21.15.46:0/544996979 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73400e030 con 0x7ff74c0c5a20 2024-02-19T06:58:39.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.658+0000 7ff748c00640 1 -- 172.21.15.46:0/544996979 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff734016470 con 0x7ff74c0c5a20 2024-02-19T06:58:39.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.658+0000 7ff751600640 1 -- 172.21.15.46:0/544996979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74c15ba80 con 0x7ff74c0c5a20 2024-02-19T06:58:39.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.658+0000 7ff748c00640 1 -- 172.21.15.46:0/544996979 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734016800 con 0x7ff74c0c5a20 2024-02-19T06:58:39.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.658+0000 7ff751600640 1 -- 172.21.15.46:0/544996979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74c1f35e0 con 0x7ff74c0c5a20 2024-02-19T06:58:39.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.659+0000 7ff751600640 1 -- 172.21.15.46:0/544996979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74c04eee0 con 0x7ff74c0c5a20 2024-02-19T06:58:39.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.660+0000 7ff748c00640 1 -- 172.21.15.46:0/544996979 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff734016960 con 0x7ff74c0c5a20 2024-02-19T06:58:39.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.661+0000 7ff748c00640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff72806b810 0x7ff72806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:39.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.661+0000 7ff748c00640 1 -- 172.21.15.46:0/544996979 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff73400f070 con 0x7ff74c0c5a20 2024-02-19T06:58:39.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.662+0000 7ff74be00640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff72806b810 0x7ff72806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:39.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.663+0000 7ff74be00640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff72806b810 0x7ff72806dcd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff73c033000 tx=0x7ff73c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:39.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.666+0000 7ff748c00640 1 -- 172.21.15.46:0/544996979 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7340be8c0 con 0x7ff74c0c5a20 2024-02-19T06:58:39.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.868+0000 7ff751600640 1 -- 172.21.15.46:0/544996979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff74c06b140 con 0x7ff74c0c5a20 2024-02-19T06:58:39.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.869+0000 7ff748c00640 1 -- 172.21.15.46:0/544996979 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff73401a0a0 con 0x7ff74c0c5a20 2024-02-19T06:58:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:39.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.872+0000 7ff751600640 1 -- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff72806b810 msgr2=0x7ff72806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:39.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.872+0000 7ff751600640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff72806b810 0x7ff72806dcd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff73c033000 tx=0x7ff73c009030 comp rx=0 tx=0).stop 2024-02-19T06:58:39.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.872+0000 7ff751600640 1 -- 172.21.15.46:0/544996979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0c5a20 msgr2=0x7ff74c1f30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:39.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.872+0000 7ff751600640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0c5a20 0x7ff74c1f30a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff734009f20 tx=0x7ff7340115a0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.873+0000 7ff751600640 1 -- 172.21.15.46:0/544996979 shutdown_connections 2024-02-19T06:58:39.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.873+0000 7ff751600640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff72806b810 0x7ff72806dcd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.873+0000 7ff751600640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff74c0c2f10 0x7ff74c0c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.873+0000 7ff751600640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0c5a20 0x7ff74c1f30a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.873+0000 7ff751600640 1 --2- 172.21.15.46:0/544996979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff730003970 0x7ff74c15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:39.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.873+0000 7ff751600640 1 -- 172.21.15.46:0/544996979 >> 172.21.15.46:0/544996979 conn(0x7ff74c06ad60 msgr2=0x7ff74c0ac4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:39.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.873+0000 7ff751600640 1 -- 172.21.15.46:0/544996979 shutdown_connections 2024-02-19T06:58:39.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:39.873+0000 7ff751600640 1 -- 172.21.15.46:0/544996979 wait complete. 2024-02-19T06:58:39.894 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:40.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.114+0000 7f28a9400640 1 Processor -- start 2024-02-19T06:58:40.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.114+0000 7f28a9400640 1 -- start start 2024-02-19T06:58:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.116+0000 7f28a9400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28a40d0b30 0x7f28a40cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.116+0000 7f28a9400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28a40d2330 0x7f28a40d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.116+0000 7f28a9400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a40d19f0 con 0x7f28a4160f50 2024-02-19T06:58:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.116+0000 7f28a9400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a40ceed0 con 0x7f28a40d0b30 2024-02-19T06:58:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.116+0000 7f28a9400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40ce5e0 con 0x7f28a40d2330 2024-02-19T06:58:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.117+0000 7f2899e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28a40d0b30 0x7f28a40cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.117+0000 7f28a2800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f28a4160f50 0x7f28a40d1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54948/0 (socket says 172.21.15.46:54948) 2024-02-19T06:58:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.117+0000 7f28a2800640 1 -- 172.21.15.46:0/1231248140 learned_addr learned my addr 172.21.15.46:0/1231248140 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:40.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.117+0000 7f28a3200640 1 --2- 172.21.15.46:0/1231248140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28a40d2330 0x7f28a40d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:40.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.117+0000 7f2899e00640 1 -- 172.21.15.46:0/1231248140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28a40d2330 msgr2=0x7f28a40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:40.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.117+0000 7f2899e00640 1 --2- 172.21.15.46:0/1231248140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28a40d2330 0x7f28a40d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.117+0000 7f2899e00640 1 -- 172.21.15.46:0/1231248140 >> v1:172.21.15.46:6789/0 conn(0x7f28a4160f50 legacy=0x7f28a40d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:40.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.117+0000 7f2899e00640 1 -- 172.21.15.46:0/1231248140 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a40d27c0 con 0x7f28a40d0b30 2024-02-19T06:58:40.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.118+0000 7f2899e00640 1 --2- 172.21.15.46:0/1231248140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28a40d0b30 0x7f28a40cf360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f288c0097a0 tx=0x7f288c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d6a3c205d9f0e8 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:40.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.119+0000 7f28a1e00640 1 -- 172.21.15.46:0/1231248140 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c02d040 con 0x7f28a40d0b30 2024-02-19T06:58:40.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.119+0000 7f28a1e00640 1 -- 172.21.15.46:0/1231248140 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c031810 con 0x7f28a40d0b30 2024-02-19T06:58:40.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.119+0000 7f28a1e00640 1 -- 172.21.15.46:0/1231248140 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c031ba0 con 0x7f28a40d0b30 2024-02-19T06:58:40.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.119+0000 7f28a9400640 1 -- 172.21.15.46:0/1231248140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28a40d0b30 msgr2=0x7f28a40cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:40.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.119+0000 7f28a9400640 1 --2- 172.21.15.46:0/1231248140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28a40d0b30 0x7f28a40cf360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f288c0097a0 tx=0x7f288c02b8b0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.120+0000 7f28a9400640 1 -- 172.21.15.46:0/1231248140 shutdown_connections 2024-02-19T06:58:40.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.120+0000 7f28a9400640 1 --2- 172.21.15.46:0/1231248140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28a40d2330 0x7f28a40d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.120+0000 7f28a9400640 1 --2- 172.21.15.46:0/1231248140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28a40d0b30 0x7f28a40cf360 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.120+0000 7f28a9400640 1 -- 172.21.15.46:0/1231248140 >> 172.21.15.46:0/1231248140 conn(0x7f28a408afc0 msgr2=0x7f28a40d38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:40.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.120+0000 7f28a9400640 1 -- 172.21.15.46:0/1231248140 shutdown_connections 2024-02-19T06:58:40.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.120+0000 7f28a9400640 1 -- 172.21.15.46:0/1231248140 wait complete. 2024-02-19T06:58:40.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.121+0000 7f28a9400640 1 Processor -- start 2024-02-19T06:58:40.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.122+0000 7f28a9400640 1 -- start start 2024-02-19T06:58:40.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a9400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28a40d0b30 0x7f28a40c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:40.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a9400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28a40d2330 0x7f28a40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:40.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a9400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28a4160f50 0x7f28a406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a9400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40c8830 con 0x7f28a40d0b30 2024-02-19T06:58:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a9400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40b70b0 con 0x7f28a4160f50 2024-02-19T06:58:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a9400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40b7390 con 0x7f28a40d2330 2024-02-19T06:58:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a2800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28a40d0b30 0x7f28a40c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a2800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28a40d0b30 0x7f28a40c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60390/0 (socket says 172.21.15.46:60390) 2024-02-19T06:58:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a2800640 1 -- 172.21.15.46:0/413724639 learned_addr learned my addr 172.21.15.46:0/413724639 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a2800640 1 -- 172.21.15.46:0/413724639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28a40d2330 msgr2=0x7f28a40b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a2800640 1 --2- 172.21.15.46:0/413724639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28a40d2330 0x7f28a40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a2800640 1 -- 172.21.15.46:0/413724639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28a4160f50 msgr2=0x7f28a406d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a2800640 1 --2- 172.21.15.46:0/413724639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28a4160f50 0x7f28a406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.123+0000 7f28a2800640 1 -- 172.21.15.46:0/413724639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c009400 con 0x7f28a40d0b30 2024-02-19T06:58:40.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.124+0000 7f28a2800640 1 --2- 172.21.15.46:0/413724639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28a40d0b30 0x7f28a40c7fe0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f289400ca70 tx=0x7f289400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:40.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.124+0000 7f289b400640 1 -- 172.21.15.46:0/413724639 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289400abd0 con 0x7f28a40d0b30 2024-02-19T06:58:40.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.124+0000 7f289b400640 1 -- 172.21.15.46:0/413724639 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289400ad30 con 0x7f28a40d0b30 2024-02-19T06:58:40.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.124+0000 7f289b400640 1 -- 172.21.15.46:0/413724639 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894012620 con 0x7f28a40d0b30 2024-02-19T06:58:40.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.124+0000 7f28a9400640 1 -- 172.21.15.46:0/413724639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a40b90c0 con 0x7f28a40d0b30 2024-02-19T06:58:40.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.124+0000 7f28a9400640 1 -- 172.21.15.46:0/413724639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a406d930 con 0x7f28a40d0b30 2024-02-19T06:58:40.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.125+0000 7f28a9400640 1 -- 172.21.15.46:0/413724639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a40682b0 con 0x7f28a40d0b30 2024-02-19T06:58:40.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.126+0000 7f289b400640 1 -- 172.21.15.46:0/413724639 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2894007070 con 0x7f28a40d0b30 2024-02-19T06:58:40.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.128+0000 7f289b400640 1 --2- 172.21.15.46:0/413724639 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f288006b810 0x7f288006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:40.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.128+0000 7f289b400640 1 -- 172.21.15.46:0/413724639 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f289408a200 con 0x7f28a40d0b30 2024-02-19T06:58:40.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.129+0000 7f2899e00640 1 --2- 172.21.15.46:0/413724639 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f288006b810 0x7f288006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:40.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.130+0000 7f2899e00640 1 --2- 172.21.15.46:0/413724639 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f288006b810 0x7f288006dcd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f288c036000 tx=0x7f288c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:40.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.133+0000 7f289b400640 1 -- 172.21.15.46:0/413724639 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2894054b90 con 0x7f28a40d0b30 2024-02-19T06:58:40.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.331+0000 7f28a9400640 1 -- 172.21.15.46:0/413724639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28a40d3ff0 con 0x7f28a40d0b30 2024-02-19T06:58:40.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.332+0000 7f289b400640 1 -- 172.21.15.46:0/413724639 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2894058250 con 0x7f28a40d0b30 2024-02-19T06:58:40.333 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:40.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.334+0000 7f28a9400640 1 -- 172.21.15.46:0/413724639 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f288006b810 msgr2=0x7f288006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:40.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.334+0000 7f28a9400640 1 --2- 172.21.15.46:0/413724639 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f288006b810 0x7f288006dcd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f288c036000 tx=0x7f288c030000 comp rx=0 tx=0).stop 2024-02-19T06:58:40.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.334+0000 7f28a9400640 1 -- 172.21.15.46:0/413724639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28a40d0b30 msgr2=0x7f28a40c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:40.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.334+0000 7f28a9400640 1 --2- 172.21.15.46:0/413724639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28a40d0b30 0x7f28a40c7fe0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f289400ca70 tx=0x7f289400cf30 comp rx=0 tx=0).stop 2024-02-19T06:58:40.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.335+0000 7f28a9400640 1 -- 172.21.15.46:0/413724639 shutdown_connections 2024-02-19T06:58:40.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.335+0000 7f28a9400640 1 --2- 172.21.15.46:0/413724639 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f288006b810 0x7f288006dcd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.335+0000 7f28a9400640 1 --2- 172.21.15.46:0/413724639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28a4160f50 0x7f28a406d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.335+0000 7f28a9400640 1 --2- 172.21.15.46:0/413724639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28a40d2330 0x7f28a40b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.335+0000 7f28a9400640 1 --2- 172.21.15.46:0/413724639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28a40d0b30 0x7f28a40c7fe0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.335+0000 7f28a9400640 1 -- 172.21.15.46:0/413724639 >> 172.21.15.46:0/413724639 conn(0x7f28a408afc0 msgr2=0x7f28a40cfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:40.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.335+0000 7f28a9400640 1 -- 172.21.15.46:0/413724639 shutdown_connections 2024-02-19T06:58:40.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.335+0000 7f28a9400640 1 -- 172.21.15.46:0/413724639 wait complete. 2024-02-19T06:58:40.357 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:40.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.584+0000 7fd5da600640 1 Processor -- start 2024-02-19T06:58:40.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.585+0000 7fd5da600640 1 -- start start 2024-02-19T06:58:40.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.586+0000 7fd5da600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d4145050 0x7fd5d40cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:40.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.586+0000 7fd5da600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd5d40cfae0 0x7fd5d406d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:40.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.586+0000 7fd5da600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d4071e80 con 0x7fd5d40ccce0 2024-02-19T06:58:40.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.586+0000 7fd5da600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d4071020 con 0x7fd5d40cfae0 2024-02-19T06:58:40.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.586+0000 7fd5da600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d40aef70 con 0x7fd5d4145050 2024-02-19T06:58:40.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.587+0000 7fd5d3e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd5d40cfae0 0x7fd5d406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:40.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.587+0000 7fd5d3e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd5d40cfae0 0x7fd5d406d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60392/0 (socket says 172.21.15.46:60392) 2024-02-19T06:58:40.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.587+0000 7fd5d3e00640 1 -- 172.21.15.46:0/2982228123 learned_addr learned my addr 172.21.15.46:0/2982228123 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:40.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.587+0000 7fd5d3400640 1 --2- 172.21.15.46:0/2982228123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d4145050 0x7fd5d40cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:40.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.587+0000 7fd5d3e00640 1 -- 172.21.15.46:0/2982228123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d4145050 msgr2=0x7fd5d40cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:40.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.587+0000 7fd5d3e00640 1 --2- 172.21.15.46:0/2982228123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d4145050 0x7fd5d40cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.587+0000 7fd5d3e00640 1 -- 172.21.15.46:0/2982228123 >> v1:172.21.15.142:6789/0 conn(0x7fd5d40ccce0 legacy=0x7fd5d40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:40.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.587+0000 7fd5d3e00640 1 -- 172.21.15.46:0/2982228123 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d4071270 con 0x7fd5d40cfae0 2024-02-19T06:58:40.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.588+0000 7fd5d3e00640 1 --2- 172.21.15.46:0/2982228123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5d40cfae0 0x7fd5d406d680 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009e50 tx=0x7fd5cc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b429d196fa59a0a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:40.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.589+0000 7fd5d2a00640 1 -- 172.21.15.46:0/2982228123 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc02ca70 con 0x7fd5d40cfae0 2024-02-19T06:58:40.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.589+0000 7fd5d2a00640 1 -- 172.21.15.46:0/2982228123 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc02cbd0 con 0x7fd5d40cfae0 2024-02-19T06:58:40.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.589+0000 7fd5d2a00640 1 -- 172.21.15.46:0/2982228123 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0343f0 con 0x7fd5d40cfae0 2024-02-19T06:58:40.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.589+0000 7fd5da600640 1 -- 172.21.15.46:0/2982228123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5d40cfae0 msgr2=0x7fd5d406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:40.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.589+0000 7fd5da600640 1 --2- 172.21.15.46:0/2982228123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5d40cfae0 0x7fd5d406d680 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009e50 tx=0x7fd5cc02bed0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.590+0000 7fd5da600640 1 -- 172.21.15.46:0/2982228123 shutdown_connections 2024-02-19T06:58:40.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.590+0000 7fd5da600640 1 --2- 172.21.15.46:0/2982228123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5d40cfae0 0x7fd5d406d680 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.590+0000 7fd5da600640 1 --2- 172.21.15.46:0/2982228123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d4145050 0x7fd5d40cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.590+0000 7fd5da600640 1 -- 172.21.15.46:0/2982228123 >> 172.21.15.46:0/2982228123 conn(0x7fd5d4066fc0 msgr2=0x7fd5d406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:40.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.590+0000 7fd5da600640 1 -- 172.21.15.46:0/2982228123 shutdown_connections 2024-02-19T06:58:40.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.590+0000 7fd5da600640 1 -- 172.21.15.46:0/2982228123 wait complete. 2024-02-19T06:58:40.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.591+0000 7fd5da600640 1 Processor -- start 2024-02-19T06:58:40.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.592+0000 7fd5da600640 1 -- start start 2024-02-19T06:58:40.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.592+0000 7fd5da600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40ccce0 0x7fd5d415c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:40.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.592+0000 7fd5da600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5d40cfae0 0x7fd5d4135410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:40.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.592+0000 7fd5da600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d4145050 0x7fd5d415b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:40.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.592+0000 7fd5da600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d415d6a0 con 0x7fd5d40cfae0 2024-02-19T06:58:40.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.592+0000 7fd5da600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d412f820 con 0x7fd5d4145050 2024-02-19T06:58:40.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.592+0000 7fd5da600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d4135950 con 0x7fd5d40ccce0 2024-02-19T06:58:40.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.593+0000 7fd5cbe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5d40cfae0 0x7fd5d4135410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:40.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.593+0000 7fd5cbe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5d40cfae0 0x7fd5d4135410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60396/0 (socket says 172.21.15.46:60396) 2024-02-19T06:58:40.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.593+0000 7fd5cbe00640 1 -- 172.21.15.46:0/1012942729 learned_addr learned my addr 172.21.15.46:0/1012942729 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:40.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.593+0000 7fd5d3e00640 1 --2- 172.21.15.46:0/1012942729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d4145050 0x7fd5d415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:40.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.593+0000 7fd5cbe00640 1 -- 172.21.15.46:0/1012942729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40ccce0 msgr2=0x7fd5d415c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:40.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.593+0000 7fd5cbe00640 1 --2- 172.21.15.46:0/1012942729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40ccce0 0x7fd5d415c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.593+0000 7fd5cbe00640 1 -- 172.21.15.46:0/1012942729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d4145050 msgr2=0x7fd5d415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:40.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.593+0000 7fd5cbe00640 1 --2- 172.21.15.46:0/1012942729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d4145050 0x7fd5d415b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.593+0000 7fd5cbe00640 1 -- 172.21.15.46:0/1012942729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc009b30 con 0x7fd5d40cfae0 2024-02-19T06:58:40.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.594+0000 7fd5cbe00640 1 --2- 172.21.15.46:0/1012942729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5d40cfae0 0x7fd5d4135410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00c430 tx=0x7fd5bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:40.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.594+0000 7fd5cb400640 1 -- 172.21.15.46:0/1012942729 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc011790 con 0x7fd5d40cfae0 2024-02-19T06:58:40.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.594+0000 7fd5cb400640 1 -- 172.21.15.46:0/1012942729 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc0118f0 con 0x7fd5d40cfae0 2024-02-19T06:58:40.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.594+0000 7fd5da600640 1 -- 172.21.15.46:0/1012942729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d415ce00 con 0x7fd5d40cfae0 2024-02-19T06:58:40.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.594+0000 7fd5cb400640 1 -- 172.21.15.46:0/1012942729 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc011ce0 con 0x7fd5d40cfae0 2024-02-19T06:58:40.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.594+0000 7fd5da600640 1 -- 172.21.15.46:0/1012942729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d415d3c0 con 0x7fd5d40cfae0 2024-02-19T06:58:40.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.595+0000 7fd5da600640 1 -- 172.21.15.46:0/1012942729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d412f580 con 0x7fd5d40cfae0 2024-02-19T06:58:40.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.596+0000 7fd5cb400640 1 -- 172.21.15.46:0/1012942729 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd5bc01c460 con 0x7fd5d40cfae0 2024-02-19T06:58:40.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.597+0000 7fd5cb400640 1 --2- 172.21.15.46:0/1012942729 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5b006b810 0x7fd5b006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:40.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.597+0000 7fd5cb400640 1 -- 172.21.15.46:0/1012942729 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd5bc08a330 con 0x7fd5d40cfae0 2024-02-19T06:58:40.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.598+0000 7fd5d3400640 1 --2- 172.21.15.46:0/1012942729 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5b006b810 0x7fd5b006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:40.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.599+0000 7fd5d3400640 1 --2- 172.21.15.46:0/1012942729 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5b006b810 0x7fd5b006dcd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4006fd0 tx=0x7fd5c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:40.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.602+0000 7fd5cb400640 1 -- 172.21.15.46:0/1012942729 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd5d412f580 con 0x7fd5d40cfae0 2024-02-19T06:58:40.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.804+0000 7fd5da600640 1 -- 172.21.15.46:0/1012942729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5d412f580 con 0x7fd5d40cfae0 2024-02-19T06:58:40.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.805+0000 7fd5cb400640 1 -- 172.21.15.46:0/1012942729 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5d412f580 con 0x7fd5d40cfae0 2024-02-19T06:58:40.807 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:40.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.808+0000 7fd5da600640 1 -- 172.21.15.46:0/1012942729 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5b006b810 msgr2=0x7fd5b006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:40.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.808+0000 7fd5da600640 1 --2- 172.21.15.46:0/1012942729 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5b006b810 0x7fd5b006dcd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4006fd0 tx=0x7fd5c4008040 comp rx=0 tx=0).stop 2024-02-19T06:58:40.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.808+0000 7fd5da600640 1 -- 172.21.15.46:0/1012942729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5d40cfae0 msgr2=0x7fd5d4135410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:40.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.808+0000 7fd5da600640 1 --2- 172.21.15.46:0/1012942729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5d40cfae0 0x7fd5d4135410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00c430 tx=0x7fd5bc00c8f0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.808+0000 7fd5da600640 1 -- 172.21.15.46:0/1012942729 shutdown_connections 2024-02-19T06:58:40.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.808+0000 7fd5da600640 1 --2- 172.21.15.46:0/1012942729 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5b006b810 0x7fd5b006dcd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.808+0000 7fd5da600640 1 --2- 172.21.15.46:0/1012942729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d4145050 0x7fd5d415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.808+0000 7fd5da600640 1 --2- 172.21.15.46:0/1012942729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5d40cfae0 0x7fd5d4135410 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.808+0000 7fd5da600640 1 --2- 172.21.15.46:0/1012942729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40ccce0 0x7fd5d415c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:40.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.808+0000 7fd5da600640 1 -- 172.21.15.46:0/1012942729 >> 172.21.15.46:0/1012942729 conn(0x7fd5d4066fc0 msgr2=0x7fd5d40cb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.809+0000 7fd5da600640 1 -- 172.21.15.46:0/1012942729 shutdown_connections 2024-02-19T06:58:40.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:40.809+0000 7fd5da600640 1 -- 172.21.15.46:0/1012942729 wait complete. 2024-02-19T06:58:40.828 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-19T06:58:41.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.049+0000 7fc2f7e00640 1 Processor -- start 2024-02-19T06:58:41.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.049+0000 7fc2f7e00640 1 -- start start 2024-02-19T06:58:41.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.050+0000 7fc2f7e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2f815b610 0x7fc2f815fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.050+0000 7fc2f7e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80cdc00 con 0x7fc2f80cf690 2024-02-19T06:58:41.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.050+0000 7fc2f7e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f815c900 con 0x7fc2f80cfb20 2024-02-19T06:58:41.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.050+0000 7fc2f7e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f815cbe0 con 0x7fc2f815b610 2024-02-19T06:58:41.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.051+0000 7fc2efe00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc2f80cf690 0x7fc2f815b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54954/0 (socket says 172.21.15.46:54954) 2024-02-19T06:58:41.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.051+0000 7fc2efe00640 1 -- 172.21.15.46:0/1159371195 learned_addr learned my addr 172.21.15.46:0/1159371195 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:41.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.051+0000 7fc2f6a00640 1 --2- 172.21.15.46:0/1159371195 >> v2:172.21.15.142:3300/0 conn(0x7fc2f815b610 0x7fc2f815fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.051+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156931446 0 0) 0x7fc2f80cdc00 con 0x7fc2f80cf690 2024-02-19T06:58:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2dc003520 con 0x7fc2f80cf690 2024-02-19T06:58:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2310001282 0 0) 0x7fc2dc003520 con 0x7fc2f80cf690 2024-02-19T06:58:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 >> v2:172.21.15.142:3300/0 conn(0x7fc2f815b610 msgr2=0x7fc2f815fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 --2- 172.21.15.46:0/1159371195 >> v2:172.21.15.142:3300/0 conn(0x7fc2f815b610 0x7fc2f815fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 >> v1:172.21.15.142:6789/0 conn(0x7fc2f80cfb20 legacy=0x7fc2f815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f815f310 con 0x7fc2f80cf690 2024-02-19T06:58:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fc2e0001670 con 0x7fc2f80cf690 2024-02-19T06:58:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 >> v1:172.21.15.46:6789/0 conn(0x7fc2f80cf690 legacy=0x7fc2f815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 --2- 172.21.15.46:0/1159371195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2dc0039c0 0x7fc2dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 --2- 172.21.15.46:0/1159371195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2dc0047c0 0x7fc2dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 --2- 172.21.15.46:0/1159371195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2dc005180 0x7fc2dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f815cbe0 con 0x7fc2dc005180 2024-02-19T06:58:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00c080 con 0x7fc2dc0047c0 2024-02-19T06:58:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00c240 con 0x7fc2dc0039c0 2024-02-19T06:58:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.052+0000 7fc2f7400640 1 --2- 172.21.15.46:0/1159371195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2dc005180 0x7fc2dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.053+0000 7fc2f6a00640 1 --2- 172.21.15.46:0/1159371195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2dc0039c0 0x7fc2dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.053+0000 7fc2efe00640 1 --2- 172.21.15.46:0/1159371195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2dc0047c0 0x7fc2dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.053+0000 7fc2f7400640 1 -- 172.21.15.46:0/1159371195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2dc0039c0 msgr2=0x7fc2dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.053+0000 7fc2f7400640 1 --2- 172.21.15.46:0/1159371195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2dc0039c0 0x7fc2dc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.053+0000 7fc2f7400640 1 -- 172.21.15.46:0/1159371195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2dc0047c0 msgr2=0x7fc2dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.053+0000 7fc2f7400640 1 --2- 172.21.15.46:0/1159371195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2dc0047c0 0x7fc2dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.053+0000 7fc2f7400640 1 -- 172.21.15.46:0/1159371195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc003520 con 0x7fc2dc005180 2024-02-19T06:58:41.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.054+0000 7fc2f7400640 1 -- 172.21.15.46:0/1159371195 reap_dead start 2024-02-19T06:58:41.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.054+0000 7fc2f7400640 1 --2- 172.21.15.46:0/1159371195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2dc005180 0x7fc2dc00b980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0001e50 tx=0x7fc2dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b006cd9a5fd3f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:41.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.054+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0003b70 con 0x7fc2dc005180 2024-02-19T06:58:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.054+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f0003d10 con 0x7fc2dc005180 2024-02-19T06:58:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.054+0000 7fc2f6000640 1 -- 172.21.15.46:0/1159371195 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0005310 con 0x7fc2dc005180 2024-02-19T06:58:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.055+0000 7fc2f7e00640 1 -- 172.21.15.46:0/1159371195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2dc005180 msgr2=0x7fc2dc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.055+0000 7fc2f7e00640 1 --2- 172.21.15.46:0/1159371195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2dc005180 0x7fc2dc00b980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0001e50 tx=0x7fc2dc0057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.055+0000 7fc2f7e00640 1 -- 172.21.15.46:0/1159371195 shutdown_connections 2024-02-19T06:58:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.055+0000 7fc2f7e00640 1 --2- 172.21.15.46:0/1159371195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2dc005180 0x7fc2dc00b980 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.055+0000 7fc2f7e00640 1 -- 172.21.15.46:0/1159371195 >> 172.21.15.46:0/1159371195 conn(0x7fc2f80b1200 msgr2=0x7fc2f80b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.055+0000 7fc2f7e00640 1 -- 172.21.15.46:0/1159371195 shutdown_connections 2024-02-19T06:58:41.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.055+0000 7fc2f7e00640 1 -- 172.21.15.46:0/1159371195 wait complete. 2024-02-19T06:58:41.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.057+0000 7fc2f7e00640 1 Processor -- start 2024-02-19T06:58:41.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.057+0000 7fc2f7e00640 1 -- start start 2024-02-19T06:58:41.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.058+0000 7fc2f7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2dc005180 0x7fc2f8156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.058+0000 7fc2f7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f80ae2b0 0x7fc2f8149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.058+0000 7fc2f7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2f8158490 0x7fc2f8158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.058+0000 7fc2f7e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80adbb0 con 0x7fc2f8158490 2024-02-19T06:58:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.058+0000 7fc2f7e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f809aba0 con 0x7fc2dc005180 2024-02-19T06:58:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.058+0000 7fc2f7e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f8158e50 con 0x7fc2f80ae2b0 2024-02-19T06:58:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.058+0000 7fc2f7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2f8158490 0x7fc2f8158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.058+0000 7fc2f7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2f8158490 0x7fc2f8158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60404/0 (socket says 172.21.15.46:60404) 2024-02-19T06:58:41.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.058+0000 7fc2f7400640 1 -- 172.21.15.46:0/3218631126 learned_addr learned my addr 172.21.15.46:0/3218631126 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:41.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.059+0000 7fc2f6a00640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2dc005180 0x7fc2f8156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.059+0000 7fc2efe00640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f80ae2b0 0x7fc2f8149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.059+0000 7fc2f7400640 1 -- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f80ae2b0 msgr2=0x7fc2f8149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.059+0000 7fc2f7400640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f80ae2b0 0x7fc2f8149840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.059+0000 7fc2f7400640 1 -- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2dc005180 msgr2=0x7fc2f8156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.059+0000 7fc2f7400640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2dc005180 0x7fc2f8156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.059+0000 7fc2f7400640 1 -- 172.21.15.46:0/3218631126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f8149d80 con 0x7fc2f8158490 2024-02-19T06:58:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.059+0000 7fc2f7400640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2f8158490 0x7fc2f8158910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0001f70 tx=0x7fc2f00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.059+0000 7fc2eea00640 1 -- 172.21.15.46:0/3218631126 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0006d50 con 0x7fc2f8158490 2024-02-19T06:58:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.059+0000 7fc2eea00640 1 -- 172.21.15.46:0/3218631126 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f0039480 con 0x7fc2f8158490 2024-02-19T06:58:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.059+0000 7fc2eea00640 1 -- 172.21.15.46:0/3218631126 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0039810 con 0x7fc2f8158490 2024-02-19T06:58:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.059+0000 7fc2f7e00640 1 -- 172.21.15.46:0/3218631126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f80acfa0 con 0x7fc2f8158490 2024-02-19T06:58:41.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.060+0000 7fc2f7e00640 1 -- 172.21.15.46:0/3218631126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f80ad560 con 0x7fc2f8158490 2024-02-19T06:58:41.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.061+0000 7fc2f7e00640 1 -- 172.21.15.46:0/3218631126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f804eee0 con 0x7fc2f8158490 2024-02-19T06:58:41.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.062+0000 7fc2eea00640 1 -- 172.21.15.46:0/3218631126 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc2f0039970 con 0x7fc2f8158490 2024-02-19T06:58:41.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.063+0000 7fc2eea00640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc2d406b810 0x7fc2d406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.063+0000 7fc2eea00640 1 -- 172.21.15.46:0/3218631126 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc2f00abfe0 con 0x7fc2f8158490 2024-02-19T06:58:41.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.063+0000 7fc2f6a00640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc2d406b810 0x7fc2d406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.064+0000 7fc2f6a00640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc2d406b810 0x7fc2d406dcd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009990 tx=0x7fc2e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:41.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.067+0000 7fc2eea00640 1 -- 172.21.15.46:0/3218631126 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc2f00768e0 con 0x7fc2f8158490 2024-02-19T06:58:41.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.277+0000 7fc2f7e00640 1 -- 172.21.15.46:0/3218631126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc2f80ce6b0 con 0x7fc2f8158490 2024-02-19T06:58:41.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.278+0000 7fc2eea00640 1 -- 172.21.15.46:0/3218631126 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc2f0047070 con 0x7fc2f8158490 2024-02-19T06:58:41.279 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-02-19T06:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.280+0000 7fc2f7e00640 1 -- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc2d406b810 msgr2=0x7fc2d406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.280+0000 7fc2f7e00640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc2d406b810 0x7fc2d406dcd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009990 tx=0x7fc2e8008040 comp rx=0 tx=0).stop 2024-02-19T06:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.280+0000 7fc2f7e00640 1 -- 172.21.15.46:0/3218631126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2f8158490 msgr2=0x7fc2f8158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.280+0000 7fc2f7e00640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2f8158490 0x7fc2f8158910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0001f70 tx=0x7fc2f00014a0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.280+0000 7fc2f7e00640 1 -- 172.21.15.46:0/3218631126 shutdown_connections 2024-02-19T06:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.280+0000 7fc2f7e00640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc2d406b810 0x7fc2d406dcd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.280+0000 7fc2f7e00640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2f8158490 0x7fc2f8158910 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.280+0000 7fc2f7e00640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f80ae2b0 0x7fc2f8149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.280+0000 7fc2f7e00640 1 --2- 172.21.15.46:0/3218631126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2dc005180 0x7fc2f8156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.280+0000 7fc2f7e00640 1 -- 172.21.15.46:0/3218631126 >> 172.21.15.46:0/3218631126 conn(0x7fc2f80b1200 msgr2=0x7fc2f80cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.280+0000 7fc2f7e00640 1 -- 172.21.15.46:0/3218631126 shutdown_connections 2024-02-19T06:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.280+0000 7fc2f7e00640 1 -- 172.21.15.46:0/3218631126 wait complete. 2024-02-19T06:58:41.299 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:58:41.300 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T06:58:41.345 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:41.518 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T06:58:41.526 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T06:58:41.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.591+0000 7f2a9d600640 1 Processor -- start 2024-02-19T06:58:41.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.591+0000 7f2a9d600640 1 -- start start 2024-02-19T06:58:41.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.593+0000 7f2a9d600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a980b6ad0 0x7f2a980d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.593+0000 7f2a9d600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a980ce920 0x7f2a980d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.593+0000 7f2a9d600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a980ceec0 con 0x7f2a9815dc40 2024-02-19T06:58:41.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.593+0000 7f2a9d600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a980d0b50 con 0x7f2a980ce920 2024-02-19T06:58:41.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.593+0000 7f2a9d600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a980cf1a0 con 0x7f2a980b6ad0 2024-02-19T06:58:41.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.593+0000 7f2a8fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a980b6ad0 0x7f2a980d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.593+0000 7f2a96a00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2a9815dc40 0x7f2a9806c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:40252/0 (socket says 172.21.15.46:40252) 2024-02-19T06:58:41.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.593+0000 7f2a96a00640 1 -- 172.21.15.46:0/3890339295 learned_addr learned my addr 172.21.15.46:0/3890339295 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:41.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.593+0000 7f2a97400640 1 --2- 172.21.15.46:0/3890339295 >> v2:172.21.15.142:3300/0 conn(0x7f2a980ce920 0x7f2a980d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.594+0000 7f2a96000640 1 -- 172.21.15.46:0/3890339295 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964825758 0 0) 0x7f2a980ceec0 con 0x7f2a9815dc40 2024-02-19T06:58:41.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.594+0000 7f2a96000640 1 -- 172.21.15.46:0/3890339295 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a7c003520 con 0x7f2a9815dc40 2024-02-19T06:58:41.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.594+0000 7f2a97400640 1 -- 172.21.15.46:0/3890339295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a980b6ad0 msgr2=0x7f2a980d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:41.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.594+0000 7f2a97400640 1 --2- 172.21.15.46:0/3890339295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a980b6ad0 0x7f2a980d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.594+0000 7f2a97400640 1 -- 172.21.15.46:0/3890339295 >> v1:172.21.15.142:6789/0 conn(0x7f2a9815dc40 legacy=0x7f2a9806c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:41.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.594+0000 7f2a97400640 1 -- 172.21.15.46:0/3890339295 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a980d1cb0 con 0x7f2a980ce920 2024-02-19T06:58:41.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.595+0000 7f2a97400640 1 --2- 172.21.15.46:0/3890339295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a980ce920 0x7f2a980d0610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009d90 tx=0x7f2a9002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a58527fd7bf6fec0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:41.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.595+0000 7f2a96000640 1 -- 172.21.15.46:0/3890339295 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9002cc50 con 0x7f2a980ce920 2024-02-19T06:58:41.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.595+0000 7f2a96000640 1 -- 172.21.15.46:0/3890339295 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9002cdb0 con 0x7f2a980ce920 2024-02-19T06:58:41.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.595+0000 7f2a96000640 1 -- 172.21.15.46:0/3890339295 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90034660 con 0x7f2a980ce920 2024-02-19T06:58:41.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.596+0000 7f2a9d600640 1 -- 172.21.15.46:0/3890339295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a980ce920 msgr2=0x7f2a980d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:41.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.596+0000 7f2a9d600640 1 --2- 172.21.15.46:0/3890339295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a980ce920 0x7f2a980d0610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009d90 tx=0x7f2a9002bea0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.596+0000 7f2a9d600640 1 -- 172.21.15.46:0/3890339295 shutdown_connections 2024-02-19T06:58:41.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.596+0000 7f2a9d600640 1 --2- 172.21.15.46:0/3890339295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a980b6ad0 0x7f2a980d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.596+0000 7f2a9d600640 1 --2- 172.21.15.46:0/3890339295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a980ce920 0x7f2a980d0610 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.596+0000 7f2a9d600640 1 -- 172.21.15.46:0/3890339295 >> 172.21.15.46:0/3890339295 conn(0x7f2a980b53d0 msgr2=0x7f2a980b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:41.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.596+0000 7f2a9d600640 1 -- 172.21.15.46:0/3890339295 shutdown_connections 2024-02-19T06:58:41.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.596+0000 7f2a9d600640 1 -- 172.21.15.46:0/3890339295 wait complete. 2024-02-19T06:58:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.598+0000 7f2a9d600640 1 Processor -- start 2024-02-19T06:58:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.598+0000 7f2a9d600640 1 -- start start 2024-02-19T06:58:41.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.599+0000 7f2a9d600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a980b6ad0 0x7f2a98153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.599+0000 7f2a9d600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a980ce920 0x7f2a980cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.599+0000 7f2a9d600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9815dc40 0x7f2a980b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.600+0000 7f2a9d600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a980cd860 con 0x7f2a9815dc40 2024-02-19T06:58:41.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.600+0000 7f2a9d600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a980cd3d0 con 0x7f2a980ce920 2024-02-19T06:58:41.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.600+0000 7f2a9d600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a980cc7c0 con 0x7f2a980b6ad0 2024-02-19T06:58:41.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.600+0000 7f2a97400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9815dc40 0x7f2a980b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.600+0000 7f2a97400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9815dc40 0x7f2a980b6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60406/0 (socket says 172.21.15.46:60406) 2024-02-19T06:58:41.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.600+0000 7f2a97400640 1 -- 172.21.15.46:0/2436996397 learned_addr learned my addr 172.21.15.46:0/2436996397 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:41.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.600+0000 7f2a96a00640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a980b6ad0 0x7f2a98153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.600+0000 7f2a8fe00640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a980ce920 0x7f2a980cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.600+0000 7f2a97400640 1 -- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a980b6ad0 msgr2=0x7f2a98153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:41.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.600+0000 7f2a97400640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a980b6ad0 0x7f2a98153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.600+0000 7f2a97400640 1 -- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a980ce920 msgr2=0x7f2a980cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:41.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.600+0000 7f2a97400640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a980ce920 0x7f2a980cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.600+0000 7f2a97400640 1 -- 172.21.15.46:0/2436996397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a90009a70 con 0x7f2a9815dc40 2024-02-19T06:58:41.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.601+0000 7f2a97400640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9815dc40 0x7f2a980b6f50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009d90 tx=0x7f2a90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:41.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.601+0000 7f2a8ea00640 1 -- 172.21.15.46:0/2436996397 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90040650 con 0x7f2a9815dc40 2024-02-19T06:58:41.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.601+0000 7f2a8ea00640 1 -- 172.21.15.46:0/2436996397 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a900407b0 con 0x7f2a9815dc40 2024-02-19T06:58:41.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.601+0000 7f2a9d600640 1 -- 172.21.15.46:0/2436996397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a980ccaa0 con 0x7f2a9815dc40 2024-02-19T06:58:41.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.601+0000 7f2a8ea00640 1 -- 172.21.15.46:0/2436996397 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90040b60 con 0x7f2a9815dc40 2024-02-19T06:58:41.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.601+0000 7f2a9d600640 1 -- 172.21.15.46:0/2436996397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a980cd060 con 0x7f2a9815dc40 2024-02-19T06:58:41.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.603+0000 7f2a9d600640 1 -- 172.21.15.46:0/2436996397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a98067ba0 con 0x7f2a9815dc40 2024-02-19T06:58:41.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.603+0000 7f2a8ea00640 1 -- 172.21.15.46:0/2436996397 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2a90040cc0 con 0x7f2a9815dc40 2024-02-19T06:58:41.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.604+0000 7f2a8ea00640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2a7406b810 0x7f2a7406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:41.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.604+0000 7f2a8ea00640 1 -- 172.21.15.46:0/2436996397 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2a900acff0 con 0x7f2a9815dc40 2024-02-19T06:58:41.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.605+0000 7f2a96a00640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2a7406b810 0x7f2a7406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:41.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.606+0000 7f2a96a00640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2a7406b810 0x7f2a7406dcd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a88005880 tx=0x7f2a88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:41.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.611+0000 7f2a8ea00640 1 -- 172.21.15.46:0/2436996397 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2a90077960 con 0x7f2a9815dc40 2024-02-19T06:58:41.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.813+0000 7f2a9d600640 1 -- 172.21.15.46:0/2436996397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a980cd510 con 0x7f2a9815dc40 2024-02-19T06:58:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.815+0000 7f2a8ea00640 1 -- 172.21.15.46:0/2436996397 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16855 (secure 0 0 0) 0x7f2a90009450 con 0x7f2a9815dc40 2024-02-19T06:58:41.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:41.816 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:58:37.086581+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.817+0000 7f2a9d600640 1 -- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2a7406b810 msgr2=0x7f2a7406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.817+0000 7f2a9d600640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2a7406b810 0x7f2a7406dcd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a88005880 tx=0x7f2a88009040 comp rx=0 tx=0).stop 2024-02-19T06:58:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.817+0000 7f2a9d600640 1 -- 172.21.15.46:0/2436996397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9815dc40 msgr2=0x7f2a980b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.817+0000 7f2a9d600640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9815dc40 0x7f2a980b6f50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009d90 tx=0x7f2a90004a40 comp rx=0 tx=0).stop 2024-02-19T06:58:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.817+0000 7f2a9d600640 1 -- 172.21.15.46:0/2436996397 shutdown_connections 2024-02-19T06:58:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.817+0000 7f2a9d600640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2a7406b810 0x7f2a7406dcd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.817+0000 7f2a9d600640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a9815dc40 0x7f2a980b6f50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.817+0000 7f2a9d600640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a980ce920 0x7f2a980cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.817+0000 7f2a9d600640 1 --2- 172.21.15.46:0/2436996397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a980b6ad0 0x7f2a98153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.817+0000 7f2a9d600640 1 -- 172.21.15.46:0/2436996397 >> 172.21.15.46:0/2436996397 conn(0x7f2a980b53d0 msgr2=0x7f2a9806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.817+0000 7f2a9d600640 1 -- 172.21.15.46:0/2436996397 shutdown_connections 2024-02-19T06:58:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:41.817+0000 7f2a9d600640 1 -- 172.21.15.46:0/2436996397 wait complete. 2024-02-19T06:58:41.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:41.838 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:42.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.040+0000 7f5ce1a00640 1 Processor -- start 2024-02-19T06:58:42.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.040+0000 7f5ce1a00640 1 -- start start 2024-02-19T06:58:42.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.041+0000 7f5ce1a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cdc0d1e00 0x7f5cdc0d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.042+0000 7f5ce1a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc0ce630 con 0x7f5cdc15dbc0 2024-02-19T06:58:42.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.042+0000 7f5ce1a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc0d27a0 con 0x7f5cdc0cf900 2024-02-19T06:58:42.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.042+0000 7f5ce1a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc15dfa0 con 0x7f5cdc0d1e00 2024-02-19T06:58:42.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.042+0000 7f5cdaa00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5cdc15dbc0 0x7f5cdc0d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54958/0 (socket says 172.21.15.46:54958) 2024-02-19T06:58:42.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.042+0000 7f5cdaa00640 1 -- 172.21.15.46:0/852120334 learned_addr learned my addr 172.21.15.46:0/852120334 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:42.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.042+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192392131 0 0) 0x7f5cdc0ce630 con 0x7f5cdc15dbc0 2024-02-19T06:58:42.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.042+0000 7f5cda000640 1 --2- 172.21.15.46:0/852120334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cdc0d1e00 0x7f5cdc0d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.042+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc0003520 con 0x7f5cdc15dbc0 2024-02-19T06:58:42.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1565266127 0 0) 0x7f5cc0003520 con 0x7f5cdc15dbc0 2024-02-19T06:58:42.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cdc0d1e00 msgr2=0x7f5cdc0d2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cd9600640 1 --2- 172.21.15.46:0/852120334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cdc0d1e00 0x7f5cdc0d2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 >> v1:172.21.15.142:6789/0 conn(0x7f5cdc0cf900 legacy=0x7f5cdc0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0ce860 con 0x7f5cdc15dbc0 2024-02-19T06:58:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f5ccc001670 con 0x7f5cdc15dbc0 2024-02-19T06:58:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 >> v1:172.21.15.46:6789/0 conn(0x7f5cdc15dbc0 legacy=0x7f5cdc0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cd9600640 1 --2- 172.21.15.46:0/852120334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cc00039a0 0x7f5cc0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cd9600640 1 --2- 172.21.15.46:0/852120334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cc00047c0 0x7f5cc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cd9600640 1 --2- 172.21.15.46:0/852120334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cdc0d1e00 0x7f5cc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc15dfa0 con 0x7f5cc00047c0 2024-02-19T06:58:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc000ba60 con 0x7f5cc00039a0 2024-02-19T06:58:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc000bc20 con 0x7f5cdc0d1e00 2024-02-19T06:58:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.043+0000 7f5cda000640 1 --2- 172.21.15.46:0/852120334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cc00047c0 0x7f5cc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.044+0000 7f5cdaa00640 1 --2- 172.21.15.46:0/852120334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cc00039a0 0x7f5cc0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.044+0000 7f5cdb400640 1 --2- 172.21.15.46:0/852120334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cdc0d1e00 0x7f5cc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.044+0000 7f5cda000640 1 -- 172.21.15.46:0/852120334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cdc0d1e00 msgr2=0x7f5cc0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:42.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.044+0000 7f5cda000640 1 --2- 172.21.15.46:0/852120334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cdc0d1e00 0x7f5cc0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.044+0000 7f5cda000640 1 -- 172.21.15.46:0/852120334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cc00039a0 msgr2=0x7f5cc0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:42.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.044+0000 7f5cda000640 1 --2- 172.21.15.46:0/852120334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cc00039a0 0x7f5cc0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.044+0000 7f5cda000640 1 -- 172.21.15.46:0/852120334 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc0003520 con 0x7f5cc00047c0 2024-02-19T06:58:42.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.045+0000 7f5cda000640 1 --2- 172.21.15.46:0/852120334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cc00047c0 0x7f5cc0004c40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0b4060 tx=0x7f5cc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d8d0754b5a79c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:42.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.045+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4005990 con 0x7f5cc00047c0 2024-02-19T06:58:42.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.045+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc4005af0 con 0x7f5cc00047c0 2024-02-19T06:58:42.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.045+0000 7f5cd9600640 1 -- 172.21.15.46:0/852120334 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4005e60 con 0x7f5cc00047c0 2024-02-19T06:58:42.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.046+0000 7f5ce1a00640 1 -- 172.21.15.46:0/852120334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cc00047c0 msgr2=0x7f5cc0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.046+0000 7f5ce1a00640 1 --2- 172.21.15.46:0/852120334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cc00047c0 0x7f5cc0004c40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0b4060 tx=0x7f5cc00057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.046+0000 7f5cdb400640 1 -- 172.21.15.46:0/852120334 reap_dead start 2024-02-19T06:58:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.046+0000 7f5ce1a00640 1 -- 172.21.15.46:0/852120334 shutdown_connections 2024-02-19T06:58:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.046+0000 7f5ce1a00640 1 -- 172.21.15.46:0/852120334 >> 172.21.15.46:0/852120334 conn(0x7f5cdc08afc0 msgr2=0x7f5cdc0d3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.046+0000 7f5ce1a00640 1 -- 172.21.15.46:0/852120334 shutdown_connections 2024-02-19T06:58:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.046+0000 7f5ce1a00640 1 -- 172.21.15.46:0/852120334 wait complete. 2024-02-19T06:58:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.048+0000 7f5ce1a00640 1 Processor -- start 2024-02-19T06:58:42.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.048+0000 7f5ce1a00640 1 -- start start 2024-02-19T06:58:42.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.049+0000 7f5ce1a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cc00047c0 0x7f5cdc15ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.049+0000 7f5ce1a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cdc0b1590 0x7f5cdc0b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.049+0000 7f5ce1a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cdc1f75d0 0x7f5cdc1f7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.049+0000 7f5ce1a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0b1f50 con 0x7f5cc00047c0 2024-02-19T06:58:42.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.049+0000 7f5ce1a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc1f7f90 con 0x7f5cdc0b1590 2024-02-19T06:58:42.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.049+0000 7f5ce1a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0cb810 con 0x7f5cdc1f75d0 2024-02-19T06:58:42.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.049+0000 7f5cdaa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cc00047c0 0x7f5cdc15ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.049+0000 7f5cdaa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cc00047c0 0x7f5cdc15ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60432/0 (socket says 172.21.15.46:60432) 2024-02-19T06:58:42.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.049+0000 7f5cdaa00640 1 -- 172.21.15.46:0/2072227466 learned_addr learned my addr 172.21.15.46:0/2072227466 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:42.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.050+0000 7f5cda000640 1 --2- 172.21.15.46:0/2072227466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cdc0b1590 0x7f5cdc0b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.050+0000 7f5cdaa00640 1 -- 172.21.15.46:0/2072227466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cdc1f75d0 msgr2=0x7f5cdc1f7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.050+0000 7f5cdaa00640 1 --2- 172.21.15.46:0/2072227466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cdc1f75d0 0x7f5cdc1f7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.050+0000 7f5cdaa00640 1 -- 172.21.15.46:0/2072227466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cdc0b1590 msgr2=0x7f5cdc0b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.050+0000 7f5cdaa00640 1 --2- 172.21.15.46:0/2072227466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cdc0b1590 0x7f5cdc0b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.050+0000 7f5cdaa00640 1 -- 172.21.15.46:0/2072227466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc1f81b0 con 0x7f5cc00047c0 2024-02-19T06:58:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.050+0000 7f5cdaa00640 1 --2- 172.21.15.46:0/2072227466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cc00047c0 0x7f5cdc15ec60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00e760 tx=0x7f5ccc00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.050+0000 7f5cd2a00640 1 -- 172.21.15.46:0/2072227466 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00ee70 con 0x7f5cc00047c0 2024-02-19T06:58:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.050+0000 7f5cd2a00640 1 -- 172.21.15.46:0/2072227466 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc00c870 con 0x7f5cc00047c0 2024-02-19T06:58:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.050+0000 7f5cd2a00640 1 -- 172.21.15.46:0/2072227466 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00cc20 con 0x7f5cc00047c0 2024-02-19T06:58:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.050+0000 7f5ce1a00640 1 -- 172.21.15.46:0/2072227466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc1f8490 con 0x7f5cc00047c0 2024-02-19T06:58:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.051+0000 7f5ce1a00640 1 -- 172.21.15.46:0/2072227466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc15e460 con 0x7f5cc00047c0 2024-02-19T06:58:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.052+0000 7f5ce1a00640 1 -- 172.21.15.46:0/2072227466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc067ba0 con 0x7f5cc00047c0 2024-02-19T06:58:42.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.053+0000 7f5cd2a00640 1 -- 172.21.15.46:0/2072227466 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5ccc00cd80 con 0x7f5cc00047c0 2024-02-19T06:58:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.054+0000 7f5cd2a00640 1 --2- 172.21.15.46:0/2072227466 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f5cb806b840 0x7f5cb806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.054+0000 7f5cd2a00640 1 -- 172.21.15.46:0/2072227466 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5ccc08a240 con 0x7f5cc00047c0 2024-02-19T06:58:42.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.054+0000 7f5cda000640 1 --2- 172.21.15.46:0/2072227466 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f5cb806b840 0x7f5cb806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.055+0000 7f5cda000640 1 --2- 172.21.15.46:0/2072227466 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f5cb806b840 0x7f5cb806dd00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4035000 tx=0x7f5cc4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:42.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.058+0000 7f5cd2a00640 1 -- 172.21.15.46:0/2072227466 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5ccc058670 con 0x7f5cc00047c0 2024-02-19T06:58:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.259+0000 7f5ce1a00640 1 -- 172.21.15.46:0/2072227466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5cdc0b5090 con 0x7f5cc00047c0 2024-02-19T06:58:42.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.259+0000 7f5cd2a00640 1 -- 172.21.15.46:0/2072227466 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ccc058200 con 0x7f5cc00047c0 2024-02-19T06:58:42.261 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:42.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.262+0000 7f5ce1a00640 1 -- 172.21.15.46:0/2072227466 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f5cb806b840 msgr2=0x7f5cb806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.262+0000 7f5ce1a00640 1 --2- 172.21.15.46:0/2072227466 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f5cb806b840 0x7f5cb806dd00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4035000 tx=0x7f5cc4030000 comp rx=0 tx=0).stop 2024-02-19T06:58:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.262+0000 7f5ce1a00640 1 -- 172.21.15.46:0/2072227466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cc00047c0 msgr2=0x7f5cdc15ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.262+0000 7f5ce1a00640 1 --2- 172.21.15.46:0/2072227466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cc00047c0 0x7f5cdc15ec60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00e760 tx=0x7f5ccc00ec20 comp rx=0 tx=0).stop 2024-02-19T06:58:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.262+0000 7f5ce1a00640 1 -- 172.21.15.46:0/2072227466 shutdown_connections 2024-02-19T06:58:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.262+0000 7f5ce1a00640 1 --2- 172.21.15.46:0/2072227466 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f5cb806b840 0x7f5cb806dd00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.262+0000 7f5ce1a00640 1 --2- 172.21.15.46:0/2072227466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cdc1f75d0 0x7f5cdc1f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.262+0000 7f5ce1a00640 1 --2- 172.21.15.46:0/2072227466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cdc0b1590 0x7f5cdc0b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.262+0000 7f5ce1a00640 1 --2- 172.21.15.46:0/2072227466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cc00047c0 0x7f5cdc15ec60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.262+0000 7f5ce1a00640 1 -- 172.21.15.46:0/2072227466 >> 172.21.15.46:0/2072227466 conn(0x7f5cdc08afc0 msgr2=0x7f5cdc0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.262+0000 7f5ce1a00640 1 -- 172.21.15.46:0/2072227466 shutdown_connections 2024-02-19T06:58:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.262+0000 7f5ce1a00640 1 -- 172.21.15.46:0/2072227466 wait complete. 2024-02-19T06:58:42.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:42.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.490+0000 7f7837e00640 1 Processor -- start 2024-02-19T06:58:42.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.490+0000 7f7837e00640 1 -- start start 2024-02-19T06:58:42.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.492+0000 7f7837e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f78380af5c0 0x7f78380af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.492+0000 7f7837e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7838158360 0x7f78380b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.492+0000 7f7837e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783815ebd0 con 0x7f78380b0cc0 2024-02-19T06:58:42.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.492+0000 7f7837e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7838162690 con 0x7f78380af5c0 2024-02-19T06:58:42.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.492+0000 7f7837e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783815e0a0 con 0x7f7838158360 2024-02-19T06:58:42.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.492+0000 7f7837400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f78380b0cc0 0x7f78380d03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54974/0 (socket says 172.21.15.46:54974) 2024-02-19T06:58:42.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.492+0000 7f7837400640 1 -- 172.21.15.46:0/2685190335 learned_addr learned my addr 172.21.15.46:0/2685190335 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:42.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.492+0000 7f7836a00640 1 --2- 172.21.15.46:0/2685190335 >> v2:172.21.15.142:3300/0 conn(0x7f78380af5c0 0x7f78380af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.492+0000 7f7836000640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7838158360 0x7f78380b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896428303 0 0) 0x7f783815ebd0 con 0x7f78380b0cc0 2024-02-19T06:58:42.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f781c003520 con 0x7f78380b0cc0 2024-02-19T06:58:42.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3488910367 0 0) 0x7f781c003520 con 0x7f78380b0cc0 2024-02-19T06:58:42.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7838158360 msgr2=0x7f78380b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:42.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7838158360 0x7f78380b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 >> v2:172.21.15.142:3300/0 conn(0x7f78380af5c0 msgr2=0x7f78380af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:42.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 --2- 172.21.15.46:0/2685190335 >> v2:172.21.15.142:3300/0 conn(0x7f78380af5c0 0x7f78380af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380cce70 con 0x7f78380b0cc0 2024-02-19T06:58:42.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f78300019f0 con 0x7f78380b0cc0 2024-02-19T06:58:42.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 >> v1:172.21.15.46:6789/0 conn(0x7f78380b0cc0 legacy=0x7f78380d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781c003970 0x7f781c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f781c004320 0x7f781c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c004e70 0x7f781c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7838162690 con 0x7f781c004e70 2024-02-19T06:58:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783815e0a0 con 0x7f781c004320 2024-02-19T06:58:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c00bec0 con 0x7f781c003970 2024-02-19T06:58:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.493+0000 7f7837400640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c004e70 0x7f781c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.494+0000 7f7836000640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f781c004320 0x7f781c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.494+0000 7f7836a00640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781c003970 0x7f781c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.494+0000 7f7837400640 1 -- 172.21.15.46:0/2685190335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781c003970 msgr2=0x7f781c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.494+0000 7f7837400640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781c003970 0x7f781c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.494+0000 7f7837400640 1 -- 172.21.15.46:0/2685190335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f781c004320 msgr2=0x7f781c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.494+0000 7f7837400640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f781c004320 0x7f781c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.494+0000 7f7837400640 1 -- 172.21.15.46:0/2685190335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c003520 con 0x7f781c004e70 2024-02-19T06:58:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.494+0000 7f7836000640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f781c004320 0x7f781c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.494+0000 7f7836a00640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781c003970 0x7f781c003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:42.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.495+0000 7f7837400640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c004e70 0x7f781c00b980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f783000a780 tx=0x7f781c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed57c60885b95d8c server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:42.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.495+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830034630 con 0x7f781c004e70 2024-02-19T06:58:42.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.495+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783002f070 con 0x7f781c004e70 2024-02-19T06:58:42.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.495+0000 7f7835600640 1 -- 172.21.15.46:0/2685190335 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830034a10 con 0x7f781c004e70 2024-02-19T06:58:42.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.496+0000 7f7837e00640 1 -- 172.21.15.46:0/2685190335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c004e70 msgr2=0x7f781c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.496+0000 7f7837e00640 1 --2- 172.21.15.46:0/2685190335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c004e70 0x7f781c00b980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f783000a780 tx=0x7f781c0057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.496+0000 7f7837400640 1 -- 172.21.15.46:0/2685190335 reap_dead start 2024-02-19T06:58:42.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.496+0000 7f7837e00640 1 -- 172.21.15.46:0/2685190335 shutdown_connections 2024-02-19T06:58:42.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.496+0000 7f7837e00640 1 -- 172.21.15.46:0/2685190335 >> 172.21.15.46:0/2685190335 conn(0x7f78380b5af0 msgr2=0x7f7838099a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:42.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.496+0000 7f7837e00640 1 -- 172.21.15.46:0/2685190335 shutdown_connections 2024-02-19T06:58:42.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.496+0000 7f7837e00640 1 -- 172.21.15.46:0/2685190335 wait complete. 2024-02-19T06:58:42.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.498+0000 7f7837e00640 1 Processor -- start 2024-02-19T06:58:42.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.498+0000 7f7837e00640 1 -- start start 2024-02-19T06:58:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.499+0000 7f7837e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7838150190 0x7f78381f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.499+0000 7f7837e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7838150570 0x7f783815ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.499+0000 7f7837e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78381f3b70 0x7f7838151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.499+0000 7f7837e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78381611e0 con 0x7f78381f3b70 2024-02-19T06:58:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.499+0000 7f7837e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78380c98d0 con 0x7f7838150570 2024-02-19T06:58:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.499+0000 7f7837e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78380c9bb0 con 0x7f7838150190 2024-02-19T06:58:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.499+0000 7f7837400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78381f3b70 0x7f7838151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.499+0000 7f7837400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78381f3b70 0x7f7838151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60446/0 (socket says 172.21.15.46:60446) 2024-02-19T06:58:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.499+0000 7f7837400640 1 -- 172.21.15.46:0/526274978 learned_addr learned my addr 172.21.15.46:0/526274978 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.500+0000 7f7836000640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7838150570 0x7f783815ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.500+0000 7f7836a00640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7838150190 0x7f78381f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.500+0000 7f7837400640 1 -- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7838150190 msgr2=0x7f78381f3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.500+0000 7f7837400640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7838150190 0x7f78381f3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.500+0000 7f7837400640 1 -- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7838150570 msgr2=0x7f783815ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.500+0000 7f7837400640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7838150570 0x7f783815ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.500+0000 7f7837400640 1 -- 172.21.15.46:0/526274978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380c9e90 con 0x7f78381f3b70 2024-02-19T06:58:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.500+0000 7f7836a00640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7838150190 0x7f78381f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:42.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.500+0000 7f7837400640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78381f3b70 0x7f7838151a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f783000a780 tx=0x7f7830001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:42.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.500+0000 7f782ea00640 1 -- 172.21.15.46:0/526274978 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830034630 con 0x7f78381f3b70 2024-02-19T06:58:42.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.500+0000 7f782ea00640 1 -- 172.21.15.46:0/526274978 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7830034790 con 0x7f78381f3b70 2024-02-19T06:58:42.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.500+0000 7f7837e00640 1 -- 172.21.15.46:0/526274978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78380ca170 con 0x7f78381f3b70 2024-02-19T06:58:42.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.500+0000 7f782ea00640 1 -- 172.21.15.46:0/526274978 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830034b00 con 0x7f78381f3b70 2024-02-19T06:58:42.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.501+0000 7f7837e00640 1 -- 172.21.15.46:0/526274978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78381604d0 con 0x7f78381f3b70 2024-02-19T06:58:42.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.502+0000 7f7837e00640 1 -- 172.21.15.46:0/526274978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783815f060 con 0x7f78381f3b70 2024-02-19T06:58:42.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.503+0000 7f782ea00640 1 -- 172.21.15.46:0/526274978 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7830031030 con 0x7f78381f3b70 2024-02-19T06:58:42.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.503+0000 7f782ea00640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f781806b810 0x7f781806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.503+0000 7f782ea00640 1 -- 172.21.15.46:0/526274978 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f78300abdc0 con 0x7f78381f3b70 2024-02-19T06:58:42.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.504+0000 7f7836a00640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f781806b810 0x7f781806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.505+0000 7f7836a00640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f781806b810 0x7f781806dcd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7828009b20 tx=0x7f7828008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:42.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.508+0000 7f782ea00640 1 -- 172.21.15.46:0/526274978 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f783815f060 con 0x7f78381f3b70 2024-02-19T06:58:42.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.706+0000 7f7837e00640 1 -- 172.21.15.46:0/526274978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78380ca690 con 0x7f78381f3b70 2024-02-19T06:58:42.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.706+0000 7f782ea00640 1 -- 172.21.15.46:0/526274978 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78300ae020 con 0x7f78381f3b70 2024-02-19T06:58:42.708 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:42.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.709+0000 7f7837e00640 1 -- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f781806b810 msgr2=0x7f781806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.709+0000 7f7837e00640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f781806b810 0x7f781806dcd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7828009b20 tx=0x7f7828008040 comp rx=0 tx=0).stop 2024-02-19T06:58:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.709+0000 7f7837e00640 1 -- 172.21.15.46:0/526274978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78381f3b70 msgr2=0x7f7838151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.709+0000 7f7837e00640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78381f3b70 0x7f7838151a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f783000a780 tx=0x7f7830001360 comp rx=0 tx=0).stop 2024-02-19T06:58:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.709+0000 7f7837e00640 1 -- 172.21.15.46:0/526274978 shutdown_connections 2024-02-19T06:58:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.709+0000 7f7837e00640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f781806b810 0x7f781806dcd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.709+0000 7f7837e00640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78381f3b70 0x7f7838151a00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.709+0000 7f7837e00640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7838150570 0x7f783815ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.709+0000 7f7837e00640 1 --2- 172.21.15.46:0/526274978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7838150190 0x7f78381f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.709+0000 7f7837e00640 1 -- 172.21.15.46:0/526274978 >> 172.21.15.46:0/526274978 conn(0x7f78380b5af0 msgr2=0x7f783815ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.709+0000 7f7837e00640 1 -- 172.21.15.46:0/526274978 shutdown_connections 2024-02-19T06:58:42.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.709+0000 7f7837e00640 1 -- 172.21.15.46:0/526274978 wait complete. 2024-02-19T06:58:42.726 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.939+0000 7f4150c00640 1 Processor -- start 2024-02-19T06:58:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.940+0000 7f4150c00640 1 -- start start 2024-02-19T06:58:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.941+0000 7f4150c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f414c0ce320 0x7f414c166480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.941+0000 7f4150c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f414c06e770 0x7f414c0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.941+0000 7f4150c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c06ef30 con 0x7f414c0cf3d0 2024-02-19T06:58:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.941+0000 7f4150c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c06d380 con 0x7f414c0ce320 2024-02-19T06:58:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.941+0000 7f4150c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c0ce700 con 0x7f414c06e770 2024-02-19T06:58:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.942+0000 7f4149e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f414c0ce320 0x7f414c166480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.942+0000 7f4149e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f414c0ce320 0x7f414c166480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60454/0 (socket says 172.21.15.46:60454) 2024-02-19T06:58:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.942+0000 7f4149e00640 1 -- 172.21.15.46:0/1204867838 learned_addr learned my addr 172.21.15.46:0/1204867838 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:42.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.942+0000 7f414a800640 1 --1- 172.21.15.46:0/1204867838 >> v1:172.21.15.46:6789/0 conn(0x7f414c0cf3d0 0x7f414c06d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54982/0 (socket says 172.21.15.46:54982) 2024-02-19T06:58:42.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.942+0000 7f4149400640 1 --2- 172.21.15.46:0/1204867838 >> v2:172.21.15.142:3300/0 conn(0x7f414c06e770 0x7f414c0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.942+0000 7f4149e00640 1 -- 172.21.15.46:0/1204867838 >> v2:172.21.15.142:3300/0 conn(0x7f414c06e770 msgr2=0x7f414c0cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:42.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.942+0000 7f4149e00640 1 --2- 172.21.15.46:0/1204867838 >> v2:172.21.15.142:3300/0 conn(0x7f414c06e770 0x7f414c0cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.942+0000 7f4149e00640 1 -- 172.21.15.46:0/1204867838 >> v1:172.21.15.46:6789/0 conn(0x7f414c0cf3d0 legacy=0x7f414c06d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.942+0000 7f4149e00640 1 -- 172.21.15.46:0/1204867838 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0b3030 con 0x7f414c0ce320 2024-02-19T06:58:42.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.943+0000 7f4149e00640 1 --2- 172.21.15.46:0/1204867838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c0ce320 0x7f414c166480 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f414c0cffb0 tx=0x7f413c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9e663eca1f9f72 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:42.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.944+0000 7f4148a00640 1 -- 172.21.15.46:0/1204867838 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c031870 con 0x7f414c0ce320 2024-02-19T06:58:42.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.944+0000 7f4148a00640 1 -- 172.21.15.46:0/1204867838 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c0319d0 con 0x7f414c0ce320 2024-02-19T06:58:42.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.944+0000 7f4148a00640 1 -- 172.21.15.46:0/1204867838 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c031d60 con 0x7f414c0ce320 2024-02-19T06:58:42.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.944+0000 7f4150c00640 1 -- 172.21.15.46:0/1204867838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c0ce320 msgr2=0x7f414c166480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.944+0000 7f4150c00640 1 --2- 172.21.15.46:0/1204867838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c0ce320 0x7f414c166480 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f414c0cffb0 tx=0x7f413c02b910 comp rx=0 tx=0).stop 2024-02-19T06:58:42.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.944+0000 7f4150c00640 1 -- 172.21.15.46:0/1204867838 shutdown_connections 2024-02-19T06:58:42.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.944+0000 7f4150c00640 1 --2- 172.21.15.46:0/1204867838 >> v2:172.21.15.142:3300/0 conn(0x7f414c06e770 0x7f414c0cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.944+0000 7f4150c00640 1 --2- 172.21.15.46:0/1204867838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c0ce320 0x7f414c166480 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.944+0000 7f4150c00640 1 -- 172.21.15.46:0/1204867838 >> 172.21.15.46:0/1204867838 conn(0x7f414c066fc0 msgr2=0x7f414c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:42.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.944+0000 7f4150c00640 1 -- 172.21.15.46:0/1204867838 shutdown_connections 2024-02-19T06:58:42.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.945+0000 7f4150c00640 1 -- 172.21.15.46:0/1204867838 wait complete. 2024-02-19T06:58:42.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.946+0000 7f4150c00640 1 Processor -- start 2024-02-19T06:58:42.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.946+0000 7f4150c00640 1 -- start start 2024-02-19T06:58:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.947+0000 7f4150c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c06e770 0x7f414c1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.947+0000 7f4150c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414c0ce320 0x7f414c1ec0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.947+0000 7f4150c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414c0cf3d0 0x7f414c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.947+0000 7f4150c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c163f90 con 0x7f414c06e770 2024-02-19T06:58:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.947+0000 7f4150c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c164270 con 0x7f414c0cf3d0 2024-02-19T06:58:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.947+0000 7f4150c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c164550 con 0x7f414c0ce320 2024-02-19T06:58:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.948+0000 7f4149e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c06e770 0x7f414c1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.948+0000 7f4149e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c06e770 0x7f414c1552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60456/0 (socket says 172.21.15.46:60456) 2024-02-19T06:58:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.948+0000 7f4149e00640 1 -- 172.21.15.46:0/239560208 learned_addr learned my addr 172.21.15.46:0/239560208 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.948+0000 7f4149400640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414c0ce320 0x7f414c1ec0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.948+0000 7f4149e00640 1 -- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414c0ce320 msgr2=0x7f414c1ec0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.948+0000 7f4149e00640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414c0ce320 0x7f414c1ec0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.948+0000 7f4149e00640 1 -- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414c0cf3d0 msgr2=0x7f414c15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:42.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.948+0000 7f414a800640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414c0cf3d0 0x7f414c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.948+0000 7f4149e00640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414c0cf3d0 0x7f414c15c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:42.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.948+0000 7f4149e00640 1 -- 172.21.15.46:0/239560208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c0094d0 con 0x7f414c06e770 2024-02-19T06:58:42.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.948+0000 7f4149400640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414c0ce320 0x7f414c1ec0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:42.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.948+0000 7f4149e00640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c06e770 0x7f414c1552e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f413c02b950 tx=0x7f413c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:42.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.949+0000 7f4142000640 1 -- 172.21.15.46:0/239560208 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c031860 con 0x7f414c06e770 2024-02-19T06:58:42.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.949+0000 7f4142000640 1 -- 172.21.15.46:0/239560208 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c0443f0 con 0x7f414c06e770 2024-02-19T06:58:42.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.949+0000 7f4150c00640 1 -- 172.21.15.46:0/239560208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c164830 con 0x7f414c06e770 2024-02-19T06:58:42.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.949+0000 7f4142000640 1 -- 172.21.15.46:0/239560208 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0447a0 con 0x7f414c06e770 2024-02-19T06:58:42.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.949+0000 7f4150c00640 1 -- 172.21.15.46:0/239560208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c158000 con 0x7f414c06e770 2024-02-19T06:58:42.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.950+0000 7f4150c00640 1 -- 172.21.15.46:0/239560208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c0cd5d0 con 0x7f414c06e770 2024-02-19T06:58:42.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.951+0000 7f4142000640 1 -- 172.21.15.46:0/239560208 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f413c04d450 con 0x7f414c06e770 2024-02-19T06:58:42.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.952+0000 7f4142000640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f412806b810 0x7f412806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:42.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.952+0000 7f4142000640 1 -- 172.21.15.46:0/239560208 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f413c02d040 con 0x7f414c06e770 2024-02-19T06:58:42.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.952+0000 7f4149400640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f412806b810 0x7f412806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:42.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.954+0000 7f4149400640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f412806b810 0x7f412806dcd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f414c163db0 tx=0x7f4134008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:42.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:42.956+0000 7f4142000640 1 -- 172.21.15.46:0/239560208 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f413c0773f0 con 0x7f414c06e770 2024-02-19T06:58:43.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.154+0000 7f4150c00640 1 -- 172.21.15.46:0/239560208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f414c067ba0 con 0x7f414c06e770 2024-02-19T06:58:43.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.155+0000 7f4142000640 1 -- 172.21.15.46:0/239560208 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f413c035070 con 0x7f414c06e770 2024-02-19T06:58:43.157 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:43.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.157+0000 7f4150c00640 1 -- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f412806b810 msgr2=0x7f412806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:43.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.157+0000 7f4150c00640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f412806b810 0x7f412806dcd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f414c163db0 tx=0x7f4134008040 comp rx=0 tx=0).stop 2024-02-19T06:58:43.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.157+0000 7f4150c00640 1 -- 172.21.15.46:0/239560208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c06e770 msgr2=0x7f414c1552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:43.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.157+0000 7f4150c00640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c06e770 0x7f414c1552e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f413c02b950 tx=0x7f413c0046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.158+0000 7f4150c00640 1 -- 172.21.15.46:0/239560208 shutdown_connections 2024-02-19T06:58:43.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.158+0000 7f4150c00640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f412806b810 0x7f412806dcd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.158+0000 7f4150c00640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414c0cf3d0 0x7f414c15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.158+0000 7f4150c00640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414c0ce320 0x7f414c1ec0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.158+0000 7f4150c00640 1 --2- 172.21.15.46:0/239560208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c06e770 0x7f414c1552e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.158+0000 7f4150c00640 1 -- 172.21.15.46:0/239560208 >> 172.21.15.46:0/239560208 conn(0x7f414c066fc0 msgr2=0x7f414c0af250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:43.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.158+0000 7f4150c00640 1 -- 172.21.15.46:0/239560208 shutdown_connections 2024-02-19T06:58:43.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.158+0000 7f4150c00640 1 -- 172.21.15.46:0/239560208 wait complete. 2024-02-19T06:58:43.179 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-19T06:58:43.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.399+0000 7fb69e200640 1 Processor -- start 2024-02-19T06:58:43.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.399+0000 7fb69e200640 1 -- start start 2024-02-19T06:58:43.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.400+0000 7fb69e200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb69815f3c0 0x7fb69815f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:43.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.400+0000 7fb69e200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb6980cf090 0x7fb6980cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:43.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.400+0000 7fb69e200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6980b1410 con 0x7fb6980cdd10 2024-02-19T06:58:43.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.400+0000 7fb69e200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6980b2420 con 0x7fb69815f3c0 2024-02-19T06:58:43.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.400+0000 7fb69e200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6980b1660 con 0x7fb6980cf090 2024-02-19T06:58:43.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.401+0000 7fb68fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb69815f3c0 0x7fb69815f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:43.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.401+0000 7fb68fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb69815f3c0 0x7fb69815f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60468/0 (socket says 172.21.15.46:60468) 2024-02-19T06:58:43.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.401+0000 7fb68fe00640 1 -- 172.21.15.46:0/4181059113 learned_addr learned my addr 172.21.15.46:0/4181059113 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:43.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.401+0000 7fb69d800640 1 --2- 172.21.15.46:0/4181059113 >> v2:172.21.15.142:3300/0 conn(0x7fb6980cf090 0x7fb6980cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:43.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.401+0000 7fb68fe00640 1 -- 172.21.15.46:0/4181059113 >> v2:172.21.15.142:3300/0 conn(0x7fb6980cf090 msgr2=0x7fb6980cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:43.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.401+0000 7fb68fe00640 1 --2- 172.21.15.46:0/4181059113 >> v2:172.21.15.142:3300/0 conn(0x7fb6980cf090 0x7fb6980cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.401+0000 7fb68fe00640 1 -- 172.21.15.46:0/4181059113 >> v1:172.21.15.142:6789/0 conn(0x7fb6980cdd10 legacy=0x7fb6980ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:43.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.401+0000 7fb68fe00640 1 -- 172.21.15.46:0/4181059113 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6980b1940 con 0x7fb69815f3c0 2024-02-19T06:58:43.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.402+0000 7fb68fe00640 1 --2- 172.21.15.46:0/4181059113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb69815f3c0 0x7fb69815f800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb6980c8520 tx=0x7fb68002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481e33c44d3a99e server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:43.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.402+0000 7fb697e00640 1 -- 172.21.15.46:0/4181059113 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6800317e0 con 0x7fb69815f3c0 2024-02-19T06:58:43.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.403+0000 7fb697e00640 1 -- 172.21.15.46:0/4181059113 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb680031940 con 0x7fb69815f3c0 2024-02-19T06:58:43.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.403+0000 7fb697e00640 1 -- 172.21.15.46:0/4181059113 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680031cd0 con 0x7fb69815f3c0 2024-02-19T06:58:43.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.403+0000 7fb69e200640 1 -- 172.21.15.46:0/4181059113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb69815f3c0 msgr2=0x7fb69815f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:43.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.403+0000 7fb69e200640 1 --2- 172.21.15.46:0/4181059113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb69815f3c0 0x7fb69815f800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb6980c8520 tx=0x7fb68002b880 comp rx=0 tx=0).stop 2024-02-19T06:58:43.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.403+0000 7fb69e200640 1 -- 172.21.15.46:0/4181059113 shutdown_connections 2024-02-19T06:58:43.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.403+0000 7fb69e200640 1 --2- 172.21.15.46:0/4181059113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb69815f3c0 0x7fb69815f800 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.403+0000 7fb69e200640 1 --2- 172.21.15.46:0/4181059113 >> v2:172.21.15.142:3300/0 conn(0x7fb6980cf090 0x7fb6980cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.403+0000 7fb69e200640 1 -- 172.21.15.46:0/4181059113 >> 172.21.15.46:0/4181059113 conn(0x7fb6980d14c0 msgr2=0x7fb6980d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:43.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.403+0000 7fb69e200640 1 -- 172.21.15.46:0/4181059113 shutdown_connections 2024-02-19T06:58:43.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.403+0000 7fb69e200640 1 -- 172.21.15.46:0/4181059113 wait complete. 2024-02-19T06:58:43.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.405+0000 7fb69e200640 1 Processor -- start 2024-02-19T06:58:43.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.405+0000 7fb69e200640 1 -- start start 2024-02-19T06:58:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.406+0000 7fb69e200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6980cdd10 0x7fb69809ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.406+0000 7fb69e200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6980cf090 0x7fb6980af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.406+0000 7fb69e200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb69815f3c0 0x7fb6981f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.406+0000 7fb69e200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980c8e10 con 0x7fb6980cf090 2024-02-19T06:58:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.406+0000 7fb69e200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980c90f0 con 0x7fb69815f3c0 2024-02-19T06:58:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.406+0000 7fb69e200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980c93d0 con 0x7fb6980cdd10 2024-02-19T06:58:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.407+0000 7fb68fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6980cf090 0x7fb6980af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.407+0000 7fb68fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6980cf090 0x7fb6980af680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60472/0 (socket says 172.21.15.46:60472) 2024-02-19T06:58:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.407+0000 7fb68fe00640 1 -- 172.21.15.46:0/2469611064 learned_addr learned my addr 172.21.15.46:0/2469611064 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.407+0000 7fb69ce00640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6980cdd10 0x7fb69809ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.407+0000 7fb69d800640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb69815f3c0 0x7fb6981f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:43.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.407+0000 7fb68fe00640 1 -- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6980cdd10 msgr2=0x7fb69809ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:43.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.407+0000 7fb68fe00640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6980cdd10 0x7fb69809ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.407+0000 7fb68fe00640 1 -- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb69815f3c0 msgr2=0x7fb6981f4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:43.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.407+0000 7fb68fe00640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb69815f3c0 0x7fb6981f4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.407+0000 7fb68fe00640 1 -- 172.21.15.46:0/2469611064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6800094d0 con 0x7fb6980cf090 2024-02-19T06:58:43.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.407+0000 7fb68fe00640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6980cf090 0x7fb6980af680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb680000c00 tx=0x7fb6800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:43.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.408+0000 7fb695600640 1 -- 172.21.15.46:0/2469611064 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680032900 con 0x7fb6980cf090 2024-02-19T06:58:43.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.408+0000 7fb695600640 1 -- 172.21.15.46:0/2469611064 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb680032a60 con 0x7fb6980cf090 2024-02-19T06:58:43.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.408+0000 7fb695600640 1 -- 172.21.15.46:0/2469611064 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680032e10 con 0x7fb6980cf090 2024-02-19T06:58:43.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.408+0000 7fb69e200640 1 -- 172.21.15.46:0/2469611064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6981f3b10 con 0x7fb6980cf090 2024-02-19T06:58:43.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.408+0000 7fb69e200640 1 -- 172.21.15.46:0/2469611064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69809ef40 con 0x7fb6980cf090 2024-02-19T06:58:43.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.409+0000 7fb69e200640 1 -- 172.21.15.46:0/2469611064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6980c9510 con 0x7fb6980cf090 2024-02-19T06:58:43.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.410+0000 7fb695600640 1 -- 172.21.15.46:0/2469611064 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb68004e450 con 0x7fb6980cf090 2024-02-19T06:58:43.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.411+0000 7fb695600640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb67406b810 0x7fb67406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:43.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.411+0000 7fb695600640 1 -- 172.21.15.46:0/2469611064 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb6800ac570 con 0x7fb6980cf090 2024-02-19T06:58:43.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.411+0000 7fb69ce00640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb67406b810 0x7fb67406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:43.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.413+0000 7fb69ce00640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb67406b810 0x7fb67406dcd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb688006fd0 tx=0x7fb688008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:43.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.416+0000 7fb695600640 1 -- 172.21.15.46:0/2469611064 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb6980c9510 con 0x7fb6980cf090 2024-02-19T06:58:43.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.628+0000 7fb69e200640 1 -- 172.21.15.46:0/2469611064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb6980c9510 con 0x7fb6980cf090 2024-02-19T06:58:43.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.629+0000 7fb695600640 1 -- 172.21.15.46:0/2469611064 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb6980c9510 con 0x7fb6980cf090 2024-02-19T06:58:43.630 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-02-19T06:58:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.631+0000 7fb69e200640 1 -- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb67406b810 msgr2=0x7fb67406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.631+0000 7fb69e200640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb67406b810 0x7fb67406dcd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb688006fd0 tx=0x7fb688008040 comp rx=0 tx=0).stop 2024-02-19T06:58:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.631+0000 7fb69e200640 1 -- 172.21.15.46:0/2469611064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6980cf090 msgr2=0x7fb6980af680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.631+0000 7fb69e200640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6980cf090 0x7fb6980af680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb680000c00 tx=0x7fb6800046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.632+0000 7fb69e200640 1 -- 172.21.15.46:0/2469611064 shutdown_connections 2024-02-19T06:58:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.632+0000 7fb69e200640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb67406b810 0x7fb67406dcd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.632+0000 7fb69e200640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb69815f3c0 0x7fb6981f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.632+0000 7fb69e200640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6980cf090 0x7fb6980af680 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.632+0000 7fb69e200640 1 --2- 172.21.15.46:0/2469611064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6980cdd10 0x7fb69809ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.632+0000 7fb69e200640 1 -- 172.21.15.46:0/2469611064 >> 172.21.15.46:0/2469611064 conn(0x7fb6980d14c0 msgr2=0x7fb698070460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.632+0000 7fb69e200640 1 -- 172.21.15.46:0/2469611064 shutdown_connections 2024-02-19T06:58:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:43.632+0000 7fb69e200640 1 -- 172.21.15.46:0/2469611064 wait complete. 2024-02-19T06:58:43.652 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2024-02-19T06:58:43.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:43.653 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-02-19T06:58:43.758 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T06:58:43.758 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T06:58:43.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:43.759 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-19T06:58:43.822 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:58:43.822 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T06:58:43.877 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:58:43.877 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T06:58:43.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:44.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.141+0000 7f3e98e00640 1 Processor -- start 2024-02-19T06:58:44.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.141+0000 7f3e98e00640 1 -- start start 2024-02-19T06:58:44.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.142+0000 7f3e98e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e940acb80 0x7f3e9415ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.142+0000 7f3e98e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e940ad000 con 0x7f3e940b2540 2024-02-19T06:58:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.142+0000 7f3e98e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9415efc0 con 0x7f3e940ae3f0 2024-02-19T06:58:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.142+0000 7f3e98e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940adee0 con 0x7f3e940acb80 2024-02-19T06:58:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.143+0000 7f3e92800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3e940b2540 0x7f3e940b29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54988/0 (socket says 172.21.15.46:54988) 2024-02-19T06:58:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.143+0000 7f3e92800640 1 -- 172.21.15.46:0/2583228309 learned_addr learned my addr 172.21.15.46:0/2583228309 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.143+0000 7f3e89400640 1 --2- 172.21.15.46:0/2583228309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e940acb80 0x7f3e9415ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.144+0000 7f3e89400640 1 -- 172.21.15.46:0/2583228309 >> v1:172.21.15.142:6789/0 conn(0x7f3e940ae3f0 legacy=0x7f3e940ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:44.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.144+0000 7f3e89400640 1 -- 172.21.15.46:0/2583228309 >> v1:172.21.15.46:6789/0 conn(0x7f3e940b2540 legacy=0x7f3e940b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:44.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.144+0000 7f3e89400640 1 -- 172.21.15.46:0/2583228309 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e940ad260 con 0x7f3e940acb80 2024-02-19T06:58:44.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.145+0000 7f3e89400640 1 --2- 172.21.15.46:0/2583228309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e940acb80 0x7f3e9415ea80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0097d0 tx=0x7f3e7c02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab62e1b224161071 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.147+0000 7f3e91400640 1 -- 172.21.15.46:0/2583228309 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c030800 con 0x7f3e940acb80 2024-02-19T06:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.147+0000 7f3e91400640 1 -- 172.21.15.46:0/2583228309 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c030960 con 0x7f3e940acb80 2024-02-19T06:58:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.147+0000 7f3e91400640 1 -- 172.21.15.46:0/2583228309 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c030cf0 con 0x7f3e940acb80 2024-02-19T06:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.148+0000 7f3e98e00640 1 -- 172.21.15.46:0/2583228309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e940acb80 msgr2=0x7f3e9415ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.148+0000 7f3e98e00640 1 --2- 172.21.15.46:0/2583228309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e940acb80 0x7f3e9415ea80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0097d0 tx=0x7f3e7c02b940 comp rx=0 tx=0).stop 2024-02-19T06:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.148+0000 7f3e98e00640 1 -- 172.21.15.46:0/2583228309 shutdown_connections 2024-02-19T06:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.148+0000 7f3e98e00640 1 --2- 172.21.15.46:0/2583228309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e940acb80 0x7f3e9415ea80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.148+0000 7f3e98e00640 1 -- 172.21.15.46:0/2583228309 >> 172.21.15.46:0/2583228309 conn(0x7f3e94066f70 msgr2=0x7f3e9406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.148+0000 7f3e98e00640 1 -- 172.21.15.46:0/2583228309 shutdown_connections 2024-02-19T06:58:44.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.148+0000 7f3e98e00640 1 -- 172.21.15.46:0/2583228309 wait complete. 2024-02-19T06:58:44.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.150+0000 7f3e98e00640 1 Processor -- start 2024-02-19T06:58:44.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.150+0000 7f3e98e00640 1 -- start start 2024-02-19T06:58:44.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e98e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e940acb80 0x7f3e9414d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e98e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e940ae3f0 0x7f3e941528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e98e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e940b2540 0x7f3e94160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e98e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940b00a0 con 0x7f3e940acb80 2024-02-19T06:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e98e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940afdc0 con 0x7f3e940b2540 2024-02-19T06:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e98e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940cb7a0 con 0x7f3e940ae3f0 2024-02-19T06:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e91e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e940acb80 0x7f3e9414d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e91e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e940acb80 0x7f3e9414d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60484/0 (socket says 172.21.15.46:60484) 2024-02-19T06:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e91e00640 1 -- 172.21.15.46:0/888236409 learned_addr learned my addr 172.21.15.46:0/888236409 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e89400640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e940ae3f0 0x7f3e941528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e92800640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e940b2540 0x7f3e94160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e91e00640 1 -- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e940ae3f0 msgr2=0x7f3e941528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e91e00640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e940ae3f0 0x7f3e941528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e91e00640 1 -- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e940b2540 msgr2=0x7f3e94160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.151+0000 7f3e91e00640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e940b2540 0x7f3e94160240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.152+0000 7f3e91e00640 1 -- 172.21.15.46:0/888236409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c009400 con 0x7f3e940acb80 2024-02-19T06:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.152+0000 7f3e89400640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e940ae3f0 0x7f3e941528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.152+0000 7f3e92800640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e940b2540 0x7f3e94160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.152+0000 7f3e91e00640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e940acb80 0x7f3e9414d170 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400c450 tx=0x7f3e8400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.152+0000 7f3e8aa00640 1 -- 172.21.15.46:0/888236409 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e840052d0 con 0x7f3e940acb80 2024-02-19T06:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.152+0000 7f3e8aa00640 1 -- 172.21.15.46:0/888236409 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e84005430 con 0x7f3e940acb80 2024-02-19T06:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.152+0000 7f3e98e00640 1 -- 172.21.15.46:0/888236409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e940cba80 con 0x7f3e940acb80 2024-02-19T06:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.152+0000 7f3e8aa00640 1 -- 172.21.15.46:0/888236409 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84012870 con 0x7f3e940acb80 2024-02-19T06:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.152+0000 7f3e98e00640 1 -- 172.21.15.46:0/888236409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9414d6b0 con 0x7f3e940acb80 2024-02-19T06:58:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.154+0000 7f3e98e00640 1 -- 172.21.15.46:0/888236409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9414d840 con 0x7f3e940acb80 2024-02-19T06:58:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.154+0000 7f3e8aa00640 1 -- 172.21.15.46:0/888236409 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3e840129d0 con 0x7f3e940acb80 2024-02-19T06:58:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.155+0000 7f3e8aa00640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3e7006b810 0x7f3e7006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.156+0000 7f3e8aa00640 1 -- 172.21.15.46:0/888236409 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3e84089e40 con 0x7f3e940acb80 2024-02-19T06:58:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.156+0000 7f3e89400640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3e7006b810 0x7f3e7006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.157+0000 7f3e89400640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3e7006b810 0x7f3e7006dcd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c036000 tx=0x7f3e7c03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:44.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.160+0000 7f3e8aa00640 1 -- 172.21.15.46:0/888236409 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e84054740 con 0x7f3e940acb80 2024-02-19T06:58:44.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.359+0000 7f3e98e00640 1 -- 172.21.15.46:0/888236409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e94067ba0 con 0x7f3e940acb80 2024-02-19T06:58:44.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.363+0000 7f3e8aa00640 1 -- 172.21.15.46:0/888236409 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16855 (secure 0 0 0) 0x7f3e84057e00 con 0x7f3e940acb80 2024-02-19T06:58:44.364 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:44.365 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:58:37.086581+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:44.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.365+0000 7f3e98e00640 1 -- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3e7006b810 msgr2=0x7f3e7006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:44.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.365+0000 7f3e98e00640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3e7006b810 0x7f3e7006dcd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c036000 tx=0x7f3e7c03b040 comp rx=0 tx=0).stop 2024-02-19T06:58:44.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.365+0000 7f3e98e00640 1 -- 172.21.15.46:0/888236409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e940acb80 msgr2=0x7f3e9414d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:44.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.365+0000 7f3e98e00640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e940acb80 0x7f3e9414d170 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400c450 tx=0x7f3e8400c910 comp rx=0 tx=0).stop 2024-02-19T06:58:44.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.366+0000 7f3e98e00640 1 -- 172.21.15.46:0/888236409 shutdown_connections 2024-02-19T06:58:44.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.366+0000 7f3e98e00640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3e7006b810 0x7f3e7006dcd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.366+0000 7f3e98e00640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e940b2540 0x7f3e94160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.366+0000 7f3e98e00640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e940ae3f0 0x7f3e941528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.366+0000 7f3e98e00640 1 --2- 172.21.15.46:0/888236409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e940acb80 0x7f3e9414d170 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.366+0000 7f3e98e00640 1 -- 172.21.15.46:0/888236409 >> 172.21.15.46:0/888236409 conn(0x7f3e94066f70 msgr2=0x7f3e9406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:44.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.366+0000 7f3e98e00640 1 -- 172.21.15.46:0/888236409 shutdown_connections 2024-02-19T06:58:44.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.366+0000 7f3e98e00640 1 -- 172.21.15.46:0/888236409 wait complete. 2024-02-19T06:58:44.385 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:44.386 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:44.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.615+0000 7fcd20c00640 1 Processor -- start 2024-02-19T06:58:44.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.615+0000 7fcd20c00640 1 -- start start 2024-02-19T06:58:44.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.617+0000 7fcd20c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c145050 0x7fcd1c0cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.617+0000 7fcd20c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd1c0cfae0 0x7fcd1c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.617+0000 7fcd20c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c071e80 con 0x7fcd1c0ccce0 2024-02-19T06:58:44.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.617+0000 7fcd20c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c071020 con 0x7fcd1c0cfae0 2024-02-19T06:58:44.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.617+0000 7fcd20c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0aef70 con 0x7fcd1c145050 2024-02-19T06:58:44.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.617+0000 7fcd19400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcd1c0ccce0 0x7fcd1c0cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54996/0 (socket says 172.21.15.46:54996) 2024-02-19T06:58:44.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.617+0000 7fcd19400640 1 -- 172.21.15.46:0/3786127663 learned_addr learned my addr 172.21.15.46:0/3786127663 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:44.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd1a800640 1 --2- 172.21.15.46:0/3786127663 >> v2:172.21.15.142:3300/0 conn(0x7fcd1c0cfae0 0x7fcd1c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd19e00640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c145050 0x7fcd1c0cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979550789 0 0) 0x7fcd1c071e80 con 0x7fcd1c0ccce0 2024-02-19T06:58:44.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd00003520 con 0x7fcd1c0ccce0 2024-02-19T06:58:44.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3152559029 0 0) 0x7fcd00003520 con 0x7fcd1c0ccce0 2024-02-19T06:58:44.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c145050 msgr2=0x7fcd1c0cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:44.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c145050 0x7fcd1c0cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 >> v2:172.21.15.142:3300/0 conn(0x7fcd1c0cfae0 msgr2=0x7fcd1c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:44.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 --2- 172.21.15.46:0/3786127663 >> v2:172.21.15.142:3300/0 conn(0x7fcd1c0cfae0 0x7fcd1c06d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c071270 con 0x7fcd1c0ccce0 2024-02-19T06:58:44.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fcd080019f0 con 0x7fcd1c0ccce0 2024-02-19T06:58:44.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 >> v1:172.21.15.46:6789/0 conn(0x7fcd1c0ccce0 legacy=0x7fcd1c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c145050 0x7fcd00003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd00003ef0 0x7fcd000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00004d00 0x7fcd00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c071020 con 0x7fcd00004d00 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0aef70 con 0x7fcd00003ef0 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.618+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0000b980 con 0x7fcd1c145050 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.619+0000 7fcd1a800640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00004d00 0x7fcd00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.619+0000 7fcd19e00640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c145050 0x7fcd00003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.619+0000 7fcd19400640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd00003ef0 0x7fcd000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.619+0000 7fcd1a800640 1 -- 172.21.15.46:0/3786127663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c145050 msgr2=0x7fcd00003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.619+0000 7fcd1a800640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c145050 0x7fcd00003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.619+0000 7fcd1a800640 1 -- 172.21.15.46:0/3786127663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd00003ef0 msgr2=0x7fcd000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.619+0000 7fcd1a800640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd00003ef0 0x7fcd000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.619+0000 7fcd1a800640 1 -- 172.21.15.46:0/3786127663 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd00003520 con 0x7fcd00004d00 2024-02-19T06:58:44.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.619+0000 7fcd19e00640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c145050 0x7fcd00003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:44.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.619+0000 7fcd19400640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd00003ef0 0x7fcd000047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:44.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.620+0000 7fcd1a800640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00004d00 0x7fcd00005180 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009a90 tx=0x7fcd000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f405475fbd108e31 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:44.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.621+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1402c6b0 con 0x7fcd00004d00 2024-02-19T06:58:44.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.621+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1402c810 con 0x7fcd00004d00 2024-02-19T06:58:44.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.621+0000 7fcd18a00640 1 -- 172.21.15.46:0/3786127663 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1402cba0 con 0x7fcd00004d00 2024-02-19T06:58:44.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.621+0000 7fcd20c00640 1 -- 172.21.15.46:0/3786127663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00004d00 msgr2=0x7fcd00005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:44.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.621+0000 7fcd20c00640 1 --2- 172.21.15.46:0/3786127663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00004d00 0x7fcd00005180 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009a90 tx=0x7fcd000057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.621+0000 7fcd1a800640 1 -- 172.21.15.46:0/3786127663 reap_dead start 2024-02-19T06:58:44.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.621+0000 7fcd20c00640 1 -- 172.21.15.46:0/3786127663 shutdown_connections 2024-02-19T06:58:44.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.621+0000 7fcd20c00640 1 -- 172.21.15.46:0/3786127663 >> 172.21.15.46:0/3786127663 conn(0x7fcd1c066fc0 msgr2=0x7fcd1c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:44.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.622+0000 7fcd20c00640 1 -- 172.21.15.46:0/3786127663 shutdown_connections 2024-02-19T06:58:44.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.622+0000 7fcd20c00640 1 -- 172.21.15.46:0/3786127663 wait complete. 2024-02-19T06:58:44.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.623+0000 7fcd20c00640 1 Processor -- start 2024-02-19T06:58:44.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.623+0000 7fcd20c00640 1 -- start start 2024-02-19T06:58:44.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.624+0000 7fcd20c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00004d00 0x7fcd1c1f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.624+0000 7fcd20c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c0ae0a0 0x7fcd1c0ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.624+0000 7fcd20c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd1c13ea70 0x7fcd1c13eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.624+0000 7fcd20c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c13f430 con 0x7fcd00004d00 2024-02-19T06:58:44.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.624+0000 7fcd20c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1f3050 con 0x7fcd1c13ea70 2024-02-19T06:58:44.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.624+0000 7fcd20c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0ac940 con 0x7fcd1c0ae0a0 2024-02-19T06:58:44.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.625+0000 7fcd19e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00004d00 0x7fcd1c1f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.625+0000 7fcd19e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00004d00 0x7fcd1c1f2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60516/0 (socket says 172.21.15.46:60516) 2024-02-19T06:58:44.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.625+0000 7fcd19e00640 1 -- 172.21.15.46:0/1105511405 learned_addr learned my addr 172.21.15.46:0/1105511405 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:44.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.625+0000 7fcd1a800640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd1c13ea70 0x7fcd1c13eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.625+0000 7fcd19400640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c0ae0a0 0x7fcd1c0ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.625+0000 7fcd19e00640 1 -- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c0ae0a0 msgr2=0x7fcd1c0ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:44.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.625+0000 7fcd19e00640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c0ae0a0 0x7fcd1c0ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.625+0000 7fcd19e00640 1 -- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd1c13ea70 msgr2=0x7fcd1c13eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:44.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.625+0000 7fcd19e00640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd1c13ea70 0x7fcd1c13eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.625+0000 7fcd19e00640 1 -- 172.21.15.46:0/1105511405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c0acbe0 con 0x7fcd00004d00 2024-02-19T06:58:44.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.625+0000 7fcd1a800640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd1c13ea70 0x7fcd1c13eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:44.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.625+0000 7fcd19400640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c0ae0a0 0x7fcd1c0ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:44.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.626+0000 7fcd19e00640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00004d00 0x7fcd1c1f2b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0108e0 tx=0x7fcd0c010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:44.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.626+0000 7fcd12000640 1 -- 172.21.15.46:0/1105511405 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00ec20 con 0x7fcd00004d00 2024-02-19T06:58:44.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.626+0000 7fcd12000640 1 -- 172.21.15.46:0/1105511405 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c00ed80 con 0x7fcd00004d00 2024-02-19T06:58:44.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.626+0000 7fcd20c00640 1 -- 172.21.15.46:0/1105511405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c0acec0 con 0x7fcd00004d00 2024-02-19T06:58:44.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.626+0000 7fcd12000640 1 -- 172.21.15.46:0/1105511405 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c01c600 con 0x7fcd00004d00 2024-02-19T06:58:44.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.626+0000 7fcd20c00640 1 -- 172.21.15.46:0/1105511405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c0ad480 con 0x7fcd00004d00 2024-02-19T06:58:44.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.627+0000 7fcd20c00640 1 -- 172.21.15.46:0/1105511405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1c0ad640 con 0x7fcd00004d00 2024-02-19T06:58:44.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.628+0000 7fcd12000640 1 -- 172.21.15.46:0/1105511405 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcd0c01c760 con 0x7fcd00004d00 2024-02-19T06:58:44.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.629+0000 7fcd12000640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fccfc06b810 0x7fccfc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:44.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.629+0000 7fcd12000640 1 -- 172.21.15.46:0/1105511405 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcd0c08a940 con 0x7fcd00004d00 2024-02-19T06:58:44.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.630+0000 7fcd19400640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fccfc06b810 0x7fccfc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:44.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.631+0000 7fcd19400640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fccfc06b810 0x7fccfc06dcd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd08001b20 tx=0x7fcd08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:44.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.634+0000 7fcd12000640 1 -- 172.21.15.46:0/1105511405 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd0c0552e0 con 0x7fcd00004d00 2024-02-19T06:58:44.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.832+0000 7fcd20c00640 1 -- 172.21.15.46:0/1105511405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd1c067ba0 con 0x7fcd00004d00 2024-02-19T06:58:44.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.833+0000 7fcd12000640 1 -- 172.21.15.46:0/1105511405 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd0c0589a0 con 0x7fcd00004d00 2024-02-19T06:58:44.835 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:44.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.836+0000 7fcd20c00640 1 -- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fccfc06b810 msgr2=0x7fccfc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:44.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.836+0000 7fcd20c00640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fccfc06b810 0x7fccfc06dcd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd08001b20 tx=0x7fcd08009040 comp rx=0 tx=0).stop 2024-02-19T06:58:44.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.836+0000 7fcd20c00640 1 -- 172.21.15.46:0/1105511405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00004d00 msgr2=0x7fcd1c1f2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:44.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.836+0000 7fcd20c00640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00004d00 0x7fcd1c1f2b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0108e0 tx=0x7fcd0c010da0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.836+0000 7fcd20c00640 1 -- 172.21.15.46:0/1105511405 shutdown_connections 2024-02-19T06:58:44.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.836+0000 7fcd20c00640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fccfc06b810 0x7fccfc06dcd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.836+0000 7fcd20c00640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd1c13ea70 0x7fcd1c13eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.836+0000 7fcd20c00640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd1c0ae0a0 0x7fcd1c0ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.836+0000 7fcd20c00640 1 --2- 172.21.15.46:0/1105511405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd00004d00 0x7fcd1c1f2b10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:44.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.836+0000 7fcd20c00640 1 -- 172.21.15.46:0/1105511405 >> 172.21.15.46:0/1105511405 conn(0x7fcd1c066fc0 msgr2=0x7fcd1c15fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:44.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.836+0000 7fcd20c00640 1 -- 172.21.15.46:0/1105511405 shutdown_connections 2024-02-19T06:58:44.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:44.836+0000 7fcd20c00640 1 -- 172.21.15.46:0/1105511405 wait complete. 2024-02-19T06:58:44.858 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:45.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.083+0000 7fd939200640 1 Processor -- start 2024-02-19T06:58:45.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.083+0000 7fd939200640 1 -- start start 2024-02-19T06:58:45.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.084+0000 7fd939200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd934155b20 0x7fd9340cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:45.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.085+0000 7fd939200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340b2bf0 0x7fd93406d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:45.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.085+0000 7fd939200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93415be60 con 0x7fd9340cfa70 2024-02-19T06:58:45.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.085+0000 7fd939200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9340cff00 con 0x7fd934155b20 2024-02-19T06:58:45.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.085+0000 7fd939200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93415c140 con 0x7fd9340b2bf0 2024-02-19T06:58:45.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.085+0000 7fd933400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd934155b20 0x7fd9340cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:45.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.085+0000 7fd933400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd934155b20 0x7fd9340cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60520/0 (socket says 172.21.15.46:60520) 2024-02-19T06:58:45.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.085+0000 7fd933400640 1 -- 172.21.15.46:0/1320481520 learned_addr learned my addr 172.21.15.46:0/1320481520 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:45.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.085+0000 7fd933400640 1 -- 172.21.15.46:0/1320481520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340b2bf0 msgr2=0x7fd93406d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:45.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.085+0000 7fd933e00640 1 --2- 172.21.15.46:0/1320481520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340b2bf0 0x7fd93406d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:45.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.086+0000 7fd933400640 1 --2- 172.21.15.46:0/1320481520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340b2bf0 0x7fd93406d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.086+0000 7fd933400640 1 -- 172.21.15.46:0/1320481520 >> v1:172.21.15.46:6789/0 conn(0x7fd9340cfa70 legacy=0x7fd9340b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:45.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.086+0000 7fd933400640 1 -- 172.21.15.46:0/1320481520 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93415c420 con 0x7fd934155b20 2024-02-19T06:58:45.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.086+0000 7fd932a00640 1 -- 172.21.15.46:0/1320481520 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985132529 0 0) 0x7fd93415be60 con 0x7fd9340cfa70 2024-02-19T06:58:45.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.086+0000 7fd933e00640 1 --2- 172.21.15.46:0/1320481520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340b2bf0 0x7fd93406d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.087+0000 7fd933400640 1 --2- 172.21.15.46:0/1320481520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd934155b20 0x7fd9340cf530 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd924009870 tx=0x7fd92402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7ec06ac51e3303 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.087+0000 7fd932a00640 1 -- 172.21.15.46:0/1320481520 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd924031640 con 0x7fd934155b20 2024-02-19T06:58:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.088+0000 7fd932a00640 1 -- 172.21.15.46:0/1320481520 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9240317a0 con 0x7fd934155b20 2024-02-19T06:58:45.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.088+0000 7fd932a00640 1 -- 172.21.15.46:0/1320481520 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd924031b30 con 0x7fd934155b20 2024-02-19T06:58:45.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.088+0000 7fd939200640 1 -- 172.21.15.46:0/1320481520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd934155b20 msgr2=0x7fd9340cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:45.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.088+0000 7fd939200640 1 --2- 172.21.15.46:0/1320481520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd934155b20 0x7fd9340cf530 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd924009870 tx=0x7fd92402b8f0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.088+0000 7fd939200640 1 -- 172.21.15.46:0/1320481520 shutdown_connections 2024-02-19T06:58:45.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.088+0000 7fd939200640 1 --2- 172.21.15.46:0/1320481520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340b2bf0 0x7fd93406d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.088+0000 7fd939200640 1 --2- 172.21.15.46:0/1320481520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd934155b20 0x7fd9340cf530 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.089+0000 7fd939200640 1 -- 172.21.15.46:0/1320481520 >> 172.21.15.46:0/1320481520 conn(0x7fd93406ad60 msgr2=0x7fd93406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:45.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.089+0000 7fd939200640 1 -- 172.21.15.46:0/1320481520 shutdown_connections 2024-02-19T06:58:45.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.089+0000 7fd939200640 1 -- 172.21.15.46:0/1320481520 wait complete. 2024-02-19T06:58:45.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.091+0000 7fd939200640 1 Processor -- start 2024-02-19T06:58:45.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.091+0000 7fd939200640 1 -- start start 2024-02-19T06:58:45.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.092+0000 7fd939200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9340b2bf0 0x7fd9340c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:45.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.092+0000 7fd939200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9340cfa70 0x7fd9341561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:45.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.092+0000 7fd939200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd934155b20 0x7fd9340aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:45.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.092+0000 7fd939200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9341566e0 con 0x7fd9340cfa70 2024-02-19T06:58:45.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.092+0000 7fd939200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340ac540 con 0x7fd9340b2bf0 2024-02-19T06:58:45.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.092+0000 7fd939200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340ac240 con 0x7fd934155b20 2024-02-19T06:58:45.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.092+0000 7fd92be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9340cfa70 0x7fd9341561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:45.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.092+0000 7fd92be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9340cfa70 0x7fd9341561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60528/0 (socket says 172.21.15.46:60528) 2024-02-19T06:58:45.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.092+0000 7fd92be00640 1 -- 172.21.15.46:0/178133681 learned_addr learned my addr 172.21.15.46:0/178133681 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:45.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.092+0000 7fd933400640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9340b2bf0 0x7fd9340c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.092+0000 7fd933e00640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd934155b20 0x7fd9340aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.093+0000 7fd92be00640 1 -- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd934155b20 msgr2=0x7fd9340aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.093+0000 7fd92be00640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd934155b20 0x7fd9340aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.093+0000 7fd92be00640 1 -- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9340b2bf0 msgr2=0x7fd9340c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.093+0000 7fd92be00640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9340b2bf0 0x7fd9340c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.093+0000 7fd92be00640 1 -- 172.21.15.46:0/178133681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9240094d0 con 0x7fd9340cfa70 2024-02-19T06:58:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.093+0000 7fd92be00640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9340cfa70 0x7fd9341561a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00c4b0 tx=0x7fd91c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.093+0000 7fd92b400640 1 -- 172.21.15.46:0/178133681 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c005480 con 0x7fd9340cfa70 2024-02-19T06:58:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.093+0000 7fd92b400640 1 -- 172.21.15.46:0/178133681 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c0035f0 con 0x7fd9340cfa70 2024-02-19T06:58:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.093+0000 7fd92b400640 1 -- 172.21.15.46:0/178133681 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c0039e0 con 0x7fd9340cfa70 2024-02-19T06:58:45.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.093+0000 7fd939200640 1 -- 172.21.15.46:0/178133681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9340c63c0 con 0x7fd9340cfa70 2024-02-19T06:58:45.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.094+0000 7fd939200640 1 -- 172.21.15.46:0/178133681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd934156bf0 con 0x7fd9340cfa70 2024-02-19T06:58:45.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.095+0000 7fd939200640 1 -- 172.21.15.46:0/178133681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93404eee0 con 0x7fd9340cfa70 2024-02-19T06:58:45.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.096+0000 7fd92b400640 1 -- 172.21.15.46:0/178133681 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd91c003b40 con 0x7fd9340cfa70 2024-02-19T06:58:45.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.097+0000 7fd92b400640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd91006b810 0x7fd91006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:45.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.097+0000 7fd92b400640 1 -- 172.21.15.46:0/178133681 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd91c089920 con 0x7fd9340cfa70 2024-02-19T06:58:45.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.098+0000 7fd933400640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd91006b810 0x7fd91006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:45.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.099+0000 7fd933400640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd91006b810 0x7fd91006dcd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd924036000 tx=0x7fd92403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:45.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.103+0000 7fd92b400640 1 -- 172.21.15.46:0/178133681 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd91c054220 con 0x7fd9340cfa70 2024-02-19T06:58:45.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.304+0000 7fd939200640 1 -- 172.21.15.46:0/178133681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd93415aef0 con 0x7fd9340cfa70 2024-02-19T06:58:45.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.305+0000 7fd92b400640 1 -- 172.21.15.46:0/178133681 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd91c0578e0 con 0x7fd9340cfa70 2024-02-19T06:58:45.307 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.308+0000 7fd939200640 1 -- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd91006b810 msgr2=0x7fd91006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.308+0000 7fd939200640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd91006b810 0x7fd91006dcd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd924036000 tx=0x7fd92403c040 comp rx=0 tx=0).stop 2024-02-19T06:58:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.308+0000 7fd939200640 1 -- 172.21.15.46:0/178133681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9340cfa70 msgr2=0x7fd9341561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.308+0000 7fd939200640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9340cfa70 0x7fd9341561a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00c4b0 tx=0x7fd91c00c970 comp rx=0 tx=0).stop 2024-02-19T06:58:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.308+0000 7fd939200640 1 -- 172.21.15.46:0/178133681 shutdown_connections 2024-02-19T06:58:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.308+0000 7fd939200640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd91006b810 0x7fd91006dcd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.308+0000 7fd939200640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd934155b20 0x7fd9340aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.308+0000 7fd939200640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9340cfa70 0x7fd9341561a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.308+0000 7fd939200640 1 --2- 172.21.15.46:0/178133681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9340b2bf0 0x7fd9340c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.308+0000 7fd939200640 1 -- 172.21.15.46:0/178133681 >> 172.21.15.46:0/178133681 conn(0x7fd93406ad60 msgr2=0x7fd93415df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:45.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.308+0000 7fd939200640 1 -- 172.21.15.46:0/178133681 shutdown_connections 2024-02-19T06:58:45.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.308+0000 7fd939200640 1 -- 172.21.15.46:0/178133681 wait complete. 2024-02-19T06:58:45.330 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:45.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.555+0000 7f52b3a00640 1 Processor -- start 2024-02-19T06:58:45.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.555+0000 7f52b3a00640 1 -- start start 2024-02-19T06:58:45.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.557+0000 7f52b3a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f52ac145050 0x7f52ac0cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:45.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.557+0000 7f52b3a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f52ac0ccce0 0x7f52ac0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:45.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.557+0000 7f52b3a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ac071e80 con 0x7f52ac0cf910 2024-02-19T06:58:45.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.557+0000 7f52b3a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ac0cfd80 con 0x7f52ac0ccce0 2024-02-19T06:58:45.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.557+0000 7f52b3a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ac071020 con 0x7f52ac145050 2024-02-19T06:58:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.557+0000 7f52abe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f52ac0ccce0 0x7f52ac0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.557+0000 7f52abe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f52ac0ccce0 0x7f52ac0cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45238/0 (socket says 172.21.15.46:45238) 2024-02-19T06:58:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.557+0000 7f52abe00640 1 -- 172.21.15.46:0/3724374580 learned_addr learned my addr 172.21.15.46:0/3724374580 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.557+0000 7f52b1a00640 1 --1- 172.21.15.46:0/3724374580 >> v1:172.21.15.46:6789/0 conn(0x7f52ac0cf910 0x7f52ac15f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46040/0 (socket says 172.21.15.46:46040) 2024-02-19T06:58:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.557+0000 7f52b1000640 1 --2- 172.21.15.46:0/3724374580 >> v2:172.21.15.142:3300/0 conn(0x7f52ac145050 0x7f52ac0cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.558+0000 7f52abe00640 1 -- 172.21.15.46:0/3724374580 >> v2:172.21.15.142:3300/0 conn(0x7f52ac145050 msgr2=0x7f52ac0cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.558+0000 7f52abe00640 1 --2- 172.21.15.46:0/3724374580 >> v2:172.21.15.142:3300/0 conn(0x7f52ac145050 0x7f52ac0cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.558+0000 7f52abe00640 1 -- 172.21.15.46:0/3724374580 >> v1:172.21.15.46:6789/0 conn(0x7f52ac0cf910 legacy=0x7f52ac15f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.558+0000 7f52abe00640 1 -- 172.21.15.46:0/3724374580 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac0aef70 con 0x7f52ac0ccce0 2024-02-19T06:58:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.558+0000 7f52ab400640 1 -- 172.21.15.46:0/3724374580 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112382592 0 0) 0x7f52ac071e80 con 0x7f52ac0cf910 2024-02-19T06:58:45.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.559+0000 7f52abe00640 1 --2- 172.21.15.46:0/3724374580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ac0ccce0 0x7f52ac0cf3d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f52ac06f2c0 tx=0x7f529802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bbb150ebfe6aba server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:45.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.559+0000 7f52ab400640 1 -- 172.21.15.46:0/3724374580 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298030860 con 0x7f52ac0ccce0 2024-02-19T06:58:45.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.559+0000 7f52ab400640 1 -- 172.21.15.46:0/3724374580 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52980309c0 con 0x7f52ac0ccce0 2024-02-19T06:58:45.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.559+0000 7f52ab400640 1 -- 172.21.15.46:0/3724374580 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298030d50 con 0x7f52ac0ccce0 2024-02-19T06:58:45.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.560+0000 7f52b3a00640 1 -- 172.21.15.46:0/3724374580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ac0ccce0 msgr2=0x7f52ac0cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:45.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.560+0000 7f52b3a00640 1 --2- 172.21.15.46:0/3724374580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ac0ccce0 0x7f52ac0cf3d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f52ac06f2c0 tx=0x7f529802b9a0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.560+0000 7f52b3a00640 1 -- 172.21.15.46:0/3724374580 shutdown_connections 2024-02-19T06:58:45.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.560+0000 7f52b3a00640 1 --2- 172.21.15.46:0/3724374580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ac0ccce0 0x7f52ac0cf3d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.560+0000 7f52b3a00640 1 --2- 172.21.15.46:0/3724374580 >> v2:172.21.15.142:3300/0 conn(0x7f52ac145050 0x7f52ac0cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.560+0000 7f52b3a00640 1 -- 172.21.15.46:0/3724374580 >> 172.21.15.46:0/3724374580 conn(0x7f52ac066fc0 msgr2=0x7f52ac06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:45.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.560+0000 7f52b3a00640 1 -- 172.21.15.46:0/3724374580 shutdown_connections 2024-02-19T06:58:45.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.560+0000 7f52b3a00640 1 -- 172.21.15.46:0/3724374580 wait complete. 2024-02-19T06:58:45.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.562+0000 7f52b3a00640 1 Processor -- start 2024-02-19T06:58:45.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.562+0000 7f52b3a00640 1 -- start start 2024-02-19T06:58:45.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52b3a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52ac0ccce0 0x7f52ac0adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:45.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52b3a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ac0cf910 0x7f52ac0c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:45.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52b3a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ac145050 0x7f52ac137bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:45.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52b3a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac0ac960 con 0x7f52ac145050 2024-02-19T06:58:45.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52b3a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac0abdd0 con 0x7f52ac0cf910 2024-02-19T06:58:45.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52b3a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac0ae330 con 0x7f52ac0ccce0 2024-02-19T06:58:45.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52b1a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ac145050 0x7f52ac137bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:45.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52b1a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ac145050 0x7f52ac137bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45244/0 (socket says 172.21.15.46:45244) 2024-02-19T06:58:45.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52b1a00640 1 -- 172.21.15.46:0/2889089996 learned_addr learned my addr 172.21.15.46:0/2889089996 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:45.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52b1a00640 1 -- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52ac0ccce0 msgr2=0x7f52ac0adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:45.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52b1000640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52ac0ccce0 0x7f52ac0adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52abe00640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ac0cf910 0x7f52ac0c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52b1a00640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52ac0ccce0 0x7f52ac0adcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.563+0000 7f52b1a00640 1 -- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ac0cf910 msgr2=0x7f52ac0c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.564+0000 7f52b1a00640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ac0cf910 0x7f52ac0c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.564+0000 7f52b1a00640 1 -- 172.21.15.46:0/2889089996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52980094d0 con 0x7f52ac145050 2024-02-19T06:58:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.564+0000 7f52abe00640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ac0cf910 0x7f52ac0c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.564+0000 7f52b1a00640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ac145050 0x7f52ac137bd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f52a400c7a0 tx=0x7f52a400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.564+0000 7f52a8c00640 1 -- 172.21.15.46:0/2889089996 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a400a640 con 0x7f52ac145050 2024-02-19T06:58:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.564+0000 7f52a8c00640 1 -- 172.21.15.46:0/2889089996 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a400a7a0 con 0x7f52ac145050 2024-02-19T06:58:45.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.564+0000 7f52a8c00640 1 -- 172.21.15.46:0/2889089996 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a400abd0 con 0x7f52ac145050 2024-02-19T06:58:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.564+0000 7f52b3a00640 1 -- 172.21.15.46:0/2889089996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ac141f50 con 0x7f52ac145050 2024-02-19T06:58:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.564+0000 7f52b3a00640 1 -- 172.21.15.46:0/2889089996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ac0ac2a0 con 0x7f52ac145050 2024-02-19T06:58:45.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.566+0000 7f52b3a00640 1 -- 172.21.15.46:0/2889089996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ac0acaa0 con 0x7f52ac145050 2024-02-19T06:58:45.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.567+0000 7f52a8c00640 1 -- 172.21.15.46:0/2889089996 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f52a400ad30 con 0x7f52ac145050 2024-02-19T06:58:45.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.567+0000 7f52a8c00640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f528c06b810 0x7f528c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:45.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.568+0000 7f52a8c00640 1 -- 172.21.15.46:0/2889089996 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f52a40898b0 con 0x7f52ac145050 2024-02-19T06:58:45.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.568+0000 7f52b1000640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f528c06b810 0x7f528c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:45.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.570+0000 7f52b1000640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f528c06b810 0x7f528c06dcd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f52a0006fd0 tx=0x7f52a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:45.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.573+0000 7f52a8c00640 1 -- 172.21.15.46:0/2889089996 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52ac0acaa0 con 0x7f52ac145050 2024-02-19T06:58:45.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.770+0000 7f52b3a00640 1 -- 172.21.15.46:0/2889089996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52ac0acaa0 con 0x7f52ac145050 2024-02-19T06:58:45.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.771+0000 7f52a8c00640 1 -- 172.21.15.46:0/2889089996 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52ac0acaa0 con 0x7f52ac145050 2024-02-19T06:58:45.773 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.774+0000 7f52b3a00640 1 -- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f528c06b810 msgr2=0x7f528c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.774+0000 7f52b3a00640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f528c06b810 0x7f528c06dcd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f52a0006fd0 tx=0x7f52a0008040 comp rx=0 tx=0).stop 2024-02-19T06:58:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.774+0000 7f52b3a00640 1 -- 172.21.15.46:0/2889089996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ac145050 msgr2=0x7f52ac137bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.774+0000 7f52b3a00640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ac145050 0x7f52ac137bd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f52a400c7a0 tx=0x7f52a400cc60 comp rx=0 tx=0).stop 2024-02-19T06:58:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.774+0000 7f52b3a00640 1 -- 172.21.15.46:0/2889089996 shutdown_connections 2024-02-19T06:58:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.774+0000 7f52b3a00640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f528c06b810 0x7f528c06dcd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.774+0000 7f52b3a00640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ac145050 0x7f52ac137bd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.774+0000 7f52b3a00640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ac0cf910 0x7f52ac0c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.774+0000 7f52b3a00640 1 --2- 172.21.15.46:0/2889089996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52ac0ccce0 0x7f52ac0adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.774+0000 7f52b3a00640 1 -- 172.21.15.46:0/2889089996 >> 172.21.15.46:0/2889089996 conn(0x7f52ac066fc0 msgr2=0x7f52ac144280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.775+0000 7f52b3a00640 1 -- 172.21.15.46:0/2889089996 shutdown_connections 2024-02-19T06:58:45.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:45.775+0000 7f52b3a00640 1 -- 172.21.15.46:0/2889089996 wait complete. 2024-02-19T06:58:45.796 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-19T06:58:46.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.012+0000 7fbd12400640 1 Processor -- start 2024-02-19T06:58:46.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.012+0000 7fbd12400640 1 -- start start 2024-02-19T06:58:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.013+0000 7fbd12400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd0c1613d0 0x7fbd0c0d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.013+0000 7fbd12400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd0c0d34f0 0x7fbd0c0d3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.013+0000 7fbd12400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0c15dcb0 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.013+0000 7fbd12400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c161860 con 0x7fbd0c0d34f0 2024-02-19T06:58:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.013+0000 7fbd12400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c161b40 con 0x7fbd0c1613d0 2024-02-19T06:58:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.013+0000 7fbd11a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd0c0d34f0 0x7fbd0c0d3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.014+0000 7fbd11a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbd0c0d34f0 0x7fbd0c0d3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45246/0 (socket says 172.21.15.46:45246) 2024-02-19T06:58:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.014+0000 7fbd11a00640 1 -- 172.21.15.46:0/813881994 learned_addr learned my addr 172.21.15.46:0/813881994 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.014+0000 7fbd0be00640 1 --2- 172.21.15.46:0/813881994 >> v2:172.21.15.142:3300/0 conn(0x7fbd0c1613d0 0x7fbd0c0d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.014+0000 7fbd11a00640 1 -- 172.21.15.46:0/813881994 >> v2:172.21.15.142:3300/0 conn(0x7fbd0c1613d0 msgr2=0x7fbd0c0d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.014+0000 7fbd11a00640 1 --2- 172.21.15.46:0/813881994 >> v2:172.21.15.142:3300/0 conn(0x7fbd0c1613d0 0x7fbd0c0d1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.014+0000 7fbd11a00640 1 -- 172.21.15.46:0/813881994 >> v1:172.21.15.142:6789/0 conn(0x7fbd0c15d8d0 legacy=0x7fbd0c0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.014+0000 7fbd11a00640 1 -- 172.21.15.46:0/813881994 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c161e20 con 0x7fbd0c0d34f0 2024-02-19T06:58:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.015+0000 7fbd11a00640 1 --2- 172.21.15.46:0/813881994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c0d34f0 0x7fbd0c0d3900 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0cfd90 tx=0x7fbd0402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f897be4c8241f8be server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:46.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.015+0000 7fbd0b400640 1 -- 172.21.15.46:0/813881994 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0402c9f0 con 0x7fbd0c0d34f0 2024-02-19T06:58:46.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.015+0000 7fbd0b400640 1 -- 172.21.15.46:0/813881994 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0402cb50 con 0x7fbd0c0d34f0 2024-02-19T06:58:46.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.015+0000 7fbd0b400640 1 -- 172.21.15.46:0/813881994 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd040343f0 con 0x7fbd0c0d34f0 2024-02-19T06:58:46.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.016+0000 7fbd12400640 1 -- 172.21.15.46:0/813881994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c0d34f0 msgr2=0x7fbd0c0d3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:46.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.016+0000 7fbd12400640 1 --2- 172.21.15.46:0/813881994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c0d34f0 0x7fbd0c0d3900 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0cfd90 tx=0x7fbd0402be50 comp rx=0 tx=0).stop 2024-02-19T06:58:46.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.016+0000 7fbd12400640 1 -- 172.21.15.46:0/813881994 shutdown_connections 2024-02-19T06:58:46.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.016+0000 7fbd12400640 1 --2- 172.21.15.46:0/813881994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c0d34f0 0x7fbd0c0d3900 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.016+0000 7fbd12400640 1 --2- 172.21.15.46:0/813881994 >> v2:172.21.15.142:3300/0 conn(0x7fbd0c1613d0 0x7fbd0c0d1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.016+0000 7fbd12400640 1 -- 172.21.15.46:0/813881994 >> 172.21.15.46:0/813881994 conn(0x7fbd0c09c9d0 msgr2=0x7fbd0c08afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:46.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.016+0000 7fbd12400640 1 -- 172.21.15.46:0/813881994 shutdown_connections 2024-02-19T06:58:46.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.016+0000 7fbd12400640 1 -- 172.21.15.46:0/813881994 wait complete. 2024-02-19T06:58:46.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.018+0000 7fbd12400640 1 Processor -- start 2024-02-19T06:58:46.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.018+0000 7fbd12400640 1 -- start start 2024-02-19T06:58:46.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.019+0000 7fbd12400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd0c0d34f0 0x7fbd0c15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:46.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.019+0000 7fbd12400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c15d8d0 0x7fbd0c0b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:46.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.019+0000 7fbd12400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd0c0b8810 0x7fbd0c15f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:46.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.019+0000 7fbd12400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c160250 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.019+0000 7fbd12400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0b8cc0 con 0x7fbd0c0b8810 2024-02-19T06:58:46.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.019+0000 7fbd12400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c15cf20 con 0x7fbd0c0d34f0 2024-02-19T06:58:46.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.019+0000 7fbd0be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c15d8d0 0x7fbd0c0b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:46.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.019+0000 7fbd0be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c15d8d0 0x7fbd0c0b82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45248/0 (socket says 172.21.15.46:45248) 2024-02-19T06:58:46.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.019+0000 7fbd0be00640 1 -- 172.21.15.46:0/1704877522 learned_addr learned my addr 172.21.15.46:0/1704877522 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:46.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.020+0000 7fbd11a00640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd0c0b8810 0x7fbd0c15f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:46.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.020+0000 7fbd0be00640 1 -- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd0c0d34f0 msgr2=0x7fbd0c15c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:46.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.020+0000 7fbd11000640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd0c0d34f0 0x7fbd0c15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:46.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.020+0000 7fbd0be00640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd0c0d34f0 0x7fbd0c15c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.020+0000 7fbd0be00640 1 -- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd0c0b8810 msgr2=0x7fbd0c15f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:46.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.020+0000 7fbd0be00640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd0c0b8810 0x7fbd0c15f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.020+0000 7fbd0be00640 1 -- 172.21.15.46:0/1704877522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd04009b30 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.020+0000 7fbd11a00640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd0c0b8810 0x7fbd0c15f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:46.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.020+0000 7fbd0be00640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c15d8d0 0x7fbd0c0b82d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800c7f0 tx=0x7fbcf800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:46.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.020+0000 7fbd08c00640 1 -- 172.21.15.46:0/1704877522 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8004220 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.020+0000 7fbd08c00640 1 -- 172.21.15.46:0/1704877522 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8004380 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.020+0000 7fbd08c00640 1 -- 172.21.15.46:0/1704877522 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8007840 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.021+0000 7fbd12400640 1 -- 172.21.15.46:0/1704877522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0c15e350 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.021+0000 7fbd12400640 1 -- 172.21.15.46:0/1704877522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0c0cb260 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.022+0000 7fbd12400640 1 -- 172.21.15.46:0/1704877522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0c0b9610 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.023+0000 7fbd08c00640 1 -- 172.21.15.46:0/1704877522 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbcf8007bb0 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.024+0000 7fbd08c00640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbcec06b840 0x7fbcec06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:46.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.024+0000 7fbd08c00640 1 -- 172.21.15.46:0/1704877522 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbcf808a1e0 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.024+0000 7fbd11000640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbcec06b840 0x7fbcec06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:46.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.026+0000 7fbd11000640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbcec06b840 0x7fbcec06dd00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbd000015d0 tx=0x7fbd00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:46.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.029+0000 7fbd08c00640 1 -- 172.21.15.46:0/1704877522 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbcf8054ae0 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.242+0000 7fbd12400640 1 -- 172.21.15.46:0/1704877522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbd0c0cb3f0 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.243+0000 7fbd08c00640 1 -- 172.21.15.46:0/1704877522 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbcf8007e60 con 0x7fbd0c15d8d0 2024-02-19T06:58:46.245 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-02-19T06:58:46.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.246+0000 7fbd12400640 1 -- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbcec06b840 msgr2=0x7fbcec06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:46.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.246+0000 7fbd12400640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbcec06b840 0x7fbcec06dd00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbd000015d0 tx=0x7fbd00009040 comp rx=0 tx=0).stop 2024-02-19T06:58:46.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.246+0000 7fbd12400640 1 -- 172.21.15.46:0/1704877522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c15d8d0 msgr2=0x7fbd0c0b82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:46.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.246+0000 7fbd12400640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c15d8d0 0x7fbd0c0b82d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800c7f0 tx=0x7fbcf800ccb0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.246+0000 7fbd12400640 1 -- 172.21.15.46:0/1704877522 shutdown_connections 2024-02-19T06:58:46.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.246+0000 7fbd12400640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbcec06b840 0x7fbcec06dd00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.246+0000 7fbd12400640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd0c0b8810 0x7fbd0c15f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.246+0000 7fbd12400640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c15d8d0 0x7fbd0c0b82d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.246+0000 7fbd12400640 1 --2- 172.21.15.46:0/1704877522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd0c0d34f0 0x7fbd0c15c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.246+0000 7fbd12400640 1 -- 172.21.15.46:0/1704877522 >> 172.21.15.46:0/1704877522 conn(0x7fbd0c09c9d0 msgr2=0x7fbd0c0b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:46.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.246+0000 7fbd12400640 1 -- 172.21.15.46:0/1704877522 shutdown_connections 2024-02-19T06:58:46.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.246+0000 7fbd12400640 1 -- 172.21.15.46:0/1704877522 wait complete. 2024-02-19T06:58:46.267 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:58:46.267 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T06:58:46.325 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:46.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.554+0000 7f51aa600640 1 Processor -- start 2024-02-19T06:58:46.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.555+0000 7f51aa600640 1 -- start start 2024-02-19T06:58:46.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.556+0000 7f51aa600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f51a415db30 0x7f51a40af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:46.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.556+0000 7f51aa600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a40b3aa0 con 0x7f51a40b3330 2024-02-19T06:58:46.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.556+0000 7f51aa600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a40af6f0 con 0x7f51a415e990 2024-02-19T06:58:46.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.556+0000 7f51aa600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a415ee90 con 0x7f51a415db30 2024-02-19T06:58:46.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.557+0000 7f51a9200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f51a415db30 0x7f51a40af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:46.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.557+0000 7f51a9c00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f51a40b3330 0x7f51a406ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46048/0 (socket says 172.21.15.46:46048) 2024-02-19T06:58:46.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.557+0000 7f51a9c00640 1 -- 172.21.15.46:0/2215788793 learned_addr learned my addr 172.21.15.46:0/2215788793 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:46.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.557+0000 7f51a9200640 1 -- 172.21.15.46:0/2215788793 >> v1:172.21.15.142:6789/0 conn(0x7f51a415e990 legacy=0x7f51a40b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:46.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.557+0000 7f51a9200640 1 -- 172.21.15.46:0/2215788793 >> v1:172.21.15.46:6789/0 conn(0x7f51a40b3330 legacy=0x7f51a406ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:46.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.557+0000 7f51a9200640 1 -- 172.21.15.46:0/2215788793 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a406d9f0 con 0x7f51a415db30 2024-02-19T06:58:46.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.559+0000 7f51a9200640 1 --2- 172.21.15.46:0/2215788793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a415db30 0x7f51a40af1b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5194009d90 tx=0x7f519402bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3fb6099a943818 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:46.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.559+0000 7f51a3400640 1 -- 172.21.15.46:0/2215788793 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519402ca20 con 0x7f51a415db30 2024-02-19T06:58:46.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.559+0000 7f51a3400640 1 -- 172.21.15.46:0/2215788793 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519402cb80 con 0x7f51a415db30 2024-02-19T06:58:46.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.559+0000 7f51a3400640 1 -- 172.21.15.46:0/2215788793 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5194034440 con 0x7f51a415db30 2024-02-19T06:58:46.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.559+0000 7f51aa600640 1 -- 172.21.15.46:0/2215788793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a415db30 msgr2=0x7f51a40af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:46.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.559+0000 7f51aa600640 1 --2- 172.21.15.46:0/2215788793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a415db30 0x7f51a40af1b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5194009d90 tx=0x7f519402bcf0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.560+0000 7f51aa600640 1 -- 172.21.15.46:0/2215788793 shutdown_connections 2024-02-19T06:58:46.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.560+0000 7f51aa600640 1 --2- 172.21.15.46:0/2215788793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a415db30 0x7f51a40af1b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.560+0000 7f51aa600640 1 -- 172.21.15.46:0/2215788793 >> 172.21.15.46:0/2215788793 conn(0x7f51a40cfc90 msgr2=0x7f51a40d0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:46.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.560+0000 7f51aa600640 1 -- 172.21.15.46:0/2215788793 shutdown_connections 2024-02-19T06:58:46.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.560+0000 7f51aa600640 1 -- 172.21.15.46:0/2215788793 wait complete. 2024-02-19T06:58:46.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.561+0000 7f51aa600640 1 Processor -- start 2024-02-19T06:58:46.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.562+0000 7f51aa600640 1 -- start start 2024-02-19T06:58:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.562+0000 7f51aa600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a40b3330 0x7f51a4144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.562+0000 7f51aa600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a415db30 0x7f51a4158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51aa600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a415e990 0x7f51a4156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51aa600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4156660 con 0x7f51a415e990 2024-02-19T06:58:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51aa600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4154d10 con 0x7f51a40b3330 2024-02-19T06:58:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51aa600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4154ff0 con 0x7f51a415db30 2024-02-19T06:58:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51a9c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a415e990 0x7f51a4156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51a9c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a415e990 0x7f51a4156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45274/0 (socket says 172.21.15.46:45274) 2024-02-19T06:58:46.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51a9c00640 1 -- 172.21.15.46:0/2828830508 learned_addr learned my addr 172.21.15.46:0/2828830508 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51a9200640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a40b3330 0x7f51a4144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51a9c00640 1 -- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a415db30 msgr2=0x7f51a4158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51a3e00640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a415db30 0x7f51a4158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51a9c00640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a415db30 0x7f51a4158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51a9c00640 1 -- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a40b3330 msgr2=0x7f51a4144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51a9c00640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a40b3330 0x7f51a4144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51a9c00640 1 -- 172.21.15.46:0/2828830508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194009a70 con 0x7f51a415e990 2024-02-19T06:58:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.563+0000 7f51a9200640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a40b3330 0x7f51a4144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.564+0000 7f51a3e00640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a415db30 0x7f51a4158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:46.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.564+0000 7f51a9c00640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a415e990 0x7f51a4156a80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f519c00c780 tx=0x7f519c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:46.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.564+0000 7f51a0c00640 1 -- 172.21.15.46:0/2828830508 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c0072d0 con 0x7f51a415e990 2024-02-19T06:58:46.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.564+0000 7f51a0c00640 1 -- 172.21.15.46:0/2828830508 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c007430 con 0x7f51a415e990 2024-02-19T06:58:46.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.564+0000 7f51a0c00640 1 -- 172.21.15.46:0/2828830508 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c0047e0 con 0x7f51a415e990 2024-02-19T06:58:46.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.564+0000 7f51aa600640 1 -- 172.21.15.46:0/2828830508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a41552d0 con 0x7f51a415e990 2024-02-19T06:58:46.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.564+0000 7f51aa600640 1 -- 172.21.15.46:0/2828830508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a41593e0 con 0x7f51a415e990 2024-02-19T06:58:46.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.565+0000 7f51aa600640 1 -- 172.21.15.46:0/2828830508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a40680c0 con 0x7f51a415e990 2024-02-19T06:58:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.566+0000 7f51a0c00640 1 -- 172.21.15.46:0/2828830508 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f519c004940 con 0x7f51a415e990 2024-02-19T06:58:46.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.568+0000 7f51a0c00640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f518406b810 0x7f518406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:46.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.568+0000 7f51a0c00640 1 -- 172.21.15.46:0/2828830508 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f519c089680 con 0x7f51a415e990 2024-02-19T06:58:46.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.568+0000 7f51a9200640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f518406b810 0x7f518406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:46.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.570+0000 7f51a9200640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f518406b810 0x7f518406dcd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5194036000 tx=0x7f5194030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.573+0000 7f51a0c00640 1 -- 172.21.15.46:0/2828830508 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f519c057a20 con 0x7f51a415e990 2024-02-19T06:58:46.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.773+0000 7f51aa600640 1 -- 172.21.15.46:0/2828830508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51a41567a0 con 0x7f51a415e990 2024-02-19T06:58:46.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.775+0000 7f51a0c00640 1 -- 172.21.15.46:0/2828830508 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16855 (secure 0 0 0) 0x7f51a41567a0 con 0x7f51a415e990 2024-02-19T06:58:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:46.777 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:58:37.086581+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.778+0000 7f51aa600640 1 -- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f518406b810 msgr2=0x7f518406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.778+0000 7f51aa600640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f518406b810 0x7f518406dcd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5194036000 tx=0x7f5194030000 comp rx=0 tx=0).stop 2024-02-19T06:58:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.778+0000 7f51aa600640 1 -- 172.21.15.46:0/2828830508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a415e990 msgr2=0x7f51a4156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.778+0000 7f51aa600640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a415e990 0x7f51a4156a80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f519c00c780 tx=0x7f519c00cc40 comp rx=0 tx=0).stop 2024-02-19T06:58:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.778+0000 7f51aa600640 1 -- 172.21.15.46:0/2828830508 shutdown_connections 2024-02-19T06:58:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.778+0000 7f51aa600640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f518406b810 0x7f518406dcd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.778+0000 7f51aa600640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a415e990 0x7f51a4156a80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.778+0000 7f51aa600640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a415db30 0x7f51a4158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.778+0000 7f51aa600640 1 --2- 172.21.15.46:0/2828830508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a40b3330 0x7f51a4144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.778+0000 7f51aa600640 1 -- 172.21.15.46:0/2828830508 >> 172.21.15.46:0/2828830508 conn(0x7f51a40cfc90 msgr2=0x7f51a40ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.778+0000 7f51aa600640 1 -- 172.21.15.46:0/2828830508 shutdown_connections 2024-02-19T06:58:46.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:46.779+0000 7f51aa600640 1 -- 172.21.15.46:0/2828830508 wait complete. 2024-02-19T06:58:46.799 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:46.799 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:47.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.025+0000 7f2049800640 1 Processor -- start 2024-02-19T06:58:47.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.025+0000 7f2049800640 1 -- start start 2024-02-19T06:58:47.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.027+0000 7f2049800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f20440cfc40 0x7f20440b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.027+0000 7f2049800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20440b2eb0 con 0x7f2044155b20 2024-02-19T06:58:47.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.027+0000 7f2049800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204415be60 con 0x7f20440b2a20 2024-02-19T06:58:47.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.027+0000 7f2049800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204415c140 con 0x7f20440cfc40 2024-02-19T06:58:47.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.027+0000 7f2043e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2044155b20 0x7f20440cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46052/0 (socket says 172.21.15.46:46052) 2024-02-19T06:58:47.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.027+0000 7f2043e00640 1 -- 172.21.15.46:0/4159893804 learned_addr learned my addr 172.21.15.46:0/4159893804 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.027+0000 7f203be00640 1 --2- 172.21.15.46:0/4159893804 >> v2:172.21.15.142:3300/0 conn(0x7f20440cfc40 0x7f20440b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.027+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809700916 0 0) 0x7f20440b2eb0 con 0x7f2044155b20 2024-02-19T06:58:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.027+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2028003520 con 0x7f2044155b20 2024-02-19T06:58:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1771883439 0 0) 0x7f2028003520 con 0x7f2044155b20 2024-02-19T06:58:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 >> v2:172.21.15.142:3300/0 conn(0x7f20440cfc40 msgr2=0x7f20440b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2043400640 1 --2- 172.21.15.46:0/4159893804 >> v2:172.21.15.142:3300/0 conn(0x7f20440cfc40 0x7f20440b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 >> v1:172.21.15.142:6789/0 conn(0x7f20440b2a20 legacy=0x7f204406d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204415c420 con 0x7f2044155b20 2024-02-19T06:58:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f2034001670 con 0x7f2044155b20 2024-02-19T06:58:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 >> v1:172.21.15.46:6789/0 conn(0x7f2044155b20 legacy=0x7f20440cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2043400640 1 --2- 172.21.15.46:0/4159893804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20280039c0 0x7f2028003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2043400640 1 --2- 172.21.15.46:0/4159893804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20280047c0 0x7f2028004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2043400640 1 --2- 172.21.15.46:0/4159893804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20280051d0 0x7f202800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204415c140 con 0x7f20280051d0 2024-02-19T06:58:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202800c100 con 0x7f20280047c0 2024-02-19T06:58:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202800c2c0 con 0x7f20280039c0 2024-02-19T06:58:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.028+0000 7f2048e00640 1 --2- 172.21.15.46:0/4159893804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20280051d0 0x7f202800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.029+0000 7f203be00640 1 --2- 172.21.15.46:0/4159893804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20280047c0 0x7f2028004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.029+0000 7f2043e00640 1 --2- 172.21.15.46:0/4159893804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20280039c0 0x7f2028003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.029+0000 7f2048e00640 1 -- 172.21.15.46:0/4159893804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20280039c0 msgr2=0x7f2028003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.029+0000 7f2048e00640 1 --2- 172.21.15.46:0/4159893804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20280039c0 0x7f2028003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.029+0000 7f2048e00640 1 -- 172.21.15.46:0/4159893804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20280047c0 msgr2=0x7f2028004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.029+0000 7f2048e00640 1 --2- 172.21.15.46:0/4159893804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20280047c0 0x7f2028004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.029+0000 7f2048e00640 1 -- 172.21.15.46:0/4159893804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028003520 con 0x7f20280051d0 2024-02-19T06:58:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.030+0000 7f2048e00640 1 -- 172.21.15.46:0/4159893804 reap_dead start 2024-02-19T06:58:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.030+0000 7f2048e00640 1 --2- 172.21.15.46:0/4159893804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20280051d0 0x7f202800b980 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f203c0044b0 tx=0x7f20280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19234845522ed007 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.030+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c006d50 con 0x7f20280051d0 2024-02-19T06:58:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.030+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c007020 con 0x7f20280051d0 2024-02-19T06:58:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.030+0000 7f2043400640 1 -- 172.21.15.46:0/4159893804 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c0073d0 con 0x7f20280051d0 2024-02-19T06:58:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.031+0000 7f2049800640 1 -- 172.21.15.46:0/4159893804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20280051d0 msgr2=0x7f202800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.031+0000 7f2049800640 1 --2- 172.21.15.46:0/4159893804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20280051d0 0x7f202800b980 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f203c0044b0 tx=0x7f20280057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.031+0000 7f2049800640 1 -- 172.21.15.46:0/4159893804 shutdown_connections 2024-02-19T06:58:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.031+0000 7f2049800640 1 --2- 172.21.15.46:0/4159893804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20280051d0 0x7f202800b980 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.031+0000 7f2049800640 1 -- 172.21.15.46:0/4159893804 >> 172.21.15.46:0/4159893804 conn(0x7f204406ad60 msgr2=0x7f204406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.031+0000 7f2049800640 1 -- 172.21.15.46:0/4159893804 shutdown_connections 2024-02-19T06:58:47.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.031+0000 7f2049800640 1 -- 172.21.15.46:0/4159893804 wait complete. 2024-02-19T06:58:47.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.033+0000 7f2049800640 1 Processor -- start 2024-02-19T06:58:47.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.033+0000 7f2049800640 1 -- start start 2024-02-19T06:58:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.034+0000 7f2049800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20280051d0 0x7f2044098b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.034+0000 7f2049800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2044158d80 0x7f204415e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.034+0000 7f2049800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20440c8e10 0x7f20440c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.034+0000 7f2049800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20440c97d0 con 0x7f2044158d80 2024-02-19T06:58:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.034+0000 7f2049800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20441572b0 con 0x7f20280051d0 2024-02-19T06:58:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.034+0000 7f2049800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20440c5230 con 0x7f20440c8e10 2024-02-19T06:58:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.034+0000 7f203be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2044158d80 0x7f204415e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.034+0000 7f203be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2044158d80 0x7f204415e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45286/0 (socket says 172.21.15.46:45286) 2024-02-19T06:58:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.034+0000 7f203be00640 1 -- 172.21.15.46:0/1721694423 learned_addr learned my addr 172.21.15.46:0/1721694423 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.035+0000 7f2043e00640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20280051d0 0x7f2044098b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.035+0000 7f2048e00640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20440c8e10 0x7f20440c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.035+0000 7f203be00640 1 -- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20440c8e10 msgr2=0x7f20440c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.035+0000 7f203be00640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20440c8e10 0x7f20440c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.035+0000 7f203be00640 1 -- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20280051d0 msgr2=0x7f2044098b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.035+0000 7f203be00640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20280051d0 0x7f2044098b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.035+0000 7f203be00640 1 -- 172.21.15.46:0/1721694423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204415eae0 con 0x7f2044158d80 2024-02-19T06:58:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.035+0000 7f203be00640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2044158d80 0x7f204415e5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f202c011590 tx=0x7f202c011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.035+0000 7f2040c00640 1 -- 172.21.15.46:0/1721694423 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c004220 con 0x7f2044158d80 2024-02-19T06:58:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.036+0000 7f2040c00640 1 -- 172.21.15.46:0/1721694423 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202c004380 con 0x7f2044158d80 2024-02-19T06:58:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.036+0000 7f2040c00640 1 -- 172.21.15.46:0/1721694423 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c015930 con 0x7f2044158d80 2024-02-19T06:58:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.036+0000 7f2049800640 1 -- 172.21.15.46:0/1721694423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20440c54d0 con 0x7f2044158d80 2024-02-19T06:58:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.036+0000 7f2049800640 1 -- 172.21.15.46:0/1721694423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20440c5a90 con 0x7f2044158d80 2024-02-19T06:58:47.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.037+0000 7f2049800640 1 -- 172.21.15.46:0/1721694423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204404eee0 con 0x7f2044158d80 2024-02-19T06:58:47.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.038+0000 7f2040c00640 1 -- 172.21.15.46:0/1721694423 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f202c015a90 con 0x7f2044158d80 2024-02-19T06:58:47.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.039+0000 7f2040c00640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f202006b810 0x7f202006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.039+0000 7f2040c00640 1 -- 172.21.15.46:0/1721694423 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f202c08a460 con 0x7f2044158d80 2024-02-19T06:58:47.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.040+0000 7f2043e00640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f202006b810 0x7f202006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.041+0000 7f2043e00640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f202006b810 0x7f202006dcd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f204406eed0 tx=0x7f2034009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:47.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.044+0000 7f2040c00640 1 -- 172.21.15.46:0/1721694423 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f202c054d60 con 0x7f2044158d80 2024-02-19T06:58:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.244+0000 7f2049800640 1 -- 172.21.15.46:0/1721694423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f204406beb0 con 0x7f2044158d80 2024-02-19T06:58:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.244+0000 7f2040c00640 1 -- 172.21.15.46:0/1721694423 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f202c058420 con 0x7f2044158d80 2024-02-19T06:58:47.246 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:47.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.247+0000 7f2049800640 1 -- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f202006b810 msgr2=0x7f202006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.247+0000 7f2049800640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f202006b810 0x7f202006dcd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f204406eed0 tx=0x7f2034009040 comp rx=0 tx=0).stop 2024-02-19T06:58:47.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.247+0000 7f2049800640 1 -- 172.21.15.46:0/1721694423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2044158d80 msgr2=0x7f204415e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.247+0000 7f2049800640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2044158d80 0x7f204415e5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f202c011590 tx=0x7f202c011a50 comp rx=0 tx=0).stop 2024-02-19T06:58:47.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.247+0000 7f2049800640 1 -- 172.21.15.46:0/1721694423 shutdown_connections 2024-02-19T06:58:47.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.247+0000 7f2049800640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f202006b810 0x7f202006dcd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.247+0000 7f2049800640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20440c8e10 0x7f20440c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.247+0000 7f2049800640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2044158d80 0x7f204415e5a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.247+0000 7f2049800640 1 --2- 172.21.15.46:0/1721694423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20280051d0 0x7f2044098b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.247+0000 7f2049800640 1 -- 172.21.15.46:0/1721694423 >> 172.21.15.46:0/1721694423 conn(0x7f204406ad60 msgr2=0x7f204406d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:47.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.248+0000 7f2049800640 1 -- 172.21.15.46:0/1721694423 shutdown_connections 2024-02-19T06:58:47.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.248+0000 7f2049800640 1 -- 172.21.15.46:0/1721694423 wait complete. 2024-02-19T06:58:47.268 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:47.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.495+0000 7f49d4e00640 1 Processor -- start 2024-02-19T06:58:47.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.495+0000 7f49d4e00640 1 -- start start 2024-02-19T06:58:47.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.496+0000 7f49d4e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d0155b20 0x7f49d00cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.496+0000 7f49d4e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f49d00b2bf0 0x7f49d006d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.496+0000 7f49d4e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d00cfed0 con 0x7f49d00cfa70 2024-02-19T06:58:47.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.496+0000 7f49d4e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d015be60 con 0x7f49d00b2bf0 2024-02-19T06:58:47.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.496+0000 7f49d4e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d015c140 con 0x7f49d0155b20 2024-02-19T06:58:47.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.497+0000 7f49cfe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f49d00b2bf0 0x7f49d006d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.497+0000 7f49cf400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d0155b20 0x7f49d00cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.497+0000 7f49cf400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d0155b20 0x7f49d00cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:51252/0 (socket says 172.21.15.46:51252) 2024-02-19T06:58:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.497+0000 7f49cf400640 1 -- 172.21.15.46:0/2641212593 learned_addr learned my addr 172.21.15.46:0/2641212593 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.497+0000 7f49cfe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f49d00b2bf0 0x7f49d006d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:53416/0 (socket says 172.21.15.46:53416) 2024-02-19T06:58:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.498+0000 7f49cfe00640 1 -- 172.21.15.46:0/2641212593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d0155b20 msgr2=0x7f49d00cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.498+0000 7f49cfe00640 1 --2- 172.21.15.46:0/2641212593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d0155b20 0x7f49d00cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.498+0000 7f49cfe00640 1 -- 172.21.15.46:0/2641212593 >> v1:172.21.15.142:6789/0 conn(0x7f49d00cfa70 legacy=0x7f49d00b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.498+0000 7f49cfe00640 1 -- 172.21.15.46:0/2641212593 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d015c420 con 0x7f49d00b2bf0 2024-02-19T06:58:47.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.498+0000 7f49cf400640 1 --2- 172.21.15.46:0/2641212593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d0155b20 0x7f49d00cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:58:47.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.499+0000 7f49cfe00640 1 --2- 172.21.15.46:0/2641212593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b2bf0 0x7f49d006d630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009d90 tx=0x7f49c802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=473722534c81b4a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:47.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.500+0000 7f49ce000640 1 -- 172.21.15.46:0/2641212593 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c802cc50 con 0x7f49d00b2bf0 2024-02-19T06:58:47.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.500+0000 7f49ce000640 1 -- 172.21.15.46:0/2641212593 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c802cdb0 con 0x7f49d00b2bf0 2024-02-19T06:58:47.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.500+0000 7f49ce000640 1 -- 172.21.15.46:0/2641212593 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8034660 con 0x7f49d00b2bf0 2024-02-19T06:58:47.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.501+0000 7f49d4e00640 1 -- 172.21.15.46:0/2641212593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b2bf0 msgr2=0x7f49d006d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.501+0000 7f49d4e00640 1 --2- 172.21.15.46:0/2641212593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b2bf0 0x7f49d006d630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009d90 tx=0x7f49c802bea0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.501+0000 7f49d4e00640 1 -- 172.21.15.46:0/2641212593 shutdown_connections 2024-02-19T06:58:47.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.501+0000 7f49d4e00640 1 --2- 172.21.15.46:0/2641212593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b2bf0 0x7f49d006d630 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.501+0000 7f49d4e00640 1 --2- 172.21.15.46:0/2641212593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d0155b20 0x7f49d00cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.501+0000 7f49d4e00640 1 -- 172.21.15.46:0/2641212593 >> 172.21.15.46:0/2641212593 conn(0x7f49d006ad60 msgr2=0x7f49d006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:47.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.501+0000 7f49d4e00640 1 -- 172.21.15.46:0/2641212593 shutdown_connections 2024-02-19T06:58:47.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.501+0000 7f49d4e00640 1 -- 172.21.15.46:0/2641212593 wait complete. 2024-02-19T06:58:47.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.503+0000 7f49d4e00640 1 Processor -- start 2024-02-19T06:58:47.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.503+0000 7f49d4e00640 1 -- start start 2024-02-19T06:58:47.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.504+0000 7f49d4e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49d00b2bf0 0x7f49d01554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.504+0000 7f49d4e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d00cfa70 0x7f49d00ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.504+0000 7f49d4e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d0155b20 0x7f49d0072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.504+0000 7f49d4e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d0154730 con 0x7f49d00b2bf0 2024-02-19T06:58:47.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.504+0000 7f49d4e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d0154a10 con 0x7f49d0155b20 2024-02-19T06:58:47.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.504+0000 7f49d4e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d0154cf0 con 0x7f49d00cfa70 2024-02-19T06:58:47.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.504+0000 7f49cf400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49d00b2bf0 0x7f49d01554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.504+0000 7f49cf400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49d00b2bf0 0x7f49d01554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45288/0 (socket says 172.21.15.46:45288) 2024-02-19T06:58:47.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.504+0000 7f49cf400640 1 -- 172.21.15.46:0/4263322692 learned_addr learned my addr 172.21.15.46:0/4263322692 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:47.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.504+0000 7f49cfe00640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d0155b20 0x7f49d0072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.504+0000 7f49cea00640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d00cfa70 0x7f49d00ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.505+0000 7f49cf400640 1 -- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d00cfa70 msgr2=0x7f49d00ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.505+0000 7f49cf400640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d00cfa70 0x7f49d00ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.505+0000 7f49cf400640 1 -- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d0155b20 msgr2=0x7f49d0072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.505+0000 7f49cf400640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d0155b20 0x7f49d0072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.505+0000 7f49cf400640 1 -- 172.21.15.46:0/4263322692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c00094d0 con 0x7f49d00b2bf0 2024-02-19T06:58:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.505+0000 7f49cea00640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d00cfa70 0x7f49d00ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.505+0000 7f49cfe00640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d0155b20 0x7f49d0072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.505+0000 7f49cf400640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49d00b2bf0 0x7f49d01554f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f49c000e9d0 tx=0x7f49c000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.505+0000 7f49c7400640 1 -- 172.21.15.46:0/4263322692 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c000ca60 con 0x7f49d00b2bf0 2024-02-19T06:58:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.505+0000 7f49c7400640 1 -- 172.21.15.46:0/4263322692 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c000cbc0 con 0x7f49d00b2bf0 2024-02-19T06:58:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.505+0000 7f49c7400640 1 -- 172.21.15.46:0/4263322692 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c0013470 con 0x7f49d00b2bf0 2024-02-19T06:58:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.505+0000 7f49d4e00640 1 -- 172.21.15.46:0/4263322692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c8009a70 con 0x7f49d00b2bf0 2024-02-19T06:58:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.505+0000 7f49d4e00640 1 -- 172.21.15.46:0/4263322692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d00acb80 con 0x7f49d00b2bf0 2024-02-19T06:58:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.506+0000 7f49d4e00640 1 -- 172.21.15.46:0/4263322692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d004eee0 con 0x7f49d00b2bf0 2024-02-19T06:58:47.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.507+0000 7f49c7400640 1 -- 172.21.15.46:0/4263322692 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f49c00135d0 con 0x7f49d00b2bf0 2024-02-19T06:58:47.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.508+0000 7f49c7400640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f49b006b810 0x7f49b006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.508+0000 7f49c7400640 1 -- 172.21.15.46:0/4263322692 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f49c008a670 con 0x7f49d00b2bf0 2024-02-19T06:58:47.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.509+0000 7f49cea00640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f49b006b810 0x7f49b006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.510+0000 7f49cea00640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f49b006b810 0x7f49b006dcd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f49d00aec40 tx=0x7f49bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:47.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.513+0000 7f49c7400640 1 -- 172.21.15.46:0/4263322692 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f49c0054f70 con 0x7f49d00b2bf0 2024-02-19T06:58:47.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.712+0000 7f49d4e00640 1 -- 172.21.15.46:0/4263322692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49d0154870 con 0x7f49d00b2bf0 2024-02-19T06:58:47.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.713+0000 7f49c7400640 1 -- 172.21.15.46:0/4263322692 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f49d0154870 con 0x7f49d00b2bf0 2024-02-19T06:58:47.714 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.715+0000 7f49d4e00640 1 -- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f49b006b810 msgr2=0x7f49b006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.715+0000 7f49d4e00640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f49b006b810 0x7f49b006dcd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f49d00aec40 tx=0x7f49bc009040 comp rx=0 tx=0).stop 2024-02-19T06:58:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.715+0000 7f49d4e00640 1 -- 172.21.15.46:0/4263322692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49d00b2bf0 msgr2=0x7f49d01554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.715+0000 7f49d4e00640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49d00b2bf0 0x7f49d01554f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f49c000e9d0 tx=0x7f49c000ee90 comp rx=0 tx=0).stop 2024-02-19T06:58:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.715+0000 7f49d4e00640 1 -- 172.21.15.46:0/4263322692 shutdown_connections 2024-02-19T06:58:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.715+0000 7f49d4e00640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f49b006b810 0x7f49b006dcd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.715+0000 7f49d4e00640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d0155b20 0x7f49d0072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.715+0000 7f49d4e00640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d00cfa70 0x7f49d00ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.715+0000 7f49d4e00640 1 --2- 172.21.15.46:0/4263322692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49d00b2bf0 0x7f49d01554f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.715+0000 7f49d4e00640 1 -- 172.21.15.46:0/4263322692 >> 172.21.15.46:0/4263322692 conn(0x7f49d006ad60 msgr2=0x7f49d015e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:47.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.715+0000 7f49d4e00640 1 -- 172.21.15.46:0/4263322692 shutdown_connections 2024-02-19T06:58:47.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.716+0000 7f49d4e00640 1 -- 172.21.15.46:0/4263322692 wait complete. 2024-02-19T06:58:47.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:47.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.957+0000 7f571e000640 1 Processor -- start 2024-02-19T06:58:47.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.957+0000 7f571e000640 1 -- start start 2024-02-19T06:58:47.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.959+0000 7f571e000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f57180cfc40 0x7f57180b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.959+0000 7f571e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57180b2a20 0x7f571806d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.959+0000 7f571e000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57180b2eb0 con 0x7f5718155b20 2024-02-19T06:58:47.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.959+0000 7f571e000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571815be60 con 0x7f57180cfc40 2024-02-19T06:58:47.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.959+0000 7f571e000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571815c140 con 0x7f57180b2a20 2024-02-19T06:58:47.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.959+0000 7f571d600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57180b2a20 0x7f571806d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.959+0000 7f5717e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f57180cfc40 0x7f57180b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.960+0000 7f571d600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57180b2a20 0x7f571806d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:51276/0 (socket says 172.21.15.46:51276) 2024-02-19T06:58:47.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.960+0000 7f5717e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f57180cfc40 0x7f57180b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:53430/0 (socket says 172.21.15.46:53430) 2024-02-19T06:58:47.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.960+0000 7f571d600640 1 -- 172.21.15.46:0/4012537360 learned_addr learned my addr 172.21.15.46:0/4012537360 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:47.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.960+0000 7f5717e00640 1 -- 172.21.15.46:0/4012537360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57180b2a20 msgr2=0x7f571806d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:47.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.960+0000 7f5717e00640 1 --2- 172.21.15.46:0/4012537360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57180b2a20 0x7f571806d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.960+0000 7f5717e00640 1 -- 172.21.15.46:0/4012537360 >> v1:172.21.15.142:6789/0 conn(0x7f5718155b20 legacy=0x7f57180cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.960+0000 7f5717e00640 1 -- 172.21.15.46:0/4012537360 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571815c420 con 0x7f57180cfc40 2024-02-19T06:58:47.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.960+0000 7f571d600640 1 --2- 172.21.15.46:0/4012537360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57180b2a20 0x7f571806d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:58:47.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.962+0000 7f5717e00640 1 --2- 172.21.15.46:0/4012537360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57180cfc40 0x7f57180b24e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f57000097a0 tx=0x7f570002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a140fa88dd07f14 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:47.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.962+0000 7f5717400640 1 -- 172.21.15.46:0/4012537360 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570002d040 con 0x7f57180cfc40 2024-02-19T06:58:47.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.962+0000 7f5717400640 1 -- 172.21.15.46:0/4012537360 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5700031810 con 0x7f57180cfc40 2024-02-19T06:58:47.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.962+0000 7f5717400640 1 -- 172.21.15.46:0/4012537360 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5700031ba0 con 0x7f57180cfc40 2024-02-19T06:58:47.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.963+0000 7f571e000640 1 -- 172.21.15.46:0/4012537360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57180cfc40 msgr2=0x7f57180b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.963+0000 7f571e000640 1 --2- 172.21.15.46:0/4012537360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57180cfc40 0x7f57180b24e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f57000097a0 tx=0x7f570002b8b0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.963+0000 7f571e000640 1 -- 172.21.15.46:0/4012537360 shutdown_connections 2024-02-19T06:58:47.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.963+0000 7f571e000640 1 --2- 172.21.15.46:0/4012537360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57180b2a20 0x7f571806d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.963+0000 7f571e000640 1 --2- 172.21.15.46:0/4012537360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57180cfc40 0x7f57180b24e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.963+0000 7f571e000640 1 -- 172.21.15.46:0/4012537360 >> 172.21.15.46:0/4012537360 conn(0x7f571806ad60 msgr2=0x7f571806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:47.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.963+0000 7f571e000640 1 -- 172.21.15.46:0/4012537360 shutdown_connections 2024-02-19T06:58:47.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.963+0000 7f571e000640 1 -- 172.21.15.46:0/4012537360 wait complete. 2024-02-19T06:58:47.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.965+0000 7f571e000640 1 Processor -- start 2024-02-19T06:58:47.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.965+0000 7f571e000640 1 -- start start 2024-02-19T06:58:47.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.966+0000 7f571e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57180b2a20 0x7f57180c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.966+0000 7f571e000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57180cfc40 0x7f57180c3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.966+0000 7f571e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5718155b20 0x7f571806d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.966+0000 7f571e000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57180c5220 con 0x7f57180b2a20 2024-02-19T06:58:47.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.966+0000 7f571e000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57180c5500 con 0x7f57180cfc40 2024-02-19T06:58:47.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.966+0000 7f571e000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57180c57e0 con 0x7f5718155b20 2024-02-19T06:58:47.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.966+0000 7f571cc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57180b2a20 0x7f57180c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.966+0000 7f571cc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57180b2a20 0x7f57180c4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45294/0 (socket says 172.21.15.46:45294) 2024-02-19T06:58:47.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.966+0000 7f571cc00640 1 -- 172.21.15.46:0/3650693742 learned_addr learned my addr 172.21.15.46:0/3650693742 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:47.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f5717e00640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57180cfc40 0x7f57180c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f571d600640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5718155b20 0x7f571806d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f571cc00640 1 -- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5718155b20 msgr2=0x7f571806d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f571cc00640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5718155b20 0x7f571806d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f571cc00640 1 -- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57180cfc40 msgr2=0x7f57180c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:47.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f571cc00640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57180cfc40 0x7f57180c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:47.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f571cc00640 1 -- 172.21.15.46:0/3650693742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5710009b30 con 0x7f57180b2a20 2024-02-19T06:58:47.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f5717e00640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57180cfc40 0x7f57180c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:47.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f571d600640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5718155b20 0x7f571806d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:47.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f571cc00640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57180b2a20 0x7f57180c4bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f570800c400 tx=0x7f570800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:47.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f5714c00640 1 -- 172.21.15.46:0/3650693742 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57080052d0 con 0x7f57180b2a20 2024-02-19T06:58:47.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f5714c00640 1 -- 172.21.15.46:0/3650693742 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5708005450 con 0x7f57180b2a20 2024-02-19T06:58:47.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f5714c00640 1 -- 172.21.15.46:0/3650693742 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708007260 con 0x7f57180b2a20 2024-02-19T06:58:47.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.967+0000 7f571e000640 1 -- 172.21.15.46:0/3650693742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5700009400 con 0x7f57180b2a20 2024-02-19T06:58:47.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.968+0000 7f571e000640 1 -- 172.21.15.46:0/3650693742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57180c2c00 con 0x7f57180b2a20 2024-02-19T06:58:47.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.969+0000 7f571e000640 1 -- 172.21.15.46:0/3650693742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57180c9dc0 con 0x7f57180b2a20 2024-02-19T06:58:47.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.970+0000 7f5714c00640 1 -- 172.21.15.46:0/3650693742 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f57080073c0 con 0x7f57180b2a20 2024-02-19T06:58:47.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.970+0000 7f5714c00640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f56f406b810 0x7f56f406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:47.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.971+0000 7f5714c00640 1 -- 172.21.15.46:0/3650693742 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5708089680 con 0x7f57180b2a20 2024-02-19T06:58:47.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.971+0000 7f5717e00640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f56f406b810 0x7f56f406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:47.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.972+0000 7f5717e00640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f56f406b810 0x7f56f406dcd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5700036000 tx=0x7f570003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:47.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:47.975+0000 7f5714c00640 1 -- 172.21.15.46:0/3650693742 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5708054010 con 0x7f57180b2a20 2024-02-19T06:58:48.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.171+0000 7f571e000640 1 -- 172.21.15.46:0/3650693742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f571804eee0 con 0x7f57180b2a20 2024-02-19T06:58:48.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.172+0000 7f5714c00640 1 -- 172.21.15.46:0/3650693742 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f57080576d0 con 0x7f57180b2a20 2024-02-19T06:58:48.174 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:48.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.175+0000 7f571e000640 1 -- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f56f406b810 msgr2=0x7f56f406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:48.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.175+0000 7f571e000640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f56f406b810 0x7f56f406dcd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5700036000 tx=0x7f570003c040 comp rx=0 tx=0).stop 2024-02-19T06:58:48.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.175+0000 7f571e000640 1 -- 172.21.15.46:0/3650693742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57180b2a20 msgr2=0x7f57180c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.175+0000 7f571e000640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57180b2a20 0x7f57180c4bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f570800c400 tx=0x7f570800c8c0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.175+0000 7f571e000640 1 -- 172.21.15.46:0/3650693742 shutdown_connections 2024-02-19T06:58:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.175+0000 7f571e000640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f56f406b810 0x7f56f406dcd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.175+0000 7f571e000640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5718155b20 0x7f571806d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.175+0000 7f571e000640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57180cfc40 0x7f57180c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.175+0000 7f571e000640 1 --2- 172.21.15.46:0/3650693742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57180b2a20 0x7f57180c4bb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.175+0000 7f571e000640 1 -- 172.21.15.46:0/3650693742 >> 172.21.15.46:0/3650693742 conn(0x7f571806ad60 msgr2=0x7f571815ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.175+0000 7f571e000640 1 -- 172.21.15.46:0/3650693742 shutdown_connections 2024-02-19T06:58:48.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.175+0000 7f571e000640 1 -- 172.21.15.46:0/3650693742 wait complete. 2024-02-19T06:58:48.193 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-19T06:58:48.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.408+0000 7f9cc9000640 1 Processor -- start 2024-02-19T06:58:48.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.408+0000 7f9cc9000640 1 -- start start 2024-02-19T06:58:48.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.410+0000 7f9cc9000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9cc40b2bf0 0x7f9cc415b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:48.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.410+0000 7f9cc9000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9cc40cf690 0x7f9cc40cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:48.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.410+0000 7f9cc9000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc415b2c0 con 0x7f9cc415e190 2024-02-19T06:58:48.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.410+0000 7f9cc9000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc415aac0 con 0x7f9cc40cf690 2024-02-19T06:58:48.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.410+0000 7f9cc9000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc40d0040 con 0x7f9cc40b2bf0 2024-02-19T06:58:48.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.410+0000 7f9cc3e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9cc415e190 0x7f9cc406cec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46068/0 (socket says 172.21.15.46:46068) 2024-02-19T06:58:48.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.410+0000 7f9cc3e00640 1 -- 172.21.15.46:0/4221025692 learned_addr learned my addr 172.21.15.46:0/4221025692 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:48.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.410+0000 7f9cbaa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9cc40cf690 0x7f9cc40cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:48.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.411+0000 7f9cc3400640 1 --2- 172.21.15.46:0/4221025692 >> v2:172.21.15.142:3300/0 conn(0x7f9cc40b2bf0 0x7f9cc415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:48.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.411+0000 7f9cbaa00640 1 -- 172.21.15.46:0/4221025692 >> v2:172.21.15.142:3300/0 conn(0x7f9cc40b2bf0 msgr2=0x7f9cc415b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:48.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.411+0000 7f9cbaa00640 1 --2- 172.21.15.46:0/4221025692 >> v2:172.21.15.142:3300/0 conn(0x7f9cc40b2bf0 0x7f9cc415b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.411+0000 7f9cbaa00640 1 -- 172.21.15.46:0/4221025692 >> v1:172.21.15.46:6789/0 conn(0x7f9cc415e190 legacy=0x7f9cc406cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:48.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.411+0000 7f9cbaa00640 1 -- 172.21.15.46:0/4221025692 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4143b10 con 0x7f9cc40cf690 2024-02-19T06:58:48.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.411+0000 7f9cc2a00640 1 -- 172.21.15.46:0/4221025692 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357658196 0 0) 0x7f9cc415b2c0 con 0x7f9cc415e190 2024-02-19T06:58:48.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.412+0000 7f9cbaa00640 1 --2- 172.21.15.46:0/4221025692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc40cf690 0x7f9cc40cfb00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40cce20 tx=0x7f9cac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d9590ac16773dd server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:48.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.412+0000 7f9cc2a00640 1 -- 172.21.15.46:0/4221025692 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac031830 con 0x7f9cc40cf690 2024-02-19T06:58:48.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.412+0000 7f9cc2a00640 1 -- 172.21.15.46:0/4221025692 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac031990 con 0x7f9cc40cf690 2024-02-19T06:58:48.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.412+0000 7f9cc2a00640 1 -- 172.21.15.46:0/4221025692 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac031d20 con 0x7f9cc40cf690 2024-02-19T06:58:48.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.413+0000 7f9cc9000640 1 -- 172.21.15.46:0/4221025692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc40cf690 msgr2=0x7f9cc40cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:48.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.413+0000 7f9cc9000640 1 --2- 172.21.15.46:0/4221025692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc40cf690 0x7f9cc40cfb00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40cce20 tx=0x7f9cac02b8d0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.413+0000 7f9cc9000640 1 -- 172.21.15.46:0/4221025692 shutdown_connections 2024-02-19T06:58:48.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.413+0000 7f9cc9000640 1 --2- 172.21.15.46:0/4221025692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc40cf690 0x7f9cc40cfb00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.413+0000 7f9cc9000640 1 --2- 172.21.15.46:0/4221025692 >> v2:172.21.15.142:3300/0 conn(0x7f9cc40b2bf0 0x7f9cc415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.413+0000 7f9cc9000640 1 -- 172.21.15.46:0/4221025692 >> 172.21.15.46:0/4221025692 conn(0x7f9cc40b1200 msgr2=0x7f9cc40b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:48.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.413+0000 7f9cc9000640 1 -- 172.21.15.46:0/4221025692 shutdown_connections 2024-02-19T06:58:48.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.413+0000 7f9cc9000640 1 -- 172.21.15.46:0/4221025692 wait complete. 2024-02-19T06:58:48.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.415+0000 7f9cc9000640 1 Processor -- start 2024-02-19T06:58:48.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.415+0000 7f9cc9000640 1 -- start start 2024-02-19T06:58:48.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.416+0000 7f9cc9000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cc40b2bf0 0x7f9cc4166f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:48.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.416+0000 7f9cc9000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc40cf690 0x7f9cc40ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:48.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.416+0000 7f9cc9000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cc415e190 0x7f9cc4164eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:48.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.416+0000 7f9cc9000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc41685c0 con 0x7f9cc40cf690 2024-02-19T06:58:48.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.416+0000 7f9cc9000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc4168130 con 0x7f9cc415e190 2024-02-19T06:58:48.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.416+0000 7f9cc9000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc4167520 con 0x7f9cc40b2bf0 2024-02-19T06:58:48.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.416+0000 7f9cbaa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc40cf690 0x7f9cc40ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:48.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.416+0000 7f9cbaa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc40cf690 0x7f9cc40ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45312/0 (socket says 172.21.15.46:45312) 2024-02-19T06:58:48.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.416+0000 7f9cbaa00640 1 -- 172.21.15.46:0/1520280631 learned_addr learned my addr 172.21.15.46:0/1520280631 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:48.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.417+0000 7f9cc3400640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cc40b2bf0 0x7f9cc4166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:48.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.417+0000 7f9cc3e00640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cc415e190 0x7f9cc4164eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:48.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.417+0000 7f9cbaa00640 1 -- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cc40b2bf0 msgr2=0x7f9cc4166f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:48.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.417+0000 7f9cbaa00640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cc40b2bf0 0x7f9cc4166f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.417+0000 7f9cbaa00640 1 -- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cc415e190 msgr2=0x7f9cc4164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:48.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.417+0000 7f9cbaa00640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cc415e190 0x7f9cc4164eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.417+0000 7f9cbaa00640 1 -- 172.21.15.46:0/1520280631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac009400 con 0x7f9cc40cf690 2024-02-19T06:58:48.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.417+0000 7f9cc3e00640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cc415e190 0x7f9cc4164eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:48.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.417+0000 7f9cbaa00640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc40cf690 0x7f9cc40ceac0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009890 tx=0x7f9cac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:48.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.418+0000 7f9cbbe00640 1 -- 172.21.15.46:0/1520280631 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac03ba70 con 0x7f9cc40cf690 2024-02-19T06:58:48.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.418+0000 7f9cbbe00640 1 -- 172.21.15.46:0/1520280631 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac03bbf0 con 0x7f9cc40cf690 2024-02-19T06:58:48.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.418+0000 7f9cc9000640 1 -- 172.21.15.46:0/1520280631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc4167800 con 0x7f9cc40cf690 2024-02-19T06:58:48.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.418+0000 7f9cbbe00640 1 -- 172.21.15.46:0/1520280631 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac045400 con 0x7f9cc40cf690 2024-02-19T06:58:48.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.418+0000 7f9cc9000640 1 -- 172.21.15.46:0/1520280631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc4167dc0 con 0x7f9cc40cf690 2024-02-19T06:58:48.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.419+0000 7f9cc9000640 1 -- 172.21.15.46:0/1520280631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc404eee0 con 0x7f9cc40cf690 2024-02-19T06:58:48.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.420+0000 7f9cbbe00640 1 -- 172.21.15.46:0/1520280631 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9cac04e440 con 0x7f9cc40cf690 2024-02-19T06:58:48.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.421+0000 7f9cbbe00640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9ca006b840 0x7f9ca006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:48.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.421+0000 7f9cbbe00640 1 -- 172.21.15.46:0/1520280631 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9cac0ac3f0 con 0x7f9cc40cf690 2024-02-19T06:58:48.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.421+0000 7f9cc3400640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9ca006b840 0x7f9ca006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:48.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.422+0000 7f9cc3400640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9ca006b840 0x7f9ca006dd00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4006fd0 tx=0x7f9cb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:48.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.425+0000 7f9cbbe00640 1 -- 172.21.15.46:0/1520280631 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9cac076d80 con 0x7f9cc40cf690 2024-02-19T06:58:48.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.638+0000 7f9cc9000640 1 -- 172.21.15.46:0/1520280631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9cc40cb6c0 con 0x7f9cc40cf690 2024-02-19T06:58:48.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.639+0000 7f9cbbe00640 1 -- 172.21.15.46:0/1520280631 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9cac07a440 con 0x7f9cc40cf690 2024-02-19T06:58:48.640 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-02-19T06:58:48.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.642+0000 7f9cc9000640 1 -- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9ca006b840 msgr2=0x7f9ca006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:48.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.642+0000 7f9cc9000640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9ca006b840 0x7f9ca006dd00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4006fd0 tx=0x7f9cb4008040 comp rx=0 tx=0).stop 2024-02-19T06:58:48.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.642+0000 7f9cc9000640 1 -- 172.21.15.46:0/1520280631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc40cf690 msgr2=0x7f9cc40ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:48.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.642+0000 7f9cc9000640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc40cf690 0x7f9cc40ceac0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009890 tx=0x7f9cac0046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.642+0000 7f9cc9000640 1 -- 172.21.15.46:0/1520280631 shutdown_connections 2024-02-19T06:58:48.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.642+0000 7f9cc9000640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9ca006b840 0x7f9ca006dd00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.642+0000 7f9cc9000640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cc415e190 0x7f9cc4164eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.642+0000 7f9cc9000640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cc40cf690 0x7f9cc40ceac0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.642+0000 7f9cc9000640 1 --2- 172.21.15.46:0/1520280631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cc40b2bf0 0x7f9cc4166f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:48.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.642+0000 7f9cc9000640 1 -- 172.21.15.46:0/1520280631 >> 172.21.15.46:0/1520280631 conn(0x7f9cc40b1200 msgr2=0x7f9cc40cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:48.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.642+0000 7f9cc9000640 1 -- 172.21.15.46:0/1520280631 shutdown_connections 2024-02-19T06:58:48.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:48.642+0000 7f9cc9000640 1 -- 172.21.15.46:0/1520280631 wait complete. 2024-02-19T06:58:48.664 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi142.front.sepia.ceph.com... 2024-02-19T06:58:48.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:48.664 DEBUG:teuthology.orchestra.run.smithi142:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-02-19T06:58:48.765 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T06:58:48.766 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T06:58:48.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:48.766 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-19T06:58:48.833 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:58:48.833 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T06:58:48.894 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:58:48.894 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T06:58:48.949 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:49.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.169+0000 7f8b58000640 1 Processor -- start 2024-02-19T06:58:49.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.170+0000 7f8b58000640 1 -- start start 2024-02-19T06:58:49.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.171+0000 7f8b58000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8b50145260 0x7f8b5015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.171+0000 7f8b58000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b50071000 0x7f8b50071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.171+0000 7f8b58000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b5015f440 0x7f8b5015f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.171+0000 7f8b58000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b500719c0 con 0x7f8b50145260 2024-02-19T06:58:49.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.171+0000 7f8b58000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5015ce10 con 0x7f8b5015f440 2024-02-19T06:58:49.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.171+0000 7f8b58000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b500cbde0 con 0x7f8b50071000 2024-02-19T06:58:49.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.172+0000 7f8b55600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8b50145260 0x7f8b5015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.172+0000 7f8b55600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8b50145260 0x7f8b5015c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45316/0 (socket says 172.21.15.46:45316) 2024-02-19T06:58:49.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.172+0000 7f8b55600640 1 -- 172.21.15.46:0/752141793 learned_addr learned my addr 172.21.15.46:0/752141793 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:49.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.172+0000 7f8b54c00640 1 --2- 172.21.15.46:0/752141793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b50071000 0x7f8b50071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.172+0000 7f8b56000640 1 --2- 172.21.15.46:0/752141793 >> v2:172.21.15.142:3300/0 conn(0x7f8b5015f440 0x7f8b5015f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.172+0000 7f8b55600640 1 -- 172.21.15.46:0/752141793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b50071000 msgr2=0x7f8b50071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:49.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.172+0000 7f8b55600640 1 --2- 172.21.15.46:0/752141793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b50071000 0x7f8b50071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.172+0000 7f8b55600640 1 -- 172.21.15.46:0/752141793 >> v2:172.21.15.142:3300/0 conn(0x7f8b5015f440 msgr2=0x7f8b5015f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:49.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.172+0000 7f8b55600640 1 --2- 172.21.15.46:0/752141793 >> v2:172.21.15.142:3300/0 conn(0x7f8b5015f440 0x7f8b5015f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.172+0000 7f8b55600640 1 -- 172.21.15.46:0/752141793 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500cc080 con 0x7f8b50145260 2024-02-19T06:58:49.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.173+0000 7f8b55600640 1 --2- 172.21.15.46:0/752141793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b50145260 0x7f8b5015c8d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8b500d0520 tx=0x7f8b4402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca084c60a5b7817 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:49.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.174+0000 7f8b4fe00640 1 -- 172.21.15.46:0/752141793 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440317d0 con 0x7f8b50145260 2024-02-19T06:58:49.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.174+0000 7f8b4fe00640 1 -- 172.21.15.46:0/752141793 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44031930 con 0x7f8b50145260 2024-02-19T06:58:49.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.174+0000 7f8b4fe00640 1 -- 172.21.15.46:0/752141793 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44031cc0 con 0x7f8b50145260 2024-02-19T06:58:49.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.174+0000 7f8b58000640 1 -- 172.21.15.46:0/752141793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b50145260 msgr2=0x7f8b5015c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:49.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.174+0000 7f8b58000640 1 --2- 172.21.15.46:0/752141793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b50145260 0x7f8b5015c8d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8b500d0520 tx=0x7f8b4402b870 comp rx=0 tx=0).stop 2024-02-19T06:58:49.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.174+0000 7f8b58000640 1 -- 172.21.15.46:0/752141793 shutdown_connections 2024-02-19T06:58:49.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.174+0000 7f8b58000640 1 --2- 172.21.15.46:0/752141793 >> v2:172.21.15.142:3300/0 conn(0x7f8b5015f440 0x7f8b5015f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.174+0000 7f8b58000640 1 --2- 172.21.15.46:0/752141793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b50071000 0x7f8b50071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.174+0000 7f8b58000640 1 --2- 172.21.15.46:0/752141793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b50145260 0x7f8b5015c8d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.174+0000 7f8b58000640 1 -- 172.21.15.46:0/752141793 >> 172.21.15.46:0/752141793 conn(0x7f8b50066f70 msgr2=0x7f8b5006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:49.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.174+0000 7f8b58000640 1 -- 172.21.15.46:0/752141793 shutdown_connections 2024-02-19T06:58:49.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.174+0000 7f8b58000640 1 -- 172.21.15.46:0/752141793 wait complete. 2024-02-19T06:58:49.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.176+0000 7f8b58000640 1 Processor -- start 2024-02-19T06:58:49.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.176+0000 7f8b58000640 1 -- start start 2024-02-19T06:58:49.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.177+0000 7f8b58000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b50071000 0x7f8b500b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.177+0000 7f8b58000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b50145260 0x7f8b500b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.177+0000 7f8b58000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5015f440 0x7f8b5013b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.177+0000 7f8b58000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b500b2910 con 0x7f8b50071000 2024-02-19T06:58:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.177+0000 7f8b58000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b500af9b0 con 0x7f8b5015f440 2024-02-19T06:58:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.177+0000 7f8b58000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b500afc80 con 0x7f8b50145260 2024-02-19T06:58:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.178+0000 7f8b55600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b50071000 0x7f8b500b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.178+0000 7f8b55600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b50071000 0x7f8b500b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45318/0 (socket says 172.21.15.46:45318) 2024-02-19T06:58:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.178+0000 7f8b55600640 1 -- 172.21.15.46:0/649577418 learned_addr learned my addr 172.21.15.46:0/649577418 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.178+0000 7f8b56000640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5015f440 0x7f8b5013b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.178+0000 7f8b54c00640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b50145260 0x7f8b500b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.178+0000 7f8b55600640 1 -- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b50145260 msgr2=0x7f8b500b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.178+0000 7f8b55600640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b50145260 0x7f8b500b3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.178+0000 7f8b55600640 1 -- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5015f440 msgr2=0x7f8b5013b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:49.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.178+0000 7f8b55600640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5015f440 0x7f8b5013b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.178+0000 7f8b55600640 1 -- 172.21.15.46:0/649577418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b440094d0 con 0x7f8b50071000 2024-02-19T06:58:49.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.178+0000 7f8b56000640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5015f440 0x7f8b5013b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:49.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.178+0000 7f8b55600640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b50071000 0x7f8b500b3130 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b44000c00 tx=0x7f8b440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.179+0000 7f8b4d600640 1 -- 172.21.15.46:0/649577418 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44032870 con 0x7f8b50071000 2024-02-19T06:58:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.179+0000 7f8b4d600640 1 -- 172.21.15.46:0/649577418 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44032a10 con 0x7f8b50071000 2024-02-19T06:58:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.179+0000 7f8b58000640 1 -- 172.21.15.46:0/649577418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b500aff60 con 0x7f8b50071000 2024-02-19T06:58:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.179+0000 7f8b4d600640 1 -- 172.21.15.46:0/649577418 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44032dc0 con 0x7f8b50071000 2024-02-19T06:58:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.179+0000 7f8b58000640 1 -- 172.21.15.46:0/649577418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b500b0520 con 0x7f8b50071000 2024-02-19T06:58:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.180+0000 7f8b58000640 1 -- 172.21.15.46:0/649577418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b50067ba0 con 0x7f8b50071000 2024-02-19T06:58:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.181+0000 7f8b4d600640 1 -- 172.21.15.46:0/649577418 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8b44030070 con 0x7f8b50071000 2024-02-19T06:58:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.182+0000 7f8b4d600640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8b3006b810 0x7f8b3006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.182+0000 7f8b4d600640 1 -- 172.21.15.46:0/649577418 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8b440ac070 con 0x7f8b50071000 2024-02-19T06:58:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.183+0000 7f8b54c00640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8b3006b810 0x7f8b3006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.184+0000 7f8b54c00640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8b3006b810 0x7f8b3006dcd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c006fd0 tx=0x7f8b3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.186+0000 7f8b4d600640 1 -- 172.21.15.46:0/649577418 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8b44076aa0 con 0x7f8b50071000 2024-02-19T06:58:49.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.386+0000 7f8b58000640 1 -- 172.21.15.46:0/649577418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b5015e5f0 con 0x7f8b50071000 2024-02-19T06:58:49.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.388+0000 7f8b4d600640 1 -- 172.21.15.46:0/649577418 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16855 (secure 0 0 0) 0x7f8b4407a160 con 0x7f8b50071000 2024-02-19T06:58:49.390 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:49.390 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:58:37.086581+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:49.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.391+0000 7f8b58000640 1 -- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8b3006b810 msgr2=0x7f8b3006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:49.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.391+0000 7f8b58000640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8b3006b810 0x7f8b3006dcd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c006fd0 tx=0x7f8b3c008040 comp rx=0 tx=0).stop 2024-02-19T06:58:49.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.391+0000 7f8b58000640 1 -- 172.21.15.46:0/649577418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b50071000 msgr2=0x7f8b500b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:49.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.391+0000 7f8b58000640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b50071000 0x7f8b500b3130 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b44000c00 tx=0x7f8b440046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.391+0000 7f8b58000640 1 -- 172.21.15.46:0/649577418 shutdown_connections 2024-02-19T06:58:49.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.391+0000 7f8b58000640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8b3006b810 0x7f8b3006dcd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.391+0000 7f8b58000640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5015f440 0x7f8b5013b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.391+0000 7f8b58000640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b50145260 0x7f8b500b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.391+0000 7f8b58000640 1 --2- 172.21.15.46:0/649577418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b50071000 0x7f8b500b3130 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.391+0000 7f8b58000640 1 -- 172.21.15.46:0/649577418 >> 172.21.15.46:0/649577418 conn(0x7f8b50066f70 msgr2=0x7f8b500ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:49.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.391+0000 7f8b58000640 1 -- 172.21.15.46:0/649577418 shutdown_connections 2024-02-19T06:58:49.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.392+0000 7f8b58000640 1 -- 172.21.15.46:0/649577418 wait complete. 2024-02-19T06:58:49.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:49.411 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:49.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.634+0000 7fdb3dc00640 1 Processor -- start 2024-02-19T06:58:49.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.635+0000 7fdb3dc00640 1 -- start start 2024-02-19T06:58:49.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.636+0000 7fdb3dc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdb38145050 0x7fdb380cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.636+0000 7fdb3dc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb380ccce0 0x7fdb380cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.636+0000 7fdb3dc00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb38071e80 con 0x7fdb380cf910 2024-02-19T06:58:49.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.636+0000 7fdb3dc00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb380cfda0 con 0x7fdb38145050 2024-02-19T06:58:49.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.636+0000 7fdb3dc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38071020 con 0x7fdb380ccce0 2024-02-19T06:58:49.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.637+0000 7fdb37400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdb380cf910 0x7fdb3815f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46072/0 (socket says 172.21.15.46:46072) 2024-02-19T06:58:49.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.637+0000 7fdb37400640 1 -- 172.21.15.46:0/1292898113 learned_addr learned my addr 172.21.15.46:0/1292898113 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:49.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.637+0000 7fdb2e000640 1 --2- 172.21.15.46:0/1292898113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb380ccce0 0x7fdb380cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.637+0000 7fdb36a00640 1 --2- 172.21.15.46:0/1292898113 >> v2:172.21.15.142:3300/0 conn(0x7fdb38145050 0x7fdb380cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.637+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310580547 0 0) 0x7fdb38071e80 con 0x7fdb380cf910 2024-02-19T06:58:49.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb1c003520 con 0x7fdb380cf910 2024-02-19T06:58:49.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 508799024 0 0) 0x7fdb1c003520 con 0x7fdb380cf910 2024-02-19T06:58:49.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb380ccce0 msgr2=0x7fdb380cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:49.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 --2- 172.21.15.46:0/1292898113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb380ccce0 0x7fdb380cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 >> v2:172.21.15.142:3300/0 conn(0x7fdb38145050 msgr2=0x7fdb380cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:49.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 --2- 172.21.15.46:0/1292898113 >> v2:172.21.15.142:3300/0 conn(0x7fdb38145050 0x7fdb380cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb380aef70 con 0x7fdb380cf910 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fdb30001a10 con 0x7fdb380cf910 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 >> v1:172.21.15.46:6789/0 conn(0x7fdb380cf910 legacy=0x7fdb3815f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 --2- 172.21.15.46:0/1292898113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb380ccce0 0x7fdb1c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 --2- 172.21.15.46:0/1292898113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1c003f40 0x7fdb1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 --2- 172.21.15.46:0/1292898113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb1c004d00 0x7fdb1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb380cfda0 con 0x7fdb1c003f40 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38071020 con 0x7fdb1c004d00 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c00fd90 con 0x7fdb380ccce0 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.638+0000 7fdb2e000640 1 --2- 172.21.15.46:0/1292898113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1c003f40 0x7fdb1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.639+0000 7fdb36a00640 1 --2- 172.21.15.46:0/1292898113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb380ccce0 0x7fdb1c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.639+0000 7fdb2e000640 1 -- 172.21.15.46:0/1292898113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb380ccce0 msgr2=0x7fdb1c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.639+0000 7fdb37400640 1 --2- 172.21.15.46:0/1292898113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb1c004d00 0x7fdb1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.639+0000 7fdb2e000640 1 --2- 172.21.15.46:0/1292898113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb380ccce0 0x7fdb1c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.639+0000 7fdb2e000640 1 -- 172.21.15.46:0/1292898113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb1c004d00 msgr2=0x7fdb1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:49.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.639+0000 7fdb2e000640 1 --2- 172.21.15.46:0/1292898113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb1c004d00 0x7fdb1c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.639+0000 7fdb2e000640 1 -- 172.21.15.46:0/1292898113 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c003520 con 0x7fdb1c003f40 2024-02-19T06:58:49.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.640+0000 7fdb2e000640 1 --2- 172.21.15.46:0/1292898113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1c003f40 0x7fdb1c0047c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009af0 tx=0x7fdb1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4814bb71721f25d server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:49.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.640+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2002c6b0 con 0x7fdb1c003f40 2024-02-19T06:58:49.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.640+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2002c810 con 0x7fdb1c003f40 2024-02-19T06:58:49.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.640+0000 7fdb36000640 1 -- 172.21.15.46:0/1292898113 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2002cba0 con 0x7fdb1c003f40 2024-02-19T06:58:49.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.641+0000 7fdb3dc00640 1 -- 172.21.15.46:0/1292898113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1c003f40 msgr2=0x7fdb1c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:49.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.641+0000 7fdb3dc00640 1 --2- 172.21.15.46:0/1292898113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1c003f40 0x7fdb1c0047c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009af0 tx=0x7fdb1c0057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.641+0000 7fdb37400640 1 -- 172.21.15.46:0/1292898113 reap_dead start 2024-02-19T06:58:49.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.641+0000 7fdb3dc00640 1 -- 172.21.15.46:0/1292898113 shutdown_connections 2024-02-19T06:58:49.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.641+0000 7fdb3dc00640 1 -- 172.21.15.46:0/1292898113 >> 172.21.15.46:0/1292898113 conn(0x7fdb38066fc0 msgr2=0x7fdb3806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:49.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.641+0000 7fdb3dc00640 1 -- 172.21.15.46:0/1292898113 shutdown_connections 2024-02-19T06:58:49.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.641+0000 7fdb3dc00640 1 -- 172.21.15.46:0/1292898113 wait complete. 2024-02-19T06:58:49.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.643+0000 7fdb3dc00640 1 Processor -- start 2024-02-19T06:58:49.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.643+0000 7fdb3dc00640 1 -- start start 2024-02-19T06:58:49.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.644+0000 7fdb3dc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1c003f40 0x7fdb3815be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.644+0000 7fdb3dc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb3815af20 0x7fdb3813c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.644+0000 7fdb3dc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb380b3f00 0x7fdb380b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.644+0000 7fdb3dc00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38139d40 con 0x7fdb1c003f40 2024-02-19T06:58:49.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.644+0000 7fdb3dc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb381399a0 con 0x7fdb3815af20 2024-02-19T06:58:49.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.644+0000 7fdb3dc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb380b23a0 con 0x7fdb380b3f00 2024-02-19T06:58:49.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.645+0000 7fdb36a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1c003f40 0x7fdb3815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.645+0000 7fdb36a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1c003f40 0x7fdb3815be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45340/0 (socket says 172.21.15.46:45340) 2024-02-19T06:58:49.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.645+0000 7fdb36a00640 1 -- 172.21.15.46:0/2087138312 learned_addr learned my addr 172.21.15.46:0/2087138312 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:49.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.645+0000 7fdb2e000640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb3815af20 0x7fdb3813c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.645+0000 7fdb37400640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb380b3f00 0x7fdb380b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.645+0000 7fdb36a00640 1 -- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb380b3f00 msgr2=0x7fdb380b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:49.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.645+0000 7fdb36a00640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb380b3f00 0x7fdb380b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.645+0000 7fdb36a00640 1 -- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb3815af20 msgr2=0x7fdb3813c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:49.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.645+0000 7fdb36a00640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb3815af20 0x7fdb3813c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.645+0000 7fdb36a00640 1 -- 172.21.15.46:0/2087138312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb380b2680 con 0x7fdb1c003f40 2024-02-19T06:58:49.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.646+0000 7fdb36a00640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1c003f40 0x7fdb3815be20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb280116d0 tx=0x7fdb28011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:49.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.646+0000 7fdb2f400640 1 -- 172.21.15.46:0/2087138312 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2800f9c0 con 0x7fdb1c003f40 2024-02-19T06:58:49.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.646+0000 7fdb2f400640 1 -- 172.21.15.46:0/2087138312 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2800fb20 con 0x7fdb1c003f40 2024-02-19T06:58:49.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.646+0000 7fdb2f400640 1 -- 172.21.15.46:0/2087138312 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2800fe90 con 0x7fdb1c003f40 2024-02-19T06:58:49.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.646+0000 7fdb3dc00640 1 -- 172.21.15.46:0/2087138312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb3815c360 con 0x7fdb1c003f40 2024-02-19T06:58:49.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.646+0000 7fdb3dc00640 1 -- 172.21.15.46:0/2087138312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3813caa0 con 0x7fdb1c003f40 2024-02-19T06:58:49.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.647+0000 7fdb3dc00640 1 -- 172.21.15.46:0/2087138312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb380cc820 con 0x7fdb1c003f40 2024-02-19T06:58:49.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.648+0000 7fdb2f400640 1 -- 172.21.15.46:0/2087138312 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fdb28015460 con 0x7fdb1c003f40 2024-02-19T06:58:49.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.649+0000 7fdb2f400640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdb1406b810 0x7fdb1406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:49.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.649+0000 7fdb2f400640 1 -- 172.21.15.46:0/2087138312 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdb2808a850 con 0x7fdb1c003f40 2024-02-19T06:58:49.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.650+0000 7fdb2e000640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdb1406b810 0x7fdb1406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:49.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.651+0000 7fdb2e000640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdb1406b810 0x7fdb1406dcd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb20036000 tx=0x7fdb20030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:49.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.654+0000 7fdb2f400640 1 -- 172.21.15.46:0/2087138312 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdb28055200 con 0x7fdb1c003f40 2024-02-19T06:58:49.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.853+0000 7fdb3dc00640 1 -- 172.21.15.46:0/2087138312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb38067ba0 con 0x7fdb1c003f40 2024-02-19T06:58:49.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.854+0000 7fdb2f400640 1 -- 172.21.15.46:0/2087138312 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb280588c0 con 0x7fdb1c003f40 2024-02-19T06:58:49.856 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:49.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.857+0000 7fdb3dc00640 1 -- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdb1406b810 msgr2=0x7fdb1406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:49.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.857+0000 7fdb3dc00640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdb1406b810 0x7fdb1406dcd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb20036000 tx=0x7fdb20030000 comp rx=0 tx=0).stop 2024-02-19T06:58:49.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.857+0000 7fdb3dc00640 1 -- 172.21.15.46:0/2087138312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1c003f40 msgr2=0x7fdb3815be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:49.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.857+0000 7fdb3dc00640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1c003f40 0x7fdb3815be20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb280116d0 tx=0x7fdb28011b90 comp rx=0 tx=0).stop 2024-02-19T06:58:49.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.857+0000 7fdb3dc00640 1 -- 172.21.15.46:0/2087138312 shutdown_connections 2024-02-19T06:58:49.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.857+0000 7fdb3dc00640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdb1406b810 0x7fdb1406dcd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.857+0000 7fdb3dc00640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb380b3f00 0x7fdb380b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.857+0000 7fdb3dc00640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb3815af20 0x7fdb3813c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.857+0000 7fdb3dc00640 1 --2- 172.21.15.46:0/2087138312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb1c003f40 0x7fdb3815be20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:49.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.857+0000 7fdb3dc00640 1 -- 172.21.15.46:0/2087138312 >> 172.21.15.46:0/2087138312 conn(0x7fdb38066fc0 msgr2=0x7fdb380b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:49.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.857+0000 7fdb3dc00640 1 -- 172.21.15.46:0/2087138312 shutdown_connections 2024-02-19T06:58:49.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:49.857+0000 7fdb3dc00640 1 -- 172.21.15.46:0/2087138312 wait complete. 2024-02-19T06:58:49.880 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.108+0000 7fa93a400640 1 Processor -- start 2024-02-19T06:58:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.108+0000 7fa93a400640 1 -- start start 2024-02-19T06:58:50.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.110+0000 7fa93a400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9340cf3d0 0x7fa9340cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:50.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.110+0000 7fa93a400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa93406d680 0x7fa93406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:50.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.110+0000 7fa93a400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa934071e80 con 0x7fa934145050 2024-02-19T06:58:50.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.110+0000 7fa93a400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa934071020 con 0x7fa93406d680 2024-02-19T06:58:50.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.110+0000 7fa93a400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9340aef70 con 0x7fa9340cf3d0 2024-02-19T06:58:50.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.110+0000 7fa933e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa93406d680 0x7fa93406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:50.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.110+0000 7fa933e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa93406d680 0x7fa93406db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45352/0 (socket says 172.21.15.46:45352) 2024-02-19T06:58:50.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.110+0000 7fa933e00640 1 -- 172.21.15.46:0/1415098459 learned_addr learned my addr 172.21.15.46:0/1415098459 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:50.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.111+0000 7fa92be00640 1 --2- 172.21.15.46:0/1415098459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9340cf3d0 0x7fa9340cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:50.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.111+0000 7fa933e00640 1 -- 172.21.15.46:0/1415098459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9340cf3d0 msgr2=0x7fa9340cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:50.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.111+0000 7fa933e00640 1 --2- 172.21.15.46:0/1415098459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9340cf3d0 0x7fa9340cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.111+0000 7fa933e00640 1 -- 172.21.15.46:0/1415098459 >> v1:172.21.15.142:6789/0 conn(0x7fa934145050 legacy=0x7fa9340cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:50.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.111+0000 7fa933e00640 1 -- 172.21.15.46:0/1415098459 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9340cfd70 con 0x7fa93406d680 2024-02-19T06:58:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.112+0000 7fa933e00640 1 --2- 172.21.15.46:0/1415098459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa93406d680 0x7fa93406db10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009e50 tx=0x7fa92c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a59aabf204bc6f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.112+0000 7fa932a00640 1 -- 172.21.15.46:0/1415098459 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c02caf0 con 0x7fa93406d680 2024-02-19T06:58:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.113+0000 7fa932a00640 1 -- 172.21.15.46:0/1415098459 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92c02cc50 con 0x7fa93406d680 2024-02-19T06:58:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.113+0000 7fa932a00640 1 -- 172.21.15.46:0/1415098459 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0343f0 con 0x7fa93406d680 2024-02-19T06:58:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.113+0000 7fa93a400640 1 -- 172.21.15.46:0/1415098459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa93406d680 msgr2=0x7fa93406db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.113+0000 7fa93a400640 1 --2- 172.21.15.46:0/1415098459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa93406d680 0x7fa93406db10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009e50 tx=0x7fa92c02bf50 comp rx=0 tx=0).stop 2024-02-19T06:58:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.113+0000 7fa93a400640 1 -- 172.21.15.46:0/1415098459 shutdown_connections 2024-02-19T06:58:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.113+0000 7fa93a400640 1 --2- 172.21.15.46:0/1415098459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa93406d680 0x7fa93406db10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.113+0000 7fa93a400640 1 --2- 172.21.15.46:0/1415098459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9340cf3d0 0x7fa9340cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.113+0000 7fa93a400640 1 -- 172.21.15.46:0/1415098459 >> 172.21.15.46:0/1415098459 conn(0x7fa934066fc0 msgr2=0x7fa93406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.114+0000 7fa93a400640 1 -- 172.21.15.46:0/1415098459 shutdown_connections 2024-02-19T06:58:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.114+0000 7fa93a400640 1 -- 172.21.15.46:0/1415098459 wait complete. 2024-02-19T06:58:50.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.115+0000 7fa93a400640 1 Processor -- start 2024-02-19T06:58:50.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.116+0000 7fa93a400640 1 -- start start 2024-02-19T06:58:50.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa93a400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa93406d680 0x7fa93415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:50.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa93a400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9340cf3d0 0x7fa9340cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:50.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa93a400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa934145050 0x7fa9340cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:50.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa93a400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93415ecc0 con 0x7fa93406d680 2024-02-19T06:58:50.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa93a400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93415e420 con 0x7fa9340cf3d0 2024-02-19T06:58:50.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa93a400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93415e700 con 0x7fa934145050 2024-02-19T06:58:50.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa933400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa93406d680 0x7fa93415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:50.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa933400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa93406d680 0x7fa93415b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45356/0 (socket says 172.21.15.46:45356) 2024-02-19T06:58:50.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa933400640 1 -- 172.21.15.46:0/1061580185 learned_addr learned my addr 172.21.15.46:0/1061580185 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:50.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa92be00640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9340cf3d0 0x7fa9340cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:50.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa933e00640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa934145050 0x7fa9340cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:50.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa933400640 1 -- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa934145050 msgr2=0x7fa9340cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:50.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa933400640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa934145050 0x7fa9340cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa933400640 1 -- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9340cf3d0 msgr2=0x7fa9340cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:50.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.117+0000 7fa933400640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9340cf3d0 0x7fa9340cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.118+0000 7fa933400640 1 -- 172.21.15.46:0/1061580185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c009b30 con 0x7fa93406d680 2024-02-19T06:58:50.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.118+0000 7fa92be00640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9340cf3d0 0x7fa9340cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:50.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.118+0000 7fa933e00640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa934145050 0x7fa9340cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:50.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.118+0000 7fa933400640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa93406d680 0x7fa93415b220 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa92400c340 tx=0x7fa92400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:50.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.118+0000 7fa92b400640 1 -- 172.21.15.46:0/1061580185 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9240052d0 con 0x7fa93406d680 2024-02-19T06:58:50.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.118+0000 7fa92b400640 1 -- 172.21.15.46:0/1061580185 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa924005430 con 0x7fa93406d680 2024-02-19T06:58:50.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.118+0000 7fa92b400640 1 -- 172.21.15.46:0/1061580185 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa924003850 con 0x7fa93406d680 2024-02-19T06:58:50.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.118+0000 7fa93a400640 1 -- 172.21.15.46:0/1061580185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa93415e9e0 con 0x7fa93406d680 2024-02-19T06:58:50.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.119+0000 7fa93a400640 1 -- 172.21.15.46:0/1061580185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93415b760 con 0x7fa93406d680 2024-02-19T06:58:50.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.120+0000 7fa93a400640 1 -- 172.21.15.46:0/1061580185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa934131110 con 0x7fa93406d680 2024-02-19T06:58:50.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.121+0000 7fa92b400640 1 -- 172.21.15.46:0/1061580185 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa9240039b0 con 0x7fa93406d680 2024-02-19T06:58:50.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.121+0000 7fa92b400640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa91006b810 0x7fa91006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:50.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.122+0000 7fa92b400640 1 -- 172.21.15.46:0/1061580185 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa9240897a0 con 0x7fa93406d680 2024-02-19T06:58:50.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.122+0000 7fa92be00640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa91006b810 0x7fa91006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:50.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.124+0000 7fa92be00640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa91006b810 0x7fa91006dcd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa9341601c0 tx=0x7fa91c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:50.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.126+0000 7fa92b400640 1 -- 172.21.15.46:0/1061580185 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa924054130 con 0x7fa93406d680 2024-02-19T06:58:50.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.329+0000 7fa93a400640 1 -- 172.21.15.46:0/1061580185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa934067ba0 con 0x7fa93406d680 2024-02-19T06:58:50.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.330+0000 7fa92b400640 1 -- 172.21.15.46:0/1061580185 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa9240577f0 con 0x7fa93406d680 2024-02-19T06:58:50.332 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:50.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.333+0000 7fa93a400640 1 -- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa91006b810 msgr2=0x7fa91006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.333+0000 7fa93a400640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa91006b810 0x7fa91006dcd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa9341601c0 tx=0x7fa91c008040 comp rx=0 tx=0).stop 2024-02-19T06:58:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.333+0000 7fa93a400640 1 -- 172.21.15.46:0/1061580185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa93406d680 msgr2=0x7fa93415b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.333+0000 7fa93a400640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa93406d680 0x7fa93415b220 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa92400c340 tx=0x7fa92400c800 comp rx=0 tx=0).stop 2024-02-19T06:58:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.333+0000 7fa93a400640 1 -- 172.21.15.46:0/1061580185 shutdown_connections 2024-02-19T06:58:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.333+0000 7fa93a400640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa91006b810 0x7fa91006dcd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.333+0000 7fa93a400640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa934145050 0x7fa9340cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.333+0000 7fa93a400640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9340cf3d0 0x7fa9340cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.333+0000 7fa93a400640 1 --2- 172.21.15.46:0/1061580185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa93406d680 0x7fa93415b220 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.333+0000 7fa93a400640 1 -- 172.21.15.46:0/1061580185 >> 172.21.15.46:0/1061580185 conn(0x7fa934066fc0 msgr2=0x7fa9340ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:50.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.333+0000 7fa93a400640 1 -- 172.21.15.46:0/1061580185 shutdown_connections 2024-02-19T06:58:50.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.333+0000 7fa93a400640 1 -- 172.21.15.46:0/1061580185 wait complete. 2024-02-19T06:58:50.353 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.571+0000 7f8cf7200640 1 Processor -- start 2024-02-19T06:58:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.572+0000 7f8cf7200640 1 -- start start 2024-02-19T06:58:50.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.573+0000 7f8cf7200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8cf0155e10 0x7f8cf015c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:50.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.573+0000 7f8cf7200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cf00d1050 0x7f8cf00d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:50.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.573+0000 7f8cf7200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8cf00d0910 0x7f8cf006ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:50.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.573+0000 7f8cf7200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00ccbf0 con 0x7f8cf00d0910 2024-02-19T06:58:50.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.573+0000 7f8cf7200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00d0d60 con 0x7f8cf0155e10 2024-02-19T06:58:50.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.573+0000 7f8cf7200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf015cda0 con 0x7f8cf00d1050 2024-02-19T06:58:50.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.573+0000 7f8cf6800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8cf00d0910 0x7f8cf006ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:50.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.573+0000 7f8cf6800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8cf00d0910 0x7f8cf006ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45360/0 (socket says 172.21.15.46:45360) 2024-02-19T06:58:50.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.573+0000 7f8cf6800640 1 -- 172.21.15.46:0/3836430445 learned_addr learned my addr 172.21.15.46:0/3836430445 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:50.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.574+0000 7f8cf5400640 1 --2- 172.21.15.46:0/3836430445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cf00d1050 0x7f8cf00d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:50.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.574+0000 7f8cf5e00640 1 --2- 172.21.15.46:0/3836430445 >> v2:172.21.15.142:3300/0 conn(0x7f8cf0155e10 0x7f8cf015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:50.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.574+0000 7f8cf6800640 1 -- 172.21.15.46:0/3836430445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cf00d1050 msgr2=0x7f8cf00d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:50.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.574+0000 7f8cf6800640 1 --2- 172.21.15.46:0/3836430445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cf00d1050 0x7f8cf00d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.574+0000 7f8cf6800640 1 -- 172.21.15.46:0/3836430445 >> v2:172.21.15.142:3300/0 conn(0x7f8cf0155e10 msgr2=0x7f8cf015c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:50.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.574+0000 7f8cf6800640 1 --2- 172.21.15.46:0/3836430445 >> v2:172.21.15.142:3300/0 conn(0x7f8cf0155e10 0x7f8cf015c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.574+0000 7f8cf6800640 1 -- 172.21.15.46:0/3836430445 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00cce00 con 0x7f8cf00d0910 2024-02-19T06:58:50.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.575+0000 7f8cf6800640 1 --2- 172.21.15.46:0/3836430445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf00d0910 0x7f8cf006ab80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0071880 tx=0x7f8cec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe3acdfd94853c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:50.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.575+0000 7f8cf4a00640 1 -- 172.21.15.46:0/3836430445 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec031870 con 0x7f8cf00d0910 2024-02-19T06:58:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.575+0000 7f8cf4a00640 1 -- 172.21.15.46:0/3836430445 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec0319d0 con 0x7f8cf00d0910 2024-02-19T06:58:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.575+0000 7f8cf4a00640 1 -- 172.21.15.46:0/3836430445 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec031d60 con 0x7f8cf00d0910 2024-02-19T06:58:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.576+0000 7f8cf7200640 1 -- 172.21.15.46:0/3836430445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf00d0910 msgr2=0x7f8cf006ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.576+0000 7f8cf7200640 1 --2- 172.21.15.46:0/3836430445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf00d0910 0x7f8cf006ab80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0071880 tx=0x7f8cec02b910 comp rx=0 tx=0).stop 2024-02-19T06:58:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.576+0000 7f8cf7200640 1 -- 172.21.15.46:0/3836430445 shutdown_connections 2024-02-19T06:58:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.576+0000 7f8cf7200640 1 --2- 172.21.15.46:0/3836430445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf00d0910 0x7f8cf006ab80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.576+0000 7f8cf7200640 1 --2- 172.21.15.46:0/3836430445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cf00d1050 0x7f8cf00d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.576+0000 7f8cf7200640 1 --2- 172.21.15.46:0/3836430445 >> v2:172.21.15.142:3300/0 conn(0x7f8cf0155e10 0x7f8cf015c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.576+0000 7f8cf7200640 1 -- 172.21.15.46:0/3836430445 >> 172.21.15.46:0/3836430445 conn(0x7f8cf00b5af0 msgr2=0x7f8cf0099a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.576+0000 7f8cf7200640 1 -- 172.21.15.46:0/3836430445 shutdown_connections 2024-02-19T06:58:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.576+0000 7f8cf7200640 1 -- 172.21.15.46:0/3836430445 wait complete. 2024-02-19T06:58:50.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.578+0000 7f8cf7200640 1 Processor -- start 2024-02-19T06:58:50.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.578+0000 7f8cf7200640 1 -- start start 2024-02-19T06:58:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.579+0000 7f8cf7200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cf00d0910 0x7f8cf01f0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.579+0000 7f8cf7200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cf00d1050 0x7f8cf01f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.579+0000 7f8cf7200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf0155e10 0x7f8cf01f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.579+0000 7f8cf7200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf009c840 con 0x7f8cf0155e10 2024-02-19T06:58:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.579+0000 7f8cf7200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf01f0d40 con 0x7f8cf00d1050 2024-02-19T06:58:50.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.579+0000 7f8cf7200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf0156540 con 0x7f8cf00d0910 2024-02-19T06:58:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.579+0000 7f8cf6800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf0155e10 0x7f8cf01f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.579+0000 7f8cf6800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf0155e10 0x7f8cf01f1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45366/0 (socket says 172.21.15.46:45366) 2024-02-19T06:58:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.579+0000 7f8cf6800640 1 -- 172.21.15.46:0/2445940650 learned_addr learned my addr 172.21.15.46:0/2445940650 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.580+0000 7f8cf5e00640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cf00d0910 0x7f8cf01f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.580+0000 7f8cf5400640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cf00d1050 0x7f8cf01f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.580+0000 7f8cf6800640 1 -- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cf00d0910 msgr2=0x7f8cf01f0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.580+0000 7f8cf6800640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cf00d0910 0x7f8cf01f0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.580+0000 7f8cf6800640 1 -- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cf00d1050 msgr2=0x7f8cf01f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.580+0000 7f8cf6800640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cf00d1050 0x7f8cf01f18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.580+0000 7f8cf6800640 1 -- 172.21.15.46:0/2445940650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec0094d0 con 0x7f8cf0155e10 2024-02-19T06:58:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.580+0000 7f8cf5e00640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cf00d0910 0x7f8cf01f0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:50.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.580+0000 7f8cf6800640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf0155e10 0x7f8cf01f1fd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8cec02b950 tx=0x7f8cec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:50.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.580+0000 7f8ce6000640 1 -- 172.21.15.46:0/2445940650 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec03ac60 con 0x7f8cf0155e10 2024-02-19T06:58:50.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.580+0000 7f8ce6000640 1 -- 172.21.15.46:0/2445940650 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec03adc0 con 0x7f8cf0155e10 2024-02-19T06:58:50.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.580+0000 7f8ce6000640 1 -- 172.21.15.46:0/2445940650 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec045690 con 0x7f8cf0155e10 2024-02-19T06:58:50.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.580+0000 7f8cf7200640 1 -- 172.21.15.46:0/2445940650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf01f1e10 con 0x7f8cf0155e10 2024-02-19T06:58:50.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.581+0000 7f8cf7200640 1 -- 172.21.15.46:0/2445940650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf009bbc0 con 0x7f8cf0155e10 2024-02-19T06:58:50.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.582+0000 7f8cf7200640 1 -- 172.21.15.46:0/2445940650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf009c980 con 0x7f8cf0155e10 2024-02-19T06:58:50.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.583+0000 7f8ce6000640 1 -- 172.21.15.46:0/2445940650 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8cec0457f0 con 0x7f8cf0155e10 2024-02-19T06:58:50.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.584+0000 7f8ce6000640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8cd406b810 0x7f8cd406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:50.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.584+0000 7f8ce6000640 1 -- 172.21.15.46:0/2445940650 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8cec02d040 con 0x7f8cf0155e10 2024-02-19T06:58:50.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.584+0000 7f8cf5e00640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8cd406b810 0x7f8cd406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:50.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.586+0000 7f8cf5e00640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8cd406b810 0x7f8cd406dcd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00cfa90 tx=0x7f8ce800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:50.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.589+0000 7f8ce6000640 1 -- 172.21.15.46:0/2445940650 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8cf009c980 con 0x7f8cf0155e10 2024-02-19T06:58:50.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.787+0000 7f8cf7200640 1 -- 172.21.15.46:0/2445940650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8cf01f1e10 con 0x7f8cf0155e10 2024-02-19T06:58:50.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.788+0000 7f8ce6000640 1 -- 172.21.15.46:0/2445940650 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8cf01f1e10 con 0x7f8cf0155e10 2024-02-19T06:58:50.789 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:50.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.791+0000 7f8cf7200640 1 -- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8cd406b810 msgr2=0x7f8cd406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:50.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.791+0000 7f8cf7200640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8cd406b810 0x7f8cd406dcd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00cfa90 tx=0x7f8ce800b040 comp rx=0 tx=0).stop 2024-02-19T06:58:50.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.791+0000 7f8cf7200640 1 -- 172.21.15.46:0/2445940650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf0155e10 msgr2=0x7f8cf01f1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:50.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.791+0000 7f8cf7200640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf0155e10 0x7f8cf01f1fd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8cec02b950 tx=0x7f8cec0046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.791+0000 7f8cf7200640 1 -- 172.21.15.46:0/2445940650 shutdown_connections 2024-02-19T06:58:50.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.791+0000 7f8cf7200640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8cd406b810 0x7f8cd406dcd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.791+0000 7f8cf7200640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf0155e10 0x7f8cf01f1fd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.791+0000 7f8cf7200640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cf00d1050 0x7f8cf01f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.791+0000 7f8cf7200640 1 --2- 172.21.15.46:0/2445940650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cf00d0910 0x7f8cf01f0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:50.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.791+0000 7f8cf7200640 1 -- 172.21.15.46:0/2445940650 >> 172.21.15.46:0/2445940650 conn(0x7f8cf00b5af0 msgr2=0x7f8cf006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:50.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.791+0000 7f8cf7200640 1 -- 172.21.15.46:0/2445940650 shutdown_connections 2024-02-19T06:58:50.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:50.791+0000 7f8cf7200640 1 -- 172.21.15.46:0/2445940650 wait complete. 2024-02-19T06:58:50.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-19T06:58:51.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.029+0000 7fd94a400640 1 Processor -- start 2024-02-19T06:58:51.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.029+0000 7fd94a400640 1 -- start start 2024-02-19T06:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.030+0000 7fd94a400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd944154b60 0x7fd9440acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.031+0000 7fd94a400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd9440b37f0 0x7fd9441618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.031+0000 7fd94a400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94415eed0 con 0x7fd9440b3390 2024-02-19T06:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.031+0000 7fd94a400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9440ae010 con 0x7fd9440b37f0 2024-02-19T06:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.031+0000 7fd94a400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94415e350 con 0x7fd944154b60 2024-02-19T06:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.031+0000 7fd93be00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd9440b3390 0x7fd9440ae360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46078/0 (socket says 172.21.15.46:46078) 2024-02-19T06:58:51.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.031+0000 7fd93be00640 1 -- 172.21.15.46:0/2386166165 learned_addr learned my addr 172.21.15.46:0/2386166165 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:51.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.031+0000 7fd943400640 1 --2- 172.21.15.46:0/2386166165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd944154b60 0x7fd9440acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.031+0000 7fd943e00640 1 --2- 172.21.15.46:0/2386166165 >> v2:172.21.15.142:3300/0 conn(0x7fd9440b37f0 0x7fd9441618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.031+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414601969 0 0) 0x7fd94415eed0 con 0x7fd9440b3390 2024-02-19T06:58:51.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd928003520 con 0x7fd9440b3390 2024-02-19T06:58:51.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2146576443 0 0) 0x7fd928003520 con 0x7fd9440b3390 2024-02-19T06:58:51.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd944154b60 msgr2=0x7fd9440acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 --2- 172.21.15.46:0/2386166165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd944154b60 0x7fd9440acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 >> v2:172.21.15.142:3300/0 conn(0x7fd9440b37f0 msgr2=0x7fd9441618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 --2- 172.21.15.46:0/2386166165 >> v2:172.21.15.142:3300/0 conn(0x7fd9440b37f0 0x7fd9441618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94415e630 con 0x7fd9440b3390 2024-02-19T06:58:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fd92c001670 con 0x7fd9440b3390 2024-02-19T06:58:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 >> v1:172.21.15.46:6789/0 conn(0x7fd9440b3390 legacy=0x7fd9440ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 --2- 172.21.15.46:0/2386166165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd928003970 0x7fd928003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 --2- 172.21.15.46:0/2386166165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd944154b60 0x7fd9280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 --2- 172.21.15.46:0/2386166165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd928004d00 0x7fd928005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9440ae010 con 0x7fd928003970 2024-02-19T06:58:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94415e350 con 0x7fd928004d00 2024-02-19T06:58:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92800b980 con 0x7fd944154b60 2024-02-19T06:58:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.032+0000 7fd943400640 1 --2- 172.21.15.46:0/2386166165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd928003970 0x7fd928003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.033+0000 7fd943e00640 1 --2- 172.21.15.46:0/2386166165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd928004d00 0x7fd928005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.033+0000 7fd943400640 1 -- 172.21.15.46:0/2386166165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd944154b60 msgr2=0x7fd9280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:51.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.033+0000 7fd943400640 1 --2- 172.21.15.46:0/2386166165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd944154b60 0x7fd9280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.033+0000 7fd943400640 1 -- 172.21.15.46:0/2386166165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd928004d00 msgr2=0x7fd928005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:51.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.033+0000 7fd943400640 1 --2- 172.21.15.46:0/2386166165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd928004d00 0x7fd928005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.033+0000 7fd943400640 1 -- 172.21.15.46:0/2386166165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928003520 con 0x7fd928003970 2024-02-19T06:58:51.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.034+0000 7fd943400640 1 --2- 172.21.15.46:0/2386166165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd928003970 0x7fd928003d90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd934009ac0 tx=0x7fd9280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a444387c655a1a server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:51.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.034+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93402c710 con 0x7fd928003970 2024-02-19T06:58:51.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.034+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93402c870 con 0x7fd928003970 2024-02-19T06:58:51.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.034+0000 7fd942a00640 1 -- 172.21.15.46:0/2386166165 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93402cc00 con 0x7fd928003970 2024-02-19T06:58:51.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.035+0000 7fd94a400640 1 -- 172.21.15.46:0/2386166165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd928003970 msgr2=0x7fd928003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:51.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.035+0000 7fd94a400640 1 --2- 172.21.15.46:0/2386166165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd928003970 0x7fd928003d90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd934009ac0 tx=0x7fd9280057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.035+0000 7fd943e00640 1 -- 172.21.15.46:0/2386166165 reap_dead start 2024-02-19T06:58:51.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.035+0000 7fd94a400640 1 -- 172.21.15.46:0/2386166165 shutdown_connections 2024-02-19T06:58:51.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.035+0000 7fd94a400640 1 -- 172.21.15.46:0/2386166165 >> 172.21.15.46:0/2386166165 conn(0x7fd944066f70 msgr2=0x7fd94406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:51.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.035+0000 7fd94a400640 1 -- 172.21.15.46:0/2386166165 shutdown_connections 2024-02-19T06:58:51.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.035+0000 7fd94a400640 1 -- 172.21.15.46:0/2386166165 wait complete. 2024-02-19T06:58:51.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.037+0000 7fd94a400640 1 Processor -- start 2024-02-19T06:58:51.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.037+0000 7fd94a400640 1 -- start start 2024-02-19T06:58:51.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.038+0000 7fd94a400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd928003970 0x7fd944145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.038+0000 7fd94a400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd944160240 0x7fd9441606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.038+0000 7fd94a400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94414b510 0x7fd94414b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.038+0000 7fd94a400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94414a570 con 0x7fd928003970 2024-02-19T06:58:51.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.038+0000 7fd94a400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9441f3240 con 0x7fd94414b510 2024-02-19T06:58:51.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.038+0000 7fd94a400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd944160c00 con 0x7fd944160240 2024-02-19T06:58:51.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.038+0000 7fd943400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd928003970 0x7fd944145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.038+0000 7fd943400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd928003970 0x7fd944145840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45386/0 (socket says 172.21.15.46:45386) 2024-02-19T06:58:51.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.038+0000 7fd943400640 1 -- 172.21.15.46:0/3492827536 learned_addr learned my addr 172.21.15.46:0/3492827536 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:51.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.039+0000 7fd943e00640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94414b510 0x7fd94414b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.039+0000 7fd93be00640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd944160240 0x7fd9441606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.039+0000 7fd943400640 1 -- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd944160240 msgr2=0x7fd9441606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:51.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.039+0000 7fd943400640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd944160240 0x7fd9441606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.039+0000 7fd943400640 1 -- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94414b510 msgr2=0x7fd94414b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:51.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.039+0000 7fd943400640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94414b510 0x7fd94414b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.039+0000 7fd943400640 1 -- 172.21.15.46:0/3492827536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9440af100 con 0x7fd928003970 2024-02-19T06:58:51.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.039+0000 7fd943e00640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94414b510 0x7fd94414b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:51.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.039+0000 7fd943400640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd928003970 0x7fd944145840 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd934000c00 tx=0x7fd934004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:51.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.039+0000 7fd93b400640 1 -- 172.21.15.46:0/3492827536 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934003810 con 0x7fd928003970 2024-02-19T06:58:51.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.039+0000 7fd93b400640 1 -- 172.21.15.46:0/3492827536 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93402de90 con 0x7fd928003970 2024-02-19T06:58:51.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.039+0000 7fd93b400640 1 -- 172.21.15.46:0/3492827536 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934003b70 con 0x7fd928003970 2024-02-19T06:58:51.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.039+0000 7fd94a400640 1 -- 172.21.15.46:0/3492827536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94414bed0 con 0x7fd928003970 2024-02-19T06:58:51.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.040+0000 7fd94a400640 1 -- 172.21.15.46:0/3492827536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94414aa30 con 0x7fd928003970 2024-02-19T06:58:51.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.041+0000 7fd94a400640 1 -- 172.21.15.46:0/3492827536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd944067ba0 con 0x7fd928003970 2024-02-19T06:58:51.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.042+0000 7fd93b400640 1 -- 172.21.15.46:0/3492827536 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd934003cd0 con 0x7fd928003970 2024-02-19T06:58:51.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.043+0000 7fd93b400640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd92006b810 0x7fd92006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.043+0000 7fd93b400640 1 -- 172.21.15.46:0/3492827536 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd9340ac2a0 con 0x7fd928003970 2024-02-19T06:58:51.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.044+0000 7fd93be00640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd92006b810 0x7fd92006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.045+0000 7fd93be00640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd92006b810 0x7fd92006dcd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd92c000ff0 tx=0x7fd92c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:51.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.048+0000 7fd93b400640 1 -- 172.21.15.46:0/3492827536 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd934076c50 con 0x7fd928003970 2024-02-19T06:58:51.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.264+0000 7fd94a400640 1 -- 172.21.15.46:0/3492827536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd94406d0f0 con 0x7fd928003970 2024-02-19T06:58:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.265+0000 7fd93b400640 1 -- 172.21.15.46:0/3492827536 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd93407a310 con 0x7fd928003970 2024-02-19T06:58:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-02-19T06:58:51.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.268+0000 7fd94a400640 1 -- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd92006b810 msgr2=0x7fd92006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:51.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.268+0000 7fd94a400640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd92006b810 0x7fd92006dcd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd92c000ff0 tx=0x7fd92c009040 comp rx=0 tx=0).stop 2024-02-19T06:58:51.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.268+0000 7fd94a400640 1 -- 172.21.15.46:0/3492827536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd928003970 msgr2=0x7fd944145840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:51.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.268+0000 7fd94a400640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd928003970 0x7fd944145840 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd934000c00 tx=0x7fd934004730 comp rx=0 tx=0).stop 2024-02-19T06:58:51.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.269+0000 7fd94a400640 1 -- 172.21.15.46:0/3492827536 shutdown_connections 2024-02-19T06:58:51.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.269+0000 7fd94a400640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd92006b810 0x7fd92006dcd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.269+0000 7fd94a400640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94414b510 0x7fd94414b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.269+0000 7fd94a400640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd944160240 0x7fd9441606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.269+0000 7fd94a400640 1 --2- 172.21.15.46:0/3492827536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd928003970 0x7fd944145840 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.269+0000 7fd94a400640 1 -- 172.21.15.46:0/3492827536 >> 172.21.15.46:0/3492827536 conn(0x7fd944066f70 msgr2=0x7fd944161d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:51.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.269+0000 7fd94a400640 1 -- 172.21.15.46:0/3492827536 shutdown_connections 2024-02-19T06:58:51.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.269+0000 7fd94a400640 1 -- 172.21.15.46:0/3492827536 wait complete. 2024-02-19T06:58:51.288 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T06:58:51.288 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T06:58:51.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.565+0000 7f3ff2600640 1 Processor -- start 2024-02-19T06:58:51.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.565+0000 7f3ff2600640 1 -- start start 2024-02-19T06:58:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.566+0000 7f3ff2600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3fec15b540 0x7f3fec0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.567+0000 7f3ff2600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fec0cb150 0x7f3fec0cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.567+0000 7f3ff2600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec0cb5f0 con 0x7f3fec15fd50 2024-02-19T06:58:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.567+0000 7f3ff2600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec15f270 con 0x7f3fec15b540 2024-02-19T06:58:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.567+0000 7f3ff2600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec15f550 con 0x7f3fec0cb150 2024-02-19T06:58:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.567+0000 7f3ff1200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3fec15b540 0x7f3fec0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.567+0000 7f3ff1200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3fec15b540 0x7f3fec0cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45388/0 (socket says 172.21.15.46:45388) 2024-02-19T06:58:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.567+0000 7f3ff1200640 1 -- 172.21.15.46:0/3488093713 learned_addr learned my addr 172.21.15.46:0/3488093713 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.567+0000 7f3febe00640 1 --2- 172.21.15.46:0/3488093713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fec0cb150 0x7f3fec0cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.568+0000 7f3ff1200640 1 -- 172.21.15.46:0/3488093713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fec0cb150 msgr2=0x7f3fec0cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.568+0000 7f3ff1200640 1 --2- 172.21.15.46:0/3488093713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fec0cb150 0x7f3fec0cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.568+0000 7f3ff1200640 1 -- 172.21.15.46:0/3488093713 >> v1:172.21.15.142:6789/0 conn(0x7f3fec15fd50 legacy=0x7f3fec0c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:51.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.568+0000 7f3ff1200640 1 -- 172.21.15.46:0/3488093713 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec15f830 con 0x7f3fec15b540 2024-02-19T06:58:51.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.569+0000 7f3ff1200640 1 --2- 172.21.15.46:0/3488093713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fec15b540 0x7f3fec0cac10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009870 tx=0x7f3fe002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60306d629638bfd server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:51.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.569+0000 7f3feb400640 1 -- 172.21.15.46:0/3488093713 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0031640 con 0x7f3fec15b540 2024-02-19T06:58:51.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.569+0000 7f3feb400640 1 -- 172.21.15.46:0/3488093713 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe00317a0 con 0x7f3fec15b540 2024-02-19T06:58:51.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.569+0000 7f3feb400640 1 -- 172.21.15.46:0/3488093713 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0031b30 con 0x7f3fec15b540 2024-02-19T06:58:51.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.570+0000 7f3ff2600640 1 -- 172.21.15.46:0/3488093713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fec15b540 msgr2=0x7f3fec0cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:51.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.570+0000 7f3ff2600640 1 --2- 172.21.15.46:0/3488093713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fec15b540 0x7f3fec0cac10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009870 tx=0x7f3fe002b8f0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.570+0000 7f3ff2600640 1 -- 172.21.15.46:0/3488093713 shutdown_connections 2024-02-19T06:58:51.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.570+0000 7f3ff2600640 1 --2- 172.21.15.46:0/3488093713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fec0cb150 0x7f3fec0cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.570+0000 7f3ff2600640 1 --2- 172.21.15.46:0/3488093713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fec15b540 0x7f3fec0cac10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.570+0000 7f3ff2600640 1 -- 172.21.15.46:0/3488093713 >> 172.21.15.46:0/3488093713 conn(0x7f3fec06afa0 msgr2=0x7f3fec06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:51.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.570+0000 7f3ff2600640 1 -- 172.21.15.46:0/3488093713 shutdown_connections 2024-02-19T06:58:51.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.570+0000 7f3ff2600640 1 -- 172.21.15.46:0/3488093713 wait complete. 2024-02-19T06:58:51.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.572+0000 7f3ff2600640 1 Processor -- start 2024-02-19T06:58:51.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.572+0000 7f3ff2600640 1 -- start start 2024-02-19T06:58:51.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.573+0000 7f3ff2600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fec0cb150 0x7f3fec0acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.573+0000 7f3ff2600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fec15b540 0x7f3fec0b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.573+0000 7f3ff2600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fec15fd50 0x7f3fec0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.573+0000 7f3ff2600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0ad380 con 0x7f3fec15fd50 2024-02-19T06:58:51.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.573+0000 7f3ff2600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0ad660 con 0x7f3fec0cb150 2024-02-19T06:58:51.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.573+0000 7f3ff2600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0ad940 con 0x7f3fec15b540 2024-02-19T06:58:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.573+0000 7f3ff1c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fec15fd50 0x7f3fec0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.573+0000 7f3ff1c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fec15fd50 0x7f3fec0b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45396/0 (socket says 172.21.15.46:45396) 2024-02-19T06:58:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.573+0000 7f3ff1c00640 1 -- 172.21.15.46:0/3320388149 learned_addr learned my addr 172.21.15.46:0/3320388149 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.573+0000 7f3febe00640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fec15b540 0x7f3fec0b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.574+0000 7f3ff1200640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fec0cb150 0x7f3fec0acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.574+0000 7f3ff1c00640 1 -- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fec15b540 msgr2=0x7f3fec0b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.574+0000 7f3ff1c00640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fec15b540 0x7f3fec0b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.574+0000 7f3ff1c00640 1 -- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fec0cb150 msgr2=0x7f3fec0acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.574+0000 7f3ff1c00640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fec0cb150 0x7f3fec0acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.574+0000 7f3ff1c00640 1 -- 172.21.15.46:0/3320388149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe00094d0 con 0x7f3fec15fd50 2024-02-19T06:58:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.574+0000 7f3ff1c00640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fec15fd50 0x7f3fec0b1870 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400b970 tx=0x7f3fe400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:51.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.574+0000 7f3fe8c00640 1 -- 172.21.15.46:0/3320388149 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400cb40 con 0x7f3fec15fd50 2024-02-19T06:58:51.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.574+0000 7f3fe8c00640 1 -- 172.21.15.46:0/3320388149 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe400cca0 con 0x7f3fec15fd50 2024-02-19T06:58:51.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.574+0000 7f3fe8c00640 1 -- 172.21.15.46:0/3320388149 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4014680 con 0x7f3fec15fd50 2024-02-19T06:58:51.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.574+0000 7f3ff2600640 1 -- 172.21.15.46:0/3320388149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec0adc20 con 0x7f3fec15fd50 2024-02-19T06:58:51.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.575+0000 7f3ff2600640 1 -- 172.21.15.46:0/3320388149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec0ad090 con 0x7f3fec15fd50 2024-02-19T06:58:51.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.576+0000 7f3ff2600640 1 -- 172.21.15.46:0/3320388149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec06b9b0 con 0x7f3fec15fd50 2024-02-19T06:58:51.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.577+0000 7f3fe8c00640 1 -- 172.21.15.46:0/3320388149 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3fe401d3b0 con 0x7f3fec15fd50 2024-02-19T06:58:51.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.578+0000 7f3fe8c00640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3fcc06b860 0x7f3fcc06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:51.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.578+0000 7f3fe8c00640 1 -- 172.21.15.46:0/3320388149 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3fe4089ff0 con 0x7f3fec15fd50 2024-02-19T06:58:51.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.578+0000 7f3ff1200640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3fcc06b860 0x7f3fcc06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:51.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.579+0000 7f3ff1200640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3fcc06b860 0x7f3fcc06dd20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0036000 tx=0x7f3fe003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:51.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.582+0000 7f3fe8c00640 1 -- 172.21.15.46:0/3320388149 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3fe40bd8c0 con 0x7f3fec15fd50 2024-02-19T06:58:51.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.782+0000 7f3ff2600640 1 -- 172.21.15.46:0/3320388149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fec04eee0 con 0x7f3fec15fd50 2024-02-19T06:58:51.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.784+0000 7f3fe8c00640 1 -- 172.21.15.46:0/3320388149 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16855 (secure 0 0 0) 0x7f3fe4054a40 con 0x7f3fec15fd50 2024-02-19T06:58:51.786 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:51.786 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:58:37.086581+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.787+0000 7f3ff2600640 1 -- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3fcc06b860 msgr2=0x7f3fcc06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.787+0000 7f3ff2600640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3fcc06b860 0x7f3fcc06dd20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0036000 tx=0x7f3fe003c040 comp rx=0 tx=0).stop 2024-02-19T06:58:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.787+0000 7f3ff2600640 1 -- 172.21.15.46:0/3320388149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fec15fd50 msgr2=0x7f3fec0b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.787+0000 7f3ff2600640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fec15fd50 0x7f3fec0b1870 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400b970 tx=0x7f3fe400be30 comp rx=0 tx=0).stop 2024-02-19T06:58:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.787+0000 7f3ff2600640 1 -- 172.21.15.46:0/3320388149 shutdown_connections 2024-02-19T06:58:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.787+0000 7f3ff2600640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f3fcc06b860 0x7f3fcc06dd20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.787+0000 7f3ff2600640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fec15fd50 0x7f3fec0b1870 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.787+0000 7f3ff2600640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fec15b540 0x7f3fec0b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.787+0000 7f3ff2600640 1 --2- 172.21.15.46:0/3320388149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fec0cb150 0x7f3fec0acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.787+0000 7f3ff2600640 1 -- 172.21.15.46:0/3320388149 >> 172.21.15.46:0/3320388149 conn(0x7f3fec06afa0 msgr2=0x7f3fec0b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.787+0000 7f3ff2600640 1 -- 172.21.15.46:0/3320388149 shutdown_connections 2024-02-19T06:58:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:51.787+0000 7f3ff2600640 1 -- 172.21.15.46:0/3320388149 wait complete. 2024-02-19T06:58:51.810 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:51.810 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:52.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.031+0000 7f5000400640 1 Processor -- start 2024-02-19T06:58:52.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.031+0000 7f5000400640 1 -- start start 2024-02-19T06:58:52.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.033+0000 7f5000400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4ff815dcb0 0x7f4ff80ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.033+0000 7f5000400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff80d21b0 con 0x7f4ff80d3250 2024-02-19T06:58:52.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.033+0000 7f5000400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff80d2490 con 0x7f4ff815d8d0 2024-02-19T06:58:52.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.033+0000 7f5000400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff80d2770 con 0x7f4ff815dcb0 2024-02-19T06:58:52.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.033+0000 7f4ffd000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4ff815dcb0 0x7f4ff80ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.033+0000 7f4ffe400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4ff80d3250 0x7f4ff80b69a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46090/0 (socket says 172.21.15.46:46090) 2024-02-19T06:58:52.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.033+0000 7f4ffe400640 1 -- 172.21.15.46:0/2119706812 learned_addr learned my addr 172.21.15.46:0/2119706812 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:52.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.033+0000 7f4ffd000640 1 -- 172.21.15.46:0/2119706812 >> v1:172.21.15.142:6789/0 conn(0x7f4ff815d8d0 legacy=0x7f4ff80d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:52.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.034+0000 7f4ffd000640 1 -- 172.21.15.46:0/2119706812 >> v1:172.21.15.46:6789/0 conn(0x7f4ff80d3250 legacy=0x7f4ff80b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.034+0000 7f4ffd000640 1 -- 172.21.15.46:0/2119706812 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff80d2a50 con 0x7f4ff815dcb0 2024-02-19T06:58:52.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.034+0000 7f4ff7e00640 1 -- 172.21.15.46:0/2119706812 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013119534 0 0) 0x7f4ff80d21b0 con 0x7f4ff80d3250 2024-02-19T06:58:52.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.035+0000 7f4ffd000640 1 --2- 172.21.15.46:0/2119706812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff815dcb0 0x7f4ff80ce640 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097a0 tx=0x7f4fec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae74e3dc3e8d2c5 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:52.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.035+0000 7f4ff7e00640 1 -- 172.21.15.46:0/2119706812 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec031830 con 0x7f4ff815dcb0 2024-02-19T06:58:52.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.035+0000 7f4ff7e00640 1 -- 172.21.15.46:0/2119706812 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec031990 con 0x7f4ff815dcb0 2024-02-19T06:58:52.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.035+0000 7f4ff7e00640 1 -- 172.21.15.46:0/2119706812 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec031d20 con 0x7f4ff815dcb0 2024-02-19T06:58:52.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.036+0000 7f5000400640 1 -- 172.21.15.46:0/2119706812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff815dcb0 msgr2=0x7f4ff80ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.036+0000 7f5000400640 1 --2- 172.21.15.46:0/2119706812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff815dcb0 0x7f4ff80ce640 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097a0 tx=0x7f4fec02b8d0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.036+0000 7f5000400640 1 -- 172.21.15.46:0/2119706812 shutdown_connections 2024-02-19T06:58:52.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.036+0000 7f5000400640 1 --2- 172.21.15.46:0/2119706812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff815dcb0 0x7f4ff80ce640 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.036+0000 7f5000400640 1 -- 172.21.15.46:0/2119706812 >> 172.21.15.46:0/2119706812 conn(0x7f4ff806be70 msgr2=0x7f4ff806c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:52.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.036+0000 7f5000400640 1 -- 172.21.15.46:0/2119706812 shutdown_connections 2024-02-19T06:58:52.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.036+0000 7f5000400640 1 -- 172.21.15.46:0/2119706812 wait complete. 2024-02-19T06:58:52.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.038+0000 7f5000400640 1 Processor -- start 2024-02-19T06:58:52.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.038+0000 7f5000400640 1 -- start start 2024-02-19T06:58:52.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f5000400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff80d3250 0x7f4ff81f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f5000400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff815d8d0 0x7f4ff80cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f5000400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff815dcb0 0x7f4ff81f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f5000400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80cd8e0 con 0x7f4ff815d8d0 2024-02-19T06:58:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f5000400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80cd3d0 con 0x7f4ff80d3250 2024-02-19T06:58:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f5000400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff815f810 con 0x7f4ff815dcb0 2024-02-19T06:58:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f4ffd000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff815d8d0 0x7f4ff80cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f4ffd000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff815d8d0 0x7f4ff80cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45426/0 (socket says 172.21.15.46:45426) 2024-02-19T06:58:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f4ffd000640 1 -- 172.21.15.46:0/2424629474 learned_addr learned my addr 172.21.15.46:0/2424629474 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f4ffd000640 1 -- 172.21.15.46:0/2424629474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff815dcb0 msgr2=0x7f4ff81f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f4ffd000640 1 --2- 172.21.15.46:0/2424629474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff815dcb0 0x7f4ff81f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f4ffd000640 1 -- 172.21.15.46:0/2424629474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff80d3250 msgr2=0x7f4ff81f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f4ffd000640 1 --2- 172.21.15.46:0/2424629474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff80d3250 0x7f4ff81f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.039+0000 7f4ffd000640 1 -- 172.21.15.46:0/2424629474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec009400 con 0x7f4ff815d8d0 2024-02-19T06:58:52.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.040+0000 7f4ffd000640 1 --2- 172.21.15.46:0/2424629474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff815d8d0 0x7f4ff80cce90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0098c0 tx=0x7f4fec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:52.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.040+0000 7f4ff5600640 1 -- 172.21.15.46:0/2424629474 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec03aa60 con 0x7f4ff815d8d0 2024-02-19T06:58:52.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.040+0000 7f4ff5600640 1 -- 172.21.15.46:0/2424629474 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec03abc0 con 0x7f4ff815d8d0 2024-02-19T06:58:52.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.040+0000 7f4ff5600640 1 -- 172.21.15.46:0/2424629474 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0423f0 con 0x7f4ff815d8d0 2024-02-19T06:58:52.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.040+0000 7f5000400640 1 -- 172.21.15.46:0/2424629474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff80cd600 con 0x7f4ff815d8d0 2024-02-19T06:58:52.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.040+0000 7f5000400640 1 -- 172.21.15.46:0/2424629474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff815fd90 con 0x7f4ff815d8d0 2024-02-19T06:58:52.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.042+0000 7f5000400640 1 -- 172.21.15.46:0/2424629474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff8067ba0 con 0x7f4ff815d8d0 2024-02-19T06:58:52.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.043+0000 7f4ff5600640 1 -- 172.21.15.46:0/2424629474 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4fec04b3b0 con 0x7f4ff815d8d0 2024-02-19T06:58:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.044+0000 7f4ff5600640 1 --2- 172.21.15.46:0/2424629474 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f4fdc06b810 0x7f4fdc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.044+0000 7f4ff5600640 1 -- 172.21.15.46:0/2424629474 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4fec0ac180 con 0x7f4ff815d8d0 2024-02-19T06:58:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.044+0000 7f4ffda00640 1 --2- 172.21.15.46:0/2424629474 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f4fdc06b810 0x7f4fdc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.046+0000 7f4ffda00640 1 --2- 172.21.15.46:0/2424629474 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f4fdc06b810 0x7f4fdc06dcd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8001560 tx=0x7f4fe8007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:52.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.049+0000 7f4ff5600640 1 -- 172.21.15.46:0/2424629474 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4fec076c30 con 0x7f4ff815d8d0 2024-02-19T06:58:52.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.252+0000 7f5000400640 1 -- 172.21.15.46:0/2424629474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ff81f2f80 con 0x7f4ff815d8d0 2024-02-19T06:58:52.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.253+0000 7f4ff5600640 1 -- 172.21.15.46:0/2424629474 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4fec07a2f0 con 0x7f4ff815d8d0 2024-02-19T06:58:52.254 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:52.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.255+0000 7f5000400640 1 -- 172.21.15.46:0/2424629474 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f4fdc06b810 msgr2=0x7f4fdc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.255+0000 7f5000400640 1 --2- 172.21.15.46:0/2424629474 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f4fdc06b810 0x7f4fdc06dcd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8001560 tx=0x7f4fe8007990 comp rx=0 tx=0).stop 2024-02-19T06:58:52.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.255+0000 7f5000400640 1 -- 172.21.15.46:0/2424629474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff815d8d0 msgr2=0x7f4ff80cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.255+0000 7f5000400640 1 --2- 172.21.15.46:0/2424629474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff815d8d0 0x7f4ff80cce90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0098c0 tx=0x7f4fec0046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.256+0000 7f5000400640 1 -- 172.21.15.46:0/2424629474 shutdown_connections 2024-02-19T06:58:52.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.256+0000 7f5000400640 1 --2- 172.21.15.46:0/2424629474 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f4fdc06b810 0x7f4fdc06dcd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.256+0000 7f5000400640 1 --2- 172.21.15.46:0/2424629474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff815dcb0 0x7f4ff81f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.256+0000 7f5000400640 1 --2- 172.21.15.46:0/2424629474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff815d8d0 0x7f4ff80cce90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.256+0000 7f5000400640 1 --2- 172.21.15.46:0/2424629474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff80d3250 0x7f4ff81f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.256+0000 7f5000400640 1 -- 172.21.15.46:0/2424629474 >> 172.21.15.46:0/2424629474 conn(0x7f4ff806be70 msgr2=0x7f4ff815c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:52.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.256+0000 7f5000400640 1 -- 172.21.15.46:0/2424629474 shutdown_connections 2024-02-19T06:58:52.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.256+0000 7f5000400640 1 -- 172.21.15.46:0/2424629474 wait complete. 2024-02-19T06:58:52.276 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.502+0000 7f57a3200640 1 Processor -- start 2024-02-19T06:58:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.502+0000 7f57a3200640 1 -- start start 2024-02-19T06:58:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.503+0000 7f57a3200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f57a40cfc40 0x7f57a40b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.503+0000 7f57a3200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a40b2eb0 con 0x7f57a4155b20 2024-02-19T06:58:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.504+0000 7f57a3200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a415be60 con 0x7f57a40b2a20 2024-02-19T06:58:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.504+0000 7f57a3200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a415c140 con 0x7f57a40cfc40 2024-02-19T06:58:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.504+0000 7f5799400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f57a40cfc40 0x7f57a40b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.504+0000 7f5799400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f57a40cfc40 0x7f57a40b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45428/0 (socket says 172.21.15.46:45428) 2024-02-19T06:58:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.504+0000 7f5799400640 1 -- 172.21.15.46:0/1766238675 learned_addr learned my addr 172.21.15.46:0/1766238675 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.504+0000 7f57a1e00640 1 --1- 172.21.15.46:0/1766238675 >> v1:172.21.15.46:6789/0 conn(0x7f57a4155b20 0x7f57a40cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46094/0 (socket says 172.21.15.46:46094) 2024-02-19T06:58:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.504+0000 7f5799400640 1 -- 172.21.15.46:0/1766238675 >> v1:172.21.15.142:6789/0 conn(0x7f57a40b2a20 legacy=0x7f57a406d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.504+0000 7f5799400640 1 -- 172.21.15.46:0/1766238675 >> v1:172.21.15.46:6789/0 conn(0x7f57a4155b20 legacy=0x7f57a40cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.504+0000 7f5799400640 1 -- 172.21.15.46:0/1766238675 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a415c420 con 0x7f57a40cfc40 2024-02-19T06:58:52.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.506+0000 7f5799400640 1 --2- 172.21.15.46:0/1766238675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57a40cfc40 0x7f57a40b24e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f578c009870 tx=0x7f578c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb15306c8c26a5c server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:52.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.506+0000 7f57a1400640 1 -- 172.21.15.46:0/1766238675 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c031870 con 0x7f57a40cfc40 2024-02-19T06:58:52.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.506+0000 7f57a1400640 1 -- 172.21.15.46:0/1766238675 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c0319d0 con 0x7f57a40cfc40 2024-02-19T06:58:52.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.506+0000 7f57a1400640 1 -- 172.21.15.46:0/1766238675 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c031d60 con 0x7f57a40cfc40 2024-02-19T06:58:52.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.507+0000 7f57a3200640 1 -- 172.21.15.46:0/1766238675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57a40cfc40 msgr2=0x7f57a40b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.507+0000 7f57a3200640 1 --2- 172.21.15.46:0/1766238675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57a40cfc40 0x7f57a40b24e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f578c009870 tx=0x7f578c02b910 comp rx=0 tx=0).stop 2024-02-19T06:58:52.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.507+0000 7f57a3200640 1 -- 172.21.15.46:0/1766238675 shutdown_connections 2024-02-19T06:58:52.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.507+0000 7f57a3200640 1 --2- 172.21.15.46:0/1766238675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57a40cfc40 0x7f57a40b24e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.507+0000 7f57a3200640 1 -- 172.21.15.46:0/1766238675 >> 172.21.15.46:0/1766238675 conn(0x7f57a406ad60 msgr2=0x7f57a406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:52.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.507+0000 7f57a3200640 1 -- 172.21.15.46:0/1766238675 shutdown_connections 2024-02-19T06:58:52.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.507+0000 7f57a3200640 1 -- 172.21.15.46:0/1766238675 wait complete. 2024-02-19T06:58:52.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.509+0000 7f57a3200640 1 Processor -- start 2024-02-19T06:58:52.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.509+0000 7f57a3200640 1 -- start start 2024-02-19T06:58:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.510+0000 7f57a3200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a40b2a20 0x7f57a41f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.510+0000 7f57a3200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57a40cfc40 0x7f57a4071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.510+0000 7f57a3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a4155b20 0x7f57a40cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.510+0000 7f57a3200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a4155330 con 0x7f57a40cfc40 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.510+0000 7f57a3200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a41547f0 con 0x7f57a4155b20 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.510+0000 7f57a3200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a4154a90 con 0x7f57a40b2a20 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.510+0000 7f5799400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57a40cfc40 0x7f57a4071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.510+0000 7f5799400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57a40cfc40 0x7f57a4071230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45440/0 (socket says 172.21.15.46:45440) 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.510+0000 7f5799400640 1 -- 172.21.15.46:0/1112888455 learned_addr learned my addr 172.21.15.46:0/1112888455 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.511+0000 7f57a1e00640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a40b2a20 0x7f57a41f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.511+0000 7f57a2800640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a4155b20 0x7f57a40cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.511+0000 7f5799400640 1 -- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a40b2a20 msgr2=0x7f57a41f6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.511+0000 7f5799400640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a40b2a20 0x7f57a41f6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.511+0000 7f5799400640 1 -- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a4155b20 msgr2=0x7f57a40cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.511+0000 7f5799400640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a4155b20 0x7f57a40cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.511+0000 7f5799400640 1 -- 172.21.15.46:0/1112888455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0094d0 con 0x7f57a40cfc40 2024-02-19T06:58:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.511+0000 7f57a2800640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a4155b20 0x7f57a40cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.511+0000 7f5799400640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57a40cfc40 0x7f57a4071230 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f578c009870 tx=0x7f578c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.512+0000 7f579aa00640 1 -- 172.21.15.46:0/1112888455 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c031820 con 0x7f57a40cfc40 2024-02-19T06:58:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.512+0000 7f579aa00640 1 -- 172.21.15.46:0/1112888455 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c0443f0 con 0x7f57a40cfc40 2024-02-19T06:58:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.512+0000 7f579aa00640 1 -- 172.21.15.46:0/1112888455 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c0447a0 con 0x7f57a40cfc40 2024-02-19T06:58:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.512+0000 7f57a3200640 1 -- 172.21.15.46:0/1112888455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a4154d70 con 0x7f57a40cfc40 2024-02-19T06:58:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.512+0000 7f57a3200640 1 -- 172.21.15.46:0/1112888455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a41f71a0 con 0x7f57a40cfc40 2024-02-19T06:58:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.513+0000 7f57a3200640 1 -- 172.21.15.46:0/1112888455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a406cf80 con 0x7f57a40cfc40 2024-02-19T06:58:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.514+0000 7f579aa00640 1 -- 172.21.15.46:0/1112888455 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f578c04d450 con 0x7f57a40cfc40 2024-02-19T06:58:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.515+0000 7f579aa00640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f578006b810 0x7f578006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.515+0000 7f579aa00640 1 -- 172.21.15.46:0/1112888455 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f578c02d040 con 0x7f57a40cfc40 2024-02-19T06:58:52.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.516+0000 7f57a1e00640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f578006b810 0x7f578006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.517+0000 7f57a1e00640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f578006b810 0x7f578006dcd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5794000f60 tx=0x7f5794007cc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.520+0000 7f579aa00640 1 -- 172.21.15.46:0/1112888455 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f578c077410 con 0x7f57a40cfc40 2024-02-19T06:58:52.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.718+0000 7f57a3200640 1 -- 172.21.15.46:0/1112888455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57a40c9810 con 0x7f57a40cfc40 2024-02-19T06:58:52.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.720+0000 7f579aa00640 1 -- 172.21.15.46:0/1112888455 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f578c07aad0 con 0x7f57a40cfc40 2024-02-19T06:58:52.721 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:52.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.722+0000 7f57a3200640 1 -- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f578006b810 msgr2=0x7f578006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.722+0000 7f57a3200640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f578006b810 0x7f578006dcd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5794000f60 tx=0x7f5794007cc0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.722+0000 7f57a3200640 1 -- 172.21.15.46:0/1112888455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57a40cfc40 msgr2=0x7f57a4071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.722+0000 7f57a3200640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57a40cfc40 0x7f57a4071230 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f578c009870 tx=0x7f578c0046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.723+0000 7f57a3200640 1 -- 172.21.15.46:0/1112888455 shutdown_connections 2024-02-19T06:58:52.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.723+0000 7f57a3200640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f578006b810 0x7f578006dcd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.723+0000 7f57a3200640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a4155b20 0x7f57a40cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.723+0000 7f57a3200640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57a40cfc40 0x7f57a4071230 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.723+0000 7f57a3200640 1 --2- 172.21.15.46:0/1112888455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a40b2a20 0x7f57a41f6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.723+0000 7f57a3200640 1 -- 172.21.15.46:0/1112888455 >> 172.21.15.46:0/1112888455 conn(0x7f57a406ad60 msgr2=0x7f57a4159970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.723+0000 7f57a3200640 1 -- 172.21.15.46:0/1112888455 shutdown_connections 2024-02-19T06:58:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.723+0000 7f57a3200640 1 -- 172.21.15.46:0/1112888455 wait complete. 2024-02-19T06:58:52.745 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:52.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.963+0000 7f5695a00640 1 Processor -- start 2024-02-19T06:58:52.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.964+0000 7f5695a00640 1 -- start start 2024-02-19T06:58:52.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.965+0000 7f5695a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5690161600 0x7f56900b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.965+0000 7f5695a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f56900b34f0 0x7f56900d4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.965+0000 7f5695a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56900d4660 con 0x7f569015dcb0 2024-02-19T06:58:52.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.965+0000 7f5695a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56900b3960 con 0x7f56900b34f0 2024-02-19T06:58:52.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.965+0000 7f5695a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56900b3bd0 con 0x7f5690161600 2024-02-19T06:58:52.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.966+0000 7f568f400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f569015dcb0 0x7f56901619e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46106/0 (socket says 172.21.15.46:46106) 2024-02-19T06:58:52.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.966+0000 7f568f400640 1 -- 172.21.15.46:0/2881550785 learned_addr learned my addr 172.21.15.46:0/2881550785 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:52.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.966+0000 7f568fe00640 1 --2- 172.21.15.46:0/2881550785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5690161600 0x7f56900b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.966+0000 7f5695000640 1 --2- 172.21.15.46:0/2881550785 >> v2:172.21.15.142:3300/0 conn(0x7f56900b34f0 0x7f56900d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.966+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751729889 0 0) 0x7f56900d4660 con 0x7f569015dcb0 2024-02-19T06:58:52.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.966+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5670003520 con 0x7f569015dcb0 2024-02-19T06:58:52.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1811987285 0 0) 0x7f5670003520 con 0x7f569015dcb0 2024-02-19T06:58:52.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5690161600 msgr2=0x7f56900b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:52.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 --2- 172.21.15.46:0/2881550785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5690161600 0x7f56900b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 >> v2:172.21.15.142:3300/0 conn(0x7f56900b34f0 msgr2=0x7f56900d4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 --2- 172.21.15.46:0/2881550785 >> v2:172.21.15.142:3300/0 conn(0x7f56900b34f0 0x7f56900d4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900b3eb0 con 0x7f569015dcb0 2024-02-19T06:58:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f56780017f0 con 0x7f569015dcb0 2024-02-19T06:58:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 >> v1:172.21.15.46:6789/0 conn(0x7f569015dcb0 legacy=0x7f56901619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 --2- 172.21.15.46:0/2881550785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670003970 0x7f5670003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 --2- 172.21.15.46:0/2881550785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56700047c0 0x7f5670004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 --2- 172.21.15.46:0/2881550785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5690161600 0x7f5670005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900b3960 con 0x7f5670003970 2024-02-19T06:58:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900b3bd0 con 0x7f56700047c0 2024-02-19T06:58:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567000b980 con 0x7f5690161600 2024-02-19T06:58:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568fe00640 1 --2- 172.21.15.46:0/2881550785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670003970 0x7f5670003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.967+0000 7f568f400640 1 --2- 172.21.15.46:0/2881550785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56700047c0 0x7f5670004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.968+0000 7f5695000640 1 --2- 172.21.15.46:0/2881550785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5690161600 0x7f5670005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.968+0000 7f568fe00640 1 -- 172.21.15.46:0/2881550785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5690161600 msgr2=0x7f5670005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:52.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.968+0000 7f568fe00640 1 --2- 172.21.15.46:0/2881550785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5690161600 0x7f5670005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.968+0000 7f568fe00640 1 -- 172.21.15.46:0/2881550785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56700047c0 msgr2=0x7f5670004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:52.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.968+0000 7f568fe00640 1 --2- 172.21.15.46:0/2881550785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56700047c0 0x7f5670004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.968+0000 7f568fe00640 1 -- 172.21.15.46:0/2881550785 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5670003520 con 0x7f5670003970 2024-02-19T06:58:52.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.969+0000 7f568fe00640 1 --2- 172.21.15.46:0/2881550785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670003970 0x7f5670003d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5680009ab0 tx=0x7f56700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b144f62987fad95 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:52.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.969+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680005990 con 0x7f5670003970 2024-02-19T06:58:52.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.969+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5680005af0 con 0x7f5670003970 2024-02-19T06:58:52.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.969+0000 7f568ea00640 1 -- 172.21.15.46:0/2881550785 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680005ea0 con 0x7f5670003970 2024-02-19T06:58:52.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.970+0000 7f5695a00640 1 -- 172.21.15.46:0/2881550785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670003970 msgr2=0x7f5670003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.970+0000 7f5695a00640 1 --2- 172.21.15.46:0/2881550785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5670003970 0x7f5670003d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5680009ab0 tx=0x7f56700057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.970+0000 7f5695000640 1 -- 172.21.15.46:0/2881550785 reap_dead start 2024-02-19T06:58:52.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.970+0000 7f5695a00640 1 -- 172.21.15.46:0/2881550785 shutdown_connections 2024-02-19T06:58:52.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.970+0000 7f5695a00640 1 -- 172.21.15.46:0/2881550785 >> 172.21.15.46:0/2881550785 conn(0x7f569008afc0 msgr2=0x7f56900d36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:52.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.970+0000 7f5695a00640 1 -- 172.21.15.46:0/2881550785 shutdown_connections 2024-02-19T06:58:52.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.970+0000 7f5695a00640 1 -- 172.21.15.46:0/2881550785 wait complete. 2024-02-19T06:58:52.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.972+0000 7f5695a00640 1 Processor -- start 2024-02-19T06:58:52.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.972+0000 7f5695a00640 1 -- start start 2024-02-19T06:58:52.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.973+0000 7f5695a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5670003970 0x7f5690160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.973+0000 7f5695a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56900b02e0 0x7f56900b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.973+0000 7f5695a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f569015e0c0 0x7f569015e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.973+0000 7f5695a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900b0ca0 con 0x7f569015e0c0 2024-02-19T06:58:52.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.973+0000 7f5695a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5690160f60 con 0x7f5670003970 2024-02-19T06:58:52.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.973+0000 7f5695a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56900c6d10 con 0x7f56900b02e0 2024-02-19T06:58:52.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.973+0000 7f5695000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f569015e0c0 0x7f569015e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.973+0000 7f5695000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f569015e0c0 0x7f569015e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45464/0 (socket says 172.21.15.46:45464) 2024-02-19T06:58:52.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.973+0000 7f5695000640 1 -- 172.21.15.46:0/116951866 learned_addr learned my addr 172.21.15.46:0/116951866 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:52.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.973+0000 7f568fe00640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5670003970 0x7f5690160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.973+0000 7f568f400640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56900b02e0 0x7f56900b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.974+0000 7f5695000640 1 -- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56900b02e0 msgr2=0x7f56900b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.974+0000 7f5695000640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56900b02e0 0x7f56900b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.974+0000 7f5695000640 1 -- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5670003970 msgr2=0x7f5690160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:52.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.974+0000 7f5695000640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5670003970 0x7f5690160a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:52.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.974+0000 7f5695000640 1 -- 172.21.15.46:0/116951866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56901f6b50 con 0x7f569015e0c0 2024-02-19T06:58:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.974+0000 7f5695000640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f569015e0c0 0x7f569015e570 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f56900c7080 tx=0x7f56880115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.974+0000 7f5687e00640 1 -- 172.21.15.46:0/116951866 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800e070 con 0x7f569015e0c0 2024-02-19T06:58:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.974+0000 7f5687e00640 1 -- 172.21.15.46:0/116951866 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5688003990 con 0x7f569015e0c0 2024-02-19T06:58:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.974+0000 7f5695a00640 1 -- 172.21.15.46:0/116951866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56901f6da0 con 0x7f569015e0c0 2024-02-19T06:58:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.974+0000 7f5687e00640 1 -- 172.21.15.46:0/116951866 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688003b40 con 0x7f569015e0c0 2024-02-19T06:58:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.975+0000 7f5695a00640 1 -- 172.21.15.46:0/116951866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56901f7360 con 0x7f569015e0c0 2024-02-19T06:58:52.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.976+0000 7f5695a00640 1 -- 172.21.15.46:0/116951866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569008b8e0 con 0x7f569015e0c0 2024-02-19T06:58:52.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.977+0000 7f5687e00640 1 -- 172.21.15.46:0/116951866 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5688003ca0 con 0x7f569015e0c0 2024-02-19T06:58:52.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.977+0000 7f5687e00640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f566c06b810 0x7f566c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:52.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.978+0000 7f5687e00640 1 -- 172.21.15.46:0/116951866 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f568808a920 con 0x7f569015e0c0 2024-02-19T06:58:52.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.978+0000 7f568fe00640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f566c06b810 0x7f566c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:52.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.979+0000 7f568fe00640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f566c06b810 0x7f566c06dcd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5680035000 tx=0x7f5680030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:52.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:52.982+0000 7f5687e00640 1 -- 172.21.15.46:0/116951866 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5688055220 con 0x7f569015e0c0 2024-02-19T06:58:53.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.187+0000 7f5695a00640 1 -- 172.21.15.46:0/116951866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f569004eee0 con 0x7f569015e0c0 2024-02-19T06:58:53.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.188+0000 7f5687e00640 1 -- 172.21.15.46:0/116951866 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56880588e0 con 0x7f569015e0c0 2024-02-19T06:58:53.190 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.191+0000 7f5695a00640 1 -- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f566c06b810 msgr2=0x7f566c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.191+0000 7f5695a00640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f566c06b810 0x7f566c06dcd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5680035000 tx=0x7f5680030000 comp rx=0 tx=0).stop 2024-02-19T06:58:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.191+0000 7f5695a00640 1 -- 172.21.15.46:0/116951866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f569015e0c0 msgr2=0x7f569015e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.191+0000 7f5695a00640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f569015e0c0 0x7f569015e570 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f56900c7080 tx=0x7f56880115a0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.191+0000 7f5695a00640 1 -- 172.21.15.46:0/116951866 shutdown_connections 2024-02-19T06:58:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.191+0000 7f5695a00640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f566c06b810 0x7f566c06dcd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.191+0000 7f5695a00640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f569015e0c0 0x7f569015e570 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.191+0000 7f5695a00640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56900b02e0 0x7f56900b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.191+0000 7f5695a00640 1 --2- 172.21.15.46:0/116951866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5670003970 0x7f5690160a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.191+0000 7f5695a00640 1 -- 172.21.15.46:0/116951866 >> 172.21.15.46:0/116951866 conn(0x7f569008afc0 msgr2=0x7f56900d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:53.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.192+0000 7f5695a00640 1 -- 172.21.15.46:0/116951866 shutdown_connections 2024-02-19T06:58:53.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.192+0000 7f5695a00640 1 -- 172.21.15.46:0/116951866 wait complete. 2024-02-19T06:58:53.215 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-19T06:58:53.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.436+0000 7f6d5ce00640 1 Processor -- start 2024-02-19T06:58:53.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.436+0000 7f6d5ce00640 1 -- start start 2024-02-19T06:58:53.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.437+0000 7f6d5ce00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6d5806ea20 0x7f6d580cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:53.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.437+0000 7f6d5ce00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d580cf890 0x7f6d5806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:53.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.438+0000 7f6d5ce00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5815fec0 con 0x7f6d581452d0 2024-02-19T06:58:53.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.438+0000 7f6d5ce00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d580ccf00 con 0x7f6d5806ea20 2024-02-19T06:58:53.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.438+0000 7f6d5ce00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58160350 con 0x7f6d580cf890 2024-02-19T06:58:53.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.438+0000 7f6d56800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d580cf890 0x7f6d5806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:53.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.438+0000 7f6d55400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6d5806ea20 0x7f6d580cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:53.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.438+0000 7f6d56800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d580cf890 0x7f6d5806d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:51456/0 (socket says 172.21.15.46:51456) 2024-02-19T06:58:53.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.438+0000 7f6d56800640 1 -- 172.21.15.46:0/1870531734 learned_addr learned my addr 172.21.15.46:0/1870531734 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:53.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.439+0000 7f6d55400640 1 -- 172.21.15.46:0/1870531734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d580cf890 msgr2=0x7f6d5806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:53.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.439+0000 7f6d55400640 1 --2- 172.21.15.46:0/1870531734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d580cf890 0x7f6d5806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.439+0000 7f6d55400640 1 -- 172.21.15.46:0/1870531734 >> v1:172.21.15.142:6789/0 conn(0x7f6d581452d0 legacy=0x7f6d580cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:53.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.439+0000 7f6d55400640 1 -- 172.21.15.46:0/1870531734 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d580cfd20 con 0x7f6d5806ea20 2024-02-19T06:58:53.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.441+0000 7f6d55400640 1 --2- 172.21.15.46:0/1870531734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5806ea20 0x7f6d580cc870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d400097d0 tx=0x7f6d4002b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=732567b86ce52330 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:53.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.441+0000 7f6d54a00640 1 -- 172.21.15.46:0/1870531734 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40031800 con 0x7f6d5806ea20 2024-02-19T06:58:53.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.441+0000 7f6d54a00640 1 -- 172.21.15.46:0/1870531734 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d40031960 con 0x7f6d5806ea20 2024-02-19T06:58:53.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.441+0000 7f6d54a00640 1 -- 172.21.15.46:0/1870531734 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40031cf0 con 0x7f6d5806ea20 2024-02-19T06:58:53.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.442+0000 7f6d5ce00640 1 -- 172.21.15.46:0/1870531734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5806ea20 msgr2=0x7f6d580cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:53.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.442+0000 7f6d5ce00640 1 --2- 172.21.15.46:0/1870531734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5806ea20 0x7f6d580cc870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d400097d0 tx=0x7f6d4002b8a0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.442+0000 7f6d5ce00640 1 -- 172.21.15.46:0/1870531734 shutdown_connections 2024-02-19T06:58:53.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.442+0000 7f6d5ce00640 1 --2- 172.21.15.46:0/1870531734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d580cf890 0x7f6d5806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.442+0000 7f6d5ce00640 1 --2- 172.21.15.46:0/1870531734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5806ea20 0x7f6d580cc870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.442+0000 7f6d5ce00640 1 -- 172.21.15.46:0/1870531734 >> 172.21.15.46:0/1870531734 conn(0x7f6d58066f70 msgr2=0x7f6d5806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:53.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.442+0000 7f6d5ce00640 1 -- 172.21.15.46:0/1870531734 shutdown_connections 2024-02-19T06:58:53.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.442+0000 7f6d5ce00640 1 -- 172.21.15.46:0/1870531734 wait complete. 2024-02-19T06:58:53.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.444+0000 7f6d5ce00640 1 Processor -- start 2024-02-19T06:58:53.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.444+0000 7f6d5ce00640 1 -- start start 2024-02-19T06:58:53.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.445+0000 7f6d5ce00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d5806ea20 0x7f6d5815bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:53.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.445+0000 7f6d5ce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d580cf890 0x7f6d581f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:53.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.445+0000 7f6d5ce00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d581452d0 0x7f6d5815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:53.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.445+0000 7f6d5ce00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5815c4c0 con 0x7f6d581452d0 2024-02-19T06:58:53.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.445+0000 7f6d5ce00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5815c7a0 con 0x7f6d580cf890 2024-02-19T06:58:53.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.445+0000 7f6d5ce00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5815ca80 con 0x7f6d5806ea20 2024-02-19T06:58:53.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.445+0000 7f6d56800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d581452d0 0x7f6d5815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:53.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.445+0000 7f6d56800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d581452d0 0x7f6d5815ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45468/0 (socket says 172.21.15.46:45468) 2024-02-19T06:58:53.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.445+0000 7f6d56800640 1 -- 172.21.15.46:0/2745103056 learned_addr learned my addr 172.21.15.46:0/2745103056 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:53.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.446+0000 7f6d55400640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d580cf890 0x7f6d581f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:53.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.446+0000 7f6d55e00640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d5806ea20 0x7f6d5815bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:53.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.446+0000 7f6d56800640 1 -- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d5806ea20 msgr2=0x7f6d5815bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:53.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.446+0000 7f6d56800640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d5806ea20 0x7f6d5815bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.446+0000 7f6d56800640 1 -- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d580cf890 msgr2=0x7f6d581f6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:53.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.446+0000 7f6d56800640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d580cf890 0x7f6d581f6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.446+0000 7f6d56800640 1 -- 172.21.15.46:0/2745103056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d40009400 con 0x7f6d581452d0 2024-02-19T06:58:53.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.446+0000 7f6d55e00640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d5806ea20 0x7f6d5815bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:53.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.446+0000 7f6d56800640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d581452d0 0x7f6d5815ae30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000efc0 tx=0x7f6d5000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:53.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.446+0000 7f6d4e000640 1 -- 172.21.15.46:0/2745103056 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5000cd20 con 0x7f6d581452d0 2024-02-19T06:58:53.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.447+0000 7f6d4e000640 1 -- 172.21.15.46:0/2745103056 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5000f040 con 0x7f6d581452d0 2024-02-19T06:58:53.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.447+0000 7f6d5ce00640 1 -- 172.21.15.46:0/2745103056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5815cd60 con 0x7f6d581452d0 2024-02-19T06:58:53.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.447+0000 7f6d4e000640 1 -- 172.21.15.46:0/2745103056 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50003bd0 con 0x7f6d581452d0 2024-02-19T06:58:53.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.447+0000 7f6d5ce00640 1 -- 172.21.15.46:0/2745103056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5815c1d0 con 0x7f6d581452d0 2024-02-19T06:58:53.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.448+0000 7f6d5ce00640 1 -- 172.21.15.46:0/2745103056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5815d280 con 0x7f6d581452d0 2024-02-19T06:58:53.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.449+0000 7f6d4e000640 1 -- 172.21.15.46:0/2745103056 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6d50003d30 con 0x7f6d581452d0 2024-02-19T06:58:53.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.451+0000 7f6d4e000640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f6d3406b810 0x7f6d3406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:53.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.451+0000 7f6d4e000640 1 -- 172.21.15.46:0/2745103056 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6d5008a8e0 con 0x7f6d581452d0 2024-02-19T06:58:53.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.451+0000 7f6d55e00640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f6d3406b810 0x7f6d3406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:53.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.452+0000 7f6d55e00640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f6d3406b810 0x7f6d3406dcd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d480015e0 tx=0x7f6d48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:53.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.455+0000 7f6d4e000640 1 -- 172.21.15.46:0/2745103056 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6d5815d280 con 0x7f6d581452d0 2024-02-19T06:58:53.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.666+0000 7f6d5ce00640 1 -- 172.21.15.46:0/2745103056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6d5815d280 con 0x7f6d581452d0 2024-02-19T06:58:53.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.666+0000 7f6d4e000640 1 -- 172.21.15.46:0/2745103056 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6d5815d280 con 0x7f6d581452d0 2024-02-19T06:58:53.668 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-02-19T06:58:53.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.669+0000 7f6d5ce00640 1 -- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f6d3406b810 msgr2=0x7f6d3406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:53.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.669+0000 7f6d5ce00640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f6d3406b810 0x7f6d3406dcd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d480015e0 tx=0x7f6d48009040 comp rx=0 tx=0).stop 2024-02-19T06:58:53.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.669+0000 7f6d5ce00640 1 -- 172.21.15.46:0/2745103056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d581452d0 msgr2=0x7f6d5815ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:53.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.669+0000 7f6d5ce00640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d581452d0 0x7f6d5815ae30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000efc0 tx=0x7f6d5000c490 comp rx=0 tx=0).stop 2024-02-19T06:58:53.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.669+0000 7f6d5ce00640 1 -- 172.21.15.46:0/2745103056 shutdown_connections 2024-02-19T06:58:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.669+0000 7f6d5ce00640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f6d3406b810 0x7f6d3406dcd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.669+0000 7f6d5ce00640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d581452d0 0x7f6d5815ae30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.669+0000 7f6d5ce00640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d580cf890 0x7f6d581f6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.669+0000 7f6d5ce00640 1 --2- 172.21.15.46:0/2745103056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d5806ea20 0x7f6d5815bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.669+0000 7f6d5ce00640 1 -- 172.21.15.46:0/2745103056 >> 172.21.15.46:0/2745103056 conn(0x7f6d58066f70 msgr2=0x7f6d580b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.670+0000 7f6d5ce00640 1 -- 172.21.15.46:0/2745103056 shutdown_connections 2024-02-19T06:58:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:53.670+0000 7f6d5ce00640 1 -- 172.21.15.46:0/2745103056 wait complete. 2024-02-19T06:58:53.691 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2024-02-19T06:58:53.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:53.691 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-02-19T06:58:53.789 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T06:58:53.790 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T06:58:53.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:53.790 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-02-19T06:58:53.845 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:58:53.845 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T06:58:53.904 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:58:53.904 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T06:58:53.952 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.187+0000 7fcf31600640 1 Processor -- start 2024-02-19T06:58:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.187+0000 7fcf31600640 1 -- start start 2024-02-19T06:58:54.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.188+0000 7fcf31600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcf2c071000 0x7fcf2c0714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.189+0000 7fcf31600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2c06d390 con 0x7fcf2c0b3dd0 2024-02-19T06:58:54.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.189+0000 7fcf31600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2c06d670 con 0x7fcf2c1506a0 2024-02-19T06:58:54.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.189+0000 7fcf31600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2c0719f0 con 0x7fcf2c071000 2024-02-19T06:58:54.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.189+0000 7fcf2aa00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcf2c0b3dd0 0x7fcf2c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46112/0 (socket says 172.21.15.46:46112) 2024-02-19T06:58:54.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.189+0000 7fcf2aa00640 1 -- 172.21.15.46:0/2975621019 learned_addr learned my addr 172.21.15.46:0/2975621019 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:54.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.189+0000 7fcf22000640 1 --2- 172.21.15.46:0/2975621019 >> v2:172.21.15.142:3300/0 conn(0x7fcf2c071000 0x7fcf2c0714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.189+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191673541 0 0) 0x7fcf2c06d390 con 0x7fcf2c0b3dd0 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf10003520 con 0x7fcf2c0b3dd0 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1730613418 0 0) 0x7fcf10003520 con 0x7fcf2c0b3dd0 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 >> v2:172.21.15.142:3300/0 conn(0x7fcf2c071000 msgr2=0x7fcf2c0714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 --2- 172.21.15.46:0/2975621019 >> v2:172.21.15.142:3300/0 conn(0x7fcf2c071000 0x7fcf2c0714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 >> v1:172.21.15.142:6789/0 conn(0x7fcf2c1506a0 legacy=0x7fcf2c150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c06d950 con 0x7fcf2c0b3dd0 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fcf1c001670 con 0x7fcf2c0b3dd0 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 >> v1:172.21.15.46:6789/0 conn(0x7fcf2c0b3dd0 legacy=0x7fcf2c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 --2- 172.21.15.46:0/2975621019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf100039c0 0x7fcf10003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 --2- 172.21.15.46:0/2975621019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf100047c0 0x7fcf10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 --2- 172.21.15.46:0/2975621019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf10005180 0x7fcf1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0719f0 con 0x7fcf100039c0 2024-02-19T06:58:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1000c080 con 0x7fcf10005180 2024-02-19T06:58:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1000c240 con 0x7fcf100047c0 2024-02-19T06:58:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.190+0000 7fcf2aa00640 1 --2- 172.21.15.46:0/2975621019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf100039c0 0x7fcf10003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.191+0000 7fcf2b400640 1 --2- 172.21.15.46:0/2975621019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf10005180 0x7fcf1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.191+0000 7fcf2aa00640 1 -- 172.21.15.46:0/2975621019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf100047c0 msgr2=0x7fcf10004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.191+0000 7fcf2aa00640 1 --2- 172.21.15.46:0/2975621019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf100047c0 0x7fcf10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.191+0000 7fcf2aa00640 1 -- 172.21.15.46:0/2975621019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf10005180 msgr2=0x7fcf1000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.191+0000 7fcf2aa00640 1 --2- 172.21.15.46:0/2975621019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf10005180 0x7fcf1000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.191+0000 7fcf2aa00640 1 -- 172.21.15.46:0/2975621019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10003520 con 0x7fcf100039c0 2024-02-19T06:58:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.191+0000 7fcf2b400640 1 --2- 172.21.15.46:0/2975621019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf10005180 0x7fcf1000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.191+0000 7fcf2b400640 1 -- 172.21.15.46:0/2975621019 reap_dead start 2024-02-19T06:58:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.192+0000 7fcf2aa00640 1 --2- 172.21.15.46:0/2975621019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf100039c0 0x7fcf10003de0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c0e0 tx=0x7fcf100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8fd67dba58e9a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.192+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c005ad0 con 0x7fcf100039c0 2024-02-19T06:58:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.192+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c005c50 con 0x7fcf100039c0 2024-02-19T06:58:54.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.192+0000 7fcf2a000640 1 -- 172.21.15.46:0/2975621019 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c02c810 con 0x7fcf100039c0 2024-02-19T06:58:54.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.193+0000 7fcf31600640 1 -- 172.21.15.46:0/2975621019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf100039c0 msgr2=0x7fcf10003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:54.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.193+0000 7fcf31600640 1 --2- 172.21.15.46:0/2975621019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf100039c0 0x7fcf10003de0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c0e0 tx=0x7fcf100057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.193+0000 7fcf31600640 1 -- 172.21.15.46:0/2975621019 shutdown_connections 2024-02-19T06:58:54.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.193+0000 7fcf31600640 1 --2- 172.21.15.46:0/2975621019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf100039c0 0x7fcf10003de0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.193+0000 7fcf31600640 1 -- 172.21.15.46:0/2975621019 >> 172.21.15.46:0/2975621019 conn(0x7fcf2c066f70 msgr2=0x7fcf2c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:54.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.193+0000 7fcf31600640 1 -- 172.21.15.46:0/2975621019 shutdown_connections 2024-02-19T06:58:54.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.193+0000 7fcf31600640 1 -- 172.21.15.46:0/2975621019 wait complete. 2024-02-19T06:58:54.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.195+0000 7fcf31600640 1 Processor -- start 2024-02-19T06:58:54.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.196+0000 7fcf31600640 1 -- start start 2024-02-19T06:58:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.197+0000 7fcf31600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf100039c0 0x7fcf2c14b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.197+0000 7fcf31600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf2c148850 0x7fcf2c0aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.197+0000 7fcf31600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2c1e4e20 0x7fcf2c1e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.197+0000 7fcf31600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c14cc60 con 0x7fcf100039c0 2024-02-19T06:58:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.197+0000 7fcf31600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c1e57e0 con 0x7fcf2c148850 2024-02-19T06:58:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.197+0000 7fcf31600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c14bbc0 con 0x7fcf2c1e4e20 2024-02-19T06:58:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.197+0000 7fcf2aa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf100039c0 0x7fcf2c14b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.197+0000 7fcf2aa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf100039c0 0x7fcf2c14b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45486/0 (socket says 172.21.15.46:45486) 2024-02-19T06:58:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.197+0000 7fcf2aa00640 1 -- 172.21.15.46:0/1031113304 learned_addr learned my addr 172.21.15.46:0/1031113304 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.197+0000 7fcf22000640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf2c148850 0x7fcf2c0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.197+0000 7fcf2b400640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2c1e4e20 0x7fcf2c1e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.197+0000 7fcf2aa00640 1 -- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2c1e4e20 msgr2=0x7fcf2c1e52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:54.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.197+0000 7fcf2aa00640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2c1e4e20 0x7fcf2c1e52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.198+0000 7fcf2aa00640 1 -- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf2c148850 msgr2=0x7fcf2c0aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:54.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.198+0000 7fcf2aa00640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf2c148850 0x7fcf2c0aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.198+0000 7fcf2aa00640 1 -- 172.21.15.46:0/1031113304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c14bea0 con 0x7fcf100039c0 2024-02-19T06:58:54.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.198+0000 7fcf2aa00640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf100039c0 0x7fcf2c14b5e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c000c00 tx=0x7fcf1c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:54.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.199+0000 7fcf23400640 1 -- 172.21.15.46:0/1031113304 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c03c040 con 0x7fcf100039c0 2024-02-19T06:58:54.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.199+0000 7fcf23400640 1 -- 172.21.15.46:0/1031113304 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c02cce0 con 0x7fcf100039c0 2024-02-19T06:58:54.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.199+0000 7fcf23400640 1 -- 172.21.15.46:0/1031113304 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c007290 con 0x7fcf100039c0 2024-02-19T06:58:54.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.199+0000 7fcf31600640 1 -- 172.21.15.46:0/1031113304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c14c180 con 0x7fcf100039c0 2024-02-19T06:58:54.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.199+0000 7fcf31600640 1 -- 172.21.15.46:0/1031113304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c14c740 con 0x7fcf100039c0 2024-02-19T06:58:54.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.201+0000 7fcf31600640 1 -- 172.21.15.46:0/1031113304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c14c8d0 con 0x7fcf100039c0 2024-02-19T06:58:54.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.202+0000 7fcf23400640 1 -- 172.21.15.46:0/1031113304 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcf1c032070 con 0x7fcf100039c0 2024-02-19T06:58:54.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.203+0000 7fcf23400640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcf0806b840 0x7fcf0806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.203+0000 7fcf23400640 1 -- 172.21.15.46:0/1031113304 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcf1c0ab510 con 0x7fcf100039c0 2024-02-19T06:58:54.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.204+0000 7fcf22000640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcf0806b840 0x7fcf0806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.205+0000 7fcf22000640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcf0806b840 0x7fcf0806dd00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c14f180 tx=0x7fcf14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:54.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.208+0000 7fcf23400640 1 -- 172.21.15.46:0/1031113304 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf1c075f60 con 0x7fcf100039c0 2024-02-19T06:58:54.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.408+0000 7fcf31600640 1 -- 172.21.15.46:0/1031113304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf2c067ba0 con 0x7fcf100039c0 2024-02-19T06:58:54.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.411+0000 7fcf23400640 1 -- 172.21.15.46:0/1031113304 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16855 (secure 0 0 0) 0x7fcf1c079620 con 0x7fcf100039c0 2024-02-19T06:58:54.412 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:54.413 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:58:37.086581+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.413+0000 7fcf31600640 1 -- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcf0806b840 msgr2=0x7fcf0806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.413+0000 7fcf31600640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcf0806b840 0x7fcf0806dd00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c14f180 tx=0x7fcf14008040 comp rx=0 tx=0).stop 2024-02-19T06:58:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.413+0000 7fcf31600640 1 -- 172.21.15.46:0/1031113304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf100039c0 msgr2=0x7fcf2c14b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.413+0000 7fcf31600640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf100039c0 0x7fcf2c14b5e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c000c00 tx=0x7fcf1c02e070 comp rx=0 tx=0).stop 2024-02-19T06:58:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.414+0000 7fcf31600640 1 -- 172.21.15.46:0/1031113304 shutdown_connections 2024-02-19T06:58:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.414+0000 7fcf31600640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcf0806b840 0x7fcf0806dd00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.414+0000 7fcf31600640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2c1e4e20 0x7fcf2c1e52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.414+0000 7fcf31600640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf2c148850 0x7fcf2c0aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.414+0000 7fcf31600640 1 --2- 172.21.15.46:0/1031113304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf100039c0 0x7fcf2c14b5e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.414+0000 7fcf31600640 1 -- 172.21.15.46:0/1031113304 >> 172.21.15.46:0/1031113304 conn(0x7fcf2c066f70 msgr2=0x7fcf2c0ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:54.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.414+0000 7fcf31600640 1 -- 172.21.15.46:0/1031113304 shutdown_connections 2024-02-19T06:58:54.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.414+0000 7fcf31600640 1 -- 172.21.15.46:0/1031113304 wait complete. 2024-02-19T06:58:54.436 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:54.436 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:54.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.657+0000 7f132d600640 1 Processor -- start 2024-02-19T06:58:54.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.658+0000 7f132d600640 1 -- start start 2024-02-19T06:58:54.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.659+0000 7f132d600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1328161600 0x7f13280b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.659+0000 7f132d600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f13280b34f0 0x7f13280d4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.659+0000 7f132d600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13280d4660 con 0x7f132815dcb0 2024-02-19T06:58:54.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.659+0000 7f132d600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13280b3940 con 0x7f13280b34f0 2024-02-19T06:58:54.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.659+0000 7f132d600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13280b3bd0 con 0x7f1328161600 2024-02-19T06:58:54.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.659+0000 7f132cc00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f13280b34f0 0x7f13280d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:54.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.660+0000 7f132cc00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f13280b34f0 0x7f13280d4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45502/0 (socket says 172.21.15.46:45502) 2024-02-19T06:58:54.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.660+0000 7f132cc00640 1 -- 172.21.15.46:0/3425806739 learned_addr learned my addr 172.21.15.46:0/3425806739 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:54.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.660+0000 7f1327e00640 1 --2- 172.21.15.46:0/3425806739 >> v2:172.21.15.142:3300/0 conn(0x7f1328161600 0x7f13280b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:54.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.660+0000 7f132cc00640 1 -- 172.21.15.46:0/3425806739 >> v2:172.21.15.142:3300/0 conn(0x7f1328161600 msgr2=0x7f13280b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:54.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.660+0000 7f132cc00640 1 --2- 172.21.15.46:0/3425806739 >> v2:172.21.15.142:3300/0 conn(0x7f1328161600 0x7f13280b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.660+0000 7f132cc00640 1 -- 172.21.15.46:0/3425806739 >> v1:172.21.15.142:6789/0 conn(0x7f132815dcb0 legacy=0x7f13281619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:54.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.660+0000 7f132cc00640 1 -- 172.21.15.46:0/3425806739 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13280b3eb0 con 0x7f13280b34f0 2024-02-19T06:58:54.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.661+0000 7f132cc00640 1 --2- 172.21.15.46:0/3425806739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13280b34f0 0x7f13280d4120 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f132808b450 tx=0x7f132002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1950e39335d69ec2 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:54.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.661+0000 7f1326a00640 1 -- 172.21.15.46:0/3425806739 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320030860 con 0x7f13280b34f0 2024-02-19T06:58:54.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.661+0000 7f1326a00640 1 -- 172.21.15.46:0/3425806739 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13200309c0 con 0x7f13280b34f0 2024-02-19T06:58:54.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.661+0000 7f1326a00640 1 -- 172.21.15.46:0/3425806739 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320030d50 con 0x7f13280b34f0 2024-02-19T06:58:54.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.662+0000 7f132d600640 1 -- 172.21.15.46:0/3425806739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13280b34f0 msgr2=0x7f13280d4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:54.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.662+0000 7f132d600640 1 --2- 172.21.15.46:0/3425806739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13280b34f0 0x7f13280d4120 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f132808b450 tx=0x7f132002b9a0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.662+0000 7f132d600640 1 -- 172.21.15.46:0/3425806739 shutdown_connections 2024-02-19T06:58:54.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.662+0000 7f132d600640 1 --2- 172.21.15.46:0/3425806739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13280b34f0 0x7f13280d4120 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.662+0000 7f132d600640 1 --2- 172.21.15.46:0/3425806739 >> v2:172.21.15.142:3300/0 conn(0x7f1328161600 0x7f13280b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.662+0000 7f132d600640 1 -- 172.21.15.46:0/3425806739 >> 172.21.15.46:0/3425806739 conn(0x7f132808afc0 msgr2=0x7f13280d36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:54.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.662+0000 7f132d600640 1 -- 172.21.15.46:0/3425806739 shutdown_connections 2024-02-19T06:58:54.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.662+0000 7f132d600640 1 -- 172.21.15.46:0/3425806739 wait complete. 2024-02-19T06:58:54.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.664+0000 7f132d600640 1 Processor -- start 2024-02-19T06:58:54.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.664+0000 7f132d600640 1 -- start start 2024-02-19T06:58:54.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.665+0000 7f132d600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13280b34f0 0x7f13280cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.665+0000 7f132d600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132815dcb0 0x7f1328152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.665+0000 7f132d600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1328161600 0x7f13281f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.665+0000 7f132d600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13280b6300 con 0x7f132815dcb0 2024-02-19T06:58:54.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.665+0000 7f132d600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13280ccc80 con 0x7f13280b34f0 2024-02-19T06:58:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.665+0000 7f132d600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13280b6550 con 0x7f1328161600 2024-02-19T06:58:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.665+0000 7f1327400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132815dcb0 0x7f1328152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.665+0000 7f1327400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132815dcb0 0x7f1328152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45510/0 (socket says 172.21.15.46:45510) 2024-02-19T06:58:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.665+0000 7f1327400640 1 -- 172.21.15.46:0/1621712071 learned_addr learned my addr 172.21.15.46:0/1621712071 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.666+0000 7f1327e00640 1 --2- 172.21.15.46:0/1621712071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13280b34f0 0x7f13280cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.666+0000 7f1327400640 1 -- 172.21.15.46:0/1621712071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1328161600 msgr2=0x7f13281f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.666+0000 7f1327400640 1 --2- 172.21.15.46:0/1621712071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1328161600 0x7f13281f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.666+0000 7f1327400640 1 -- 172.21.15.46:0/1621712071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13280b34f0 msgr2=0x7f13280cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.666+0000 7f1327400640 1 --2- 172.21.15.46:0/1621712071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13280b34f0 0x7f13280cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.666+0000 7f1327400640 1 -- 172.21.15.46:0/1621712071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13200094d0 con 0x7f132815dcb0 2024-02-19T06:58:54.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.666+0000 7f1327400640 1 --2- 172.21.15.46:0/1621712071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132815dcb0 0x7f1328152720 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f131400c400 tx=0x7f131400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:54.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.666+0000 7f131fe00640 1 -- 172.21.15.46:0/1621712071 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140052d0 con 0x7f132815dcb0 2024-02-19T06:58:54.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.667+0000 7f131fe00640 1 -- 172.21.15.46:0/1621712071 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1314005470 con 0x7f132815dcb0 2024-02-19T06:58:54.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.667+0000 7f131fe00640 1 -- 172.21.15.46:0/1621712071 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314006a60 con 0x7f132815dcb0 2024-02-19T06:58:54.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.667+0000 7f132d600640 1 -- 172.21.15.46:0/1621712071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13280b6830 con 0x7f132815dcb0 2024-02-19T06:58:54.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.667+0000 7f132d600640 1 -- 172.21.15.46:0/1621712071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1328152c60 con 0x7f132815dcb0 2024-02-19T06:58:54.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.668+0000 7f132d600640 1 -- 172.21.15.46:0/1621712071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13280b6d50 con 0x7f132815dcb0 2024-02-19T06:58:54.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.669+0000 7f131fe00640 1 -- 172.21.15.46:0/1621712071 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1314006bc0 con 0x7f132815dcb0 2024-02-19T06:58:54.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.670+0000 7f131fe00640 1 --2- 172.21.15.46:0/1621712071 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f130806b810 0x7f130806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:54.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.670+0000 7f131fe00640 1 -- 172.21.15.46:0/1621712071 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1314089660 con 0x7f132815dcb0 2024-02-19T06:58:54.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.671+0000 7f1327e00640 1 --2- 172.21.15.46:0/1621712071 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f130806b810 0x7f130806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:54.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.672+0000 7f1327e00640 1 --2- 172.21.15.46:0/1621712071 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f130806b810 0x7f130806dcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1318007440 tx=0x7f131800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:54.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.677+0000 7f131fe00640 1 -- 172.21.15.46:0/1621712071 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f13280b6d50 con 0x7f132815dcb0 2024-02-19T06:58:54.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.877+0000 7f132d600640 1 -- 172.21.15.46:0/1621712071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13280b6d50 con 0x7f132815dcb0 2024-02-19T06:58:54.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.878+0000 7f131fe00640 1 -- 172.21.15.46:0/1621712071 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13280b6d50 con 0x7f132815dcb0 2024-02-19T06:58:54.879 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:54.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.881+0000 7f132d600640 1 -- 172.21.15.46:0/1621712071 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f130806b810 msgr2=0x7f130806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.881+0000 7f132d600640 1 --2- 172.21.15.46:0/1621712071 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f130806b810 0x7f130806dcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1318007440 tx=0x7f131800b040 comp rx=0 tx=0).stop 2024-02-19T06:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.881+0000 7f132d600640 1 -- 172.21.15.46:0/1621712071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132815dcb0 msgr2=0x7f1328152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.881+0000 7f132d600640 1 --2- 172.21.15.46:0/1621712071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132815dcb0 0x7f1328152720 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f131400c400 tx=0x7f131400c8c0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.881+0000 7f132d600640 1 -- 172.21.15.46:0/1621712071 shutdown_connections 2024-02-19T06:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.881+0000 7f132d600640 1 --2- 172.21.15.46:0/1621712071 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f130806b810 0x7f130806dcd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.881+0000 7f132d600640 1 --2- 172.21.15.46:0/1621712071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1328161600 0x7f13281f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.881+0000 7f132d600640 1 --2- 172.21.15.46:0/1621712071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132815dcb0 0x7f1328152720 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.881+0000 7f132d600640 1 --2- 172.21.15.46:0/1621712071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13280b34f0 0x7f13280cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:54.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.881+0000 7f132d600640 1 -- 172.21.15.46:0/1621712071 >> 172.21.15.46:0/1621712071 conn(0x7f132808afc0 msgr2=0x7f13280d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:54.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.881+0000 7f132d600640 1 -- 172.21.15.46:0/1621712071 shutdown_connections 2024-02-19T06:58:54.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:54.881+0000 7f132d600640 1 -- 172.21.15.46:0/1621712071 wait complete. 2024-02-19T06:58:54.902 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:55.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.122+0000 7f66ba200640 1 Processor -- start 2024-02-19T06:58:55.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.122+0000 7f66ba200640 1 -- start start 2024-02-19T06:58:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.124+0000 7f66ba200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f66b4145050 0x7f66b40cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.124+0000 7f66ba200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b4071e80 con 0x7f66b40ccce0 2024-02-19T06:58:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.124+0000 7f66ba200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b4071020 con 0x7f66b40cfae0 2024-02-19T06:58:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.124+0000 7f66ba200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b40aef70 con 0x7f66b4145050 2024-02-19T06:58:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.124+0000 7f66b3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f66b4145050 0x7f66b40cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.124+0000 7f66b3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f66b4145050 0x7f66b40cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45514/0 (socket says 172.21.15.46:45514) 2024-02-19T06:58:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.124+0000 7f66abe00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f66b40ccce0 0x7f66b40cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46124/0 (socket says 172.21.15.46:46124) 2024-02-19T06:58:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.125+0000 7f66b3400640 1 -- 172.21.15.46:0/1452582996 learned_addr learned my addr 172.21.15.46:0/1452582996 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:55.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.125+0000 7f66b3400640 1 -- 172.21.15.46:0/1452582996 >> v1:172.21.15.142:6789/0 conn(0x7f66b40cfae0 legacy=0x7f66b406d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:55.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.125+0000 7f66b3400640 1 -- 172.21.15.46:0/1452582996 >> v1:172.21.15.46:6789/0 conn(0x7f66b40ccce0 legacy=0x7f66b40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:55.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.125+0000 7f66b3400640 1 -- 172.21.15.46:0/1452582996 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b4071270 con 0x7f66b4145050 2024-02-19T06:58:55.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.126+0000 7f66b3400640 1 --2- 172.21.15.46:0/1452582996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b4145050 0x7f66b40cc7a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009870 tx=0x7f66a402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20af59bb2d9b45e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:55.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.126+0000 7f66b2a00640 1 -- 172.21.15.46:0/1452582996 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4030860 con 0x7f66b4145050 2024-02-19T06:58:55.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.127+0000 7f66b2a00640 1 -- 172.21.15.46:0/1452582996 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a40309c0 con 0x7f66b4145050 2024-02-19T06:58:55.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.127+0000 7f66b2a00640 1 -- 172.21.15.46:0/1452582996 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4030d50 con 0x7f66b4145050 2024-02-19T06:58:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.127+0000 7f66ba200640 1 -- 172.21.15.46:0/1452582996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b4145050 msgr2=0x7f66b40cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.127+0000 7f66ba200640 1 --2- 172.21.15.46:0/1452582996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b4145050 0x7f66b40cc7a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009870 tx=0x7f66a402b9a0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.127+0000 7f66ba200640 1 -- 172.21.15.46:0/1452582996 shutdown_connections 2024-02-19T06:58:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.127+0000 7f66ba200640 1 --2- 172.21.15.46:0/1452582996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b4145050 0x7f66b40cc7a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.127+0000 7f66ba200640 1 -- 172.21.15.46:0/1452582996 >> 172.21.15.46:0/1452582996 conn(0x7f66b4066fc0 msgr2=0x7f66b406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.127+0000 7f66ba200640 1 -- 172.21.15.46:0/1452582996 shutdown_connections 2024-02-19T06:58:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.127+0000 7f66ba200640 1 -- 172.21.15.46:0/1452582996 wait complete. 2024-02-19T06:58:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.129+0000 7f66ba200640 1 Processor -- start 2024-02-19T06:58:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.129+0000 7f66ba200640 1 -- start start 2024-02-19T06:58:55.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.130+0000 7f66ba200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b40ccce0 0x7f66b413dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.130+0000 7f66ba200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b40cfae0 0x7f66b41f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.130+0000 7f66ba200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b4145050 0x7f66b413fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.130+0000 7f66ba200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b41f2380 con 0x7f66b40cfae0 2024-02-19T06:58:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.131+0000 7f66ba200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b41f2650 con 0x7f66b40ccce0 2024-02-19T06:58:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.131+0000 7f66ba200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b41f2930 con 0x7f66b4145050 2024-02-19T06:58:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.131+0000 7f66abe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b40cfae0 0x7f66b41f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.131+0000 7f66abe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b40cfae0 0x7f66b41f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45522/0 (socket says 172.21.15.46:45522) 2024-02-19T06:58:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.131+0000 7f66abe00640 1 -- 172.21.15.46:0/2472942190 learned_addr learned my addr 172.21.15.46:0/2472942190 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.131+0000 7f66b3400640 1 --2- 172.21.15.46:0/2472942190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b40ccce0 0x7f66b413dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.131+0000 7f66abe00640 1 -- 172.21.15.46:0/2472942190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b4145050 msgr2=0x7f66b413fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.131+0000 7f66abe00640 1 --2- 172.21.15.46:0/2472942190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b4145050 0x7f66b413fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.131+0000 7f66abe00640 1 -- 172.21.15.46:0/2472942190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b40ccce0 msgr2=0x7f66b413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:55.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.131+0000 7f66abe00640 1 --2- 172.21.15.46:0/2472942190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b40ccce0 0x7f66b413dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.131+0000 7f66abe00640 1 -- 172.21.15.46:0/2472942190 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a40094d0 con 0x7f66b40cfae0 2024-02-19T06:58:55.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.132+0000 7f66abe00640 1 --2- 172.21.15.46:0/2472942190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b40cfae0 0x7f66b41f1e40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f669c00c400 tx=0x7f669c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:55.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.132+0000 7f66ab400640 1 -- 172.21.15.46:0/2472942190 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c0074e0 con 0x7f66b40cfae0 2024-02-19T06:58:55.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.132+0000 7f66ab400640 1 -- 172.21.15.46:0/2472942190 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c007640 con 0x7f66b40cfae0 2024-02-19T06:58:55.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.132+0000 7f66ab400640 1 -- 172.21.15.46:0/2472942190 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c004a00 con 0x7f66b40cfae0 2024-02-19T06:58:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.132+0000 7f66ba200640 1 -- 172.21.15.46:0/2472942190 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b41f2c10 con 0x7f66b40cfae0 2024-02-19T06:58:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.132+0000 7f66ba200640 1 -- 172.21.15.46:0/2472942190 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b41f31d0 con 0x7f66b40cfae0 2024-02-19T06:58:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.133+0000 7f66ba200640 1 -- 172.21.15.46:0/2472942190 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b4067ba0 con 0x7f66b40cfae0 2024-02-19T06:58:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.134+0000 7f66ab400640 1 -- 172.21.15.46:0/2472942190 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f669c004b60 con 0x7f66b40cfae0 2024-02-19T06:58:55.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.135+0000 7f66ab400640 1 --2- 172.21.15.46:0/2472942190 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f669006b810 0x7f669006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:55.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.135+0000 7f66ab400640 1 -- 172.21.15.46:0/2472942190 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f669c089d20 con 0x7f66b40cfae0 2024-02-19T06:58:55.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.136+0000 7f66b3400640 1 --2- 172.21.15.46:0/2472942190 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f669006b810 0x7f669006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:55.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.137+0000 7f66b3400640 1 --2- 172.21.15.46:0/2472942190 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f669006b810 0x7f669006dcd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f66a4036000 tx=0x7f66a403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:55.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.140+0000 7f66ab400640 1 -- 172.21.15.46:0/2472942190 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f669c0546d0 con 0x7f66b40cfae0 2024-02-19T06:58:55.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.343+0000 7f66ba200640 1 -- 172.21.15.46:0/2472942190 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f66b40ae8b0 con 0x7f66b40cfae0 2024-02-19T06:58:55.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.344+0000 7f66ab400640 1 -- 172.21.15.46:0/2472942190 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f669c057d90 con 0x7f66b40cfae0 2024-02-19T06:58:55.346 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:55.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.346+0000 7f66ba200640 1 -- 172.21.15.46:0/2472942190 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f669006b810 msgr2=0x7f669006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:55.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.346+0000 7f66ba200640 1 --2- 172.21.15.46:0/2472942190 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f669006b810 0x7f669006dcd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f66a4036000 tx=0x7f66a403b040 comp rx=0 tx=0).stop 2024-02-19T06:58:55.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.346+0000 7f66ba200640 1 -- 172.21.15.46:0/2472942190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b40cfae0 msgr2=0x7f66b41f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:55.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.346+0000 7f66ba200640 1 --2- 172.21.15.46:0/2472942190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b40cfae0 0x7f66b41f1e40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f669c00c400 tx=0x7f669c00c8c0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.347+0000 7f66ba200640 1 -- 172.21.15.46:0/2472942190 shutdown_connections 2024-02-19T06:58:55.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.347+0000 7f66ba200640 1 --2- 172.21.15.46:0/2472942190 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f669006b810 0x7f669006dcd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.347+0000 7f66ba200640 1 --2- 172.21.15.46:0/2472942190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66b4145050 0x7f66b413fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.347+0000 7f66ba200640 1 --2- 172.21.15.46:0/2472942190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66b40cfae0 0x7f66b41f1e40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.347+0000 7f66ba200640 1 --2- 172.21.15.46:0/2472942190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66b40ccce0 0x7f66b413dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.347+0000 7f66ba200640 1 -- 172.21.15.46:0/2472942190 >> 172.21.15.46:0/2472942190 conn(0x7f66b4066fc0 msgr2=0x7f66b406d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:55.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.347+0000 7f66ba200640 1 -- 172.21.15.46:0/2472942190 shutdown_connections 2024-02-19T06:58:55.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.347+0000 7f66ba200640 1 -- 172.21.15.46:0/2472942190 wait complete. 2024-02-19T06:58:55.368 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:55.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.594+0000 7fa93d400640 1 Processor -- start 2024-02-19T06:58:55.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.594+0000 7fa93d400640 1 -- start start 2024-02-19T06:58:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.596+0000 7fa93d400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9380c22e0 0x7fa9380c2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.596+0000 7fa93d400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa9380cd340 0x7fa9380cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.596+0000 7fa93d400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93806cef0 con 0x7fa938161c20 2024-02-19T06:58:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.596+0000 7fa93d400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93806dd50 con 0x7fa9380cd340 2024-02-19T06:58:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.596+0000 7fa93d400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9380c2c60 con 0x7fa9380c22e0 2024-02-19T06:58:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.596+0000 7fa937e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa938161c20 0x7fa9380b2bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48380/0 (socket says 172.21.15.46:48380) 2024-02-19T06:58:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.596+0000 7fa937e00640 1 -- 172.21.15.46:0/4075401737 learned_addr learned my addr 172.21.15.46:0/4075401737 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:55.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.596+0000 7fa93ca00640 1 --2- 172.21.15.46:0/4075401737 >> v2:172.21.15.46:3300/0 conn(0x7fa9380cd340 0x7fa9380cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:55.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.597+0000 7fa92fe00640 1 --2- 172.21.15.46:0/4075401737 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9380c22e0 0x7fa9380c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:55.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.597+0000 7fa937400640 1 -- 172.21.15.46:0/4075401737 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199335530 0 0) 0x7fa93806cef0 con 0x7fa938161c20 2024-02-19T06:58:55.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.597+0000 7fa937400640 1 -- 172.21.15.46:0/4075401737 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa91c003520 con 0x7fa938161c20 2024-02-19T06:58:55.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.597+0000 7fa93ca00640 1 -- 172.21.15.46:0/4075401737 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9380c22e0 msgr2=0x7fa9380c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:55.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.597+0000 7fa93ca00640 1 --2- 172.21.15.46:0/4075401737 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9380c22e0 0x7fa9380c2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.597+0000 7fa93ca00640 1 -- 172.21.15.46:0/4075401737 >> v1:172.21.15.46:6789/0 conn(0x7fa938161c20 legacy=0x7fa9380b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:55.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.597+0000 7fa93ca00640 1 -- 172.21.15.46:0/4075401737 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9380cefd0 con 0x7fa9380cd340 2024-02-19T06:58:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.598+0000 7fa93ca00640 1 --2- 172.21.15.46:0/4075401737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9380cd340 0x7fa9380cd7d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa930009d90 tx=0x7fa93002bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e21dea64abb5941 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.599+0000 7fa937400640 1 -- 172.21.15.46:0/4075401737 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93002cce0 con 0x7fa9380cd340 2024-02-19T06:58:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.599+0000 7fa937400640 1 -- 172.21.15.46:0/4075401737 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93002ce40 con 0x7fa9380cd340 2024-02-19T06:58:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.599+0000 7fa937400640 1 -- 172.21.15.46:0/4075401737 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930034660 con 0x7fa9380cd340 2024-02-19T06:58:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.599+0000 7fa93d400640 1 -- 172.21.15.46:0/4075401737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9380cd340 msgr2=0x7fa9380cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.599+0000 7fa93d400640 1 --2- 172.21.15.46:0/4075401737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9380cd340 0x7fa9380cd7d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa930009d90 tx=0x7fa93002bf30 comp rx=0 tx=0).stop 2024-02-19T06:58:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.599+0000 7fa93d400640 1 -- 172.21.15.46:0/4075401737 shutdown_connections 2024-02-19T06:58:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.599+0000 7fa93d400640 1 --2- 172.21.15.46:0/4075401737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9380cd340 0x7fa9380cd7d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.599+0000 7fa93d400640 1 --2- 172.21.15.46:0/4075401737 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9380c22e0 0x7fa9380c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.599+0000 7fa93d400640 1 -- 172.21.15.46:0/4075401737 >> 172.21.15.46:0/4075401737 conn(0x7fa93806ad60 msgr2=0x7fa93806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.599+0000 7fa93d400640 1 -- 172.21.15.46:0/4075401737 shutdown_connections 2024-02-19T06:58:55.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.599+0000 7fa93d400640 1 -- 172.21.15.46:0/4075401737 wait complete. 2024-02-19T06:58:55.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.601+0000 7fa93d400640 1 Processor -- start 2024-02-19T06:58:55.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.601+0000 7fa93d400640 1 -- start start 2024-02-19T06:58:55.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.602+0000 7fa93d400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9380c22e0 0x7fa9381607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.602+0000 7fa93d400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9380cd340 0x7fa938071f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.602+0000 7fa93d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa938161c20 0x7fa938072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.602+0000 7fa93d400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa938160d10 con 0x7fa938161c20 2024-02-19T06:58:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.602+0000 7fa93d400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9380c7fc0 con 0x7fa9380c22e0 2024-02-19T06:58:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.602+0000 7fa93d400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9380c82a0 con 0x7fa9380cd340 2024-02-19T06:58:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.603+0000 7fa93ca00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa938161c20 0x7fa938072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.603+0000 7fa93ca00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa938161c20 0x7fa938072490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49868/0 (socket says 172.21.15.46:49868) 2024-02-19T06:58:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.603+0000 7fa93ca00640 1 -- 172.21.15.46:0/104952739 learned_addr learned my addr 172.21.15.46:0/104952739 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.603+0000 7fa92fe00640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9380cd340 0x7fa938071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.603+0000 7fa937e00640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9380c22e0 0x7fa9381607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.603+0000 7fa93ca00640 1 -- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9380cd340 msgr2=0x7fa938071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.603+0000 7fa93ca00640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9380cd340 0x7fa938071f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.603+0000 7fa93ca00640 1 -- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9380c22e0 msgr2=0x7fa9381607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:55.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.603+0000 7fa93ca00640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9380c22e0 0x7fa9381607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.603+0000 7fa93ca00640 1 -- 172.21.15.46:0/104952739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa930009a70 con 0x7fa938161c20 2024-02-19T06:58:55.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.603+0000 7fa92fe00640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9380cd340 0x7fa938071f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:55.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.604+0000 7fa93ca00640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa938161c20 0x7fa938072490 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa930009d90 tx=0x7fa930004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:55.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.604+0000 7fa934c00640 1 -- 172.21.15.46:0/104952739 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93003e670 con 0x7fa938161c20 2024-02-19T06:58:55.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.604+0000 7fa934c00640 1 -- 172.21.15.46:0/104952739 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93003e7f0 con 0x7fa938161c20 2024-02-19T06:58:55.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.604+0000 7fa93d400640 1 -- 172.21.15.46:0/104952739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9380c8580 con 0x7fa938161c20 2024-02-19T06:58:55.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.604+0000 7fa934c00640 1 -- 172.21.15.46:0/104952739 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93003eba0 con 0x7fa938161c20 2024-02-19T06:58:55.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.604+0000 7fa93d400640 1 -- 172.21.15.46:0/104952739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9380c8b40 con 0x7fa938161c20 2024-02-19T06:58:55.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.605+0000 7fa93d400640 1 -- 172.21.15.46:0/104952739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa93804eee0 con 0x7fa938161c20 2024-02-19T06:58:55.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.606+0000 7fa934c00640 1 -- 172.21.15.46:0/104952739 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa93003b040 con 0x7fa938161c20 2024-02-19T06:58:55.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.607+0000 7fa934c00640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa91406b810 0x7fa91406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:55.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.607+0000 7fa934c00640 1 -- 172.21.15.46:0/104952739 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa9300acbb0 con 0x7fa938161c20 2024-02-19T06:58:55.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.608+0000 7fa937e00640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa91406b810 0x7fa91406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:55.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.609+0000 7fa937e00640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa91406b810 0x7fa91406dcd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa928007fd0 tx=0x7fa928009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:55.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.612+0000 7fa934c00640 1 -- 172.21.15.46:0/104952739 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa930077540 con 0x7fa938161c20 2024-02-19T06:58:55.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.812+0000 7fa93d400640 1 -- 172.21.15.46:0/104952739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9380ceb70 con 0x7fa938161c20 2024-02-19T06:58:55.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.813+0000 7fa934c00640 1 -- 172.21.15.46:0/104952739 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa93004f0a0 con 0x7fa938161c20 2024-02-19T06:58:55.816 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:55.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.816+0000 7fa93d400640 1 -- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa91406b810 msgr2=0x7fa91406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:55.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.816+0000 7fa93d400640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa91406b810 0x7fa91406dcd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa928007fd0 tx=0x7fa928009040 comp rx=0 tx=0).stop 2024-02-19T06:58:55.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.816+0000 7fa93d400640 1 -- 172.21.15.46:0/104952739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa938161c20 msgr2=0x7fa938072490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:55.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.816+0000 7fa93d400640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa938161c20 0x7fa938072490 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa930009d90 tx=0x7fa930004a40 comp rx=0 tx=0).stop 2024-02-19T06:58:55.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.816+0000 7fa93d400640 1 -- 172.21.15.46:0/104952739 shutdown_connections 2024-02-19T06:58:55.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.816+0000 7fa93d400640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa91406b810 0x7fa91406dcd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.816+0000 7fa93d400640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa938161c20 0x7fa938072490 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.816+0000 7fa93d400640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9380cd340 0x7fa938071f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.816+0000 7fa93d400640 1 --2- 172.21.15.46:0/104952739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9380c22e0 0x7fa9381607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:55.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.816+0000 7fa93d400640 1 -- 172.21.15.46:0/104952739 >> 172.21.15.46:0/104952739 conn(0x7fa93806ad60 msgr2=0x7fa9380af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:55.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.816+0000 7fa93d400640 1 -- 172.21.15.46:0/104952739 shutdown_connections 2024-02-19T06:58:55.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:55.816+0000 7fa93d400640 1 -- 172.21.15.46:0/104952739 wait complete. 2024-02-19T06:58:55.838 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-19T06:58:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.063+0000 7f255fe00640 1 Processor -- start 2024-02-19T06:58:56.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.063+0000 7f255fe00640 1 -- start start 2024-02-19T06:58:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.064+0000 7f255fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f256015dc20 0x7f256006c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.064+0000 7f255fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f256006c9b0 0x7f25600d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.064+0000 7f255fe00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2560161f20 con 0x7f256015d840 2024-02-19T06:58:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.064+0000 7f255fe00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25601624a0 con 0x7f256015dc20 2024-02-19T06:58:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.064+0000 7f255fe00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25600ce280 con 0x7f256006c9b0 2024-02-19T06:58:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.065+0000 7f2556000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f256015dc20 0x7f256006c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.065+0000 7f2556000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f256015dc20 0x7f256006c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49872/0 (socket says 172.21.15.46:49872) 2024-02-19T06:58:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.065+0000 7f2556000640 1 -- 172.21.15.46:0/2300895902 learned_addr learned my addr 172.21.15.46:0/2300895902 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:56.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.065+0000 7f255f400640 1 --2- 172.21.15.46:0/2300895902 >> v2:172.21.15.142:3300/0 conn(0x7f256006c9b0 0x7f25600d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.065+0000 7f2556000640 1 -- 172.21.15.46:0/2300895902 >> v2:172.21.15.142:3300/0 conn(0x7f256006c9b0 msgr2=0x7f25600d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.065+0000 7f2556000640 1 --2- 172.21.15.46:0/2300895902 >> v2:172.21.15.142:3300/0 conn(0x7f256006c9b0 0x7f25600d1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.065+0000 7f2556000640 1 -- 172.21.15.46:0/2300895902 >> v1:172.21.15.142:6789/0 conn(0x7f256015d840 legacy=0x7f2560161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:56.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.065+0000 7f2556000640 1 -- 172.21.15.46:0/2300895902 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600ce520 con 0x7f256015dc20 2024-02-19T06:58:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.066+0000 7f2556000640 1 --2- 172.21.15.46:0/2300895902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f256015dc20 0x7f256006c470 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2548009870 tx=0x7f254802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292f6b93abc240ae server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.066+0000 7f255e000640 1 -- 172.21.15.46:0/2300895902 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548030850 con 0x7f256015dc20 2024-02-19T06:58:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.067+0000 7f255e000640 1 -- 172.21.15.46:0/2300895902 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25480309b0 con 0x7f256015dc20 2024-02-19T06:58:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.067+0000 7f255e000640 1 -- 172.21.15.46:0/2300895902 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548030d40 con 0x7f256015dc20 2024-02-19T06:58:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.067+0000 7f255fe00640 1 -- 172.21.15.46:0/2300895902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f256015dc20 msgr2=0x7f256006c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.067+0000 7f255fe00640 1 --2- 172.21.15.46:0/2300895902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f256015dc20 0x7f256006c470 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2548009870 tx=0x7f254802b990 comp rx=0 tx=0).stop 2024-02-19T06:58:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.067+0000 7f255fe00640 1 -- 172.21.15.46:0/2300895902 shutdown_connections 2024-02-19T06:58:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.067+0000 7f255fe00640 1 --2- 172.21.15.46:0/2300895902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f256015dc20 0x7f256006c470 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.067+0000 7f255fe00640 1 --2- 172.21.15.46:0/2300895902 >> v2:172.21.15.142:3300/0 conn(0x7f256006c9b0 0x7f25600d1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.067+0000 7f255fe00640 1 -- 172.21.15.46:0/2300895902 >> 172.21.15.46:0/2300895902 conn(0x7f256009c9d0 msgr2=0x7f256008afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.067+0000 7f255fe00640 1 -- 172.21.15.46:0/2300895902 shutdown_connections 2024-02-19T06:58:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.067+0000 7f255fe00640 1 -- 172.21.15.46:0/2300895902 wait complete. 2024-02-19T06:58:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.069+0000 7f255fe00640 1 Processor -- start 2024-02-19T06:58:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.069+0000 7f255fe00640 1 -- start start 2024-02-19T06:58:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.070+0000 7f255fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f256006c9b0 0x7f256014b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.070+0000 7f255fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f256015d840 0x7f25600b8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.070+0000 7f255fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f256015dc20 0x7f25600b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.070+0000 7f255fe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600b8ae0 con 0x7f256006c9b0 2024-02-19T06:58:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.070+0000 7f255fe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600b7ea0 con 0x7f256015d840 2024-02-19T06:58:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.070+0000 7f255fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25600b9440 con 0x7f256015dc20 2024-02-19T06:58:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.070+0000 7f255ea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f256006c9b0 0x7f256014b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.070+0000 7f255ea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f256006c9b0 0x7f256014b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49886/0 (socket says 172.21.15.46:49886) 2024-02-19T06:58:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.070+0000 7f255ea00640 1 -- 172.21.15.46:0/72717590 learned_addr learned my addr 172.21.15.46:0/72717590 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:56.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.071+0000 7f2556000640 1 --2- 172.21.15.46:0/72717590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f256015d840 0x7f25600b8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:56.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.071+0000 7f255ea00640 1 -- 172.21.15.46:0/72717590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f256015dc20 msgr2=0x7f25600b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.071+0000 7f255ea00640 1 --2- 172.21.15.46:0/72717590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f256015dc20 0x7f25600b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.071+0000 7f255ea00640 1 -- 172.21.15.46:0/72717590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f256015d840 msgr2=0x7f25600b8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.071+0000 7f255ea00640 1 --2- 172.21.15.46:0/72717590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f256015d840 0x7f25600b8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.071+0000 7f255ea00640 1 -- 172.21.15.46:0/72717590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25480094d0 con 0x7f256006c9b0 2024-02-19T06:58:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.071+0000 7f255ea00640 1 --2- 172.21.15.46:0/72717590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f256006c9b0 0x7f256014b420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f255000c380 tx=0x7f255000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.071+0000 7f2557400640 1 -- 172.21.15.46:0/72717590 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25500052d0 con 0x7f256006c9b0 2024-02-19T06:58:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.072+0000 7f2557400640 1 -- 172.21.15.46:0/72717590 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2550005450 con 0x7f256006c9b0 2024-02-19T06:58:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.072+0000 7f255fe00640 1 -- 172.21.15.46:0/72717590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25600b8140 con 0x7f256006c9b0 2024-02-19T06:58:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.072+0000 7f2557400640 1 -- 172.21.15.46:0/72717590 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550007260 con 0x7f256006c9b0 2024-02-19T06:58:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.072+0000 7f255fe00640 1 -- 172.21.15.46:0/72717590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25600b8700 con 0x7f256006c9b0 2024-02-19T06:58:56.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.073+0000 7f255fe00640 1 -- 172.21.15.46:0/72717590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256004eee0 con 0x7f256006c9b0 2024-02-19T06:58:56.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.074+0000 7f2557400640 1 -- 172.21.15.46:0/72717590 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f25500073c0 con 0x7f256006c9b0 2024-02-19T06:58:56.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.075+0000 7f2557400640 1 --2- 172.21.15.46:0/72717590 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f253c06b840 0x7f253c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:56.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.075+0000 7f2557400640 1 -- 172.21.15.46:0/72717590 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2550089530 con 0x7f256006c9b0 2024-02-19T06:58:56.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.075+0000 7f2556000640 1 --2- 172.21.15.46:0/72717590 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f253c06b840 0x7f253c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:56.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.076+0000 7f2556000640 1 --2- 172.21.15.46:0/72717590 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f253c06b840 0x7f253c06dd00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2548036000 tx=0x7f254803b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.079+0000 7f2557400640 1 -- 172.21.15.46:0/72717590 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2550053f60 con 0x7f256006c9b0 2024-02-19T06:58:56.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.293+0000 7f255fe00640 1 -- 172.21.15.46:0/72717590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f256006be60 con 0x7f256006c9b0 2024-02-19T06:58:56.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.294+0000 7f2557400640 1 -- 172.21.15.46:0/72717590 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2550057620 con 0x7f256006c9b0 2024-02-19T06:58:56.295 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-02-19T06:58:56.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.297+0000 7f255fe00640 1 -- 172.21.15.46:0/72717590 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f253c06b840 msgr2=0x7f253c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:56.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.297+0000 7f255fe00640 1 --2- 172.21.15.46:0/72717590 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f253c06b840 0x7f253c06dd00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2548036000 tx=0x7f254803b040 comp rx=0 tx=0).stop 2024-02-19T06:58:56.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.297+0000 7f255fe00640 1 -- 172.21.15.46:0/72717590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f256006c9b0 msgr2=0x7f256014b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:56.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.297+0000 7f255fe00640 1 --2- 172.21.15.46:0/72717590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f256006c9b0 0x7f256014b420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f255000c380 tx=0x7f255000c840 comp rx=0 tx=0).stop 2024-02-19T06:58:56.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.297+0000 7f255fe00640 1 -- 172.21.15.46:0/72717590 shutdown_connections 2024-02-19T06:58:56.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.297+0000 7f255fe00640 1 --2- 172.21.15.46:0/72717590 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f253c06b840 0x7f253c06dd00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.297+0000 7f255fe00640 1 --2- 172.21.15.46:0/72717590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f256015dc20 0x7f25600b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.297+0000 7f255fe00640 1 --2- 172.21.15.46:0/72717590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f256015d840 0x7f25600b8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.297+0000 7f255fe00640 1 --2- 172.21.15.46:0/72717590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f256006c9b0 0x7f256014b420 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.297+0000 7f255fe00640 1 -- 172.21.15.46:0/72717590 >> 172.21.15.46:0/72717590 conn(0x7f256009c9d0 msgr2=0x7f25600b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:56.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.297+0000 7f255fe00640 1 -- 172.21.15.46:0/72717590 shutdown_connections 2024-02-19T06:58:56.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.297+0000 7f255fe00640 1 -- 172.21.15.46:0/72717590 wait complete. 2024-02-19T06:58:56.318 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T06:58:56.318 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T06:58:56.375 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:56.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.601+0000 7f3404400640 1 Processor -- start 2024-02-19T06:58:56.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.602+0000 7f3404400640 1 -- start start 2024-02-19T06:58:56.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.603+0000 7f3404400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f33fc1620d0 0x7f33fc0c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:56.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.603+0000 7f3404400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33fc06f650 0x7f33fc0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:56.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.603+0000 7f3404400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33fc06faa0 con 0x7f33fc0c3a70 2024-02-19T06:58:56.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.603+0000 7f3404400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33fc1624b0 con 0x7f33fc06f650 2024-02-19T06:58:56.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.603+0000 7f3404400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33fc0c3f00 con 0x7f33fc1620d0 2024-02-19T06:58:56.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.604+0000 7f3402400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33fc06f650 0x7f33fc0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:56.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.604+0000 7f3402400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33fc06f650 0x7f33fc0cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49902/0 (socket says 172.21.15.46:49902) 2024-02-19T06:58:56.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.604+0000 7f3402400640 1 -- 172.21.15.46:0/3646990694 learned_addr learned my addr 172.21.15.46:0/3646990694 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:56.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.604+0000 7f3401a00640 1 --2- 172.21.15.46:0/3646990694 >> v2:172.21.15.142:3300/0 conn(0x7f33fc1620d0 0x7f33fc0c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:56.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.604+0000 7f3402400640 1 -- 172.21.15.46:0/3646990694 >> v2:172.21.15.142:3300/0 conn(0x7f33fc1620d0 msgr2=0x7f33fc0c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:56.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.604+0000 7f3402400640 1 --2- 172.21.15.46:0/3646990694 >> v2:172.21.15.142:3300/0 conn(0x7f33fc1620d0 0x7f33fc0c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.604+0000 7f3402400640 1 -- 172.21.15.46:0/3646990694 >> v1:172.21.15.142:6789/0 conn(0x7f33fc0c3a70 legacy=0x7f33fc06ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:56.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.604+0000 7f3402400640 1 -- 172.21.15.46:0/3646990694 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc162690 con 0x7f33fc06f650 2024-02-19T06:58:56.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.606+0000 7f3402400640 1 --2- 172.21.15.46:0/3646990694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33fc06f650 0x7f33fc0cec90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f33fc071c70 tx=0x7f33f402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ce8892659a4439 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:56.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.606+0000 7f33fbe00640 1 -- 172.21.15.46:0/3646990694 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f4031870 con 0x7f33fc06f650 2024-02-19T06:58:56.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.606+0000 7f33fbe00640 1 -- 172.21.15.46:0/3646990694 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f40319d0 con 0x7f33fc06f650 2024-02-19T06:58:56.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.606+0000 7f33fbe00640 1 -- 172.21.15.46:0/3646990694 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f4031d60 con 0x7f33fc06f650 2024-02-19T06:58:56.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.607+0000 7f3404400640 1 -- 172.21.15.46:0/3646990694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33fc06f650 msgr2=0x7f33fc0cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:56.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.607+0000 7f3404400640 1 --2- 172.21.15.46:0/3646990694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33fc06f650 0x7f33fc0cec90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f33fc071c70 tx=0x7f33f402b910 comp rx=0 tx=0).stop 2024-02-19T06:58:56.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.607+0000 7f3404400640 1 -- 172.21.15.46:0/3646990694 shutdown_connections 2024-02-19T06:58:56.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.607+0000 7f3404400640 1 --2- 172.21.15.46:0/3646990694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33fc06f650 0x7f33fc0cec90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.607+0000 7f3404400640 1 --2- 172.21.15.46:0/3646990694 >> v2:172.21.15.142:3300/0 conn(0x7f33fc1620d0 0x7f33fc0c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.607+0000 7f3404400640 1 -- 172.21.15.46:0/3646990694 >> 172.21.15.46:0/3646990694 conn(0x7f33fc099a30 msgr2=0x7f33fc0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:56.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.607+0000 7f3404400640 1 -- 172.21.15.46:0/3646990694 shutdown_connections 2024-02-19T06:58:56.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.607+0000 7f3404400640 1 -- 172.21.15.46:0/3646990694 wait complete. 2024-02-19T06:58:56.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.609+0000 7f3404400640 1 Processor -- start 2024-02-19T06:58:56.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.609+0000 7f3404400640 1 -- start start 2024-02-19T06:58:56.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.610+0000 7f3404400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc06f650 0x7f33fc152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:56.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.610+0000 7f3404400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33fc0c3a70 0x7f33fc0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:56.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.610+0000 7f3404400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33fc1620d0 0x7f33fc0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:56.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.610+0000 7f3404400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc152ff0 con 0x7f33fc0c3a70 2024-02-19T06:58:56.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.610+0000 7f3404400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc0af9d0 con 0x7f33fc1620d0 2024-02-19T06:58:56.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.610+0000 7f3404400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc0c76d0 con 0x7f33fc06f650 2024-02-19T06:58:56.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.610+0000 7f3401000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33fc0c3a70 0x7f33fc0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:56.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.610+0000 7f3401000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33fc0c3a70 0x7f33fc0b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49906/0 (socket says 172.21.15.46:49906) 2024-02-19T06:58:56.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.610+0000 7f3401000640 1 -- 172.21.15.46:0/2298879730 learned_addr learned my addr 172.21.15.46:0/2298879730 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:56.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.611+0000 7f3402400640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33fc1620d0 0x7f33fc0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:56.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.611+0000 7f3401a00640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc06f650 0x7f33fc152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:56.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.611+0000 7f3401000640 1 -- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc06f650 msgr2=0x7f33fc152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:56.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.611+0000 7f3401000640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc06f650 0x7f33fc152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.611+0000 7f3401000640 1 -- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33fc1620d0 msgr2=0x7f33fc0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:56.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.611+0000 7f3401000640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33fc1620d0 0x7f33fc0b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.611+0000 7f3401000640 1 -- 172.21.15.46:0/2298879730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f40094d0 con 0x7f33fc0c3a70 2024-02-19T06:58:56.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.611+0000 7f3402400640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33fc1620d0 0x7f33fc0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:56.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.611+0000 7f3401a00640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc06f650 0x7f33fc152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:56.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.611+0000 7f3401000640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33fc0c3a70 0x7f33fc0b1b00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00c7c0 tx=0x7f33ec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:56.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.611+0000 7f33f9600640 1 -- 172.21.15.46:0/2298879730 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00aa50 con 0x7f33fc0c3a70 2024-02-19T06:58:56.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.611+0000 7f33f9600640 1 -- 172.21.15.46:0/2298879730 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec00abb0 con 0x7f33fc0c3a70 2024-02-19T06:58:56.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.611+0000 7f33f9600640 1 -- 172.21.15.46:0/2298879730 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec012420 con 0x7f33fc0c3a70 2024-02-19T06:58:56.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.612+0000 7f3404400640 1 -- 172.21.15.46:0/2298879730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33fc0c79b0 con 0x7f33fc0c3a70 2024-02-19T06:58:56.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.612+0000 7f3404400640 1 -- 172.21.15.46:0/2298879730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33fc0c7f70 con 0x7f33fc0c3a70 2024-02-19T06:58:56.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.613+0000 7f3404400640 1 -- 172.21.15.46:0/2298879730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33fc0682b0 con 0x7f33fc0c3a70 2024-02-19T06:58:56.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.614+0000 7f33f9600640 1 -- 172.21.15.46:0/2298879730 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f33ec012580 con 0x7f33fc0c3a70 2024-02-19T06:58:56.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.615+0000 7f33f9600640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f33e006b810 0x7f33e006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:56.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.615+0000 7f33f9600640 1 -- 172.21.15.46:0/2298879730 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f33ec08a4b0 con 0x7f33fc0c3a70 2024-02-19T06:58:56.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.615+0000 7f3401a00640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f33e006b810 0x7f33e006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:56.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.617+0000 7f3401a00640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f33e006b810 0x7f33e006dcd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f33f0006fd0 tx=0x7f33f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:56.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.619+0000 7f33f9600640 1 -- 172.21.15.46:0/2298879730 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f33ec054e50 con 0x7f33fc0c3a70 2024-02-19T06:58:56.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.820+0000 7f3404400640 1 -- 172.21.15.46:0/2298879730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33fc0bab00 con 0x7f33fc0c3a70 2024-02-19T06:58:56.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.822+0000 7f33f9600640 1 -- 172.21.15.46:0/2298879730 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16855 (secure 0 0 0) 0x7f33ec058510 con 0x7f33fc0c3a70 2024-02-19T06:58:56.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:56.824 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:58:37.086581+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:56.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.824+0000 7f3404400640 1 -- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f33e006b810 msgr2=0x7f33e006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:56.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.824+0000 7f3404400640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f33e006b810 0x7f33e006dcd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f33f0006fd0 tx=0x7f33f0008040 comp rx=0 tx=0).stop 2024-02-19T06:58:56.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.824+0000 7f3404400640 1 -- 172.21.15.46:0/2298879730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33fc0c3a70 msgr2=0x7f33fc0b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.824+0000 7f3404400640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33fc0c3a70 0x7f33fc0b1b00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00c7c0 tx=0x7f33ec00cc80 comp rx=0 tx=0).stop 2024-02-19T06:58:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.825+0000 7f3404400640 1 -- 172.21.15.46:0/2298879730 shutdown_connections 2024-02-19T06:58:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.825+0000 7f3404400640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f33e006b810 0x7f33e006dcd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.825+0000 7f3404400640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33fc1620d0 0x7f33fc0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.825+0000 7f3404400640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33fc0c3a70 0x7f33fc0b1b00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.825+0000 7f3404400640 1 --2- 172.21.15.46:0/2298879730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc06f650 0x7f33fc152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.825+0000 7f3404400640 1 -- 172.21.15.46:0/2298879730 >> 172.21.15.46:0/2298879730 conn(0x7f33fc099a30 msgr2=0x7f33fc163700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.825+0000 7f3404400640 1 -- 172.21.15.46:0/2298879730 shutdown_connections 2024-02-19T06:58:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:56.825+0000 7f3404400640 1 -- 172.21.15.46:0/2298879730 wait complete. 2024-02-19T06:58:56.846 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:56.846 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:58:57.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.075+0000 7efcc3e00640 1 Processor -- start 2024-02-19T06:58:57.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.075+0000 7efcc3e00640 1 -- start start 2024-02-19T06:58:57.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.076+0000 7efcc3e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc415a770 0x7efcc40b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.076+0000 7efcc3e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efcc40b27d0 0x7efcc406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.076+0000 7efcc3e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc40b4290 con 0x7efcc40cf530 2024-02-19T06:58:57.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.076+0000 7efcc3e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc40b38c0 con 0x7efcc40b27d0 2024-02-19T06:58:57.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.076+0000 7efcc3e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc40b2cb0 con 0x7efcc415a770 2024-02-19T06:58:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.077+0000 7efcc3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efcc40b27d0 0x7efcc406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.077+0000 7efcc3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efcc40b27d0 0x7efcc406e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49916/0 (socket says 172.21.15.46:49916) 2024-02-19T06:58:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.077+0000 7efcc3400640 1 -- 172.21.15.46:0/398705219 learned_addr learned my addr 172.21.15.46:0/398705219 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.077+0000 7efcba000640 1 --2- 172.21.15.46:0/398705219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc415a770 0x7efcc40b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.078+0000 7efcc3400640 1 -- 172.21.15.46:0/398705219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc415a770 msgr2=0x7efcc40b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.078+0000 7efcc3400640 1 --2- 172.21.15.46:0/398705219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc415a770 0x7efcc40b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.078+0000 7efcc3400640 1 -- 172.21.15.46:0/398705219 >> v1:172.21.15.142:6789/0 conn(0x7efcc40cf530 legacy=0x7efcc40cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.078+0000 7efcc3400640 1 -- 172.21.15.46:0/398705219 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc40b2f90 con 0x7efcc40b27d0 2024-02-19T06:58:57.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.079+0000 7efcc3400640 1 --2- 172.21.15.46:0/398705219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc40b27d0 0x7efcc406e7a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00bb10 tx=0x7efcbc02e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f342ed679241f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:57.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.080+0000 7efcc2000640 1 -- 172.21.15.46:0/398705219 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc036440 con 0x7efcc40b27d0 2024-02-19T06:58:57.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.080+0000 7efcc2000640 1 -- 172.21.15.46:0/398705219 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc0365a0 con 0x7efcc40b27d0 2024-02-19T06:58:57.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.080+0000 7efcc2000640 1 -- 172.21.15.46:0/398705219 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc036930 con 0x7efcc40b27d0 2024-02-19T06:58:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.080+0000 7efcc3e00640 1 -- 172.21.15.46:0/398705219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc40b27d0 msgr2=0x7efcc406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.080+0000 7efcc3e00640 1 --2- 172.21.15.46:0/398705219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc40b27d0 0x7efcc406e7a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00bb10 tx=0x7efcbc02e150 comp rx=0 tx=0).stop 2024-02-19T06:58:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.081+0000 7efcc3e00640 1 -- 172.21.15.46:0/398705219 shutdown_connections 2024-02-19T06:58:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.081+0000 7efcc3e00640 1 --2- 172.21.15.46:0/398705219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc40b27d0 0x7efcc406e7a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.081+0000 7efcc3e00640 1 --2- 172.21.15.46:0/398705219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc415a770 0x7efcc40b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.081+0000 7efcc3e00640 1 -- 172.21.15.46:0/398705219 >> 172.21.15.46:0/398705219 conn(0x7efcc406ad60 msgr2=0x7efcc406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.081+0000 7efcc3e00640 1 -- 172.21.15.46:0/398705219 shutdown_connections 2024-02-19T06:58:57.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.081+0000 7efcc3e00640 1 -- 172.21.15.46:0/398705219 wait complete. 2024-02-19T06:58:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.082+0000 7efcc3e00640 1 Processor -- start 2024-02-19T06:58:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.083+0000 7efcc3e00640 1 -- start start 2024-02-19T06:58:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc40b27d0 0x7efcc409ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc3e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc40cf530 0x7efcc40c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc3e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc415a770 0x7efcc415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc3e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc414dfb0 con 0x7efcc40b27d0 2024-02-19T06:58:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc3e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc41f3260 con 0x7efcc40cf530 2024-02-19T06:58:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc3e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc409d3b0 con 0x7efcc415a770 2024-02-19T06:58:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc2a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc40b27d0 0x7efcc409ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc2a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc40b27d0 0x7efcc409ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49930/0 (socket says 172.21.15.46:49930) 2024-02-19T06:58:57.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc2a00640 1 -- 172.21.15.46:0/2044674247 learned_addr learned my addr 172.21.15.46:0/2044674247 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc3400640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc415a770 0x7efcc415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcba000640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc40cf530 0x7efcc40c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc2a00640 1 -- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc415a770 msgr2=0x7efcc415cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc2a00640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc415a770 0x7efcc415cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc2a00640 1 -- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc40cf530 msgr2=0x7efcc40c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc2a00640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc40cf530 0x7efcc40c2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.084+0000 7efcc2a00640 1 -- 172.21.15.46:0/2044674247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc00b770 con 0x7efcc40b27d0 2024-02-19T06:58:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.085+0000 7efcba000640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc40cf530 0x7efcc40c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:57.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.085+0000 7efcc2a00640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc40b27d0 0x7efcc409ce70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efcb400c790 tx=0x7efcb400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.085+0000 7efcbb400640 1 -- 172.21.15.46:0/2044674247 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400cea0 con 0x7efcc40b27d0 2024-02-19T06:58:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.085+0000 7efcbb400640 1 -- 172.21.15.46:0/2044674247 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb4006d50 con 0x7efcc40b27d0 2024-02-19T06:58:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.085+0000 7efcbb400640 1 -- 172.21.15.46:0/2044674247 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb4003bb0 con 0x7efcc40b27d0 2024-02-19T06:58:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.085+0000 7efcc3e00640 1 -- 172.21.15.46:0/2044674247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc414d0e0 con 0x7efcc40b27d0 2024-02-19T06:58:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.085+0000 7efcc3e00640 1 -- 172.21.15.46:0/2044674247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc414d610 con 0x7efcc40b27d0 2024-02-19T06:58:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.086+0000 7efcc3e00640 1 -- 172.21.15.46:0/2044674247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc40ccb70 con 0x7efcc40b27d0 2024-02-19T06:58:57.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.087+0000 7efcbb400640 1 -- 172.21.15.46:0/2044674247 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7efcb4003d10 con 0x7efcc40b27d0 2024-02-19T06:58:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.088+0000 7efcbb400640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7efca006b810 0x7efca006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.088+0000 7efcbb400640 1 -- 172.21.15.46:0/2044674247 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7efcb4089d10 con 0x7efcc40b27d0 2024-02-19T06:58:57.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.089+0000 7efcba000640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7efca006b810 0x7efca006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.090+0000 7efcba000640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7efca006b810 0x7efca006dcd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efcc414cfb0 tx=0x7efcac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:57.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.093+0000 7efcbb400640 1 -- 172.21.15.46:0/2044674247 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efcb408f020 con 0x7efcc40b27d0 2024-02-19T06:58:57.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.303+0000 7efcc3e00640 1 -- 172.21.15.46:0/2044674247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcc40b4290 con 0x7efcc40b27d0 2024-02-19T06:58:57.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.304+0000 7efcbb400640 1 -- 172.21.15.46:0/2044674247 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7efcc40b4290 con 0x7efcc40b27d0 2024-02-19T06:58:57.305 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:58:57.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.306+0000 7efcc3e00640 1 -- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7efca006b810 msgr2=0x7efca006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:57.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.306+0000 7efcc3e00640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7efca006b810 0x7efca006dcd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efcc414cfb0 tx=0x7efcac008040 comp rx=0 tx=0).stop 2024-02-19T06:58:57.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.306+0000 7efcc3e00640 1 -- 172.21.15.46:0/2044674247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc40b27d0 msgr2=0x7efcc409ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:57.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.306+0000 7efcc3e00640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc40b27d0 0x7efcc409ce70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efcb400c790 tx=0x7efcb400cc50 comp rx=0 tx=0).stop 2024-02-19T06:58:57.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.307+0000 7efcc3e00640 1 -- 172.21.15.46:0/2044674247 shutdown_connections 2024-02-19T06:58:57.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.307+0000 7efcc3e00640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7efca006b810 0x7efca006dcd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.307+0000 7efcc3e00640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc415a770 0x7efcc415cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.307+0000 7efcc3e00640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc40cf530 0x7efcc40c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.307+0000 7efcc3e00640 1 --2- 172.21.15.46:0/2044674247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcc40b27d0 0x7efcc409ce70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.307+0000 7efcc3e00640 1 -- 172.21.15.46:0/2044674247 >> 172.21.15.46:0/2044674247 conn(0x7efcc406ad60 msgr2=0x7efcc40ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:57.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.307+0000 7efcc3e00640 1 -- 172.21.15.46:0/2044674247 shutdown_connections 2024-02-19T06:58:57.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.307+0000 7efcc3e00640 1 -- 172.21.15.46:0/2044674247 wait complete. 2024-02-19T06:58:57.329 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:58:57.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.551+0000 7f7c15a00640 1 Processor -- start 2024-02-19T06:58:57.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.552+0000 7f7c15a00640 1 -- start start 2024-02-19T06:58:57.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.553+0000 7f7c15a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c10155b20 0x7f7c100cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.553+0000 7f7c15a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c100cfa70 0x7f7c100b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.553+0000 7f7c15a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c100cfed0 con 0x7f7c100b2a20 2024-02-19T06:58:57.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.553+0000 7f7c15a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100b2e50 con 0x7f7c10155b20 2024-02-19T06:58:57.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.553+0000 7f7c15a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1015be60 con 0x7f7c100cfa70 2024-02-19T06:58:57.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.554+0000 7f7c15000640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7c100b2a20 0x7f7c1015f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48390/0 (socket says 172.21.15.46:48390) 2024-02-19T06:58:57.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.554+0000 7f7c15000640 1 -- 172.21.15.46:0/3384850638 learned_addr learned my addr 172.21.15.46:0/3384850638 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:58:57.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.554+0000 7f7c0fe00640 1 --2- 172.21.15.46:0/3384850638 >> v2:172.21.15.142:3300/0 conn(0x7f7c10155b20 0x7f7c100cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.554+0000 7f7c07e00640 1 --2- 172.21.15.46:0/3384850638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c100cfa70 0x7f7c100b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.554+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618001436 0 0) 0x7f7c100cfed0 con 0x7f7c100b2a20 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.554+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf4003520 con 0x7f7c100b2a20 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.554+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 242042968 0 0) 0x7f7bf4003520 con 0x7f7c100b2a20 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c100cfa70 msgr2=0x7f7c100b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0f400640 1 --2- 172.21.15.46:0/3384850638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c100cfa70 0x7f7c100b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 >> v2:172.21.15.142:3300/0 conn(0x7f7c10155b20 msgr2=0x7f7c100cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0f400640 1 --2- 172.21.15.46:0/3384850638 >> v2:172.21.15.142:3300/0 conn(0x7f7c10155b20 0x7f7c100cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1015c140 con 0x7f7c100b2a20 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f7c080019f0 con 0x7f7c100b2a20 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 >> v1:172.21.15.46:6789/0 conn(0x7f7c100b2a20 legacy=0x7f7c1015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0f400640 1 --2- 172.21.15.46:0/3384850638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c100cfa70 0x7f7bf4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0f400640 1 --2- 172.21.15.46:0/3384850638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf4003f40 0x7f7bf40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0f400640 1 --2- 172.21.15.46:0/3384850638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf4004d00 0x7f7bf4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100b2e50 con 0x7f7bf4004d00 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1015be60 con 0x7f7bf4003f40 2024-02-19T06:58:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf400b980 con 0x7f7c100cfa70 2024-02-19T06:58:57.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c15000640 1 --2- 172.21.15.46:0/3384850638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf4004d00 0x7f7bf4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c15000640 1 -- 172.21.15.46:0/3384850638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c100cfa70 msgr2=0x7f7bf4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c07e00640 1 --2- 172.21.15.46:0/3384850638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf4003f40 0x7f7bf40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c0fe00640 1 --2- 172.21.15.46:0/3384850638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c100cfa70 0x7f7bf4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c15000640 1 --2- 172.21.15.46:0/3384850638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c100cfa70 0x7f7bf4003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c15000640 1 -- 172.21.15.46:0/3384850638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf4003f40 msgr2=0x7f7bf40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.555+0000 7f7c15000640 1 --2- 172.21.15.46:0/3384850638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf4003f40 0x7f7bf40047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.556+0000 7f7c15000640 1 -- 172.21.15.46:0/3384850638 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf4003520 con 0x7f7bf4004d00 2024-02-19T06:58:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.557+0000 7f7c15000640 1 --2- 172.21.15.46:0/3384850638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf4004d00 0x7f7bf4005180 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800a7c0 tx=0x7f7bf40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a2b214362b7584 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.557+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08034630 con 0x7f7bf4004d00 2024-02-19T06:58:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.557+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0802f070 con 0x7f7bf4004d00 2024-02-19T06:58:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.557+0000 7f7c0f400640 1 -- 172.21.15.46:0/3384850638 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08034a30 con 0x7f7bf4004d00 2024-02-19T06:58:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.557+0000 7f7c15a00640 1 -- 172.21.15.46:0/3384850638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf4004d00 msgr2=0x7f7bf4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.557+0000 7f7c15a00640 1 --2- 172.21.15.46:0/3384850638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bf4004d00 0x7f7bf4005180 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800a7c0 tx=0x7f7bf40057f0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.557+0000 7f7c15000640 1 -- 172.21.15.46:0/3384850638 reap_dead start 2024-02-19T06:58:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.558+0000 7f7c15a00640 1 -- 172.21.15.46:0/3384850638 shutdown_connections 2024-02-19T06:58:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.558+0000 7f7c15a00640 1 -- 172.21.15.46:0/3384850638 >> 172.21.15.46:0/3384850638 conn(0x7f7c1006ad60 msgr2=0x7f7c1006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.558+0000 7f7c15a00640 1 -- 172.21.15.46:0/3384850638 shutdown_connections 2024-02-19T06:58:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.558+0000 7f7c15a00640 1 -- 172.21.15.46:0/3384850638 wait complete. 2024-02-19T06:58:57.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.560+0000 7f7c15a00640 1 Processor -- start 2024-02-19T06:58:57.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.560+0000 7f7c15a00640 1 -- start start 2024-02-19T06:58:57.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c15a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf4004d00 0x7f7c100c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c15a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1015e6f0 0x7f7c100c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c15a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c10071b00 0x7f7c10071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c15a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100716e0 con 0x7f7c10071b00 2024-02-19T06:58:57.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c15a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100c42a0 con 0x7f7bf4004d00 2024-02-19T06:58:57.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c15a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100c8fd0 con 0x7f7c1015e6f0 2024-02-19T06:58:57.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c15000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c10071b00 0x7f7c10071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c15000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c10071b00 0x7f7c10071f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49946/0 (socket says 172.21.15.46:49946) 2024-02-19T06:58:57.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c15000640 1 -- 172.21.15.46:0/1377047728 learned_addr learned my addr 172.21.15.46:0/1377047728 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:57.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c07e00640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1015e6f0 0x7f7c100c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c0fe00640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf4004d00 0x7f7c100c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c15000640 1 -- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1015e6f0 msgr2=0x7f7c100c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:57.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c15000640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1015e6f0 0x7f7c100c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c15000640 1 -- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf4004d00 msgr2=0x7f7c100c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:57.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.561+0000 7f7c15000640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf4004d00 0x7f7c100c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.562+0000 7f7c15000640 1 -- 172.21.15.46:0/1377047728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10070dd0 con 0x7f7c10071b00 2024-02-19T06:58:57.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.562+0000 7f7c15000640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c10071b00 0x7f7c10071f80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800a7c0 tx=0x7f7c08001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:57.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.562+0000 7f7c0cc00640 1 -- 172.21.15.46:0/1377047728 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08044070 con 0x7f7c10071b00 2024-02-19T06:58:57.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.562+0000 7f7c0cc00640 1 -- 172.21.15.46:0/1377047728 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08004d70 con 0x7f7c10071b00 2024-02-19T06:58:57.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.562+0000 7f7c0cc00640 1 -- 172.21.15.46:0/1377047728 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08034430 con 0x7f7c10071b00 2024-02-19T06:58:57.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.562+0000 7f7c15a00640 1 -- 172.21.15.46:0/1377047728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c100c8cf0 con 0x7f7c10071b00 2024-02-19T06:58:57.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.562+0000 7f7c15a00640 1 -- 172.21.15.46:0/1377047728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c10071300 con 0x7f7c10071b00 2024-02-19T06:58:57.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.563+0000 7f7c15a00640 1 -- 172.21.15.46:0/1377047728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c10071820 con 0x7f7c10071b00 2024-02-19T06:58:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.565+0000 7f7c0cc00640 1 -- 172.21.15.46:0/1377047728 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7c08031030 con 0x7f7c10071b00 2024-02-19T06:58:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.566+0000 7f7c0cc00640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7bec06b810 0x7f7bec06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.566+0000 7f7c0cc00640 1 -- 172.21.15.46:0/1377047728 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7c080abf10 con 0x7f7c10071b00 2024-02-19T06:58:57.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.567+0000 7f7c0fe00640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7bec06b810 0x7f7bec06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:57.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.568+0000 7f7c0fe00640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7bec06b810 0x7f7bec06dcd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009990 tx=0x7f7c00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:57.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.571+0000 7f7c0cc00640 1 -- 172.21.15.46:0/1377047728 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c10071820 con 0x7f7c10071b00 2024-02-19T06:58:57.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.768+0000 7f7c15a00640 1 -- 172.21.15.46:0/1377047728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c10071820 con 0x7f7c10071b00 2024-02-19T06:58:57.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.769+0000 7f7c0cc00640 1 -- 172.21.15.46:0/1377047728 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c10071820 con 0x7f7c10071b00 2024-02-19T06:58:57.771 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:58:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.772+0000 7f7c15a00640 1 -- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7bec06b810 msgr2=0x7f7bec06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.772+0000 7f7c15a00640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7bec06b810 0x7f7bec06dcd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009990 tx=0x7f7c00008040 comp rx=0 tx=0).stop 2024-02-19T06:58:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.772+0000 7f7c15a00640 1 -- 172.21.15.46:0/1377047728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c10071b00 msgr2=0x7f7c10071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.772+0000 7f7c15a00640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c10071b00 0x7f7c10071f80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800a7c0 tx=0x7f7c08001cb0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.772+0000 7f7c15a00640 1 -- 172.21.15.46:0/1377047728 shutdown_connections 2024-02-19T06:58:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.772+0000 7f7c15a00640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7bec06b810 0x7f7bec06dcd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.772+0000 7f7c15a00640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c10071b00 0x7f7c10071f80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.772+0000 7f7c15a00640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1015e6f0 0x7f7c100c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.772+0000 7f7c15a00640 1 --2- 172.21.15.46:0/1377047728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf4004d00 0x7f7c100c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.772+0000 7f7c15a00640 1 -- 172.21.15.46:0/1377047728 >> 172.21.15.46:0/1377047728 conn(0x7f7c1006ad60 msgr2=0x7f7c10159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.773+0000 7f7c15a00640 1 -- 172.21.15.46:0/1377047728 shutdown_connections 2024-02-19T06:58:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:57.773+0000 7f7c15a00640 1 -- 172.21.15.46:0/1377047728 wait complete. 2024-02-19T06:58:57.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:58:58.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.018+0000 7f6713e00640 1 Processor -- start 2024-02-19T06:58:58.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.018+0000 7f6713e00640 1 -- start start 2024-02-19T06:58:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.019+0000 7f6713e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6714155b20 0x7f67140cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.019+0000 7f6713e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f67140cfa70 0x7f67140b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.020+0000 7f6713e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67140b2e50 con 0x7f67140b2a20 2024-02-19T06:58:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.020+0000 7f6713e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67140cff00 con 0x7f6714155b20 2024-02-19T06:58:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.020+0000 7f6713e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671415be60 con 0x7f67140cfa70 2024-02-19T06:58:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.020+0000 7f6712a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6714155b20 0x7f67140cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.020+0000 7f6712a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6714155b20 0x7f67140cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49960/0 (socket says 172.21.15.46:49960) 2024-02-19T06:58:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.020+0000 7f6712a00640 1 -- 172.21.15.46:0/1892953590 learned_addr learned my addr 172.21.15.46:0/1892953590 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.020+0000 7f6713400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f67140b2a20 0x7f671415f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48396/0 (socket says 172.21.15.46:48396) 2024-02-19T06:58:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.020+0000 7f670a000640 1 --2- 172.21.15.46:0/1892953590 >> v2:172.21.15.142:3300/0 conn(0x7f67140cfa70 0x7f67140b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.020+0000 7f6712a00640 1 -- 172.21.15.46:0/1892953590 >> v2:172.21.15.142:3300/0 conn(0x7f67140cfa70 msgr2=0x7f67140b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.020+0000 7f6712a00640 1 --2- 172.21.15.46:0/1892953590 >> v2:172.21.15.142:3300/0 conn(0x7f67140cfa70 0x7f67140b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.020+0000 7f6712a00640 1 -- 172.21.15.46:0/1892953590 >> v1:172.21.15.46:6789/0 conn(0x7f67140b2a20 legacy=0x7f671415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:58.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.020+0000 7f6712a00640 1 -- 172.21.15.46:0/1892953590 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671415c140 con 0x7f6714155b20 2024-02-19T06:58:58.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.020+0000 7f670a000640 1 --2- 172.21.15.46:0/1892953590 >> v2:172.21.15.142:3300/0 conn(0x7f67140cfa70 0x7f67140b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:58.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.021+0000 7f6712a00640 1 --2- 172.21.15.46:0/1892953590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6714155b20 0x7f67140cf530 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f671406ef30 tx=0x7f670402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14754000e9a559ed server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:58.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.022+0000 7f6712000640 1 -- 172.21.15.46:0/1892953590 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670402ca80 con 0x7f6714155b20 2024-02-19T06:58:58.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.022+0000 7f6712000640 1 -- 172.21.15.46:0/1892953590 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670402cbe0 con 0x7f6714155b20 2024-02-19T06:58:58.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.022+0000 7f6712000640 1 -- 172.21.15.46:0/1892953590 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040343f0 con 0x7f6714155b20 2024-02-19T06:58:58.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.022+0000 7f6713e00640 1 -- 172.21.15.46:0/1892953590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6714155b20 msgr2=0x7f67140cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:58.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.022+0000 7f6713e00640 1 --2- 172.21.15.46:0/1892953590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6714155b20 0x7f67140cf530 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f671406ef30 tx=0x7f670402bee0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.022+0000 7f6713e00640 1 -- 172.21.15.46:0/1892953590 shutdown_connections 2024-02-19T06:58:58.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.022+0000 7f6713e00640 1 --2- 172.21.15.46:0/1892953590 >> v2:172.21.15.142:3300/0 conn(0x7f67140cfa70 0x7f67140b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.023+0000 7f6713e00640 1 --2- 172.21.15.46:0/1892953590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6714155b20 0x7f67140cf530 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.023+0000 7f6713e00640 1 -- 172.21.15.46:0/1892953590 >> 172.21.15.46:0/1892953590 conn(0x7f671406ad60 msgr2=0x7f671406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:58.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.023+0000 7f6713e00640 1 -- 172.21.15.46:0/1892953590 shutdown_connections 2024-02-19T06:58:58.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.023+0000 7f6713e00640 1 -- 172.21.15.46:0/1892953590 wait complete. 2024-02-19T06:58:58.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.024+0000 7f6713e00640 1 Processor -- start 2024-02-19T06:58:58.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.025+0000 7f6713e00640 1 -- start start 2024-02-19T06:58:58.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.025+0000 7f6713e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67140b2a20 0x7f67141f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:58.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.025+0000 7f6713e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67140cfa70 0x7f67141529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6713e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6714155b20 0x7f6714152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6713e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6714154c90 con 0x7f6714155b20 2024-02-19T06:58:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6713e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6714072830 con 0x7f67140b2a20 2024-02-19T06:58:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6713e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67140cd620 con 0x7f67140cfa70 2024-02-19T06:58:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6713400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6714155b20 0x7f6714152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6713400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6714155b20 0x7f6714152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49974/0 (socket says 172.21.15.46:49974) 2024-02-19T06:58:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6713400640 1 -- 172.21.15.46:0/2159034677 learned_addr learned my addr 172.21.15.46:0/2159034677 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6713400640 1 -- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67140cfa70 msgr2=0x7f67141529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f670a000640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67140cfa70 0x7f67141529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6712a00640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67140b2a20 0x7f67141f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6713400640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67140cfa70 0x7f67141529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6713400640 1 -- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67140b2a20 msgr2=0x7f67141f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6713400640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67140b2a20 0x7f67141f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6713400640 1 -- 172.21.15.46:0/2159034677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6704009b30 con 0x7f6714155b20 2024-02-19T06:58:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.026+0000 7f6712a00640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67140b2a20 0x7f67141f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.027+0000 7f6713400640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6714155b20 0x7f6714152f20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f670c00c390 tx=0x7f670c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.027+0000 7f670b400640 1 -- 172.21.15.46:0/2159034677 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c0074e0 con 0x7f6714155b20 2024-02-19T06:58:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.027+0000 7f670b400640 1 -- 172.21.15.46:0/2159034677 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c007640 con 0x7f6714155b20 2024-02-19T06:58:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.027+0000 7f670b400640 1 -- 172.21.15.46:0/2159034677 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c0049e0 con 0x7f6714155b20 2024-02-19T06:58:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.027+0000 7f6713e00640 1 -- 172.21.15.46:0/2159034677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67141f2eb0 con 0x7f6714155b20 2024-02-19T06:58:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.027+0000 7f6713e00640 1 -- 172.21.15.46:0/2159034677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6714072d60 con 0x7f6714155b20 2024-02-19T06:58:58.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.029+0000 7f6713e00640 1 -- 172.21.15.46:0/2159034677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671404eee0 con 0x7f6714155b20 2024-02-19T06:58:58.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.029+0000 7f670b400640 1 -- 172.21.15.46:0/2159034677 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f670c004b40 con 0x7f6714155b20 2024-02-19T06:58:58.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.031+0000 7f670b400640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f66f006b840 0x7f66f006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:58.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.031+0000 7f670b400640 1 -- 172.21.15.46:0/2159034677 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f670c089c20 con 0x7f6714155b20 2024-02-19T06:58:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.032+0000 7f6712a00640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f66f006b840 0x7f66f006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:58.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.033+0000 7f6712a00640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f66f006b840 0x7f66f006dd00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6704035000 tx=0x7f6704030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:58.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.035+0000 7f670b400640 1 -- 172.21.15.46:0/2159034677 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f670c054520 con 0x7f6714155b20 2024-02-19T06:58:58.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.235+0000 7f6713e00640 1 -- 172.21.15.46:0/2159034677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67140cd760 con 0x7f6714155b20 2024-02-19T06:58:58.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.238+0000 7f670b400640 1 -- 172.21.15.46:0/2159034677 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f670c057be0 con 0x7f6714155b20 2024-02-19T06:58:58.240 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:58:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.241+0000 7f6713e00640 1 -- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f66f006b840 msgr2=0x7f66f006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.241+0000 7f6713e00640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f66f006b840 0x7f66f006dd00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6704035000 tx=0x7f6704030000 comp rx=0 tx=0).stop 2024-02-19T06:58:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.241+0000 7f6713e00640 1 -- 172.21.15.46:0/2159034677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6714155b20 msgr2=0x7f6714152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.241+0000 7f6713e00640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6714155b20 0x7f6714152f20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f670c00c390 tx=0x7f670c00c850 comp rx=0 tx=0).stop 2024-02-19T06:58:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.241+0000 7f6713e00640 1 -- 172.21.15.46:0/2159034677 shutdown_connections 2024-02-19T06:58:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.241+0000 7f6713e00640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f66f006b840 0x7f66f006dd00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.241+0000 7f6713e00640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6714155b20 0x7f6714152f20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.241+0000 7f6713e00640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67140cfa70 0x7f67141529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.241+0000 7f6713e00640 1 --2- 172.21.15.46:0/2159034677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67140b2a20 0x7f67141f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.241+0000 7f6713e00640 1 -- 172.21.15.46:0/2159034677 >> 172.21.15.46:0/2159034677 conn(0x7f671406ad60 msgr2=0x7f6714159a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.241+0000 7f6713e00640 1 -- 172.21.15.46:0/2159034677 shutdown_connections 2024-02-19T06:58:58.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.241+0000 7f6713e00640 1 -- 172.21.15.46:0/2159034677 wait complete. 2024-02-19T06:58:58.261 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-19T06:58:58.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.460+0000 7f176a000640 1 Processor -- start 2024-02-19T06:58:58.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.461+0000 7f176a000640 1 -- start start 2024-02-19T06:58:58.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.462+0000 7f176a000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17641452d0 0x7f17640cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:58.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.462+0000 7f176a000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17640cf890 0x7f176406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:58.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.463+0000 7f176a000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176415fec0 con 0x7f176406ea20 2024-02-19T06:58:58.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.463+0000 7f176a000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17640ccf00 con 0x7f17640cf890 2024-02-19T06:58:58.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.463+0000 7f176a000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1764160350 con 0x7f17641452d0 2024-02-19T06:58:58.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.463+0000 7f1763e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17640cf890 0x7f176406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:58.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.463+0000 7f1763e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17640cf890 0x7f176406d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49986/0 (socket says 172.21.15.46:49986) 2024-02-19T06:58:58.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.463+0000 7f1763e00640 1 -- 172.21.15.46:0/2774861640 learned_addr learned my addr 172.21.15.46:0/2774861640 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:58.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.463+0000 7f1763400640 1 --2- 172.21.15.46:0/2774861640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17641452d0 0x7f17640cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:58.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.463+0000 7f1763e00640 1 -- 172.21.15.46:0/2774861640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17641452d0 msgr2=0x7f17640cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:58.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.463+0000 7f1763e00640 1 --2- 172.21.15.46:0/2774861640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17641452d0 0x7f17640cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.464+0000 7f1763e00640 1 -- 172.21.15.46:0/2774861640 >> v1:172.21.15.142:6789/0 conn(0x7f176406ea20 legacy=0x7f17640cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:58.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.464+0000 7f1763e00640 1 -- 172.21.15.46:0/2774861640 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17640cfcf0 con 0x7f17640cf890 2024-02-19T06:58:58.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.464+0000 7f1763400640 1 --2- 172.21.15.46:0/2774861640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17641452d0 0x7f17640cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:58.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.465+0000 7f1763e00640 1 --2- 172.21.15.46:0/2774861640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17640cf890 0x7f176406d230 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f175c009e80 tx=0x7f175c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1607e8216a12966f server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:58.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.465+0000 7f1762000640 1 -- 172.21.15.46:0/2774861640 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c02ca50 con 0x7f17640cf890 2024-02-19T06:58:58.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.465+0000 7f1762000640 1 -- 172.21.15.46:0/2774861640 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c02cbb0 con 0x7f17640cf890 2024-02-19T06:58:58.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.465+0000 7f1762000640 1 -- 172.21.15.46:0/2774861640 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0343f0 con 0x7f17640cf890 2024-02-19T06:58:58.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.466+0000 7f176a000640 1 -- 172.21.15.46:0/2774861640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17640cf890 msgr2=0x7f176406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:58.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.466+0000 7f176a000640 1 --2- 172.21.15.46:0/2774861640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17640cf890 0x7f176406d230 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f175c009e80 tx=0x7f175c02beb0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.466+0000 7f176a000640 1 -- 172.21.15.46:0/2774861640 shutdown_connections 2024-02-19T06:58:58.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.466+0000 7f176a000640 1 --2- 172.21.15.46:0/2774861640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17640cf890 0x7f176406d230 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.466+0000 7f176a000640 1 --2- 172.21.15.46:0/2774861640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17641452d0 0x7f17640cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.466+0000 7f176a000640 1 -- 172.21.15.46:0/2774861640 >> 172.21.15.46:0/2774861640 conn(0x7f1764066f70 msgr2=0x7f176406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:58.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.466+0000 7f176a000640 1 -- 172.21.15.46:0/2774861640 shutdown_connections 2024-02-19T06:58:58.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.466+0000 7f176a000640 1 -- 172.21.15.46:0/2774861640 wait complete. 2024-02-19T06:58:58.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.468+0000 7f176a000640 1 Processor -- start 2024-02-19T06:58:58.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.468+0000 7f176a000640 1 -- start start 2024-02-19T06:58:58.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.469+0000 7f176a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f176406ea20 0x7f1764144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:58.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.469+0000 7f176a000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17640cf890 0x7f176415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:58.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.469+0000 7f176a000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17641452d0 0x7f176415de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:58.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.469+0000 7f176a000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176415b810 con 0x7f176406ea20 2024-02-19T06:58:58.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.469+0000 7f176a000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1764138a40 con 0x7f17640cf890 2024-02-19T06:58:58.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.469+0000 7f176a000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176413d120 con 0x7f17641452d0 2024-02-19T06:58:58.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.469+0000 7f1763400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f176406ea20 0x7f1764144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:58.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.469+0000 7f1763400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f176406ea20 0x7f1764144160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49998/0 (socket says 172.21.15.46:49998) 2024-02-19T06:58:58.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.469+0000 7f1763400640 1 -- 172.21.15.46:0/3160182047 learned_addr learned my addr 172.21.15.46:0/3160182047 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:58.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.469+0000 7f1763e00640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17641452d0 0x7f176415de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:58.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.470+0000 7f1762a00640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17640cf890 0x7f176415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:58.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.470+0000 7f1763400640 1 -- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17641452d0 msgr2=0x7f176415de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:58.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.470+0000 7f1763400640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17641452d0 0x7f176415de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.470+0000 7f1763400640 1 -- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17640cf890 msgr2=0x7f176415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:58.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.470+0000 7f1763400640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17640cf890 0x7f176415b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.470+0000 7f1763400640 1 -- 172.21.15.46:0/3160182047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c009b30 con 0x7f176406ea20 2024-02-19T06:58:58.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.470+0000 7f1763e00640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17641452d0 0x7f176415de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:58.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.470+0000 7f1762a00640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17640cf890 0x7f176415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:58.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.470+0000 7f1763400640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f176406ea20 0x7f1764144160 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f175400c7f0 tx=0x7f175400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:58.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.470+0000 7f175b400640 1 -- 172.21.15.46:0/3160182047 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754007820 con 0x7f176406ea20 2024-02-19T06:58:58.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.470+0000 7f175b400640 1 -- 172.21.15.46:0/3160182047 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1754007980 con 0x7f176406ea20 2024-02-19T06:58:58.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.470+0000 7f175b400640 1 -- 172.21.15.46:0/3160182047 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754007cf0 con 0x7f176406ea20 2024-02-19T06:58:58.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.470+0000 7f176a000640 1 -- 172.21.15.46:0/3160182047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17641383f0 con 0x7f176406ea20 2024-02-19T06:58:58.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.471+0000 7f176a000640 1 -- 172.21.15.46:0/3160182047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1764141190 con 0x7f176406ea20 2024-02-19T06:58:58.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.472+0000 7f176a000640 1 -- 172.21.15.46:0/3160182047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1764067ba0 con 0x7f176406ea20 2024-02-19T06:58:58.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.473+0000 7f175b400640 1 -- 172.21.15.46:0/3160182047 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f17540113f0 con 0x7f176406ea20 2024-02-19T06:58:58.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.473+0000 7f175b400640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f174406b810 0x7f174406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:58.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.474+0000 7f175b400640 1 -- 172.21.15.46:0/3160182047 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f175408a530 con 0x7f176406ea20 2024-02-19T06:58:58.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.474+0000 7f1762a00640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f174406b810 0x7f174406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:58.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.475+0000 7f1762a00640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f174406b810 0x7f174406dcd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f176413ac20 tx=0x7f1750009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:58.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.478+0000 7f175b400640 1 -- 172.21.15.46:0/3160182047 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1754054ed0 con 0x7f176406ea20 2024-02-19T06:58:58.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.692+0000 7f176a000640 1 -- 172.21.15.46:0/3160182047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f17640ceba0 con 0x7f176406ea20 2024-02-19T06:58:58.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.693+0000 7f175b400640 1 -- 172.21.15.46:0/3160182047 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1754058590 con 0x7f176406ea20 2024-02-19T06:58:58.695 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-02-19T06:58:58.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.696+0000 7f176a000640 1 -- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f174406b810 msgr2=0x7f174406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:58.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.696+0000 7f176a000640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f174406b810 0x7f174406dcd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f176413ac20 tx=0x7f1750009040 comp rx=0 tx=0).stop 2024-02-19T06:58:58.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.696+0000 7f176a000640 1 -- 172.21.15.46:0/3160182047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f176406ea20 msgr2=0x7f1764144160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:58.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.696+0000 7f176a000640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f176406ea20 0x7f1764144160 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f175400c7f0 tx=0x7f175400ccb0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.696+0000 7f176a000640 1 -- 172.21.15.46:0/3160182047 shutdown_connections 2024-02-19T06:58:58.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.696+0000 7f176a000640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f174406b810 0x7f174406dcd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.696+0000 7f176a000640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17641452d0 0x7f176415de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.696+0000 7f176a000640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17640cf890 0x7f176415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.696+0000 7f176a000640 1 --2- 172.21.15.46:0/3160182047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f176406ea20 0x7f1764144160 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:58.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.696+0000 7f176a000640 1 -- 172.21.15.46:0/3160182047 >> 172.21.15.46:0/3160182047 conn(0x7f1764066f70 msgr2=0x7f17640afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:58.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.697+0000 7f176a000640 1 -- 172.21.15.46:0/3160182047 shutdown_connections 2024-02-19T06:58:58.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:58.697+0000 7f176a000640 1 -- 172.21.15.46:0/3160182047 wait complete. 2024-02-19T06:58:58.718 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi142.front.sepia.ceph.com... 2024-02-19T06:58:58.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:58.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-02-19T06:58:58.816 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T06:58:58.816 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T06:58:58.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:58:58.817 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-02-19T06:58:58.866 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-02-19T06:58:58.866 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T06:58:59.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.092+0000 7f8d2d000640 1 Processor -- start 2024-02-19T06:58:59.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.093+0000 7f8d2d000640 1 -- start start 2024-02-19T06:58:59.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.094+0000 7f8d2d000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d2815e480 0x7f8d2806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:59.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.094+0000 7f8d2d000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8d280cbce0 0x7f8d280cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:59.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.095+0000 7f8d2d000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2806c630 con 0x7f8d280cc680 2024-02-19T06:58:59.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.095+0000 7f8d2d000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2806dc10 con 0x7f8d280cbce0 2024-02-19T06:58:59.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.095+0000 7f8d2d000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2806c910 con 0x7f8d2815e480 2024-02-19T06:58:59.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.095+0000 7f8d25400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8d280cbce0 0x7f8d280cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:59.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.095+0000 7f8d25400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8d280cbce0 0x7f8d280cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50010/0 (socket says 172.21.15.46:50010) 2024-02-19T06:58:59.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.095+0000 7f8d25400640 1 -- 172.21.15.46:0/662641359 learned_addr learned my addr 172.21.15.46:0/662641359 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:59.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.095+0000 7f8d25e00640 1 --2- 172.21.15.46:0/662641359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d2815e480 0x7f8d2806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:59.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.095+0000 7f8d25400640 1 -- 172.21.15.46:0/662641359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d2815e480 msgr2=0x7f8d2806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:59.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.095+0000 7f8d25400640 1 --2- 172.21.15.46:0/662641359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d2815e480 0x7f8d2806d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.096+0000 7f8d25400640 1 -- 172.21.15.46:0/662641359 >> v1:172.21.15.142:6789/0 conn(0x7f8d280cc680 legacy=0x7f8d2815e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:59.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.096+0000 7f8d25400640 1 -- 172.21.15.46:0/662641359 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2806cbf0 con 0x7f8d280cbce0 2024-02-19T06:58:59.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.096+0000 7f8d25e00640 1 --2- 172.21.15.46:0/662641359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d2815e480 0x7f8d2806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:59.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.097+0000 7f8d25400640 1 --2- 172.21.15.46:0/662641359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d280cbce0 0x7f8d280cc140 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009e50 tx=0x7f8d1802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7049c0acb2ebb2c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:59.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.097+0000 7f8d24a00640 1 -- 172.21.15.46:0/662641359 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1802cb00 con 0x7f8d280cbce0 2024-02-19T06:58:59.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.097+0000 7f8d24a00640 1 -- 172.21.15.46:0/662641359 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1802cc60 con 0x7f8d280cbce0 2024-02-19T06:58:59.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.097+0000 7f8d24a00640 1 -- 172.21.15.46:0/662641359 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d180343f0 con 0x7f8d280cbce0 2024-02-19T06:58:59.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.098+0000 7f8d2d000640 1 -- 172.21.15.46:0/662641359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d280cbce0 msgr2=0x7f8d280cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:59.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.098+0000 7f8d2d000640 1 --2- 172.21.15.46:0/662641359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d280cbce0 0x7f8d280cc140 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009e50 tx=0x7f8d1802bf60 comp rx=0 tx=0).stop 2024-02-19T06:58:59.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.098+0000 7f8d2d000640 1 -- 172.21.15.46:0/662641359 shutdown_connections 2024-02-19T06:58:59.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.098+0000 7f8d2d000640 1 --2- 172.21.15.46:0/662641359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d280cbce0 0x7f8d280cc140 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.098+0000 7f8d2d000640 1 --2- 172.21.15.46:0/662641359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d2815e480 0x7f8d2806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.098+0000 7f8d2d000640 1 -- 172.21.15.46:0/662641359 >> 172.21.15.46:0/662641359 conn(0x7f8d280b3180 msgr2=0x7f8d280b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:59.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.098+0000 7f8d2d000640 1 -- 172.21.15.46:0/662641359 shutdown_connections 2024-02-19T06:58:59.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.098+0000 7f8d2d000640 1 -- 172.21.15.46:0/662641359 wait complete. 2024-02-19T06:58:59.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.100+0000 7f8d2d000640 1 Processor -- start 2024-02-19T06:58:59.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.100+0000 7f8d2d000640 1 -- start start 2024-02-19T06:58:59.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.101+0000 7f8d2d000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d280cbce0 0x7f8d280b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:59.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.101+0000 7f8d2d000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d280cc680 0x7f8d2814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.101+0000 7f8d2d000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d2815e480 0x7f8d2814d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.101+0000 7f8d2d000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2814d750 con 0x7f8d2815e480 2024-02-19T06:58:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.101+0000 7f8d2d000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d280b0550 con 0x7f8d280cc680 2024-02-19T06:58:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.101+0000 7f8d2d000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d280b0830 con 0x7f8d280cbce0 2024-02-19T06:58:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.101+0000 7f8d26800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d2815e480 0x7f8d2814d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.101+0000 7f8d26800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d2815e480 0x7f8d2814d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50016/0 (socket says 172.21.15.46:50016) 2024-02-19T06:58:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.101+0000 7f8d26800640 1 -- 172.21.15.46:0/1597900703 learned_addr learned my addr 172.21.15.46:0/1597900703 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:59.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.102+0000 7f8d26800640 1 -- 172.21.15.46:0/1597900703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d280cbce0 msgr2=0x7f8d280b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:59.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.102+0000 7f8d26800640 1 --2- 172.21.15.46:0/1597900703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d280cbce0 0x7f8d280b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.102+0000 7f8d26800640 1 -- 172.21.15.46:0/1597900703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d280cc680 msgr2=0x7f8d2814ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:59.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.102+0000 7f8d25400640 1 --2- 172.21.15.46:0/1597900703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d280cc680 0x7f8d2814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:59.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.102+0000 7f8d26800640 1 --2- 172.21.15.46:0/1597900703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d280cc680 0x7f8d2814ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.102+0000 7f8d26800640 1 -- 172.21.15.46:0/1597900703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d18009b30 con 0x7f8d2815e480 2024-02-19T06:58:59.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.102+0000 7f8d26800640 1 --2- 172.21.15.46:0/1597900703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d2815e480 0x7f8d2814d210 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8d20001eb0 tx=0x7f8d2000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:59.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.102+0000 7f8d1e000640 1 -- 172.21.15.46:0/1597900703 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d200052d0 con 0x7f8d2815e480 2024-02-19T06:58:59.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.102+0000 7f8d1e000640 1 -- 172.21.15.46:0/1597900703 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d20005430 con 0x7f8d2815e480 2024-02-19T06:58:59.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.102+0000 7f8d1e000640 1 -- 172.21.15.46:0/1597900703 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20003810 con 0x7f8d2815e480 2024-02-19T06:58:59.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.102+0000 7f8d2d000640 1 -- 172.21.15.46:0/1597900703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d280b0b10 con 0x7f8d2815e480 2024-02-19T06:58:59.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.102+0000 7f8d2d000640 1 -- 172.21.15.46:0/1597900703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d280b10d0 con 0x7f8d2815e480 2024-02-19T06:58:59.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.104+0000 7f8d2d000640 1 -- 172.21.15.46:0/1597900703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d28067ba0 con 0x7f8d2815e480 2024-02-19T06:58:59.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.105+0000 7f8d1e000640 1 -- 172.21.15.46:0/1597900703 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8d20003970 con 0x7f8d2815e480 2024-02-19T06:58:59.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.106+0000 7f8d1e000640 1 --2- 172.21.15.46:0/1597900703 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8d0406b810 0x7f8d0406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:59.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.106+0000 7f8d1e000640 1 -- 172.21.15.46:0/1597900703 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8d200898f0 con 0x7f8d2815e480 2024-02-19T06:58:59.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.106+0000 7f8d25e00640 1 --2- 172.21.15.46:0/1597900703 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8d0406b810 0x7f8d0406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:59.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.108+0000 7f8d25e00640 1 --2- 172.21.15.46:0/1597900703 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8d0406b810 0x7f8d0406dcd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8d10006fd0 tx=0x7f8d10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:59.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.110+0000 7f8d1e000640 1 -- 172.21.15.46:0/1597900703 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d200541f0 con 0x7f8d2815e480 2024-02-19T06:58:59.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.350+0000 7f8d2d000640 1 -- 172.21.15.46:0/1597900703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d2809af40 con 0x7f8d2815e480 2024-02-19T06:58:59.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.351+0000 7f8d1e000640 1 -- 172.21.15.46:0/1597900703 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f8d200578b0 con 0x7f8d2815e480 2024-02-19T06:58:59.352 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:59.352 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/380368509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":380368509},{"type":"v1","addr":"172.21.15.46:6834","nonce":380368509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/957808004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":957808004},{"type":"v1","addr":"172.21.15.46:6835","nonce":957808004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1288321773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1288321773},{"type":"v1","addr":"172.21.15.142:6837","nonce":1288321773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:57:55.292605+0000","modified":"2024-02-19T06:57:58.373002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2651895852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2651895852},{"type":"v1","addr":"172.21.15.142:6836","nonce":2651895852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-19T06:58:59.353 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-02-19T06:58:59.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.354+0000 7f8d2d000640 1 -- 172.21.15.46:0/1597900703 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8d0406b810 msgr2=0x7f8d0406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.354+0000 7f8d2d000640 1 --2- 172.21.15.46:0/1597900703 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8d0406b810 0x7f8d0406dcd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8d10006fd0 tx=0x7f8d10008040 comp rx=0 tx=0).stop 2024-02-19T06:58:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.354+0000 7f8d2d000640 1 -- 172.21.15.46:0/1597900703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d2815e480 msgr2=0x7f8d2814d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.354+0000 7f8d2d000640 1 --2- 172.21.15.46:0/1597900703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d2815e480 0x7f8d2814d210 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8d20001eb0 tx=0x7f8d2000c890 comp rx=0 tx=0).stop 2024-02-19T06:58:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.354+0000 7f8d2d000640 1 -- 172.21.15.46:0/1597900703 shutdown_connections 2024-02-19T06:58:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.354+0000 7f8d2d000640 1 --2- 172.21.15.46:0/1597900703 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8d0406b810 0x7f8d0406dcd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.354+0000 7f8d2d000640 1 --2- 172.21.15.46:0/1597900703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d2815e480 0x7f8d2814d210 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.354+0000 7f8d2d000640 1 --2- 172.21.15.46:0/1597900703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d280cc680 0x7f8d2814ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.354+0000 7f8d2d000640 1 --2- 172.21.15.46:0/1597900703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d280cbce0 0x7f8d280b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.354+0000 7f8d2d000640 1 -- 172.21.15.46:0/1597900703 >> 172.21.15.46:0/1597900703 conn(0x7f8d280b3180 msgr2=0x7f8d280cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.354+0000 7f8d2d000640 1 -- 172.21.15.46:0/1597900703 shutdown_connections 2024-02-19T06:58:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.354+0000 7f8d2d000640 1 -- 172.21.15.46:0/1597900703 wait complete. 2024-02-19T06:58:59.377 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:58:59.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.606+0000 7f9549800640 1 Processor -- start 2024-02-19T06:58:59.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.607+0000 7f9549800640 1 -- start start 2024-02-19T06:58:59.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.608+0000 7f9549800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f954415dee0 0x7f95440b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:59.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.608+0000 7f9549800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f954406bea0 0x7f95440d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.608+0000 7f9549800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954406c320 con 0x7f95440d0f80 2024-02-19T06:58:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.608+0000 7f9549800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95440b2f20 con 0x7f954415dee0 2024-02-19T06:58:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.608+0000 7f9549800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95440cfc80 con 0x7f954406bea0 2024-02-19T06:58:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.608+0000 7f9542a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f954415dee0 0x7f95440b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.608+0000 7f9542a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f954415dee0 0x7f95440b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50032/0 (socket says 172.21.15.46:50032) 2024-02-19T06:58:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.608+0000 7f9542a00640 1 -- 172.21.15.46:0/1192554611 learned_addr learned my addr 172.21.15.46:0/1192554611 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.609+0000 7f953be00640 1 --2- 172.21.15.46:0/1192554611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f954406bea0 0x7f95440d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.609+0000 7f9542a00640 1 -- 172.21.15.46:0/1192554611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f954406bea0 msgr2=0x7f95440d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.609+0000 7f9542a00640 1 --2- 172.21.15.46:0/1192554611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f954406bea0 0x7f95440d0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.609+0000 7f9542a00640 1 -- 172.21.15.46:0/1192554611 >> v1:172.21.15.142:6789/0 conn(0x7f95440d0f80 legacy=0x7f95440cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:58:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.609+0000 7f9542a00640 1 -- 172.21.15.46:0/1192554611 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95440cff60 con 0x7f954415dee0 2024-02-19T06:58:59.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.610+0000 7f9542a00640 1 --2- 172.21.15.46:0/1192554611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954415dee0 0x7f95440b2790 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9534009870 tx=0x7f953402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ac255788e143cb server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:59.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.610+0000 7f9542000640 1 -- 172.21.15.46:0/1192554611 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95340317c0 con 0x7f954415dee0 2024-02-19T06:58:59.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.610+0000 7f9542000640 1 -- 172.21.15.46:0/1192554611 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9534031920 con 0x7f954415dee0 2024-02-19T06:58:59.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.610+0000 7f9542000640 1 -- 172.21.15.46:0/1192554611 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534031cb0 con 0x7f954415dee0 2024-02-19T06:58:59.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.611+0000 7f9549800640 1 -- 172.21.15.46:0/1192554611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954415dee0 msgr2=0x7f95440b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:59.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.611+0000 7f9549800640 1 --2- 172.21.15.46:0/1192554611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954415dee0 0x7f95440b2790 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9534009870 tx=0x7f953402b860 comp rx=0 tx=0).stop 2024-02-19T06:58:59.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.611+0000 7f9549800640 1 -- 172.21.15.46:0/1192554611 shutdown_connections 2024-02-19T06:58:59.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.611+0000 7f9549800640 1 --2- 172.21.15.46:0/1192554611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f954406bea0 0x7f95440d0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.611+0000 7f9549800640 1 --2- 172.21.15.46:0/1192554611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954415dee0 0x7f95440b2790 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.611+0000 7f9549800640 1 -- 172.21.15.46:0/1192554611 >> 172.21.15.46:0/1192554611 conn(0x7f95440b3150 msgr2=0x7f95440b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:59.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.611+0000 7f9549800640 1 -- 172.21.15.46:0/1192554611 shutdown_connections 2024-02-19T06:58:59.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.611+0000 7f9549800640 1 -- 172.21.15.46:0/1192554611 wait complete. 2024-02-19T06:58:59.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.613+0000 7f9549800640 1 Processor -- start 2024-02-19T06:58:59.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.613+0000 7f9549800640 1 -- start start 2024-02-19T06:58:59.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.614+0000 7f9549800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954406bea0 0x7f9544159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:59.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.614+0000 7f9549800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95440d0f80 0x7f95441f7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:59.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.614+0000 7f9549800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f954415dee0 0x7f95441f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:59.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.614+0000 7f9549800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95440b7430 con 0x7f954406bea0 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.614+0000 7f9549800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95440b6820 con 0x7f95440d0f80 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.614+0000 7f9549800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95440b6b00 con 0x7f954415dee0 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.614+0000 7f9542a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954406bea0 0x7f9544159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.614+0000 7f9542a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954406bea0 0x7f9544159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50046/0 (socket says 172.21.15.46:50046) 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.614+0000 7f9542a00640 1 -- 172.21.15.46:0/3368579092 learned_addr learned my addr 172.21.15.46:0/3368579092 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.615+0000 7f953be00640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95440d0f80 0x7f95441f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.615+0000 7f9543400640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f954415dee0 0x7f95441f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.615+0000 7f9542a00640 1 -- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f954415dee0 msgr2=0x7f95441f7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.615+0000 7f9542a00640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f954415dee0 0x7f95441f7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.615+0000 7f9542a00640 1 -- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95440d0f80 msgr2=0x7f95441f7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.615+0000 7f9542a00640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95440d0f80 0x7f95441f7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.615+0000 7f9542a00640 1 -- 172.21.15.46:0/3368579092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95340094d0 con 0x7f954406bea0 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.615+0000 7f9543400640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f954415dee0 0x7f95441f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:58:59.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.615+0000 7f9542a00640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954406bea0 0x7f9544159290 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f953402b8a0 tx=0x7f95340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.615+0000 7f953aa00640 1 -- 172.21.15.46:0/3368579092 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95340329a0 con 0x7f954406bea0 2024-02-19T06:58:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.616+0000 7f953aa00640 1 -- 172.21.15.46:0/3368579092 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9534032b40 con 0x7f954406bea0 2024-02-19T06:58:59.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.616+0000 7f9549800640 1 -- 172.21.15.46:0/3368579092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95440b6de0 con 0x7f954406bea0 2024-02-19T06:58:59.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.616+0000 7f953aa00640 1 -- 172.21.15.46:0/3368579092 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95340453f0 con 0x7f954406bea0 2024-02-19T06:58:59.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.616+0000 7f9549800640 1 -- 172.21.15.46:0/3368579092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95441597d0 con 0x7f954406bea0 2024-02-19T06:58:59.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.617+0000 7f9549800640 1 -- 172.21.15.46:0/3368579092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9544067ba0 con 0x7f954406bea0 2024-02-19T06:58:59.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.618+0000 7f953aa00640 1 -- 172.21.15.46:0/3368579092 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f953404e450 con 0x7f954406bea0 2024-02-19T06:58:59.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.619+0000 7f953aa00640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f952006b810 0x7f952006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:58:59.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.619+0000 7f953aa00640 1 -- 172.21.15.46:0/3368579092 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f95340ac560 con 0x7f954406bea0 2024-02-19T06:58:59.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.619+0000 7f953be00640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f952006b810 0x7f952006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:58:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.621+0000 7f953be00640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f952006b810 0x7f952006dcd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f952c006fd0 tx=0x7f952c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:58:59.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.623+0000 7f953aa00640 1 -- 172.21.15.46:0/3368579092 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f95340770b0 con 0x7f954406bea0 2024-02-19T06:58:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.825+0000 7f9549800640 1 -- 172.21.15.46:0/3368579092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95440b7570 con 0x7f954406bea0 2024-02-19T06:58:59.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.828+0000 7f953aa00640 1 -- 172.21.15.46:0/3368579092 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16855 (secure 0 0 0) 0x7f953407a770 con 0x7f954406bea0 2024-02-19T06:58:59.830 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:58:59.830 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:58:37.086581+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:58:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.831+0000 7f9549800640 1 -- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f952006b810 msgr2=0x7f952006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.831+0000 7f9549800640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f952006b810 0x7f952006dcd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f952c006fd0 tx=0x7f952c008040 comp rx=0 tx=0).stop 2024-02-19T06:58:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.831+0000 7f9549800640 1 -- 172.21.15.46:0/3368579092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954406bea0 msgr2=0x7f9544159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:58:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.831+0000 7f9549800640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954406bea0 0x7f9544159290 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f953402b8a0 tx=0x7f95340046c0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.831+0000 7f9549800640 1 -- 172.21.15.46:0/3368579092 shutdown_connections 2024-02-19T06:58:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.831+0000 7f9549800640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f952006b810 0x7f952006dcd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.831+0000 7f9549800640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f954415dee0 0x7f95441f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.831+0000 7f9549800640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95440d0f80 0x7f95441f7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.831+0000 7f9549800640 1 --2- 172.21.15.46:0/3368579092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954406bea0 0x7f9544159290 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:58:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.831+0000 7f9549800640 1 -- 172.21.15.46:0/3368579092 >> 172.21.15.46:0/3368579092 conn(0x7f95440b3150 msgr2=0x7f954406fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:58:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.831+0000 7f9549800640 1 -- 172.21.15.46:0/3368579092 shutdown_connections 2024-02-19T06:58:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:58:59.832+0000 7f9549800640 1 -- 172.21.15.46:0/3368579092 wait complete. 2024-02-19T06:58:59.854 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:57:53.352097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:57:54.315102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:58:59.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:59:00.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.080+0000 7f50ff200640 1 Processor -- start 2024-02-19T06:59:00.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.080+0000 7f50ff200640 1 -- start start 2024-02-19T06:59:00.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.082+0000 7f50ff200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51000cfc40 0x7f51000b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:00.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.082+0000 7f50ff200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f51000b2a20 0x7f510006d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:00.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.082+0000 7f50ff200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51000b2eb0 con 0x7f5100155b20 2024-02-19T06:59:00.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.082+0000 7f50ff200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510015be60 con 0x7f51000b2a20 2024-02-19T06:59:00.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.082+0000 7f50ff200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510015c140 con 0x7f51000cfc40 2024-02-19T06:59:00.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.082+0000 7f50fe800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f51000b2a20 0x7f510006d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:00.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.082+0000 7f50fe800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f51000b2a20 0x7f510006d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50056/0 (socket says 172.21.15.46:50056) 2024-02-19T06:59:00.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.082+0000 7f50fe800640 1 -- 172.21.15.46:0/327225327 learned_addr learned my addr 172.21.15.46:0/327225327 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:00.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.083+0000 7f50f7e00640 1 --2- 172.21.15.46:0/327225327 >> v2:172.21.15.142:3300/0 conn(0x7f51000cfc40 0x7f51000b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:00.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.083+0000 7f50fe800640 1 -- 172.21.15.46:0/327225327 >> v2:172.21.15.142:3300/0 conn(0x7f51000cfc40 msgr2=0x7f51000b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:00.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.083+0000 7f50fe800640 1 --2- 172.21.15.46:0/327225327 >> v2:172.21.15.142:3300/0 conn(0x7f51000cfc40 0x7f51000b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.083+0000 7f50fe800640 1 -- 172.21.15.46:0/327225327 >> v1:172.21.15.142:6789/0 conn(0x7f5100155b20 legacy=0x7f51000cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:00.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.083+0000 7f50fe800640 1 -- 172.21.15.46:0/327225327 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510015c420 con 0x7f51000b2a20 2024-02-19T06:59:00.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.083+0000 7f50f7e00640 1 --2- 172.21.15.46:0/327225327 >> v2:172.21.15.142:3300/0 conn(0x7f51000cfc40 0x7f51000b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:59:00.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.084+0000 7f50fe800640 1 --2- 172.21.15.46:0/327225327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51000b2a20 0x7f510006d630 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f510006ef60 tx=0x7f50f802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3329264ad958a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:00.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.084+0000 7f50fd400640 1 -- 172.21.15.46:0/327225327 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f802c9f0 con 0x7f51000b2a20 2024-02-19T06:59:00.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.085+0000 7f50fd400640 1 -- 172.21.15.46:0/327225327 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f802cb50 con 0x7f51000b2a20 2024-02-19T06:59:00.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.085+0000 7f50fd400640 1 -- 172.21.15.46:0/327225327 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f80343f0 con 0x7f51000b2a20 2024-02-19T06:59:00.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.085+0000 7f50ff200640 1 -- 172.21.15.46:0/327225327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51000b2a20 msgr2=0x7f510006d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:00.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.085+0000 7f50ff200640 1 --2- 172.21.15.46:0/327225327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51000b2a20 0x7f510006d630 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f510006ef60 tx=0x7f50f802be50 comp rx=0 tx=0).stop 2024-02-19T06:59:00.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.085+0000 7f50ff200640 1 -- 172.21.15.46:0/327225327 shutdown_connections 2024-02-19T06:59:00.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.085+0000 7f50ff200640 1 --2- 172.21.15.46:0/327225327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51000b2a20 0x7f510006d630 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.085+0000 7f50ff200640 1 --2- 172.21.15.46:0/327225327 >> v2:172.21.15.142:3300/0 conn(0x7f51000cfc40 0x7f51000b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.085+0000 7f50ff200640 1 -- 172.21.15.46:0/327225327 >> 172.21.15.46:0/327225327 conn(0x7f510006ad60 msgr2=0x7f510006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:00.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.085+0000 7f50ff200640 1 -- 172.21.15.46:0/327225327 shutdown_connections 2024-02-19T06:59:00.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.085+0000 7f50ff200640 1 -- 172.21.15.46:0/327225327 wait complete. 2024-02-19T06:59:00.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.087+0000 7f50ff200640 1 Processor -- start 2024-02-19T06:59:00.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.087+0000 7f50ff200640 1 -- start start 2024-02-19T06:59:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.088+0000 7f50ff200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51000b2a20 0x7f51000acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.088+0000 7f50ff200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51000cfc40 0x7f51001f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.088+0000 7f50ff200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5100155b20 0x7f510015a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.088+0000 7f50ff200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51001f7380 con 0x7f51000cfc40 2024-02-19T06:59:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.088+0000 7f50ff200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51000ac240 con 0x7f5100155b20 2024-02-19T06:59:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.088+0000 7f50ff200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51000ac520 con 0x7f51000b2a20 2024-02-19T06:59:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.088+0000 7f50f7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51000cfc40 0x7f51001f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.088+0000 7f50f7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51000cfc40 0x7f51001f27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50064/0 (socket says 172.21.15.46:50064) 2024-02-19T06:59:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.088+0000 7f50f7e00640 1 -- 172.21.15.46:0/1746435761 learned_addr learned my addr 172.21.15.46:0/1746435761 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.089+0000 7f50fe800640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5100155b20 0x7f510015a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.089+0000 7f50fde00640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51000b2a20 0x7f51000acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.089+0000 7f50f7e00640 1 -- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51000b2a20 msgr2=0x7f51000acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.089+0000 7f50f7e00640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51000b2a20 0x7f51000acfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.089+0000 7f50f7e00640 1 -- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5100155b20 msgr2=0x7f510015a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.089+0000 7f50f7e00640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5100155b20 0x7f510015a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.089+0000 7f50f7e00640 1 -- 172.21.15.46:0/1746435761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f8009b30 con 0x7f51000cfc40 2024-02-19T06:59:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.089+0000 7f50fde00640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51000b2a20 0x7f51000acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.089+0000 7f50f7e00640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51000cfc40 0x7f51001f27c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f50e800e810 tx=0x7f50e800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.090+0000 7f50f6000640 1 -- 172.21.15.46:0/1746435761 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8004030 con 0x7f51000cfc40 2024-02-19T06:59:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.090+0000 7f50f6000640 1 -- 172.21.15.46:0/1746435761 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e8004190 con 0x7f51000cfc40 2024-02-19T06:59:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.090+0000 7f50f6000640 1 -- 172.21.15.46:0/1746435761 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8004520 con 0x7f51000cfc40 2024-02-19T06:59:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.090+0000 7f50ff200640 1 -- 172.21.15.46:0/1746435761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51000ac800 con 0x7f51000cfc40 2024-02-19T06:59:00.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.090+0000 7f50ff200640 1 -- 172.21.15.46:0/1746435761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51001f2d00 con 0x7f51000cfc40 2024-02-19T06:59:00.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.091+0000 7f50ff200640 1 -- 172.21.15.46:0/1746435761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510004eee0 con 0x7f51000cfc40 2024-02-19T06:59:00.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.092+0000 7f50f6000640 1 -- 172.21.15.46:0/1746435761 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f50e800c6d0 con 0x7f51000cfc40 2024-02-19T06:59:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.093+0000 7f50f6000640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f50dc06b810 0x7f50dc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.093+0000 7f50f6000640 1 -- 172.21.15.46:0/1746435761 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f50e8089e40 con 0x7f51000cfc40 2024-02-19T06:59:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.094+0000 7f50fde00640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f50dc06b810 0x7f50dc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.095+0000 7f50fde00640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f50dc06b810 0x7f50dc06dcd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f50f0003eb0 tx=0x7f50f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:00.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.097+0000 7f50f6000640 1 -- 172.21.15.46:0/1746435761 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f50e80547e0 con 0x7f51000cfc40 2024-02-19T06:59:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.295+0000 7f50ff200640 1 -- 172.21.15.46:0/1746435761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f510006beb0 con 0x7f51000cfc40 2024-02-19T06:59:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.296+0000 7f50f6000640 1 -- 172.21.15.46:0/1746435761 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50e8020020 con 0x7f51000cfc40 2024-02-19T06:59:00.297 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:59:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.299+0000 7f50ff200640 1 -- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f50dc06b810 msgr2=0x7f50dc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.299+0000 7f50ff200640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f50dc06b810 0x7f50dc06dcd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f50f0003eb0 tx=0x7f50f0009040 comp rx=0 tx=0).stop 2024-02-19T06:59:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.299+0000 7f50ff200640 1 -- 172.21.15.46:0/1746435761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51000cfc40 msgr2=0x7f51001f27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.299+0000 7f50ff200640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51000cfc40 0x7f51001f27c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f50e800e810 tx=0x7f50e800ecd0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.299+0000 7f50ff200640 1 -- 172.21.15.46:0/1746435761 shutdown_connections 2024-02-19T06:59:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.299+0000 7f50ff200640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f50dc06b810 0x7f50dc06dcd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.299+0000 7f50ff200640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5100155b20 0x7f510015a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.299+0000 7f50ff200640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51000cfc40 0x7f51001f27c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.299+0000 7f50ff200640 1 --2- 172.21.15.46:0/1746435761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51000b2a20 0x7f51000acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.299+0000 7f50ff200640 1 -- 172.21.15.46:0/1746435761 >> 172.21.15.46:0/1746435761 conn(0x7f510006ad60 msgr2=0x7f51000b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.299+0000 7f50ff200640 1 -- 172.21.15.46:0/1746435761 shutdown_connections 2024-02-19T06:59:00.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.299+0000 7f50ff200640 1 -- 172.21.15.46:0/1746435761 wait complete. 2024-02-19T06:59:00.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T06:59:00.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.546+0000 7f50b4200640 1 Processor -- start 2024-02-19T06:59:00.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.546+0000 7f50b4200640 1 -- start start 2024-02-19T06:59:00.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.547+0000 7f50b4200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ac0b3e70 0x7f50ac0b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.547+0000 7f50b4200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f50ac0b2a10 0x7f50ac0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.547+0000 7f50b4200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ac0b49f0 con 0x7f50ac15dde0 2024-02-19T06:59:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.547+0000 7f50b4200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50ac0cd340 con 0x7f50ac0b2a10 2024-02-19T06:59:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.547+0000 7f50b4200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac0b4430 con 0x7f50ac0b3e70 2024-02-19T06:59:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.548+0000 7f50b0e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ac0b3e70 0x7f50ac0b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.548+0000 7f50b2200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f50ac0b2a10 0x7f50ac0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.548+0000 7f50b0e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ac0b3e70 0x7f50ac0b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:53756/0 (socket says 172.21.15.46:53756) 2024-02-19T06:59:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.548+0000 7f50b1800640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f50ac15dde0 0x7f50ac06dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:48442/0 (socket says 172.21.15.46:48442) 2024-02-19T06:59:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.548+0000 7f50b0e00640 1 -- 172.21.15.46:0/2983726103 learned_addr learned my addr 172.21.15.46:0/2983726103 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.549+0000 7f50abe00640 1 -- 172.21.15.46:0/2983726103 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034192679 0 0) 0x7f50ac0b49f0 con 0x7f50ac15dde0 2024-02-19T06:59:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.549+0000 7f50abe00640 1 -- 172.21.15.46:0/2983726103 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5094003520 con 0x7f50ac15dde0 2024-02-19T06:59:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.549+0000 7f50b2200640 1 -- 172.21.15.46:0/2983726103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ac0b3e70 msgr2=0x7f50ac0b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.549+0000 7f50b2200640 1 --2- 172.21.15.46:0/2983726103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ac0b3e70 0x7f50ac0b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.549+0000 7f50b2200640 1 -- 172.21.15.46:0/2983726103 >> v1:172.21.15.142:6789/0 conn(0x7f50ac15dde0 legacy=0x7f50ac06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.549+0000 7f50b2200640 1 -- 172.21.15.46:0/2983726103 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ac0b4710 con 0x7f50ac0b2a10 2024-02-19T06:59:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.549+0000 7f50b0e00640 1 --2- 172.21.15.46:0/2983726103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ac0b3e70 0x7f50ac0b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:59:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.551+0000 7f50b2200640 1 --2- 172.21.15.46:0/2983726103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ac0b2a10 0x7f50ac0cf200 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f50a40097a0 tx=0x7f50a402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42af264ae73c47a server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.551+0000 7f50abe00640 1 -- 172.21.15.46:0/2983726103 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a402d040 con 0x7f50ac0b2a10 2024-02-19T06:59:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.551+0000 7f50abe00640 1 -- 172.21.15.46:0/2983726103 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a4031810 con 0x7f50ac0b2a10 2024-02-19T06:59:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.551+0000 7f50abe00640 1 -- 172.21.15.46:0/2983726103 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4031ba0 con 0x7f50ac0b2a10 2024-02-19T06:59:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.552+0000 7f50b4200640 1 -- 172.21.15.46:0/2983726103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ac0b2a10 msgr2=0x7f50ac0cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.552+0000 7f50b4200640 1 --2- 172.21.15.46:0/2983726103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ac0b2a10 0x7f50ac0cf200 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f50a40097a0 tx=0x7f50a402b8b0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.552+0000 7f50b4200640 1 -- 172.21.15.46:0/2983726103 shutdown_connections 2024-02-19T06:59:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.552+0000 7f50b4200640 1 --2- 172.21.15.46:0/2983726103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ac0b3e70 0x7f50ac0b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.552+0000 7f50b4200640 1 --2- 172.21.15.46:0/2983726103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ac0b2a10 0x7f50ac0cf200 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.552+0000 7f50b4200640 1 -- 172.21.15.46:0/2983726103 >> 172.21.15.46:0/2983726103 conn(0x7f50ac066fc0 msgr2=0x7f50ac06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.552+0000 7f50b4200640 1 -- 172.21.15.46:0/2983726103 shutdown_connections 2024-02-19T06:59:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.552+0000 7f50b4200640 1 -- 172.21.15.46:0/2983726103 wait complete. 2024-02-19T06:59:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.554+0000 7f50b4200640 1 Processor -- start 2024-02-19T06:59:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.554+0000 7f50b4200640 1 -- start start 2024-02-19T06:59:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.555+0000 7f50b4200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ac0b2a10 0x7f50ac0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.555+0000 7f50b4200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ac0b3e70 0x7f50ac147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.555+0000 7f50b4200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ac15dde0 0x7f50ac148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.555+0000 7f50b4200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac145800 con 0x7f50ac15dde0 2024-02-19T06:59:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.555+0000 7f50b4200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac156650 con 0x7f50ac0b2a10 2024-02-19T06:59:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.555+0000 7f50b4200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac156930 con 0x7f50ac0b3e70 2024-02-19T06:59:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.555+0000 7f50b2200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ac15dde0 0x7f50ac148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.555+0000 7f50b2200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ac15dde0 0x7f50ac148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50076/0 (socket says 172.21.15.46:50076) 2024-02-19T06:59:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.555+0000 7f50b2200640 1 -- 172.21.15.46:0/1762163643 learned_addr learned my addr 172.21.15.46:0/1762163643 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50b0e00640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ac0b3e70 0x7f50ac147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50b1800640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ac0b2a10 0x7f50ac0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50b2200640 1 -- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ac0b3e70 msgr2=0x7f50ac147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50b2200640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ac0b3e70 0x7f50ac147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50b2200640 1 -- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ac0b2a10 msgr2=0x7f50ac0cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50b2200640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ac0b2a10 0x7f50ac0cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50b2200640 1 -- 172.21.15.46:0/1762163643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a0009b30 con 0x7f50ac15dde0 2024-02-19T06:59:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50b1800640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ac0b2a10 0x7f50ac0cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50b0e00640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ac0b3e70 0x7f50ac147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50b2200640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ac15dde0 0x7f50ac148050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f50a40097a0 tx=0x7f50a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50a9600640 1 -- 172.21.15.46:0/1762163643 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a403ace0 con 0x7f50ac15dde0 2024-02-19T06:59:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50a9600640 1 -- 172.21.15.46:0/1762163643 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a403ae40 con 0x7f50ac15dde0 2024-02-19T06:59:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50a9600640 1 -- 172.21.15.46:0/1762163643 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4044400 con 0x7f50ac15dde0 2024-02-19T06:59:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.556+0000 7f50b4200640 1 -- 172.21.15.46:0/1762163643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a4009400 con 0x7f50ac15dde0 2024-02-19T06:59:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.557+0000 7f50b4200640 1 -- 172.21.15.46:0/1762163643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ac156ef0 con 0x7f50ac15dde0 2024-02-19T06:59:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.558+0000 7f50b4200640 1 -- 172.21.15.46:0/1762163643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ac145ac0 con 0x7f50ac15dde0 2024-02-19T06:59:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.559+0000 7f50a9600640 1 -- 172.21.15.46:0/1762163643 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f50a404d440 con 0x7f50ac15dde0 2024-02-19T06:59:00.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.560+0000 7f50a9600640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f509006b810 0x7f509006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:00.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.560+0000 7f50a9600640 1 -- 172.21.15.46:0/1762163643 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f50a40ac4e0 con 0x7f50ac15dde0 2024-02-19T06:59:00.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.560+0000 7f50b1800640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f509006b810 0x7f509006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.562+0000 7f50b1800640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f509006b810 0x7f509006dcd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f509c000f60 tx=0x7f509c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.564+0000 7f50a9600640 1 -- 172.21.15.46:0/1762163643 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f50ac145ac0 con 0x7f50ac15dde0 2024-02-19T06:59:00.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.770+0000 7f50b4200640 1 -- 172.21.15.46:0/1762163643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50ac145ac0 con 0x7f50ac15dde0 2024-02-19T06:59:00.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.771+0000 7f50a9600640 1 -- 172.21.15.46:0/1762163643 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50ac145ac0 con 0x7f50ac15dde0 2024-02-19T06:59:00.772 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T06:59:00.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.773+0000 7f50b4200640 1 -- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f509006b810 msgr2=0x7f509006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:00.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.773+0000 7f50b4200640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f509006b810 0x7f509006dcd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f509c000f60 tx=0x7f509c009040 comp rx=0 tx=0).stop 2024-02-19T06:59:00.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.773+0000 7f50b4200640 1 -- 172.21.15.46:0/1762163643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ac15dde0 msgr2=0x7f50ac148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:00.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.773+0000 7f50b4200640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ac15dde0 0x7f50ac148050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f50a40097a0 tx=0x7f50a40046c0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.773+0000 7f50b4200640 1 -- 172.21.15.46:0/1762163643 shutdown_connections 2024-02-19T06:59:00.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.773+0000 7f50b4200640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f509006b810 0x7f509006dcd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.773+0000 7f50b4200640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ac15dde0 0x7f50ac148050 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.773+0000 7f50b4200640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50ac0b3e70 0x7f50ac147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.773+0000 7f50b4200640 1 --2- 172.21.15.46:0/1762163643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50ac0b2a10 0x7f50ac0cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:00.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.773+0000 7f50b4200640 1 -- 172.21.15.46:0/1762163643 >> 172.21.15.46:0/1762163643 conn(0x7f50ac066fc0 msgr2=0x7f50ac0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:00.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.774+0000 7f50b4200640 1 -- 172.21.15.46:0/1762163643 shutdown_connections 2024-02-19T06:59:00.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:00.774+0000 7f50b4200640 1 -- 172.21.15.46:0/1762163643 wait complete. 2024-02-19T06:59:00.795 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T06:59:01.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.009+0000 7f8f49a00640 1 Processor -- start 2024-02-19T06:59:01.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.010+0000 7f8f49a00640 1 -- start start 2024-02-19T06:59:01.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.011+0000 7f8f49a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f44145050 0x7f8f440cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.011+0000 7f8f49a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f440ccce0 0x7f8f440cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.011+0000 7f8f49a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f44071e80 con 0x7f8f440cf910 2024-02-19T06:59:01.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.011+0000 7f8f49a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f440cfda0 con 0x7f8f440ccce0 2024-02-19T06:59:01.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.011+0000 7f8f49a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44071020 con 0x7f8f44145050 2024-02-19T06:59:01.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.012+0000 7f8f3be00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f440ccce0 0x7f8f440cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.012+0000 7f8f3be00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f440ccce0 0x7f8f440cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50080/0 (socket says 172.21.15.46:50080) 2024-02-19T06:59:01.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.012+0000 7f8f3be00640 1 -- 172.21.15.46:0/3319422325 learned_addr learned my addr 172.21.15.46:0/3319422325 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:01.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.012+0000 7f8f42a00640 1 --2- 172.21.15.46:0/3319422325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f44145050 0x7f8f440cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.012+0000 7f8f3be00640 1 -- 172.21.15.46:0/3319422325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f44145050 msgr2=0x7f8f440cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:01.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.012+0000 7f8f3be00640 1 --2- 172.21.15.46:0/3319422325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f44145050 0x7f8f440cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.012+0000 7f8f3be00640 1 -- 172.21.15.46:0/3319422325 >> v1:172.21.15.142:6789/0 conn(0x7f8f440cf910 legacy=0x7f8f4415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.013+0000 7f8f3be00640 1 -- 172.21.15.46:0/3319422325 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f440aef70 con 0x7f8f440ccce0 2024-02-19T06:59:01.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.014+0000 7f8f3be00640 1 --2- 172.21.15.46:0/3319422325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f440ccce0 0x7f8f440cf3d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009870 tx=0x7f8f2c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d6157f28e37fe4 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:01.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.014+0000 7f8f42000640 1 -- 172.21.15.46:0/3319422325 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c030840 con 0x7f8f440ccce0 2024-02-19T06:59:01.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.014+0000 7f8f42000640 1 -- 172.21.15.46:0/3319422325 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c0309a0 con 0x7f8f440ccce0 2024-02-19T06:59:01.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.014+0000 7f8f42000640 1 -- 172.21.15.46:0/3319422325 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c030d30 con 0x7f8f440ccce0 2024-02-19T06:59:01.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.015+0000 7f8f49a00640 1 -- 172.21.15.46:0/3319422325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f440ccce0 msgr2=0x7f8f440cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.015+0000 7f8f49a00640 1 --2- 172.21.15.46:0/3319422325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f440ccce0 0x7f8f440cf3d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009870 tx=0x7f8f2c02b980 comp rx=0 tx=0).stop 2024-02-19T06:59:01.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.015+0000 7f8f49a00640 1 -- 172.21.15.46:0/3319422325 shutdown_connections 2024-02-19T06:59:01.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.015+0000 7f8f49a00640 1 --2- 172.21.15.46:0/3319422325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f440ccce0 0x7f8f440cf3d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.015+0000 7f8f49a00640 1 --2- 172.21.15.46:0/3319422325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f44145050 0x7f8f440cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.015+0000 7f8f49a00640 1 -- 172.21.15.46:0/3319422325 >> 172.21.15.46:0/3319422325 conn(0x7f8f44066fc0 msgr2=0x7f8f4406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.015+0000 7f8f49a00640 1 -- 172.21.15.46:0/3319422325 shutdown_connections 2024-02-19T06:59:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.015+0000 7f8f49a00640 1 -- 172.21.15.46:0/3319422325 wait complete. 2024-02-19T06:59:01.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.017+0000 7f8f49a00640 1 Processor -- start 2024-02-19T06:59:01.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.017+0000 7f8f49a00640 1 -- start start 2024-02-19T06:59:01.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.018+0000 7f8f49a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f440ccce0 0x7f8f441424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.018+0000 7f8f49a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f440cf910 0x7f8f4415b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.018+0000 7f8f49a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f44145050 0x7f8f441f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.018+0000 7f8f49a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440af470 con 0x7f8f440ccce0 2024-02-19T06:59:01.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.018+0000 7f8f49a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440af140 con 0x7f8f44145050 2024-02-19T06:59:01.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.018+0000 7f8f49a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f441f3c50 con 0x7f8f440cf910 2024-02-19T06:59:01.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.018+0000 7f8f42a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f440ccce0 0x7f8f441424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.018+0000 7f8f42a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f440ccce0 0x7f8f441424d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50088/0 (socket says 172.21.15.46:50088) 2024-02-19T06:59:01.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.018+0000 7f8f42a00640 1 -- 172.21.15.46:0/1872177655 learned_addr learned my addr 172.21.15.46:0/1872177655 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:01.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.019+0000 7f8f3be00640 1 --2- 172.21.15.46:0/1872177655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f440cf910 0x7f8f4415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.019+0000 7f8f42a00640 1 -- 172.21.15.46:0/1872177655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f440cf910 msgr2=0x7f8f4415b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.019+0000 7f8f42a00640 1 --2- 172.21.15.46:0/1872177655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f440cf910 0x7f8f4415b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.019+0000 7f8f42a00640 1 -- 172.21.15.46:0/1872177655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f44145050 msgr2=0x7f8f441f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.019+0000 7f8f42a00640 1 --2- 172.21.15.46:0/1872177655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f44145050 0x7f8f441f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.019+0000 7f8f42a00640 1 -- 172.21.15.46:0/1872177655 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c0094d0 con 0x7f8f440ccce0 2024-02-19T06:59:01.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.019+0000 7f8f42a00640 1 --2- 172.21.15.46:0/1872177655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f440ccce0 0x7f8f441424d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400d5f0 tx=0x7f8f3400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:01.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.019+0000 7f8f3aa00640 1 -- 172.21.15.46:0/1872177655 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340125f0 con 0x7f8f440ccce0 2024-02-19T06:59:01.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.019+0000 7f8f3aa00640 1 -- 172.21.15.46:0/1872177655 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34012750 con 0x7f8f440ccce0 2024-02-19T06:59:01.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.019+0000 7f8f3aa00640 1 -- 172.21.15.46:0/1872177655 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34012b00 con 0x7f8f440ccce0 2024-02-19T06:59:01.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.019+0000 7f8f49a00640 1 -- 172.21.15.46:0/1872177655 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f441f3f30 con 0x7f8f440ccce0 2024-02-19T06:59:01.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.020+0000 7f8f49a00640 1 -- 172.21.15.46:0/1872177655 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f441f3910 con 0x7f8f440ccce0 2024-02-19T06:59:01.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.021+0000 7f8f49a00640 1 -- 172.21.15.46:0/1872177655 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f44067ba0 con 0x7f8f440ccce0 2024-02-19T06:59:01.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.022+0000 7f8f3aa00640 1 -- 172.21.15.46:0/1872177655 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8f34012c60 con 0x7f8f440ccce0 2024-02-19T06:59:01.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.023+0000 7f8f3aa00640 1 --2- 172.21.15.46:0/1872177655 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8f2006b810 0x7f8f2006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.023+0000 7f8f3aa00640 1 -- 172.21.15.46:0/1872177655 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8f3408a7d0 con 0x7f8f440ccce0 2024-02-19T06:59:01.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.024+0000 7f8f3be00640 1 --2- 172.21.15.46:0/1872177655 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8f2006b810 0x7f8f2006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.025+0000 7f8f3be00640 1 --2- 172.21.15.46:0/1872177655 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8f2006b810 0x7f8f2006dcd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c036000 tx=0x7f8f2c03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:01.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.028+0000 7f8f3aa00640 1 -- 172.21.15.46:0/1872177655 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8f340550d0 con 0x7f8f440ccce0 2024-02-19T06:59:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.233+0000 7f8f49a00640 1 -- 172.21.15.46:0/1872177655 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f440d02f0 con 0x7f8f440ccce0 2024-02-19T06:59:01.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.234+0000 7f8f3aa00640 1 -- 172.21.15.46:0/1872177655 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f34058790 con 0x7f8f440ccce0 2024-02-19T06:59:01.235 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T06:59:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.237+0000 7f8f49a00640 1 -- 172.21.15.46:0/1872177655 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8f2006b810 msgr2=0x7f8f2006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.237+0000 7f8f49a00640 1 --2- 172.21.15.46:0/1872177655 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8f2006b810 0x7f8f2006dcd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c036000 tx=0x7f8f2c03b040 comp rx=0 tx=0).stop 2024-02-19T06:59:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.237+0000 7f8f49a00640 1 -- 172.21.15.46:0/1872177655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f440ccce0 msgr2=0x7f8f441424d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.237+0000 7f8f49a00640 1 --2- 172.21.15.46:0/1872177655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f440ccce0 0x7f8f441424d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400d5f0 tx=0x7f8f3400dab0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.237+0000 7f8f49a00640 1 -- 172.21.15.46:0/1872177655 shutdown_connections 2024-02-19T06:59:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.237+0000 7f8f49a00640 1 --2- 172.21.15.46:0/1872177655 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8f2006b810 0x7f8f2006dcd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.237+0000 7f8f49a00640 1 --2- 172.21.15.46:0/1872177655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f44145050 0x7f8f441f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.237+0000 7f8f49a00640 1 --2- 172.21.15.46:0/1872177655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f440cf910 0x7f8f4415b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.237+0000 7f8f49a00640 1 --2- 172.21.15.46:0/1872177655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f440ccce0 0x7f8f441424d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.237+0000 7f8f49a00640 1 -- 172.21.15.46:0/1872177655 >> 172.21.15.46:0/1872177655 conn(0x7f8f44066fc0 msgr2=0x7f8f440ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.237+0000 7f8f49a00640 1 -- 172.21.15.46:0/1872177655 shutdown_connections 2024-02-19T06:59:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.237+0000 7f8f49a00640 1 -- 172.21.15.46:0/1872177655 wait complete. 2024-02-19T06:59:01.258 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T06:59:01.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.477+0000 7fc2be200640 1 Processor -- start 2024-02-19T06:59:01.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.477+0000 7fc2be200640 1 -- start start 2024-02-19T06:59:01.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.479+0000 7fc2be200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b815c4a0 0x7fc2b8165a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.479+0000 7fc2be200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2b81630f0 0x7fc2b806df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.479+0000 7fc2be200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b81663d0 con 0x7fc2b806e4c0 2024-02-19T06:59:01.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.479+0000 7fc2be200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b8166990 con 0x7fc2b81630f0 2024-02-19T06:59:01.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.479+0000 7fc2be200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b81666b0 con 0x7fc2b815c4a0 2024-02-19T06:59:01.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.480+0000 7fc2b7400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b815c4a0 0x7fc2b8165a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.480+0000 7fc2b6a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2b81630f0 0x7fc2b806df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.480+0000 7fc2b7400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b815c4a0 0x7fc2b8165a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:53786/0 (socket says 172.21.15.46:53786) 2024-02-19T06:59:01.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.480+0000 7fc2b7400640 1 -- 172.21.15.46:0/1722316023 learned_addr learned my addr 172.21.15.46:0/1722316023 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:01.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.481+0000 7fc2b6a00640 1 -- 172.21.15.46:0/1722316023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b815c4a0 msgr2=0x7fc2b8165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:01.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.481+0000 7fc2b6a00640 1 --2- 172.21.15.46:0/1722316023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b815c4a0 0x7fc2b8165a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.481+0000 7fc2b6a00640 1 -- 172.21.15.46:0/1722316023 >> v1:172.21.15.142:6789/0 conn(0x7fc2b806e4c0 legacy=0x7fc2b80b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:01.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.481+0000 7fc2b6a00640 1 -- 172.21.15.46:0/1722316023 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b806d780 con 0x7fc2b81630f0 2024-02-19T06:59:01.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.482+0000 7fc2b6a00640 1 --2- 172.21.15.46:0/1722316023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b81630f0 0x7fc2b806df80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00097a0 tx=0x7fc2a002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c47f2e80e1928cb0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:01.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.483+0000 7fc2b6000640 1 -- 172.21.15.46:0/1722316023 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0031830 con 0x7fc2b81630f0 2024-02-19T06:59:01.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.483+0000 7fc2b6000640 1 -- 172.21.15.46:0/1722316023 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a0031990 con 0x7fc2b81630f0 2024-02-19T06:59:01.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.483+0000 7fc2b6000640 1 -- 172.21.15.46:0/1722316023 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0031d20 con 0x7fc2b81630f0 2024-02-19T06:59:01.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.483+0000 7fc2be200640 1 -- 172.21.15.46:0/1722316023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b81630f0 msgr2=0x7fc2b806df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.483+0000 7fc2be200640 1 --2- 172.21.15.46:0/1722316023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b81630f0 0x7fc2b806df80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00097a0 tx=0x7fc2a002b8d0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.484+0000 7fc2be200640 1 -- 172.21.15.46:0/1722316023 shutdown_connections 2024-02-19T06:59:01.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.484+0000 7fc2be200640 1 --2- 172.21.15.46:0/1722316023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b81630f0 0x7fc2b806df80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.484+0000 7fc2be200640 1 --2- 172.21.15.46:0/1722316023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b815c4a0 0x7fc2b8165a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.484+0000 7fc2be200640 1 -- 172.21.15.46:0/1722316023 >> 172.21.15.46:0/1722316023 conn(0x7fc2b8066f70 msgr2=0x7fc2b806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:01.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.484+0000 7fc2be200640 1 -- 172.21.15.46:0/1722316023 shutdown_connections 2024-02-19T06:59:01.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.484+0000 7fc2be200640 1 -- 172.21.15.46:0/1722316023 wait complete. 2024-02-19T06:59:01.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.486+0000 7fc2be200640 1 Processor -- start 2024-02-19T06:59:01.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.486+0000 7fc2be200640 1 -- start start 2024-02-19T06:59:01.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.487+0000 7fc2be200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b806e4c0 0x7fc2b81f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.487+0000 7fc2be200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b815c4a0 0x7fc2b8160470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.487+0000 7fc2be200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2b81630f0 0x7fc2b81609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.487+0000 7fc2be200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8161030 con 0x7fc2b81630f0 2024-02-19T06:59:01.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.487+0000 7fc2be200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8161310 con 0x7fc2b815c4a0 2024-02-19T06:59:01.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.487+0000 7fc2be200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b81615f0 con 0x7fc2b806e4c0 2024-02-19T06:59:01.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.487+0000 7fc2b7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2b81630f0 0x7fc2b81609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.487+0000 7fc2b7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2b81630f0 0x7fc2b81609b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50094/0 (socket says 172.21.15.46:50094) 2024-02-19T06:59:01.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.487+0000 7fc2b7e00640 1 -- 172.21.15.46:0/2606545416 learned_addr learned my addr 172.21.15.46:0/2606545416 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:01.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.487+0000 7fc2b6a00640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b815c4a0 0x7fc2b8160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.488+0000 7fc2b7400640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b806e4c0 0x7fc2b81f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.488+0000 7fc2b7e00640 1 -- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b806e4c0 msgr2=0x7fc2b81f6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.488+0000 7fc2b7e00640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b806e4c0 0x7fc2b81f6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.488+0000 7fc2b7e00640 1 -- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b815c4a0 msgr2=0x7fc2b8160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.488+0000 7fc2b7e00640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b815c4a0 0x7fc2b8160470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.488+0000 7fc2b7e00640 1 -- 172.21.15.46:0/2606545416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a0009400 con 0x7fc2b81630f0 2024-02-19T06:59:01.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.488+0000 7fc2b7400640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b806e4c0 0x7fc2b81f6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:59:01.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.488+0000 7fc2b7e00640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2b81630f0 0x7fc2b81609b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000c7a0 tx=0x7fc2b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:01.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.488+0000 7fc2af400640 1 -- 172.21.15.46:0/2606545416 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0003b70 con 0x7fc2b81630f0 2024-02-19T06:59:01.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.489+0000 7fc2af400640 1 -- 172.21.15.46:0/2606545416 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b0003cf0 con 0x7fc2b81630f0 2024-02-19T06:59:01.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.489+0000 7fc2af400640 1 -- 172.21.15.46:0/2606545416 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0003ea0 con 0x7fc2b81630f0 2024-02-19T06:59:01.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.489+0000 7fc2be200640 1 -- 172.21.15.46:0/2606545416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b81618d0 con 0x7fc2b81630f0 2024-02-19T06:59:01.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.489+0000 7fc2be200640 1 -- 172.21.15.46:0/2606545416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b81f7460 con 0x7fc2b81630f0 2024-02-19T06:59:01.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.490+0000 7fc2be200640 1 -- 172.21.15.46:0/2606545416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b8161df0 con 0x7fc2b81630f0 2024-02-19T06:59:01.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.491+0000 7fc2af400640 1 -- 172.21.15.46:0/2606545416 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc2b000aa90 con 0x7fc2b81630f0 2024-02-19T06:59:01.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.492+0000 7fc2af400640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc29406b810 0x7fc29406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.492+0000 7fc2af400640 1 -- 172.21.15.46:0/2606545416 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc2b008a090 con 0x7fc2b81630f0 2024-02-19T06:59:01.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.493+0000 7fc2b7400640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc29406b810 0x7fc29406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.494+0000 7fc2b7400640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc29406b810 0x7fc29406dcd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009c20 tx=0x7fc2a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:01.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.497+0000 7fc2af400640 1 -- 172.21.15.46:0/2606545416 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc2b8161df0 con 0x7fc2b81630f0 2024-02-19T06:59:01.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.737+0000 7fc2be200640 1 -- 172.21.15.46:0/2606545416 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2b8161df0 con 0x7fc2b81630f0 2024-02-19T06:59:01.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.738+0000 7fc2af400640 1 -- 172.21.15.46:0/2606545416 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7fc2b8161df0 con 0x7fc2b81630f0 2024-02-19T06:59:01.740 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:01.740 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/380368509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":380368509},{"type":"v1","addr":"172.21.15.46:6834","nonce":380368509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/957808004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":957808004},{"type":"v1","addr":"172.21.15.46:6835","nonce":957808004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1288321773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1288321773},{"type":"v1","addr":"172.21.15.142:6837","nonce":1288321773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:57:55.292605+0000","modified":"2024-02-19T06:57:58.373002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2651895852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2651895852},{"type":"v1","addr":"172.21.15.142:6836","nonce":2651895852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-19T06:59:01.741 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-02-19T06:59:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.741+0000 7fc2be200640 1 -- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc29406b810 msgr2=0x7fc29406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.741+0000 7fc2be200640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc29406b810 0x7fc29406dcd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009c20 tx=0x7fc2a8008040 comp rx=0 tx=0).stop 2024-02-19T06:59:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.741+0000 7fc2be200640 1 -- 172.21.15.46:0/2606545416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2b81630f0 msgr2=0x7fc2b81609b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.741+0000 7fc2be200640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2b81630f0 0x7fc2b81609b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000c7a0 tx=0x7fc2b000cc60 comp rx=0 tx=0).stop 2024-02-19T06:59:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.741+0000 7fc2be200640 1 -- 172.21.15.46:0/2606545416 shutdown_connections 2024-02-19T06:59:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.741+0000 7fc2be200640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc29406b810 0x7fc29406dcd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.741+0000 7fc2be200640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2b81630f0 0x7fc2b81609b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.741+0000 7fc2be200640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b815c4a0 0x7fc2b8160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.741+0000 7fc2be200640 1 --2- 172.21.15.46:0/2606545416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b806e4c0 0x7fc2b81f6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.741+0000 7fc2be200640 1 -- 172.21.15.46:0/2606545416 >> 172.21.15.46:0/2606545416 conn(0x7fc2b8066f70 msgr2=0x7fc2b815b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:01.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.742+0000 7fc2be200640 1 -- 172.21.15.46:0/2606545416 shutdown_connections 2024-02-19T06:59:01.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.742+0000 7fc2be200640 1 -- 172.21.15.46:0/2606545416 wait complete. 2024-02-19T06:59:01.761 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:59:01.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.981+0000 7f41ff200640 1 Processor -- start 2024-02-19T06:59:01.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.981+0000 7f41ff200640 1 -- start start 2024-02-19T06:59:01.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.982+0000 7f41ff200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f420015b540 0x7f42000cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.982+0000 7f41ff200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42000cb150 0x7f42000cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.983+0000 7f41ff200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42000cb5f0 con 0x7f420015fd50 2024-02-19T06:59:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.983+0000 7f41ff200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420015f270 con 0x7f420015b540 2024-02-19T06:59:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.983+0000 7f41ff200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420015f550 con 0x7f42000cb150 2024-02-19T06:59:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.983+0000 7f41fde00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f420015b540 0x7f42000cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.983+0000 7f41fde00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f420015b540 0x7f42000cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50110/0 (socket says 172.21.15.46:50110) 2024-02-19T06:59:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.983+0000 7f41fde00640 1 -- 172.21.15.46:0/2036023446 learned_addr learned my addr 172.21.15.46:0/2036023446 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.983+0000 7f41fde00640 1 -- 172.21.15.46:0/2036023446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42000cb150 msgr2=0x7f42000cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.983+0000 7f41fde00640 1 --2- 172.21.15.46:0/2036023446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42000cb150 0x7f42000cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.983+0000 7f41fde00640 1 -- 172.21.15.46:0/2036023446 >> v1:172.21.15.46:6789/0 conn(0x7f420015fd50 legacy=0x7f42000c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.984+0000 7f41fde00640 1 -- 172.21.15.46:0/2036023446 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420015f830 con 0x7f420015b540 2024-02-19T06:59:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.985+0000 7f41fde00640 1 --2- 172.21.15.46:0/2036023446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f420015b540 0x7f42000cac10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009870 tx=0x7f41f002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b674e1148cf955c5 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.985+0000 7f41fca00640 1 -- 172.21.15.46:0/2036023446 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0030840 con 0x7f420015b540 2024-02-19T06:59:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.985+0000 7f41fca00640 1 -- 172.21.15.46:0/2036023446 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f00309a0 con 0x7f420015b540 2024-02-19T06:59:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.985+0000 7f41fca00640 1 -- 172.21.15.46:0/2036023446 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0030d30 con 0x7f420015b540 2024-02-19T06:59:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.986+0000 7f41ff200640 1 -- 172.21.15.46:0/2036023446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f420015b540 msgr2=0x7f42000cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.986+0000 7f41ff200640 1 --2- 172.21.15.46:0/2036023446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f420015b540 0x7f42000cac10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009870 tx=0x7f41f002b980 comp rx=0 tx=0).stop 2024-02-19T06:59:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.986+0000 7f41ff200640 1 -- 172.21.15.46:0/2036023446 shutdown_connections 2024-02-19T06:59:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.986+0000 7f41ff200640 1 --2- 172.21.15.46:0/2036023446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42000cb150 0x7f42000cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.986+0000 7f41ff200640 1 --2- 172.21.15.46:0/2036023446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f420015b540 0x7f42000cac10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.986+0000 7f41ff200640 1 -- 172.21.15.46:0/2036023446 >> 172.21.15.46:0/2036023446 conn(0x7f420006afa0 msgr2=0x7f420006b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.986+0000 7f41ff200640 1 -- 172.21.15.46:0/2036023446 shutdown_connections 2024-02-19T06:59:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.986+0000 7f41ff200640 1 -- 172.21.15.46:0/2036023446 wait complete. 2024-02-19T06:59:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.988+0000 7f41ff200640 1 Processor -- start 2024-02-19T06:59:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.988+0000 7f41ff200640 1 -- start start 2024-02-19T06:59:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41ff200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42000cb150 0x7f42000ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41ff200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f420015b540 0x7f420014ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41ff200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f420015fd50 0x7f42000cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41ff200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420014f240 con 0x7f420015b540 2024-02-19T06:59:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41ff200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42000ad120 con 0x7f42000cb150 2024-02-19T06:59:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41ff200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42000adda0 con 0x7f420015fd50 2024-02-19T06:59:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41fd400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f420015b540 0x7f420014ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41fd400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f420015b540 0x7f420014ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50126/0 (socket says 172.21.15.46:50126) 2024-02-19T06:59:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41fd400640 1 -- 172.21.15.46:0/3435572896 learned_addr learned my addr 172.21.15.46:0/3435572896 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41fd400640 1 -- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f420015fd50 msgr2=0x7f42000cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41fde00640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42000cb150 0x7f42000ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41fd400640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f420015fd50 0x7f42000cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41fd400640 1 -- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42000cb150 msgr2=0x7f42000ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41fd400640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42000cb150 0x7f42000ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.989+0000 7f41fd400640 1 -- 172.21.15.46:0/3435572896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00094d0 con 0x7f420015b540 2024-02-19T06:59:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.990+0000 7f41fde00640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42000cb150 0x7f42000ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.990+0000 7f41fd400640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f420015b540 0x7f420014ed00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f41ec00b4a0 tx=0x7f41ec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.990+0000 7f41f6000640 1 -- 172.21.15.46:0/3435572896 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec010610 con 0x7f420015b540 2024-02-19T06:59:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.990+0000 7f41f6000640 1 -- 172.21.15.46:0/3435572896 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec010770 con 0x7f420015b540 2024-02-19T06:59:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.990+0000 7f41f6000640 1 -- 172.21.15.46:0/3435572896 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec010b20 con 0x7f420015b540 2024-02-19T06:59:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.990+0000 7f41ff200640 1 -- 172.21.15.46:0/3435572896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42000ad470 con 0x7f420015b540 2024-02-19T06:59:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.990+0000 7f41ff200640 1 -- 172.21.15.46:0/3435572896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42000ada30 con 0x7f420015b540 2024-02-19T06:59:01.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.991+0000 7f41ff200640 1 -- 172.21.15.46:0/3435572896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42000adf50 con 0x7f420015b540 2024-02-19T06:59:01.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.992+0000 7f41f6000640 1 -- 172.21.15.46:0/3435572896 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f41ec010c80 con 0x7f420015b540 2024-02-19T06:59:01.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.993+0000 7f41f6000640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f41e006b810 0x7f41e006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:01.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.993+0000 7f41f6000640 1 -- 172.21.15.46:0/3435572896 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f41ec089e70 con 0x7f420015b540 2024-02-19T06:59:01.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.994+0000 7f41fde00640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f41e006b810 0x7f41e006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.995+0000 7f41fde00640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f41e006b810 0x7f41e006dcd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f41f0036000 tx=0x7f41f003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:01.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:01.997+0000 7f41f6000640 1 -- 172.21.15.46:0/3435572896 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f42000adf50 con 0x7f420015b540 2024-02-19T06:59:02.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.197+0000 7f41ff200640 1 -- 172.21.15.46:0/3435572896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42000adf10 con 0x7f420015b540 2024-02-19T06:59:02.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.201+0000 7f41f6000640 1 -- 172.21.15.46:0/3435572896 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16855 (secure 0 0 0) 0x7f41ec01e090 con 0x7f420015b540 2024-02-19T06:59:02.203 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:02.203 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:58:37.086581+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:59:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.203+0000 7f41ff200640 1 -- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f41e006b810 msgr2=0x7f41e006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.203+0000 7f41ff200640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f41e006b810 0x7f41e006dcd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f41f0036000 tx=0x7f41f003b040 comp rx=0 tx=0).stop 2024-02-19T06:59:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.204+0000 7f41ff200640 1 -- 172.21.15.46:0/3435572896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f420015b540 msgr2=0x7f420014ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.204+0000 7f41ff200640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f420015b540 0x7f420014ed00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f41ec00b4a0 tx=0x7f41ec00b960 comp rx=0 tx=0).stop 2024-02-19T06:59:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.204+0000 7f41ff200640 1 -- 172.21.15.46:0/3435572896 shutdown_connections 2024-02-19T06:59:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.204+0000 7f41ff200640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f41e006b810 0x7f41e006dcd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.204+0000 7f41ff200640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f420015fd50 0x7f42000cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.204+0000 7f41ff200640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f420015b540 0x7f420014ed00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.204+0000 7f41ff200640 1 --2- 172.21.15.46:0/3435572896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42000cb150 0x7f42000ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.204+0000 7f41ff200640 1 -- 172.21.15.46:0/3435572896 >> 172.21.15.46:0/3435572896 conn(0x7f420006afa0 msgr2=0x7f42000cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.204+0000 7f41ff200640 1 -- 172.21.15.46:0/3435572896 shutdown_connections 2024-02-19T06:59:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.204+0000 7f41ff200640 1 -- 172.21.15.46:0/3435572896 wait complete. 2024-02-19T06:59:02.227 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-19T06:59:02.227 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T06:59:02.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.433+0000 7fd370c00640 1 Processor -- start 2024-02-19T06:59:02.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.433+0000 7fd370c00640 1 -- start start 2024-02-19T06:59:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.435+0000 7fd370c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd36c0ae3f0 0x7fd36c0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.435+0000 7fd370c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd36c0b2540 0x7fd36c0b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.435+0000 7fd370c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36c0ad260 con 0x7fd36c0ae7d0 2024-02-19T06:59:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.435+0000 7fd370c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36c0adee0 con 0x7fd36c0ae3f0 2024-02-19T06:59:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.435+0000 7fd370c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36c0ad540 con 0x7fd36c0b2540 2024-02-19T06:59:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.436+0000 7fd369e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd36c0ae3f0 0x7fd36c0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.436+0000 7fd369e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd36c0ae3f0 0x7fd36c0acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50142/0 (socket says 172.21.15.46:50142) 2024-02-19T06:59:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.436+0000 7fd369e00640 1 -- 172.21.15.46:0/763601323 learned_addr learned my addr 172.21.15.46:0/763601323 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.436+0000 7fd36a800640 1 --2- 172.21.15.46:0/763601323 >> v2:172.21.15.142:3300/0 conn(0x7fd36c0b2540 0x7fd36c0b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.436+0000 7fd369e00640 1 -- 172.21.15.46:0/763601323 >> v2:172.21.15.142:3300/0 conn(0x7fd36c0b2540 msgr2=0x7fd36c0b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.436+0000 7fd369e00640 1 --2- 172.21.15.46:0/763601323 >> v2:172.21.15.142:3300/0 conn(0x7fd36c0b2540 0x7fd36c0b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.436+0000 7fd369e00640 1 -- 172.21.15.46:0/763601323 >> v1:172.21.15.142:6789/0 conn(0x7fd36c0ae7d0 legacy=0x7fd36c15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.436+0000 7fd369e00640 1 -- 172.21.15.46:0/763601323 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c0ad820 con 0x7fd36c0ae3f0 2024-02-19T06:59:02.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.438+0000 7fd369e00640 1 --2- 172.21.15.46:0/763601323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd36c0ae3f0 0x7fd36c0acb80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd36c06bb60 tx=0x7fd35c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792a7a3342d171eb server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:02.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.438+0000 7fd369400640 1 -- 172.21.15.46:0/763601323 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c031870 con 0x7fd36c0ae3f0 2024-02-19T06:59:02.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.438+0000 7fd369400640 1 -- 172.21.15.46:0/763601323 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c0319d0 con 0x7fd36c0ae3f0 2024-02-19T06:59:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.438+0000 7fd369400640 1 -- 172.21.15.46:0/763601323 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c031d60 con 0x7fd36c0ae3f0 2024-02-19T06:59:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.439+0000 7fd370c00640 1 -- 172.21.15.46:0/763601323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd36c0ae3f0 msgr2=0x7fd36c0acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.439+0000 7fd370c00640 1 --2- 172.21.15.46:0/763601323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd36c0ae3f0 0x7fd36c0acb80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd36c06bb60 tx=0x7fd35c02b910 comp rx=0 tx=0).stop 2024-02-19T06:59:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.439+0000 7fd370c00640 1 -- 172.21.15.46:0/763601323 shutdown_connections 2024-02-19T06:59:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.439+0000 7fd370c00640 1 --2- 172.21.15.46:0/763601323 >> v2:172.21.15.142:3300/0 conn(0x7fd36c0b2540 0x7fd36c0b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.439+0000 7fd370c00640 1 --2- 172.21.15.46:0/763601323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd36c0ae3f0 0x7fd36c0acb80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.439+0000 7fd370c00640 1 -- 172.21.15.46:0/763601323 >> 172.21.15.46:0/763601323 conn(0x7fd36c066f70 msgr2=0x7fd36c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.439+0000 7fd370c00640 1 -- 172.21.15.46:0/763601323 shutdown_connections 2024-02-19T06:59:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.439+0000 7fd370c00640 1 -- 172.21.15.46:0/763601323 wait complete. 2024-02-19T06:59:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.441+0000 7fd370c00640 1 Processor -- start 2024-02-19T06:59:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.441+0000 7fd370c00640 1 -- start start 2024-02-19T06:59:02.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.442+0000 7fd370c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd36c0ae3f0 0x7fd36c1f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.442+0000 7fd370c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd36c0ae7d0 0x7fd36c160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.442+0000 7fd370c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd36c0b2540 0x7fd36c160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.442+0000 7fd370c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1f7b80 con 0x7fd36c0b2540 2024-02-19T06:59:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.442+0000 7fd370c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1f75c0 con 0x7fd36c0ae3f0 2024-02-19T06:59:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.442+0000 7fd370c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1f78a0 con 0x7fd36c0ae7d0 2024-02-19T06:59:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.442+0000 7fd36a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd36c0b2540 0x7fd36c160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.443+0000 7fd36a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd36c0b2540 0x7fd36c160c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50144/0 (socket says 172.21.15.46:50144) 2024-02-19T06:59:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.443+0000 7fd36a800640 1 -- 172.21.15.46:0/2539953449 learned_addr learned my addr 172.21.15.46:0/2539953449 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.443+0000 7fd369e00640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd36c0ae3f0 0x7fd36c1f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.443+0000 7fd361400640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd36c0ae7d0 0x7fd36c160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.443+0000 7fd36a800640 1 -- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd36c0ae7d0 msgr2=0x7fd36c160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.443+0000 7fd36a800640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd36c0ae7d0 0x7fd36c160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.443+0000 7fd36a800640 1 -- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd36c0ae3f0 msgr2=0x7fd36c1f6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.443+0000 7fd36a800640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd36c0ae3f0 0x7fd36c1f6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.443+0000 7fd36a800640 1 -- 172.21.15.46:0/2539953449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c0094d0 con 0x7fd36c0b2540 2024-02-19T06:59:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.443+0000 7fd36a800640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd36c0b2540 0x7fd36c160c90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd364007e60 tx=0x7fd36400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.444+0000 7fd362a00640 1 -- 172.21.15.46:0/2539953449 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364014420 con 0x7fd36c0b2540 2024-02-19T06:59:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.444+0000 7fd362a00640 1 -- 172.21.15.46:0/2539953449 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3640145a0 con 0x7fd36c0b2540 2024-02-19T06:59:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.444+0000 7fd362a00640 1 -- 172.21.15.46:0/2539953449 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364014950 con 0x7fd36c0b2540 2024-02-19T06:59:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.444+0000 7fd370c00640 1 -- 172.21.15.46:0/2539953449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36c0cb830 con 0x7fd36c0b2540 2024-02-19T06:59:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.444+0000 7fd370c00640 1 -- 172.21.15.46:0/2539953449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36c1f7200 con 0x7fd36c0b2540 2024-02-19T06:59:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.445+0000 7fd370c00640 1 -- 172.21.15.46:0/2539953449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36c1f7390 con 0x7fd36c0b2540 2024-02-19T06:59:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.446+0000 7fd362a00640 1 -- 172.21.15.46:0/2539953449 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd364014ab0 con 0x7fd36c0b2540 2024-02-19T06:59:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.447+0000 7fd362a00640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd34806b810 0x7fd34806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.447+0000 7fd362a00640 1 -- 172.21.15.46:0/2539953449 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd36408aac0 con 0x7fd36c0b2540 2024-02-19T06:59:02.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.448+0000 7fd369e00640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd34806b810 0x7fd34806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:02.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.449+0000 7fd369e00640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd34806b810 0x7fd34806dcd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd35c036000 tx=0x7fd35c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.452+0000 7fd362a00640 1 -- 172.21.15.46:0/2539953449 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd3640554f0 con 0x7fd36c0b2540 2024-02-19T06:59:02.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.687+0000 7fd370c00640 1 -- 172.21.15.46:0/2539953449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd36c0cbd50 con 0x7fd36c0b2540 2024-02-19T06:59:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.688+0000 7fd362a00640 1 -- 172.21.15.46:0/2539953449 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7fd36408ae60 con 0x7fd36c0b2540 2024-02-19T06:59:02.690 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:02.690 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/380368509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":380368509},{"type":"v1","addr":"172.21.15.46:6834","nonce":380368509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/957808004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":957808004},{"type":"v1","addr":"172.21.15.46:6835","nonce":957808004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1288321773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1288321773},{"type":"v1","addr":"172.21.15.142:6837","nonce":1288321773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:57:55.292605+0000","modified":"2024-02-19T06:57:58.373002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2651895852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2651895852},{"type":"v1","addr":"172.21.15.142:6836","nonce":2651895852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-19T06:59:02.690 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-02-19T06:59:02.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.690+0000 7fd370c00640 1 -- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd34806b810 msgr2=0x7fd34806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:02.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.690+0000 7fd370c00640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd34806b810 0x7fd34806dcd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd35c036000 tx=0x7fd35c03c040 comp rx=0 tx=0).stop 2024-02-19T06:59:02.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.690+0000 7fd370c00640 1 -- 172.21.15.46:0/2539953449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd36c0b2540 msgr2=0x7fd36c160c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:02.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.690+0000 7fd370c00640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd36c0b2540 0x7fd36c160c90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd364007e60 tx=0x7fd36400e4b0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.691+0000 7fd370c00640 1 -- 172.21.15.46:0/2539953449 shutdown_connections 2024-02-19T06:59:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.691+0000 7fd370c00640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd34806b810 0x7fd34806dcd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.691+0000 7fd370c00640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd36c0b2540 0x7fd36c160c90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.691+0000 7fd370c00640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd36c0ae7d0 0x7fd36c160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.691+0000 7fd370c00640 1 --2- 172.21.15.46:0/2539953449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd36c0ae3f0 0x7fd36c1f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.691+0000 7fd370c00640 1 -- 172.21.15.46:0/2539953449 >> 172.21.15.46:0/2539953449 conn(0x7fd36c066f70 msgr2=0x7fd36c06d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.691+0000 7fd370c00640 1 -- 172.21.15.46:0/2539953449 shutdown_connections 2024-02-19T06:59:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.691+0000 7fd370c00640 1 -- 172.21.15.46:0/2539953449 wait complete. 2024-02-19T06:59:02.711 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T06:59:02.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.926+0000 7fd9d7200640 1 Processor -- start 2024-02-19T06:59:02.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.926+0000 7fd9d7200640 1 -- start start 2024-02-19T06:59:02.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.927+0000 7fd9d7200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd9d80ca320 0x7fd9d80cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:02.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.927+0000 7fd9d7200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd9d80cfdb0 0x7fd9d80b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:02.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.927+0000 7fd9d7200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d80cd250 con 0x7fd9d80b2700 2024-02-19T06:59:02.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.927+0000 7fd9d7200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d80b3190 con 0x7fd9d80ca320 2024-02-19T06:59:02.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.927+0000 7fd9d7200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d80d0260 con 0x7fd9d80cfdb0 2024-02-19T06:59:02.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.927+0000 7fd9d6800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd9d80b2700 0x7fd9d815e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48418/0 (socket says 172.21.15.46:48418) 2024-02-19T06:59:02.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.927+0000 7fd9d5e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd9d80ca320 0x7fd9d80cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:02.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.927+0000 7fd9d6800640 1 -- 172.21.15.46:0/2506472267 learned_addr learned my addr 172.21.15.46:0/2506472267 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:02.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.928+0000 7fd9d5400640 1 --2- 172.21.15.46:0/2506472267 >> v2:172.21.15.142:3300/0 conn(0x7fd9d80cfdb0 0x7fd9d80b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:02.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.928+0000 7fd9d5e00640 1 -- 172.21.15.46:0/2506472267 >> v2:172.21.15.142:3300/0 conn(0x7fd9d80cfdb0 msgr2=0x7fd9d80b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:02.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.928+0000 7fd9d5e00640 1 --2- 172.21.15.46:0/2506472267 >> v2:172.21.15.142:3300/0 conn(0x7fd9d80cfdb0 0x7fd9d80b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.928+0000 7fd9d5e00640 1 -- 172.21.15.46:0/2506472267 >> v1:172.21.15.46:6789/0 conn(0x7fd9d80b2700 legacy=0x7fd9d815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:02.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.928+0000 7fd9d5e00640 1 -- 172.21.15.46:0/2506472267 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d80b2eb0 con 0x7fd9d80ca320 2024-02-19T06:59:02.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.928+0000 7fd9d5400640 1 --2- 172.21.15.46:0/2506472267 >> v2:172.21.15.142:3300/0 conn(0x7fd9d80cfdb0 0x7fd9d80b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:02.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.929+0000 7fd9d5e00640 1 --2- 172.21.15.46:0/2506472267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d80ca320 0x7fd9d80cf870 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80ccfb0 tx=0x7fd9c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8505b95a6182f601 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:02.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.929+0000 7fd9d4a00640 1 -- 172.21.15.46:0/2506472267 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0031830 con 0x7fd9d80ca320 2024-02-19T06:59:02.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.930+0000 7fd9d4a00640 1 -- 172.21.15.46:0/2506472267 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c0031990 con 0x7fd9d80ca320 2024-02-19T06:59:02.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.930+0000 7fd9d4a00640 1 -- 172.21.15.46:0/2506472267 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0031d20 con 0x7fd9d80ca320 2024-02-19T06:59:02.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.930+0000 7fd9d7200640 1 -- 172.21.15.46:0/2506472267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d80ca320 msgr2=0x7fd9d80cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:02.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.930+0000 7fd9d7200640 1 --2- 172.21.15.46:0/2506472267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d80ca320 0x7fd9d80cf870 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80ccfb0 tx=0x7fd9c002b8d0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.930+0000 7fd9d7200640 1 -- 172.21.15.46:0/2506472267 shutdown_connections 2024-02-19T06:59:02.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.930+0000 7fd9d7200640 1 --2- 172.21.15.46:0/2506472267 >> v2:172.21.15.142:3300/0 conn(0x7fd9d80cfdb0 0x7fd9d80b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.930+0000 7fd9d7200640 1 --2- 172.21.15.46:0/2506472267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d80ca320 0x7fd9d80cf870 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.930+0000 7fd9d7200640 1 -- 172.21.15.46:0/2506472267 >> 172.21.15.46:0/2506472267 conn(0x7fd9d806afa0 msgr2=0x7fd9d806b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:02.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.930+0000 7fd9d7200640 1 -- 172.21.15.46:0/2506472267 shutdown_connections 2024-02-19T06:59:02.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.930+0000 7fd9d7200640 1 -- 172.21.15.46:0/2506472267 wait complete. 2024-02-19T06:59:02.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.932+0000 7fd9d7200640 1 Processor -- start 2024-02-19T06:59:02.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.932+0000 7fd9d7200640 1 -- start start 2024-02-19T06:59:02.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.933+0000 7fd9d7200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d80b2700 0x7fd9d8157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.933+0000 7fd9d7200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9d80ca320 0x7fd9d80c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.933+0000 7fd9d7200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9d80cfdb0 0x7fd9d80c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.933+0000 7fd9d7200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80c92d0 con 0x7fd9d80b2700 2024-02-19T06:59:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.933+0000 7fd9d7200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80af7d0 con 0x7fd9d80cfdb0 2024-02-19T06:59:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.933+0000 7fd9d7200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80afa20 con 0x7fd9d80ca320 2024-02-19T06:59:02.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.934+0000 7fd9d5e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d80b2700 0x7fd9d8157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:02.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.934+0000 7fd9d5e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d80b2700 0x7fd9d8157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50162/0 (socket says 172.21.15.46:50162) 2024-02-19T06:59:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.934+0000 7fd9d5e00640 1 -- 172.21.15.46:0/1267472978 learned_addr learned my addr 172.21.15.46:0/1267472978 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.934+0000 7fd9d6800640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9d80cfdb0 0x7fd9d80c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.934+0000 7fd9d5400640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9d80ca320 0x7fd9d80c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.934+0000 7fd9d5e00640 1 -- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9d80ca320 msgr2=0x7fd9d80c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.934+0000 7fd9d5e00640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9d80ca320 0x7fd9d80c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.934+0000 7fd9d5e00640 1 -- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9d80cfdb0 msgr2=0x7fd9d80c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.934+0000 7fd9d5e00640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9d80cfdb0 0x7fd9d80c2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.934+0000 7fd9d5e00640 1 -- 172.21.15.46:0/1267472978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c0009400 con 0x7fd9d80b2700 2024-02-19T06:59:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.935+0000 7fd9d5e00640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d80b2700 0x7fd9d8157250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd9c002bee0 tx=0x7fd9c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.935+0000 7fd9ce000640 1 -- 172.21.15.46:0/1267472978 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c003ba70 con 0x7fd9d80b2700 2024-02-19T06:59:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.935+0000 7fd9ce000640 1 -- 172.21.15.46:0/1267472978 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c003bbf0 con 0x7fd9d80b2700 2024-02-19T06:59:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.935+0000 7fd9d7200640 1 -- 172.21.15.46:0/1267472978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d80c8ab0 con 0x7fd9d80b2700 2024-02-19T06:59:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.935+0000 7fd9ce000640 1 -- 172.21.15.46:0/1267472978 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c00433f0 con 0x7fd9d80b2700 2024-02-19T06:59:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.935+0000 7fd9d7200640 1 -- 172.21.15.46:0/1267472978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d80c8ff0 con 0x7fd9d80b2700 2024-02-19T06:59:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.937+0000 7fd9d7200640 1 -- 172.21.15.46:0/1267472978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d80c8910 con 0x7fd9d80b2700 2024-02-19T06:59:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.937+0000 7fd9ce000640 1 -- 172.21.15.46:0/1267472978 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd9c0043550 con 0x7fd9d80b2700 2024-02-19T06:59:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.938+0000 7fd9ce000640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd9b406b810 0x7fd9b406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:02.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.938+0000 7fd9ce000640 1 -- 172.21.15.46:0/1267472978 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd9c00ac320 con 0x7fd9d80b2700 2024-02-19T06:59:02.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.939+0000 7fd9d5400640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd9b406b810 0x7fd9b406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:02.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.940+0000 7fd9d5400640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd9b406b810 0x7fd9b406dcd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8007510 tx=0x7fd9c80074a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:02.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:02.943+0000 7fd9ce000640 1 -- 172.21.15.46:0/1267472978 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9d80c8910 con 0x7fd9d80b2700 2024-02-19T06:59:03.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.177+0000 7fd9d7200640 1 -- 172.21.15.46:0/1267472978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9d80c8910 con 0x7fd9d80b2700 2024-02-19T06:59:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.178+0000 7fd9ce000640 1 -- 172.21.15.46:0/1267472978 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7fd9d80c8910 con 0x7fd9d80b2700 2024-02-19T06:59:03.179 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:03.180 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/380368509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":380368509},{"type":"v1","addr":"172.21.15.46:6834","nonce":380368509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/957808004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":957808004},{"type":"v1","addr":"172.21.15.46:6835","nonce":957808004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1288321773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1288321773},{"type":"v1","addr":"172.21.15.142:6837","nonce":1288321773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:57:55.292605+0000","modified":"2024-02-19T06:57:58.373002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2651895852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2651895852},{"type":"v1","addr":"172.21.15.142:6836","nonce":2651895852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-19T06:59:03.180 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-02-19T06:59:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.180+0000 7fd9d7200640 1 -- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd9b406b810 msgr2=0x7fd9b406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.180+0000 7fd9d7200640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd9b406b810 0x7fd9b406dcd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8007510 tx=0x7fd9c80074a0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.180+0000 7fd9d7200640 1 -- 172.21.15.46:0/1267472978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d80b2700 msgr2=0x7fd9d8157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.180+0000 7fd9d7200640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d80b2700 0x7fd9d8157250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd9c002bee0 tx=0x7fd9c00046c0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.180+0000 7fd9d7200640 1 -- 172.21.15.46:0/1267472978 shutdown_connections 2024-02-19T06:59:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.180+0000 7fd9d7200640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd9b406b810 0x7fd9b406dcd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.180+0000 7fd9d7200640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9d80cfdb0 0x7fd9d80c2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.180+0000 7fd9d7200640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9d80ca320 0x7fd9d80c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.180+0000 7fd9d7200640 1 --2- 172.21.15.46:0/1267472978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d80b2700 0x7fd9d8157250 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.180+0000 7fd9d7200640 1 -- 172.21.15.46:0/1267472978 >> 172.21.15.46:0/1267472978 conn(0x7fd9d806afa0 msgr2=0x7fd9d80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.181+0000 7fd9d7200640 1 -- 172.21.15.46:0/1267472978 shutdown_connections 2024-02-19T06:59:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.181+0000 7fd9d7200640 1 -- 172.21.15.46:0/1267472978 wait complete. 2024-02-19T06:59:03.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:59:03.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.408+0000 7fa381000640 1 Processor -- start 2024-02-19T06:59:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.408+0000 7fa381000640 1 -- start start 2024-02-19T06:59:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.410+0000 7fa381000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa37c0ce9f0 0x7fa37c0cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.410+0000 7fa381000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa37c0cfe50 0x7fa37c0b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.410+0000 7fa381000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37c0ca820 con 0x7fa37c0ca3b0 2024-02-19T06:59:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.410+0000 7fa381000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37c070eb0 con 0x7fa37c0cfe50 2024-02-19T06:59:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.410+0000 7fa381000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37c0b2700 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.410+0000 7fa372a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa37c0ca3b0 0x7fa37c0cf740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48424/0 (socket says 172.21.15.46:48424) 2024-02-19T06:59:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.410+0000 7fa372a00640 1 -- 172.21.15.46:0/1613227493 learned_addr learned my addr 172.21.15.46:0/1613227493 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.410+0000 7fa37be00640 1 --2- 172.21.15.46:0/1613227493 >> v2:172.21.15.46:3300/0 conn(0x7fa37c0cfe50 0x7fa37c0b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.410+0000 7fa37b400640 1 --2- 172.21.15.46:0/1613227493 >> v2:172.21.15.142:3300/0 conn(0x7fa37c0ce9f0 0x7fa37c0cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.411+0000 7fa37aa00640 1 -- 172.21.15.46:0/1613227493 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961663881 0 0) 0x7fa37c0ca820 con 0x7fa37c0ca3b0 2024-02-19T06:59:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.411+0000 7fa37aa00640 1 -- 172.21.15.46:0/1613227493 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa360003520 con 0x7fa37c0ca3b0 2024-02-19T06:59:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.411+0000 7fa37be00640 1 -- 172.21.15.46:0/1613227493 >> v2:172.21.15.142:3300/0 conn(0x7fa37c0ce9f0 msgr2=0x7fa37c0cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.411+0000 7fa37be00640 1 --2- 172.21.15.46:0/1613227493 >> v2:172.21.15.142:3300/0 conn(0x7fa37c0ce9f0 0x7fa37c0cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.411+0000 7fa37be00640 1 -- 172.21.15.46:0/1613227493 >> v1:172.21.15.46:6789/0 conn(0x7fa37c0ca3b0 legacy=0x7fa37c0cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.411+0000 7fa37be00640 1 -- 172.21.15.46:0/1613227493 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c0710c0 con 0x7fa37c0cfe50 2024-02-19T06:59:03.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.412+0000 7fa37be00640 1 --2- 172.21.15.46:0/1613227493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0cfe50 0x7fa37c0b21c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0d0290 tx=0x7fa37402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664eb6bd5a453ad1 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:03.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.412+0000 7fa37aa00640 1 -- 172.21.15.46:0/1613227493 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37402cc80 con 0x7fa37c0cfe50 2024-02-19T06:59:03.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.412+0000 7fa37aa00640 1 -- 172.21.15.46:0/1613227493 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37402cde0 con 0x7fa37c0cfe50 2024-02-19T06:59:03.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.412+0000 7fa37aa00640 1 -- 172.21.15.46:0/1613227493 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374034660 con 0x7fa37c0cfe50 2024-02-19T06:59:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.413+0000 7fa381000640 1 -- 172.21.15.46:0/1613227493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0cfe50 msgr2=0x7fa37c0b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.413+0000 7fa381000640 1 --2- 172.21.15.46:0/1613227493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0cfe50 0x7fa37c0b21c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0d0290 tx=0x7fa37402bed0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.413+0000 7fa381000640 1 -- 172.21.15.46:0/1613227493 shutdown_connections 2024-02-19T06:59:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.413+0000 7fa381000640 1 --2- 172.21.15.46:0/1613227493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0cfe50 0x7fa37c0b21c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.413+0000 7fa381000640 1 --2- 172.21.15.46:0/1613227493 >> v2:172.21.15.142:3300/0 conn(0x7fa37c0ce9f0 0x7fa37c0cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.413+0000 7fa381000640 1 -- 172.21.15.46:0/1613227493 >> 172.21.15.46:0/1613227493 conn(0x7fa37c06afa0 msgr2=0x7fa37c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.413+0000 7fa381000640 1 -- 172.21.15.46:0/1613227493 shutdown_connections 2024-02-19T06:59:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.413+0000 7fa381000640 1 -- 172.21.15.46:0/1613227493 wait complete. 2024-02-19T06:59:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.415+0000 7fa381000640 1 Processor -- start 2024-02-19T06:59:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.415+0000 7fa381000640 1 -- start start 2024-02-19T06:59:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa381000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa37c0ca3b0 0x7fa37c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa381000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0ce9f0 0x7fa37c15cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa381000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa37c0cfe50 0x7fa37c098850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa381000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c152a80 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa381000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c15d150 con 0x7fa37c0ca3b0 2024-02-19T06:59:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa381000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c151e00 con 0x7fa37c0cfe50 2024-02-19T06:59:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa372a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0ce9f0 0x7fa37c15cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa372a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0ce9f0 0x7fa37c15cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50194/0 (socket says 172.21.15.46:50194) 2024-02-19T06:59:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa372a00640 1 -- 172.21.15.46:0/2385725634 learned_addr learned my addr 172.21.15.46:0/2385725634 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa372a00640 1 -- 172.21.15.46:0/2385725634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa37c0cfe50 msgr2=0x7fa37c098850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa372a00640 1 --2- 172.21.15.46:0/2385725634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa37c0cfe50 0x7fa37c098850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa372a00640 1 -- 172.21.15.46:0/2385725634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa37c0ca3b0 msgr2=0x7fa37c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa372a00640 1 --2- 172.21.15.46:0/2385725634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa37c0ca3b0 0x7fa37c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.416+0000 7fa372a00640 1 -- 172.21.15.46:0/2385725634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa374009a70 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.417+0000 7fa372a00640 1 --2- 172.21.15.46:0/2385725634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0ce9f0 0x7fa37c15cc10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa36400c390 tx=0x7fa36400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.417+0000 7fa373e00640 1 -- 172.21.15.46:0/2385725634 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364005ce0 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.417+0000 7fa373e00640 1 -- 172.21.15.46:0/2385725634 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa364005e40 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.417+0000 7fa381000640 1 -- 172.21.15.46:0/2385725634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37c1520e0 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.417+0000 7fa373e00640 1 -- 172.21.15.46:0/2385725634 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3640072f0 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.417+0000 7fa381000640 1 -- 172.21.15.46:0/2385725634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c1526a0 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.418+0000 7fa381000640 1 -- 172.21.15.46:0/2385725634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37c06b8b0 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.419+0000 7fa373e00640 1 -- 172.21.15.46:0/2385725634 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa364007450 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.421+0000 7fa373e00640 1 --2- 172.21.15.46:0/2385725634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa35806b840 0x7fa35806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.421+0000 7fa373e00640 1 -- 172.21.15.46:0/2385725634 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa364089770 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.421+0000 7fa37b400640 1 --2- 172.21.15.46:0/2385725634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa35806b840 0x7fa35806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:03.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.423+0000 7fa37b400640 1 --2- 172.21.15.46:0/2385725634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa35806b840 0x7fa35806dd00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa36c006a90 tx=0x7fa36c006a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:03.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.426+0000 7fa373e00640 1 -- 172.21.15.46:0/2385725634 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa3640541a0 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.618+0000 7fa381000640 1 -- 172.21.15.46:0/2385725634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa37c152bc0 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.621+0000 7fa373e00640 1 -- 172.21.15.46:0/2385725634 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16855 (secure 0 0 0) 0x7fa37c152bc0 con 0x7fa37c0ce9f0 2024-02-19T06:59:03.623 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:03.623 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:58:37.086581+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:57:53.352097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-19T06:57:54.315102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:59:03.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.624+0000 7fa381000640 1 -- 172.21.15.46:0/2385725634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa35806b840 msgr2=0x7fa35806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:03.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.624+0000 7fa381000640 1 --2- 172.21.15.46:0/2385725634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa35806b840 0x7fa35806dd00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa36c006a90 tx=0x7fa36c006a20 comp rx=0 tx=0).stop 2024-02-19T06:59:03.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.624+0000 7fa381000640 1 -- 172.21.15.46:0/2385725634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0ce9f0 msgr2=0x7fa37c15cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:03.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.624+0000 7fa381000640 1 --2- 172.21.15.46:0/2385725634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0ce9f0 0x7fa37c15cc10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa36400c390 tx=0x7fa36400c850 comp rx=0 tx=0).stop 2024-02-19T06:59:03.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.624+0000 7fa381000640 1 -- 172.21.15.46:0/2385725634 shutdown_connections 2024-02-19T06:59:03.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.624+0000 7fa381000640 1 --2- 172.21.15.46:0/2385725634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa35806b840 0x7fa35806dd00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.624+0000 7fa381000640 1 --2- 172.21.15.46:0/2385725634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa37c0cfe50 0x7fa37c098850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.624+0000 7fa381000640 1 --2- 172.21.15.46:0/2385725634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0ce9f0 0x7fa37c15cc10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.624+0000 7fa381000640 1 --2- 172.21.15.46:0/2385725634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa37c0ca3b0 0x7fa37c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.624+0000 7fa381000640 1 -- 172.21.15.46:0/2385725634 >> 172.21.15.46:0/2385725634 conn(0x7fa37c06afa0 msgr2=0x7fa37c1570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:03.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.624+0000 7fa381000640 1 -- 172.21.15.46:0/2385725634 shutdown_connections 2024-02-19T06:59:03.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.624+0000 7fa381000640 1 -- 172.21.15.46:0/2385725634 wait complete. 2024-02-19T06:59:03.644 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-19T06:59:03.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.852+0000 7fa4ed800640 1 Processor -- start 2024-02-19T06:59:03.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.852+0000 7fa4ed800640 1 -- start start 2024-02-19T06:59:03.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.854+0000 7fa4ed800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4e815b610 0x7fa4e815fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.854+0000 7fa4ed800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4e80cf690 0x7fa4e80cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.854+0000 7fa4ed800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e80d0030 con 0x7fa4e815b9f0 2024-02-19T06:59:03.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.854+0000 7fa4ed800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e80cdc00 con 0x7fa4e80cf690 2024-02-19T06:59:03.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.854+0000 7fa4ed800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e815c900 con 0x7fa4e815b610 2024-02-19T06:59:03.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.854+0000 7fa4ece00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa4e815b9f0 0x7fa4e815be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48432/0 (socket says 172.21.15.46:48432) 2024-02-19T06:59:03.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.854+0000 7fa4ece00640 1 -- 172.21.15.46:0/1174910517 learned_addr learned my addr 172.21.15.46:0/1174910517 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.855+0000 7fa4e7e00640 1 --2- 172.21.15.46:0/1174910517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4e815b610 0x7fa4e815fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.855+0000 7fa4dfe00640 1 --2- 172.21.15.46:0/1174910517 >> v2:172.21.15.142:3300/0 conn(0x7fa4e80cf690 0x7fa4e80cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.855+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287526479 0 0) 0x7fa4e80d0030 con 0x7fa4e815b9f0 2024-02-19T06:59:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.855+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4cc003520 con 0x7fa4e815b9f0 2024-02-19T06:59:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.855+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1068684954 0 0) 0x7fa4cc003520 con 0x7fa4e815b9f0 2024-02-19T06:59:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.855+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4e815b610 msgr2=0x7fa4e815fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.855+0000 7fa4e7400640 1 --2- 172.21.15.46:0/1174910517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4e815b610 0x7fa4e815fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.855+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 >> v2:172.21.15.142:3300/0 conn(0x7fa4e80cf690 msgr2=0x7fa4e80cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.855+0000 7fa4e7400640 1 --2- 172.21.15.46:0/1174910517 >> v2:172.21.15.142:3300/0 conn(0x7fa4e80cf690 0x7fa4e80cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.855+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e815cbe0 con 0x7fa4e815b9f0 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.855+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fa4e00019f0 con 0x7fa4e815b9f0 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.855+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 >> v1:172.21.15.46:6789/0 conn(0x7fa4e815b9f0 legacy=0x7fa4e815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4e7400640 1 --2- 172.21.15.46:0/1174910517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4e815b610 0x7fa4cc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4e7400640 1 --2- 172.21.15.46:0/1174910517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc003f40 0x7fa4cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4e7400640 1 --2- 172.21.15.46:0/1174910517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4cc004d00 0x7fa4cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80cdc00 con 0x7fa4cc004d00 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e815c900 con 0x7fa4cc003f40 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc00b980 con 0x7fa4e815b610 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4ece00640 1 --2- 172.21.15.46:0/1174910517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4cc004d00 0x7fa4cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4e7e00640 1 --2- 172.21.15.46:0/1174910517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4e815b610 0x7fa4cc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4ece00640 1 -- 172.21.15.46:0/1174910517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4e815b610 msgr2=0x7fa4cc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:03.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4ece00640 1 --2- 172.21.15.46:0/1174910517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4e815b610 0x7fa4cc003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4dfe00640 1 --2- 172.21.15.46:0/1174910517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc003f40 0x7fa4cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:03.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4ece00640 1 -- 172.21.15.46:0/1174910517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc003f40 msgr2=0x7fa4cc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:03.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4ece00640 1 --2- 172.21.15.46:0/1174910517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc003f40 0x7fa4cc0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4ece00640 1 -- 172.21.15.46:0/1174910517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc003520 con 0x7fa4cc004d00 2024-02-19T06:59:03.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.856+0000 7fa4e7e00640 1 --2- 172.21.15.46:0/1174910517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4e815b610 0x7fa4cc003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:03.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.857+0000 7fa4ece00640 1 --2- 172.21.15.46:0/1174910517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4cc004d00 0x7fa4cc005180 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000a7c0 tx=0x7fa4cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c68475f52ab415e server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:03.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.858+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0034630 con 0x7fa4cc004d00 2024-02-19T06:59:03.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.858+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e002f070 con 0x7fa4cc004d00 2024-02-19T06:59:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.858+0000 7fa4e7400640 1 -- 172.21.15.46:0/1174910517 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0034a30 con 0x7fa4cc004d00 2024-02-19T06:59:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.858+0000 7fa4ed800640 1 -- 172.21.15.46:0/1174910517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4cc004d00 msgr2=0x7fa4cc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.858+0000 7fa4ed800640 1 --2- 172.21.15.46:0/1174910517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4cc004d00 0x7fa4cc005180 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000a7c0 tx=0x7fa4cc0057f0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.858+0000 7fa4ece00640 1 -- 172.21.15.46:0/1174910517 reap_dead start 2024-02-19T06:59:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.858+0000 7fa4ed800640 1 -- 172.21.15.46:0/1174910517 shutdown_connections 2024-02-19T06:59:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.858+0000 7fa4ed800640 1 -- 172.21.15.46:0/1174910517 >> 172.21.15.46:0/1174910517 conn(0x7fa4e80b1200 msgr2=0x7fa4e80b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.858+0000 7fa4ed800640 1 -- 172.21.15.46:0/1174910517 shutdown_connections 2024-02-19T06:59:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.858+0000 7fa4ed800640 1 -- 172.21.15.46:0/1174910517 wait complete. 2024-02-19T06:59:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.860+0000 7fa4ed800640 1 Processor -- start 2024-02-19T06:59:03.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.860+0000 7fa4ed800640 1 -- start start 2024-02-19T06:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.861+0000 7fa4ed800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc004d00 0x7fa4e8098980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.861+0000 7fa4ed800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e8158140 0x7fa4e81585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.861+0000 7fa4ed800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4e8159c30 0x7fa4e815a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.861+0000 7fa4ed800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e815a5f0 con 0x7fa4e8158140 2024-02-19T06:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.861+0000 7fa4ed800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e81f49b0 con 0x7fa4cc004d00 2024-02-19T06:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.861+0000 7fa4ed800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e8098ec0 con 0x7fa4e8159c30 2024-02-19T06:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.861+0000 7fa4dfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e8158140 0x7fa4e81585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.862+0000 7fa4dfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e8158140 0x7fa4e81585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50222/0 (socket says 172.21.15.46:50222) 2024-02-19T06:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.862+0000 7fa4dfe00640 1 -- 172.21.15.46:0/2608089112 learned_addr learned my addr 172.21.15.46:0/2608089112 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.862+0000 7fa4e7e00640 1 --2- 172.21.15.46:0/2608089112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc004d00 0x7fa4e8098980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.862+0000 7fa4dfe00640 1 -- 172.21.15.46:0/2608089112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4e8159c30 msgr2=0x7fa4e815a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.862+0000 7fa4dfe00640 1 --2- 172.21.15.46:0/2608089112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4e8159c30 0x7fa4e815a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.862+0000 7fa4dfe00640 1 -- 172.21.15.46:0/2608089112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc004d00 msgr2=0x7fa4e8098980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.862+0000 7fa4dfe00640 1 --2- 172.21.15.46:0/2608089112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc004d00 0x7fa4e8098980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.862+0000 7fa4dfe00640 1 -- 172.21.15.46:0/2608089112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e81f4c00 con 0x7fa4e8158140 2024-02-19T06:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.862+0000 7fa4dfe00640 1 --2- 172.21.15.46:0/2608089112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e8158140 0x7fa4e81585c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0010910 tx=0x7fa4d0010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.862+0000 7fa4e4c00640 1 -- 172.21.15.46:0/2608089112 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0009690 con 0x7fa4e8158140 2024-02-19T06:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.862+0000 7fa4e4c00640 1 -- 172.21.15.46:0/2608089112 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d000eb60 con 0x7fa4e8158140 2024-02-19T06:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.862+0000 7fa4ed800640 1 -- 172.21.15.46:0/2608089112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e81f4ee0 con 0x7fa4e8158140 2024-02-19T06:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.862+0000 7fa4e4c00640 1 -- 172.21.15.46:0/2608089112 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d001c400 con 0x7fa4e8158140 2024-02-19T06:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.863+0000 7fa4ed800640 1 -- 172.21.15.46:0/2608089112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e81f54a0 con 0x7fa4e8158140 2024-02-19T06:59:03.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.864+0000 7fa4ed800640 1 -- 172.21.15.46:0/2608089112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e804eee0 con 0x7fa4e8158140 2024-02-19T06:59:03.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.865+0000 7fa4e4c00640 1 -- 172.21.15.46:0/2608089112 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa4d001c560 con 0x7fa4e8158140 2024-02-19T06:59:03.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.865+0000 7fa4e4c00640 1 --2- 172.21.15.46:0/2608089112 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa4c406b810 0x7fa4c406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:03.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.866+0000 7fa4e4c00640 1 -- 172.21.15.46:0/2608089112 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa4d008a7e0 con 0x7fa4e8158140 2024-02-19T06:59:03.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.866+0000 7fa4e7e00640 1 --2- 172.21.15.46:0/2608089112 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa4c406b810 0x7fa4c406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:03.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.867+0000 7fa4e7e00640 1 --2- 172.21.15.46:0/2608089112 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa4c406b810 0x7fa4c406dcd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80099c0 tx=0x7fa4d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:03.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:03.870+0000 7fa4e4c00640 1 -- 172.21.15.46:0/2608089112 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa4d0055170 con 0x7fa4e8158140 2024-02-19T06:59:04.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.108+0000 7fa4ed800640 1 -- 172.21.15.46:0/2608089112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa4e80ce6b0 con 0x7fa4e8158140 2024-02-19T06:59:04.110 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-02-19T06:59:04.109+0000 7fac5be00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T06:59:04.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.113+0000 7fa4e4c00640 1 -- 172.21.15.46:0/2608089112 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa4d0058830 con 0x7fa4e8158140 2024-02-19T06:59:04.115 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-19T06:59:04.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.116+0000 7fa4ed800640 1 -- 172.21.15.46:0/2608089112 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa4c406b810 msgr2=0x7fa4c406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:04.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.116+0000 7fa4ed800640 1 --2- 172.21.15.46:0/2608089112 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa4c406b810 0x7fa4c406dcd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80099c0 tx=0x7fa4d8008040 comp rx=0 tx=0).stop 2024-02-19T06:59:04.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.116+0000 7fa4ed800640 1 -- 172.21.15.46:0/2608089112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e8158140 msgr2=0x7fa4e81585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:04.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.116+0000 7fa4ed800640 1 --2- 172.21.15.46:0/2608089112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e8158140 0x7fa4e81585c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0010910 tx=0x7fa4d0010dd0 comp rx=0 tx=0).stop 2024-02-19T06:59:04.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.117+0000 7fa4ed800640 1 -- 172.21.15.46:0/2608089112 shutdown_connections 2024-02-19T06:59:04.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.117+0000 7fa4ed800640 1 --2- 172.21.15.46:0/2608089112 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa4c406b810 0x7fa4c406dcd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:04.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.117+0000 7fa4ed800640 1 --2- 172.21.15.46:0/2608089112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4e8159c30 0x7fa4e815a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:04.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.117+0000 7fa4ed800640 1 --2- 172.21.15.46:0/2608089112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4e8158140 0x7fa4e81585c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:04.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.117+0000 7fa4ed800640 1 --2- 172.21.15.46:0/2608089112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc004d00 0x7fa4e8098980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:04.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.117+0000 7fa4ed800640 1 -- 172.21.15.46:0/2608089112 >> 172.21.15.46:0/2608089112 conn(0x7fa4e80b1200 msgr2=0x7fa4e80b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:04.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.117+0000 7fa4ed800640 1 -- 172.21.15.46:0/2608089112 shutdown_connections 2024-02-19T06:59:04.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.117+0000 7fa4ed800640 1 -- 172.21.15.46:0/2608089112 wait complete. 2024-02-19T06:59:04.137 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-19T06:59:04.146 INFO:tasks.ceph.mds.b.smithi142.stderr: -4047> 2024-02-19T06:58:01.239+0000 7fd5f3400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-19T06:59:04.219 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-02-19T06:59:04.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.353+0000 7f8ced800640 1 Processor -- start 2024-02-19T06:59:04.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.354+0000 7f8ced800640 1 -- start start 2024-02-19T06:59:04.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.355+0000 7f8ced800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8ce8161600 0x7f8ce80b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:04.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.355+0000 7f8ced800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce80b3940 con 0x7f8ce815dcb0 2024-02-19T06:59:04.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.355+0000 7f8ced800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce80b3bd0 con 0x7f8ce80b34f0 2024-02-19T06:59:04.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.355+0000 7f8ced800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce80b3eb0 con 0x7f8ce8161600 2024-02-19T06:59:04.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.356+0000 7f8cdf400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8ce815dcb0 0x7f8ce81619e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:48446/0 (socket says 172.21.15.46:48446) 2024-02-19T06:59:04.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.356+0000 7f8cdf400640 1 -- 172.21.15.46:0/3302788107 learned_addr learned my addr 172.21.15.46:0/3302788107 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:04.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.356+0000 7f8ce7e00640 1 --2- 172.21.15.46:0/3302788107 >> v2:172.21.15.46:3300/0 conn(0x7f8ce8161600 0x7f8ce80b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:04.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.356+0000 7f8ce7400640 1 -- 172.21.15.46:0/3302788107 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890445973 0 0) 0x7f8ce80b3940 con 0x7f8ce815dcb0 2024-02-19T06:59:04.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.356+0000 7f8ce7400640 1 -- 172.21.15.46:0/3302788107 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ccc003520 con 0x7f8ce815dcb0 2024-02-19T06:59:04.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.356+0000 7f8ce7e00640 1 -- 172.21.15.46:0/3302788107 >> v1:172.21.15.142:6789/0 conn(0x7f8ce80b34f0 legacy=0x7f8ce80ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:04.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.356+0000 7f8ce7e00640 1 -- 172.21.15.46:0/3302788107 >> v1:172.21.15.46:6789/0 conn(0x7f8ce815dcb0 legacy=0x7f8ce81619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:04.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.356+0000 7f8ce7e00640 1 -- 172.21.15.46:0/3302788107 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce80b4190 con 0x7f8ce8161600 2024-02-19T06:59:04.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.358+0000 7f8ce7e00640 1 --2- 172.21.15.46:0/3302788107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ce8161600 0x7f8ce80b4c70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009790 tx=0x7f8cd802b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32576fe4cb893e22 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:04.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.358+0000 7f8ce7400640 1 -- 172.21.15.46:0/3302788107 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8030800 con 0x7f8ce8161600 2024-02-19T06:59:04.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.358+0000 7f8ce7400640 1 -- 172.21.15.46:0/3302788107 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd8030960 con 0x7f8ce8161600 2024-02-19T06:59:04.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.358+0000 7f8ce7400640 1 -- 172.21.15.46:0/3302788107 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8030cf0 con 0x7f8ce8161600 2024-02-19T06:59:04.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.359+0000 7f8ced800640 1 -- 172.21.15.46:0/3302788107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ce8161600 msgr2=0x7f8ce80b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:04.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.359+0000 7f8ced800640 1 --2- 172.21.15.46:0/3302788107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ce8161600 0x7f8ce80b4c70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009790 tx=0x7f8cd802b940 comp rx=0 tx=0).stop 2024-02-19T06:59:04.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.359+0000 7f8ced800640 1 -- 172.21.15.46:0/3302788107 shutdown_connections 2024-02-19T06:59:04.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.359+0000 7f8ced800640 1 --2- 172.21.15.46:0/3302788107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ce8161600 0x7f8ce80b4c70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:04.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.359+0000 7f8ced800640 1 -- 172.21.15.46:0/3302788107 >> 172.21.15.46:0/3302788107 conn(0x7f8ce808afc0 msgr2=0x7f8ce80d36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:04.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.359+0000 7f8ced800640 1 -- 172.21.15.46:0/3302788107 shutdown_connections 2024-02-19T06:59:04.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.359+0000 7f8ced800640 1 -- 172.21.15.46:0/3302788107 wait complete. 2024-02-19T06:59:04.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.361+0000 7f8ced800640 1 Processor -- start 2024-02-19T06:59:04.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.361+0000 7f8ced800640 1 -- start start 2024-02-19T06:59:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.362+0000 7f8ced800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce80b34f0 0x7f8ce81f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.362+0000 7f8ced800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce815dcb0 0x7f8ce815e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.362+0000 7f8ced800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ce8161600 0x7f8ce80b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:04.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.362+0000 7f8ced800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce815fd90 con 0x7f8ce8161600 2024-02-19T06:59:04.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.362+0000 7f8ced800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce81608d0 con 0x7f8ce80b34f0 2024-02-19T06:59:04.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.362+0000 7f8ced800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce815e5d0 con 0x7f8ce815dcb0 2024-02-19T06:59:04.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.362+0000 7f8cece00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ce8161600 0x7f8ce80b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:04.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.362+0000 7f8cece00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ce8161600 0x7f8ce80b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50248/0 (socket says 172.21.15.46:50248) 2024-02-19T06:59:04.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.362+0000 7f8cece00640 1 -- 172.21.15.46:0/4294714250 learned_addr learned my addr 172.21.15.46:0/4294714250 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.363+0000 7f8cdf400640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce815dcb0 0x7f8ce815e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.363+0000 7f8ce7e00640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce80b34f0 0x7f8ce81f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.363+0000 7f8cece00640 1 -- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce815dcb0 msgr2=0x7f8ce815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.363+0000 7f8cece00640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce815dcb0 0x7f8ce815e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:04.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.363+0000 7f8cece00640 1 -- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce80b34f0 msgr2=0x7f8ce81f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:04.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.363+0000 7f8cece00640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce80b34f0 0x7f8ce81f75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:04.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.363+0000 7f8cece00640 1 -- 172.21.15.46:0/4294714250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd80093a0 con 0x7f8ce8161600 2024-02-19T06:59:04.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.363+0000 7f8cece00640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ce8161600 0x7f8ce80b1f60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000c7a0 tx=0x7f8ce000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:04.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.363+0000 7f8ce4c00640 1 -- 172.21.15.46:0/4294714250 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0003b70 con 0x7f8ce8161600 2024-02-19T06:59:04.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.363+0000 7f8ce4c00640 1 -- 172.21.15.46:0/4294714250 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce0003cf0 con 0x7f8ce8161600 2024-02-19T06:59:04.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.363+0000 7f8ced800640 1 -- 172.21.15.46:0/4294714250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce815ffa0 con 0x7f8ce8161600 2024-02-19T06:59:04.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.363+0000 7f8ce4c00640 1 -- 172.21.15.46:0/4294714250 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0003ea0 con 0x7f8ce8161600 2024-02-19T06:59:04.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.364+0000 7f8ced800640 1 -- 172.21.15.46:0/4294714250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce815e8a0 con 0x7f8ce8161600 2024-02-19T06:59:04.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.365+0000 7f8ced800640 1 -- 172.21.15.46:0/4294714250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce80680c0 con 0x7f8ce8161600 2024-02-19T06:59:04.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.366+0000 7f8ce4c00640 1 -- 172.21.15.46:0/4294714250 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8ce000aa90 con 0x7f8ce8161600 2024-02-19T06:59:04.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.367+0000 7f8ce4c00640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8cc406b810 0x7f8cc406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:04.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.367+0000 7f8ce4c00640 1 -- 172.21.15.46:0/4294714250 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f8ce008a120 con 0x7f8ce8161600 2024-02-19T06:59:04.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.367+0000 7f8ce7e00640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8cc406b810 0x7f8cc406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:04.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.368+0000 7f8ce7e00640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8cc406b810 0x7f8cc406dcd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8036000 tx=0x7f8cd803b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:04.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.371+0000 7f8ce4c00640 1 -- 172.21.15.46:0/4294714250 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ce0054a70 con 0x7f8ce8161600 2024-02-19T06:59:04.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:04.609+0000 7f8ced800640 1 -- 172.21.15.46:0/4294714250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8ce8160190 con 0x7f8ce8161600 2024-02-19T06:59:05.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.117+0000 7f8ce4c00640 1 -- 172.21.15.46:0/4294714250 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8ce0058130 con 0x7f8ce8161600 2024-02-19T06:59:05.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.120+0000 7f8ced800640 1 -- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8cc406b810 msgr2=0x7f8cc406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:05.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.120+0000 7f8ced800640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8cc406b810 0x7f8cc406dcd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8036000 tx=0x7f8cd803b040 comp rx=0 tx=0).stop 2024-02-19T06:59:05.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.120+0000 7f8ced800640 1 -- 172.21.15.46:0/4294714250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ce8161600 msgr2=0x7f8ce80b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:05.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.120+0000 7f8ced800640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ce8161600 0x7f8ce80b1f60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000c7a0 tx=0x7f8ce000cc60 comp rx=0 tx=0).stop 2024-02-19T06:59:05.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.120+0000 7f8ced800640 1 -- 172.21.15.46:0/4294714250 shutdown_connections 2024-02-19T06:59:05.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.120+0000 7f8ced800640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8cc406b810 0x7f8cc406dcd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:05.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.120+0000 7f8ced800640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ce8161600 0x7f8ce80b1f60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:05.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.120+0000 7f8ced800640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce815dcb0 0x7f8ce815e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:05.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.120+0000 7f8ced800640 1 --2- 172.21.15.46:0/4294714250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce80b34f0 0x7f8ce81f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:05.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.120+0000 7f8ced800640 1 -- 172.21.15.46:0/4294714250 >> 172.21.15.46:0/4294714250 conn(0x7f8ce808afc0 msgr2=0x7f8ce80b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:05.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.121+0000 7f8ced800640 1 -- 172.21.15.46:0/4294714250 shutdown_connections 2024-02-19T06:59:05.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.121+0000 7f8ced800640 1 -- 172.21.15.46:0/4294714250 wait complete. 2024-02-19T06:59:05.141 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-19T06:59:05.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.367+0000 7fdee7e00640 1 Processor -- start 2024-02-19T06:59:05.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.367+0000 7fdee7e00640 1 -- start start 2024-02-19T06:59:05.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.369+0000 7fdee7e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdee80cf520 0x7fdee80cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:05.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.369+0000 7fdee7e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdee80b3b00 0x7fdee80cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:05.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.369+0000 7fdee7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdee8072990 0x7fdee80ac130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:05.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.369+0000 7fdee7e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee80b36e0 con 0x7fdee80cf520 2024-02-19T06:59:05.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.369+0000 7fdee7e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee80b3f80 con 0x7fdee80b3b00 2024-02-19T06:59:05.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.369+0000 7fdee7e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee8098db0 con 0x7fdee8072990 2024-02-19T06:59:05.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.369+0000 7fdee6a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdee80cf520 0x7fdee80cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:05.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.369+0000 7fdee6a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdee80cf520 0x7fdee80cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32896/0 (socket says 172.21.15.46:32896) 2024-02-19T06:59:05.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.369+0000 7fdee6a00640 1 -- 172.21.15.46:0/797149252 learned_addr learned my addr 172.21.15.46:0/797149252 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:05.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.369+0000 7fdee7400640 1 --2- 172.21.15.46:0/797149252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdee8072990 0x7fdee80ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:05.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.370+0000 7fdee6a00640 1 -- 172.21.15.46:0/797149252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdee8072990 msgr2=0x7fdee80ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:05.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.370+0000 7fdee6a00640 1 --2- 172.21.15.46:0/797149252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdee8072990 0x7fdee80ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:05.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.370+0000 7fdee6a00640 1 -- 172.21.15.46:0/797149252 >> v2:172.21.15.142:3300/0 conn(0x7fdee80b3b00 msgr2=0x7fdee80cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:05.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.370+0000 7fdedfe00640 1 --2- 172.21.15.46:0/797149252 >> v2:172.21.15.142:3300/0 conn(0x7fdee80b3b00 0x7fdee80cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:05.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.370+0000 7fdee6a00640 1 --2- 172.21.15.46:0/797149252 >> v2:172.21.15.142:3300/0 conn(0x7fdee80b3b00 0x7fdee80cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:05.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.370+0000 7fdee6a00640 1 -- 172.21.15.46:0/797149252 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee815bad0 con 0x7fdee80cf520 2024-02-19T06:59:05.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.370+0000 7fdedfe00640 1 --2- 172.21.15.46:0/797149252 >> v2:172.21.15.142:3300/0 conn(0x7fdee80b3b00 0x7fdee80cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:05.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.371+0000 7fdee6a00640 1 --2- 172.21.15.46:0/797149252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdee80cf520 0x7fdee80cc840 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdee8071680 tx=0x7fded802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7668d32c5e5e9211 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:05.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.371+0000 7fdee6000640 1 -- 172.21.15.46:0/797149252 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded80317c0 con 0x7fdee80cf520 2024-02-19T06:59:05.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.371+0000 7fdee6000640 1 -- 172.21.15.46:0/797149252 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded8031920 con 0x7fdee80cf520 2024-02-19T06:59:05.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.371+0000 7fdee6000640 1 -- 172.21.15.46:0/797149252 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8031cb0 con 0x7fdee80cf520 2024-02-19T06:59:05.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.372+0000 7fdee7e00640 1 -- 172.21.15.46:0/797149252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdee80cf520 msgr2=0x7fdee80cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:05.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.372+0000 7fdee7e00640 1 --2- 172.21.15.46:0/797149252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdee80cf520 0x7fdee80cc840 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdee8071680 tx=0x7fded802b860 comp rx=0 tx=0).stop 2024-02-19T06:59:05.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.372+0000 7fdee7e00640 1 -- 172.21.15.46:0/797149252 shutdown_connections 2024-02-19T06:59:05.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.373+0000 7fdee7e00640 1 --2- 172.21.15.46:0/797149252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdee8072990 0x7fdee80ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:05.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.373+0000 7fdee7e00640 1 --2- 172.21.15.46:0/797149252 >> v2:172.21.15.142:3300/0 conn(0x7fdee80b3b00 0x7fdee80cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:05.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.373+0000 7fdee7e00640 1 --2- 172.21.15.46:0/797149252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdee80cf520 0x7fdee80cc840 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:05.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.373+0000 7fdee7e00640 1 -- 172.21.15.46:0/797149252 >> 172.21.15.46:0/797149252 conn(0x7fdee806ad60 msgr2=0x7fdee806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:05.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.373+0000 7fdee7e00640 1 -- 172.21.15.46:0/797149252 shutdown_connections 2024-02-19T06:59:05.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.373+0000 7fdee7e00640 1 -- 172.21.15.46:0/797149252 wait complete. 2024-02-19T06:59:05.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.375+0000 7fdee7e00640 1 Processor -- start 2024-02-19T06:59:05.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.375+0000 7fdee7e00640 1 -- start start 2024-02-19T06:59:05.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.376+0000 7fdee7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdee8072990 0x7fdee81f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:05.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.376+0000 7fdee7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdee80b3b00 0x7fdee80c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:05.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.376+0000 7fdee7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdee80cf520 0x7fdee80c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:05.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.376+0000 7fdee7e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80c3780 con 0x7fdee8072990 2024-02-19T06:59:05.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.376+0000 7fdee7e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80c3a60 con 0x7fdee80b3b00 2024-02-19T06:59:05.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.376+0000 7fdee7e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80c3d40 con 0x7fdee80cf520 2024-02-19T06:59:05.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.376+0000 7fdee6a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdee8072990 0x7fdee81f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:05.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.377+0000 7fdee6a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdee8072990 0x7fdee81f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32902/0 (socket says 172.21.15.46:32902) 2024-02-19T06:59:05.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.377+0000 7fdee6a00640 1 -- 172.21.15.46:0/3997235448 learned_addr learned my addr 172.21.15.46:0/3997235448 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:05.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.377+0000 7fdedfe00640 1 --2- 172.21.15.46:0/3997235448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdee80b3b00 0x7fdee80c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:05.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.377+0000 7fdee6a00640 1 -- 172.21.15.46:0/3997235448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdee80cf520 msgr2=0x7fdee80c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:05.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.377+0000 7fdee6a00640 1 --2- 172.21.15.46:0/3997235448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdee80cf520 0x7fdee80c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:05.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.377+0000 7fdee6a00640 1 -- 172.21.15.46:0/3997235448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdee80b3b00 msgr2=0x7fdee80c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:05.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.377+0000 7fdee6a00640 1 --2- 172.21.15.46:0/3997235448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdee80b3b00 0x7fdee80c2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:05.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.377+0000 7fdee6a00640 1 -- 172.21.15.46:0/3997235448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded80094d0 con 0x7fdee8072990 2024-02-19T06:59:05.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.377+0000 7fdee6a00640 1 --2- 172.21.15.46:0/3997235448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdee8072990 0x7fdee81f4560 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fded802b8a0 tx=0x7fded80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:05.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.378+0000 7fdedea00640 1 -- 172.21.15.46:0/3997235448 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8032860 con 0x7fdee8072990 2024-02-19T06:59:05.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.378+0000 7fdedea00640 1 -- 172.21.15.46:0/3997235448 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded80329e0 con 0x7fdee8072990 2024-02-19T06:59:05.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.378+0000 7fdedea00640 1 -- 172.21.15.46:0/3997235448 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8032d90 con 0x7fdee8072990 2024-02-19T06:59:05.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.378+0000 7fdee7e00640 1 -- 172.21.15.46:0/3997235448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee80c4020 con 0x7fdee8072990 2024-02-19T06:59:05.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.378+0000 7fdee7e00640 1 -- 172.21.15.46:0/3997235448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee80c3350 con 0x7fdee8072990 2024-02-19T06:59:05.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.379+0000 7fdee7e00640 1 -- 172.21.15.46:0/3997235448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee80c3540 con 0x7fdee8072990 2024-02-19T06:59:05.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.380+0000 7fdedea00640 1 -- 172.21.15.46:0/3997235448 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fded804e450 con 0x7fdee8072990 2024-02-19T06:59:05.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.381+0000 7fdedea00640 1 --2- 172.21.15.46:0/3997235448 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdec406b810 0x7fdec406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:05.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.382+0000 7fdedea00640 1 -- 172.21.15.46:0/3997235448 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fded80ac4c0 con 0x7fdee8072990 2024-02-19T06:59:05.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.382+0000 7fdedfe00640 1 --2- 172.21.15.46:0/3997235448 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdec406b810 0x7fdec406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:05.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.384+0000 7fdedfe00640 1 --2- 172.21.15.46:0/3997235448 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdec406b810 0x7fdec406dcd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdee80c5180 tx=0x7fded0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:05.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.386+0000 7fdedea00640 1 -- 172.21.15.46:0/3997235448 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdee80c3540 con 0x7fdee8072990 2024-02-19T06:59:05.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:05.588+0000 7fdee7e00640 1 -- 172.21.15.46:0/3997235448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdee80c4540 con 0x7fdee8072990 2024-02-19T06:59:06.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.287+0000 7fdedea00640 1 -- 172.21.15.46:0/3997235448 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdee80c4540 con 0x7fdee8072990 2024-02-19T06:59:06.289 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2024-02-19T06:59:06.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.291+0000 7fdee7e00640 1 -- 172.21.15.46:0/3997235448 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdec406b810 msgr2=0x7fdec406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:06.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.291+0000 7fdee7e00640 1 --2- 172.21.15.46:0/3997235448 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdec406b810 0x7fdec406dcd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdee80c5180 tx=0x7fded0008040 comp rx=0 tx=0).stop 2024-02-19T06:59:06.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.292+0000 7fdee7e00640 1 -- 172.21.15.46:0/3997235448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdee8072990 msgr2=0x7fdee81f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:06.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.292+0000 7fdee7e00640 1 --2- 172.21.15.46:0/3997235448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdee8072990 0x7fdee81f4560 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fded802b8a0 tx=0x7fded80046c0 comp rx=0 tx=0).stop 2024-02-19T06:59:06.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.292+0000 7fdee7e00640 1 -- 172.21.15.46:0/3997235448 shutdown_connections 2024-02-19T06:59:06.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.292+0000 7fdee7e00640 1 --2- 172.21.15.46:0/3997235448 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdec406b810 0x7fdec406dcd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:06.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.292+0000 7fdee7e00640 1 --2- 172.21.15.46:0/3997235448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdee80cf520 0x7fdee80c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:06.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.292+0000 7fdee7e00640 1 --2- 172.21.15.46:0/3997235448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdee80b3b00 0x7fdee80c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:06.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.292+0000 7fdee7e00640 1 --2- 172.21.15.46:0/3997235448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdee8072990 0x7fdee81f4560 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:06.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.292+0000 7fdee7e00640 1 -- 172.21.15.46:0/3997235448 >> 172.21.15.46:0/3997235448 conn(0x7fdee806ad60 msgr2=0x7fdee80cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:06.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.292+0000 7fdee7e00640 1 -- 172.21.15.46:0/3997235448 shutdown_connections 2024-02-19T06:59:06.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.292+0000 7fdee7e00640 1 -- 172.21.15.46:0/3997235448 wait complete. 2024-02-19T06:59:06.325 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-19T06:59:06.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.535+0000 7ffb20600640 1 Processor -- start 2024-02-19T06:59:06.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.535+0000 7ffb20600640 1 -- start start 2024-02-19T06:59:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.537+0000 7ffb20600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffb18145120 0x7ffb1806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.537+0000 7ffb20600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb1806da50 0x7ffb1815fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.537+0000 7ffb20600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1806ef30 con 0x7ffb180cf3d0 2024-02-19T06:59:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.537+0000 7ffb20600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb18144990 con 0x7ffb18145120 2024-02-19T06:59:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.537+0000 7ffb20600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb180ccf20 con 0x7ffb1806da50 2024-02-19T06:59:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.537+0000 7ffb1dc00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ffb180cf3d0 0x7ffb180cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42028/0 (socket says 172.21.15.46:42028) 2024-02-19T06:59:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.537+0000 7ffb1dc00640 1 -- 172.21.15.46:0/4030274981 learned_addr learned my addr 172.21.15.46:0/4030274981 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.537+0000 7ffb1d200640 1 --2- 172.21.15.46:0/4030274981 >> v2:172.21.15.46:3300/0 conn(0x7ffb18145120 0x7ffb1806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.538+0000 7ffb1e600640 1 --2- 172.21.15.46:0/4030274981 >> v2:172.21.15.142:3300/0 conn(0x7ffb1806da50 0x7ffb1815fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.538+0000 7ffb17e00640 1 -- 172.21.15.46:0/4030274981 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244555524 0 0) 0x7ffb1806ef30 con 0x7ffb180cf3d0 2024-02-19T06:59:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.538+0000 7ffb17e00640 1 -- 172.21.15.46:0/4030274981 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb00003520 con 0x7ffb180cf3d0 2024-02-19T06:59:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.538+0000 7ffb1d200640 1 -- 172.21.15.46:0/4030274981 >> v2:172.21.15.142:3300/0 conn(0x7ffb1806da50 msgr2=0x7ffb1815fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.538+0000 7ffb1d200640 1 --2- 172.21.15.46:0/4030274981 >> v2:172.21.15.142:3300/0 conn(0x7ffb1806da50 0x7ffb1815fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.538+0000 7ffb1d200640 1 -- 172.21.15.46:0/4030274981 >> v1:172.21.15.46:6789/0 conn(0x7ffb180cf3d0 legacy=0x7ffb180cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.538+0000 7ffb1d200640 1 -- 172.21.15.46:0/4030274981 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb180cc960 con 0x7ffb18145120 2024-02-19T06:59:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.539+0000 7ffb1d200640 1 --2- 172.21.15.46:0/4030274981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb18145120 0x7ffb1806d510 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffb1806ba40 tx=0x7ffb0802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9172315bfa46b954 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.539+0000 7ffb17e00640 1 -- 172.21.15.46:0/4030274981 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08031710 con 0x7ffb18145120 2024-02-19T06:59:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.539+0000 7ffb17e00640 1 -- 172.21.15.46:0/4030274981 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0802f050 con 0x7ffb18145120 2024-02-19T06:59:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.539+0000 7ffb17e00640 1 -- 172.21.15.46:0/4030274981 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08031a90 con 0x7ffb18145120 2024-02-19T06:59:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.540+0000 7ffb20600640 1 -- 172.21.15.46:0/4030274981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb18145120 msgr2=0x7ffb1806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.540+0000 7ffb20600640 1 --2- 172.21.15.46:0/4030274981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb18145120 0x7ffb1806d510 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffb1806ba40 tx=0x7ffb0802b7b0 comp rx=0 tx=0).stop 2024-02-19T06:59:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.540+0000 7ffb20600640 1 -- 172.21.15.46:0/4030274981 shutdown_connections 2024-02-19T06:59:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.540+0000 7ffb20600640 1 --2- 172.21.15.46:0/4030274981 >> v2:172.21.15.142:3300/0 conn(0x7ffb1806da50 0x7ffb1815fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.540+0000 7ffb20600640 1 --2- 172.21.15.46:0/4030274981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb18145120 0x7ffb1806d510 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.540+0000 7ffb20600640 1 -- 172.21.15.46:0/4030274981 >> 172.21.15.46:0/4030274981 conn(0x7ffb18066ff0 msgr2=0x7ffb1806abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.540+0000 7ffb20600640 1 -- 172.21.15.46:0/4030274981 shutdown_connections 2024-02-19T06:59:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.540+0000 7ffb20600640 1 -- 172.21.15.46:0/4030274981 wait complete. 2024-02-19T06:59:06.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.542+0000 7ffb20600640 1 Processor -- start 2024-02-19T06:59:06.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.542+0000 7ffb20600640 1 -- start start 2024-02-19T06:59:06.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.543+0000 7ffb20600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb180cf3d0 0x7ffb181e80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:06.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.543+0000 7ffb20600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb18145120 0x7ffb1813f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:06.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.543+0000 7ffb20600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb18143930 0x7ffb18143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:06.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.543+0000 7ffb20600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18144320 con 0x7ffb18145120 2024-02-19T06:59:06.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.543+0000 7ffb20600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18140410 con 0x7ffb18143930 2024-02-19T06:59:06.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.543+0000 7ffb20600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18141270 con 0x7ffb180cf3d0 2024-02-19T06:59:06.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.543+0000 7ffb1d200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb18145120 0x7ffb1813f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:06.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.543+0000 7ffb1d200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb18145120 0x7ffb1813f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32912/0 (socket says 172.21.15.46:32912) 2024-02-19T06:59:06.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.543+0000 7ffb1d200640 1 -- 172.21.15.46:0/2481320652 learned_addr learned my addr 172.21.15.46:0/2481320652 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:06.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.544+0000 7ffb1dc00640 1 --2- 172.21.15.46:0/2481320652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb180cf3d0 0x7ffb181e80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:06.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.544+0000 7ffb1d200640 1 -- 172.21.15.46:0/2481320652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb180cf3d0 msgr2=0x7ffb181e80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:06.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.544+0000 7ffb1d200640 1 --2- 172.21.15.46:0/2481320652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb180cf3d0 0x7ffb181e80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:06.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.544+0000 7ffb1d200640 1 -- 172.21.15.46:0/2481320652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb18143930 msgr2=0x7ffb18143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:06.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.544+0000 7ffb1d200640 1 --2- 172.21.15.46:0/2481320652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb18143930 0x7ffb18143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:06.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.544+0000 7ffb1d200640 1 -- 172.21.15.46:0/2481320652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08009400 con 0x7ffb18145120 2024-02-19T06:59:06.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.544+0000 7ffb1d200640 1 --2- 172.21.15.46:0/2481320652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb18145120 0x7ffb1813f3e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009890 tx=0x7ffb080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:06.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.544+0000 7ffb15600640 1 -- 172.21.15.46:0/2481320652 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0803c810 con 0x7ffb18145120 2024-02-19T06:59:06.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.544+0000 7ffb15600640 1 -- 172.21.15.46:0/2481320652 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0803c970 con 0x7ffb18145120 2024-02-19T06:59:06.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.544+0000 7ffb15600640 1 -- 172.21.15.46:0/2481320652 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0803cd20 con 0x7ffb18145120 2024-02-19T06:59:06.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.544+0000 7ffb20600640 1 -- 172.21.15.46:0/2481320652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb18140660 con 0x7ffb18145120 2024-02-19T06:59:06.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.545+0000 7ffb20600640 1 -- 172.21.15.46:0/2481320652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb18140c20 con 0x7ffb18145120 2024-02-19T06:59:06.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.546+0000 7ffb20600640 1 -- 172.21.15.46:0/2481320652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb18067ba0 con 0x7ffb18145120 2024-02-19T06:59:06.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.547+0000 7ffb15600640 1 -- 172.21.15.46:0/2481320652 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ffb0803a040 con 0x7ffb18145120 2024-02-19T06:59:06.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.548+0000 7ffb15600640 1 --2- 172.21.15.46:0/2481320652 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ffafc06b810 0x7ffafc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:06.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.548+0000 7ffb15600640 1 -- 172.21.15.46:0/2481320652 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5473+0+0 (secure 0 0 0) 0x7ffb080ab930 con 0x7ffb18145120 2024-02-19T06:59:06.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.549+0000 7ffb1dc00640 1 --2- 172.21.15.46:0/2481320652 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ffafc06b810 0x7ffafc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:06.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.550+0000 7ffb1dc00640 1 --2- 172.21.15.46:0/2481320652 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ffafc06b810 0x7ffafc06dcd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0011e0 tx=0x7ffb0c007bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:06.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.553+0000 7ffb15600640 1 -- 172.21.15.46:0/2481320652 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb08076420 con 0x7ffb18145120 2024-02-19T06:59:06.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:06.764+0000 7ffb20600640 1 -- 172.21.15.46:0/2481320652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffb181413b0 con 0x7ffb18145120 2024-02-19T06:59:07.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.291+0000 7ffb15600640 1 -- 172.21.15.46:0/2481320652 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7ffb08079ae0 con 0x7ffb18145120 2024-02-19T06:59:07.293 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2024-02-19T06:59:07.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.295+0000 7ffb20600640 1 -- 172.21.15.46:0/2481320652 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ffafc06b810 msgr2=0x7ffafc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.295+0000 7ffb20600640 1 --2- 172.21.15.46:0/2481320652 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ffafc06b810 0x7ffafc06dcd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0011e0 tx=0x7ffb0c007bf0 comp rx=0 tx=0).stop 2024-02-19T06:59:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.295+0000 7ffb20600640 1 -- 172.21.15.46:0/2481320652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb18145120 msgr2=0x7ffb1813f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.295+0000 7ffb20600640 1 --2- 172.21.15.46:0/2481320652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb18145120 0x7ffb1813f3e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009890 tx=0x7ffb080046c0 comp rx=0 tx=0).stop 2024-02-19T06:59:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.295+0000 7ffb20600640 1 -- 172.21.15.46:0/2481320652 shutdown_connections 2024-02-19T06:59:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.295+0000 7ffb20600640 1 --2- 172.21.15.46:0/2481320652 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ffafc06b810 0x7ffafc06dcd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.295+0000 7ffb20600640 1 --2- 172.21.15.46:0/2481320652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb18143930 0x7ffb18143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.295+0000 7ffb20600640 1 --2- 172.21.15.46:0/2481320652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb18145120 0x7ffb1813f3e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.295+0000 7ffb20600640 1 --2- 172.21.15.46:0/2481320652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb180cf3d0 0x7ffb181e80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.295+0000 7ffb20600640 1 -- 172.21.15.46:0/2481320652 >> 172.21.15.46:0/2481320652 conn(0x7ffb1806da50 msgr2=0x7ffb1815e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.295+0000 7ffb20600640 1 -- 172.21.15.46:0/2481320652 shutdown_connections 2024-02-19T06:59:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.295+0000 7ffb20600640 1 -- 172.21.15.46:0/2481320652 wait complete. 2024-02-19T06:59:07.329 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-19T06:59:07.329 INFO:tasks.ceph.mds.a:Stopping old one... 2024-02-19T06:59:07.329 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-19T06:59:07.329 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T06:59:07.330 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-19T06:59:07.330 INFO:tasks.ceph.mds.c:Stopping old one... 2024-02-19T06:59:07.330 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-19T06:59:07.330 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T06:59:07.330 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-19T06:59:07.330 INFO:tasks.ceph.mds.b:Stopping old one... 2024-02-19T06:59:07.330 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-19T06:59:07.330 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T06:59:07.331 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-19T06:59:07.331 INFO:tasks.ceph.mds.d:Stopping old one... 2024-02-19T06:59:07.331 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-19T06:59:07.331 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T06:59:07.347 INFO:tasks.ceph.mds.a:Stopped 2024-02-19T06:59:07.347 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-19T06:59:07.349 INFO:tasks.ceph.mds.d:Stopped 2024-02-19T06:59:07.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-19T06:59:07.351 INFO:tasks.ceph.mds.c:Stopped 2024-02-19T06:59:07.351 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-19T06:59:07.352 INFO:tasks.ceph.mds.b:Stopped 2024-02-19T06:59:07.353 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-19T06:59:07.398 INFO:tasks.ceph.mds.a:Started 2024-02-19T06:59:07.399 DEBUG:teuthology.parallel:result is None 2024-02-19T06:59:07.400 INFO:tasks.ceph.mds.d:Started 2024-02-19T06:59:07.400 DEBUG:teuthology.parallel:result is None 2024-02-19T06:59:07.406 INFO:tasks.ceph.mds.b:Started 2024-02-19T06:59:07.406 INFO:tasks.ceph.mds.c:Started 2024-02-19T06:59:07.406 DEBUG:teuthology.parallel:result is None 2024-02-19T06:59:07.406 DEBUG:teuthology.parallel:result is None 2024-02-19T06:59:07.406 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-02-19T06:59:07.565 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-02-19T06:59:07.566 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2024-02-19T06:59:07.568 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2024-02-19T06:59:07.570 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-02-19T06:59:07.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.602+0000 7feaab000640 1 Processor -- start 2024-02-19T06:59:07.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.602+0000 7feaab000640 1 -- start start 2024-02-19T06:59:07.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.603+0000 7feaab000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaa409a140 0x7feaa40b0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:07.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.603+0000 7feaab000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feaa40cdac0 0x7feaa40b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:07.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.603+0000 7feaab000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa40b10f0 con 0x7feaa415f240 2024-02-19T06:59:07.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.603+0000 7feaab000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa40ccd60 con 0x7feaa40cdac0 2024-02-19T06:59:07.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.603+0000 7feaab000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40cd040 con 0x7feaa409a140 2024-02-19T06:59:07.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.603+0000 7feaa3e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7feaa415f240 0x7feaa4099a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42060/0 (socket says 172.21.15.46:42060) 2024-02-19T06:59:07.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.603+0000 7feaa3e00640 1 -- 172.21.15.46:0/2544888504 learned_addr learned my addr 172.21.15.46:0/2544888504 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:07.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.603+0000 7feaa9000640 1 --2- 172.21.15.46:0/2544888504 >> v2:172.21.15.46:3300/0 conn(0x7feaa40cdac0 0x7feaa40b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:07.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.603+0000 7fea9b400640 1 --2- 172.21.15.46:0/2544888504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaa409a140 0x7feaa40b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:07.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.604+0000 7fea9b400640 1 -- 172.21.15.46:0/2544888504 >> v2:172.21.15.46:3300/0 conn(0x7feaa40cdac0 msgr2=0x7feaa40b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:07.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.604+0000 7fea9b400640 1 --2- 172.21.15.46:0/2544888504 >> v2:172.21.15.46:3300/0 conn(0x7feaa40cdac0 0x7feaa40b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:07.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.604+0000 7fea9b400640 1 -- 172.21.15.46:0/2544888504 >> v1:172.21.15.46:6789/0 conn(0x7feaa415f240 legacy=0x7feaa4099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:07.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.604+0000 7fea9b400640 1 -- 172.21.15.46:0/2544888504 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40cd320 con 0x7feaa409a140 2024-02-19T06:59:07.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.605+0000 7fea9b400640 1 --2- 172.21.15.46:0/2544888504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaa409a140 0x7feaa40b0590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0097a0 tx=0x7fea8c02b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bd70ef018cfc13b server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:07.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.605+0000 7feaa3400640 1 -- 172.21.15.46:0/2544888504 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c030710 con 0x7feaa409a140 2024-02-19T06:59:07.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.605+0000 7feaa3400640 1 -- 172.21.15.46:0/2544888504 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8c02e050 con 0x7feaa409a140 2024-02-19T06:59:07.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.605+0000 7feaa3400640 1 -- 172.21.15.46:0/2544888504 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c030a90 con 0x7feaa409a140 2024-02-19T06:59:07.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.606+0000 7feaab000640 1 -- 172.21.15.46:0/2544888504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaa409a140 msgr2=0x7feaa40b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:07.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.606+0000 7feaab000640 1 --2- 172.21.15.46:0/2544888504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaa409a140 0x7feaa40b0590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0097a0 tx=0x7fea8c02b660 comp rx=0 tx=0).stop 2024-02-19T06:59:07.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.606+0000 7feaab000640 1 -- 172.21.15.46:0/2544888504 shutdown_connections 2024-02-19T06:59:07.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.606+0000 7feaab000640 1 --2- 172.21.15.46:0/2544888504 >> v2:172.21.15.46:3300/0 conn(0x7feaa40cdac0 0x7feaa40b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:07.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.606+0000 7feaab000640 1 --2- 172.21.15.46:0/2544888504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaa409a140 0x7feaa40b0590 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:07.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.606+0000 7feaab000640 1 -- 172.21.15.46:0/2544888504 >> 172.21.15.46:0/2544888504 conn(0x7feaa40b31e0 msgr2=0x7feaa40b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:07.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.606+0000 7feaab000640 1 -- 172.21.15.46:0/2544888504 shutdown_connections 2024-02-19T06:59:07.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.606+0000 7feaab000640 1 -- 172.21.15.46:0/2544888504 wait complete. 2024-02-19T06:59:07.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.608+0000 7feaab000640 1 Processor -- start 2024-02-19T06:59:07.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.608+0000 7feaab000640 1 -- start start 2024-02-19T06:59:07.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.609+0000 7feaab000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaa409a140 0x7feaa41508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:07.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.609+0000 7feaab000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa40cdac0 0x7feaa40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:07.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.609+0000 7feaab000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa415f240 0x7feaa40ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:07.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.609+0000 7feaab000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40b4e70 con 0x7feaa415f240 2024-02-19T06:59:07.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.609+0000 7feaab000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40b4280 con 0x7feaa40cdac0 2024-02-19T06:59:07.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.609+0000 7feaab000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40b4540 con 0x7feaa409a140 2024-02-19T06:59:07.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.609+0000 7feaa9000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa415f240 0x7feaa40ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:07.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.609+0000 7feaa9000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa415f240 0x7feaa40ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32966/0 (socket says 172.21.15.46:32966) 2024-02-19T06:59:07.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.609+0000 7feaa9000640 1 -- 172.21.15.46:0/1180798963 learned_addr learned my addr 172.21.15.46:0/1180798963 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:07.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.609+0000 7feaa3e00640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaa409a140 0x7feaa41508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:07.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.609+0000 7fea9b400640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa40cdac0 0x7feaa40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:07.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.610+0000 7feaa9000640 1 -- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaa409a140 msgr2=0x7feaa41508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:07.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.610+0000 7feaa9000640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaa409a140 0x7feaa41508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:07.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.610+0000 7feaa9000640 1 -- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa40cdac0 msgr2=0x7feaa40ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:07.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.610+0000 7feaa9000640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa40cdac0 0x7feaa40ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:07.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.610+0000 7feaa9000640 1 -- 172.21.15.46:0/1180798963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c009400 con 0x7feaa415f240 2024-02-19T06:59:07.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.610+0000 7feaa9000640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa415f240 0x7feaa40ceb20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00e930 tx=0x7fea9c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:07.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.610+0000 7feaa0c00640 1 -- 172.21.15.46:0/1180798963 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c009690 con 0x7feaa415f240 2024-02-19T06:59:07.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.610+0000 7feaa0c00640 1 -- 172.21.15.46:0/1180798963 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c00c980 con 0x7feaa415f240 2024-02-19T06:59:07.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.610+0000 7feaa0c00640 1 -- 172.21.15.46:0/1180798963 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00cd30 con 0x7feaa415f240 2024-02-19T06:59:07.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.610+0000 7feaab000640 1 -- 172.21.15.46:0/1180798963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa40b4820 con 0x7feaa415f240 2024-02-19T06:59:07.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.611+0000 7feaab000640 1 -- 172.21.15.46:0/1180798963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa40b5300 con 0x7feaa415f240 2024-02-19T06:59:07.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.612+0000 7feaab000640 1 -- 172.21.15.46:0/1180798963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa40b09b0 con 0x7feaa415f240 2024-02-19T06:59:07.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.613+0000 7feaa0c00640 1 -- 172.21.15.46:0/1180798963 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fea9c013470 con 0x7feaa415f240 2024-02-19T06:59:07.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.614+0000 7feaa0c00640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fea8006b840 0x7fea8006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:07.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.614+0000 7feaa0c00640 1 -- 172.21.15.46:0/1180798963 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fea9c08a130 con 0x7feaa415f240 2024-02-19T06:59:07.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.614+0000 7feaa3e00640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fea8006b840 0x7fea8006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:07.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.615+0000 7feaa3e00640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fea8006b840 0x7fea8006dd00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fea940012e0 tx=0x7fea940017a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:07.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.618+0000 7feaa0c00640 1 -- 172.21.15.46:0/1180798963 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fea9c054e90 con 0x7feaa415f240 2024-02-19T06:59:07.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:07.831+0000 7feaab000640 1 -- 172.21.15.46:0/1180798963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7feaa40b29f0 con 0x7feaa415f240 2024-02-19T06:59:08.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.326+0000 7feaa0c00640 1 -- 172.21.15.46:0/1180798963 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7fea9c058550 con 0x7feaa415f240 2024-02-19T06:59:08.328 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2024-02-19T06:59:08.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.330+0000 7feaab000640 1 -- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fea8006b840 msgr2=0x7fea8006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:08.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.330+0000 7feaab000640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fea8006b840 0x7fea8006dd00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fea940012e0 tx=0x7fea940017a0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.330+0000 7feaab000640 1 -- 172.21.15.46:0/1180798963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa415f240 msgr2=0x7feaa40ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.330+0000 7feaab000640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa415f240 0x7feaa40ceb20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00e930 tx=0x7fea9c00edf0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.331+0000 7feaab000640 1 -- 172.21.15.46:0/1180798963 shutdown_connections 2024-02-19T06:59:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.331+0000 7feaab000640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fea8006b840 0x7fea8006dd00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.331+0000 7feaab000640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa415f240 0x7feaa40ceb20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.331+0000 7feaab000640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa40cdac0 0x7feaa40ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.331+0000 7feaab000640 1 --2- 172.21.15.46:0/1180798963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaa409a140 0x7feaa41508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.331+0000 7feaab000640 1 -- 172.21.15.46:0/1180798963 >> 172.21.15.46:0/1180798963 conn(0x7feaa40b31e0 msgr2=0x7feaa4099a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.331+0000 7feaab000640 1 -- 172.21.15.46:0/1180798963 shutdown_connections 2024-02-19T06:59:08.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.331+0000 7feaab000640 1 -- 172.21.15.46:0/1180798963 wait complete. 2024-02-19T06:59:08.354 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-02-19T06:59:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.561+0000 7f20b1e00640 1 Processor -- start 2024-02-19T06:59:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.562+0000 7f20b1e00640 1 -- start start 2024-02-19T06:59:08.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.563+0000 7f20b1e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f20ac145260 0x7f20ac15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:08.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.563+0000 7f20b1e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f20ac06e500 0x7f20ac0714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:08.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.563+0000 7f20b1e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ac15ce10 con 0x7f20ac071000 2024-02-19T06:59:08.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.563+0000 7f20b1e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ac0719f0 con 0x7f20ac145260 2024-02-19T06:59:08.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.563+0000 7f20b1e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ac0cbde0 con 0x7f20ac06e500 2024-02-19T06:59:08.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.564+0000 7f20a2000640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f20ac071000 0x7f20ac15f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42076/0 (socket says 172.21.15.46:42076) 2024-02-19T06:59:08.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.564+0000 7f20a2000640 1 -- 172.21.15.46:0/1006256310 learned_addr learned my addr 172.21.15.46:0/1006256310 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:08.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.564+0000 7f20aaa00640 1 --2- 172.21.15.46:0/1006256310 >> v2:172.21.15.46:3300/0 conn(0x7f20ac145260 0x7f20ac15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.564+0000 7f20aa000640 1 -- 172.21.15.46:0/1006256310 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159608061 0 0) 0x7f20ac15ce10 con 0x7f20ac071000 2024-02-19T06:59:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.564+0000 7f20ab400640 1 --2- 172.21.15.46:0/1006256310 >> v2:172.21.15.142:3300/0 conn(0x7f20ac06e500 0x7f20ac0714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.564+0000 7f20aa000640 1 -- 172.21.15.46:0/1006256310 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2090003520 con 0x7f20ac071000 2024-02-19T06:59:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.564+0000 7f20aaa00640 1 -- 172.21.15.46:0/1006256310 >> v2:172.21.15.142:3300/0 conn(0x7f20ac06e500 msgr2=0x7f20ac0714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.564+0000 7f20aaa00640 1 --2- 172.21.15.46:0/1006256310 >> v2:172.21.15.142:3300/0 conn(0x7f20ac06e500 0x7f20ac0714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.564+0000 7f20aaa00640 1 -- 172.21.15.46:0/1006256310 >> v1:172.21.15.46:6789/0 conn(0x7f20ac071000 legacy=0x7f20ac15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.564+0000 7f20aaa00640 1 -- 172.21.15.46:0/1006256310 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac0cc080 con 0x7f20ac145260 2024-02-19T06:59:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.565+0000 7f20aaa00640 1 --2- 172.21.15.46:0/1006256310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20ac145260 0x7f20ac15c8d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f20ac1604e0 tx=0x7f209c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e94c5843814a94b server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.566+0000 7f20aa000640 1 -- 172.21.15.46:0/1006256310 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c02e070 con 0x7f20ac145260 2024-02-19T06:59:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.566+0000 7f20aa000640 1 -- 172.21.15.46:0/1006256310 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c0315a0 con 0x7f20ac145260 2024-02-19T06:59:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.566+0000 7f20aa000640 1 -- 172.21.15.46:0/1006256310 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c031930 con 0x7f20ac145260 2024-02-19T06:59:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.566+0000 7f20b1e00640 1 -- 172.21.15.46:0/1006256310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20ac145260 msgr2=0x7f20ac15c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.566+0000 7f20b1e00640 1 --2- 172.21.15.46:0/1006256310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20ac145260 0x7f20ac15c8d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f20ac1604e0 tx=0x7f209c02b840 comp rx=0 tx=0).stop 2024-02-19T06:59:08.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.567+0000 7f20b1e00640 1 -- 172.21.15.46:0/1006256310 shutdown_connections 2024-02-19T06:59:08.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.567+0000 7f20b1e00640 1 --2- 172.21.15.46:0/1006256310 >> v2:172.21.15.142:3300/0 conn(0x7f20ac06e500 0x7f20ac0714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.567+0000 7f20b1e00640 1 --2- 172.21.15.46:0/1006256310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20ac145260 0x7f20ac15c8d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.567+0000 7f20b1e00640 1 -- 172.21.15.46:0/1006256310 >> 172.21.15.46:0/1006256310 conn(0x7f20ac066f70 msgr2=0x7f20ac06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:08.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.567+0000 7f20b1e00640 1 -- 172.21.15.46:0/1006256310 shutdown_connections 2024-02-19T06:59:08.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.567+0000 7f20b1e00640 1 -- 172.21.15.46:0/1006256310 wait complete. 2024-02-19T06:59:08.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.568+0000 7f20b1e00640 1 Processor -- start 2024-02-19T06:59:08.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.569+0000 7f20b1e00640 1 -- start start 2024-02-19T06:59:08.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20b1e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20ac06e500 0x7f20ac142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:08.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20b1e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20ac071000 0x7f20ac1f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:08.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20b1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20ac145260 0x7f20ac0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20b1e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac143280 con 0x7f20ac071000 2024-02-19T06:59:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20b1e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac142cc0 con 0x7f20ac145260 2024-02-19T06:59:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20b1e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac142fa0 con 0x7f20ac06e500 2024-02-19T06:59:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20a2000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20ac071000 0x7f20ac1f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20a2000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20ac071000 0x7f20ac1f6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32986/0 (socket says 172.21.15.46:32986) 2024-02-19T06:59:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20a2000640 1 -- 172.21.15.46:0/132111634 learned_addr learned my addr 172.21.15.46:0/132111634 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20aaa00640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20ac06e500 0x7f20ac142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20ab400640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20ac145260 0x7f20ac0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20a2000640 1 -- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20ac06e500 msgr2=0x7f20ac142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20a2000640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20ac06e500 0x7f20ac142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20a2000640 1 -- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20ac145260 msgr2=0x7f20ac0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20a2000640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20ac145260 0x7f20ac0ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20a2000640 1 -- 172.21.15.46:0/132111634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c009400 con 0x7f20ac071000 2024-02-19T06:59:08.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.570+0000 7f20ab400640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20ac145260 0x7f20ac0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:08.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.571+0000 7f20a2000640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20ac071000 0x7f20ac1f6390 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f209400c430 tx=0x7f209400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:08.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.571+0000 7f20a3e00640 1 -- 172.21.15.46:0/132111634 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2094005ce0 con 0x7f20ac071000 2024-02-19T06:59:08.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.571+0000 7f20a3e00640 1 -- 172.21.15.46:0/132111634 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2094005e40 con 0x7f20ac071000 2024-02-19T06:59:08.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.571+0000 7f20a3e00640 1 -- 172.21.15.46:0/132111634 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20940072f0 con 0x7f20ac071000 2024-02-19T06:59:08.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.571+0000 7f20b1e00640 1 -- 172.21.15.46:0/132111634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac139fe0 con 0x7f20ac071000 2024-02-19T06:59:08.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.571+0000 7f20b1e00640 1 -- 172.21.15.46:0/132111634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ac1429d0 con 0x7f20ac071000 2024-02-19T06:59:08.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.572+0000 7f20b1e00640 1 -- 172.21.15.46:0/132111634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ac139e40 con 0x7f20ac071000 2024-02-19T06:59:08.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.573+0000 7f20a3e00640 1 -- 172.21.15.46:0/132111634 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2094007450 con 0x7f20ac071000 2024-02-19T06:59:08.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.574+0000 7f20a3e00640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f208806b810 0x7f208806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:08.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.574+0000 7f20a3e00640 1 -- 172.21.15.46:0/132111634 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2094089550 con 0x7f20ac071000 2024-02-19T06:59:08.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.575+0000 7f20aaa00640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f208806b810 0x7f208806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:08.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.576+0000 7f20aaa00640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f208806b810 0x7f208806dcd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f209c036000 tx=0x7f209c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:08.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.579+0000 7f20a3e00640 1 -- 172.21.15.46:0/132111634 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20ac139e40 con 0x7f20ac071000 2024-02-19T06:59:08.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.849+0000 7f20b1e00640 1 -- 172.21.15.46:0/132111634 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f20ac13a500 con 0x7f20ac071000 2024-02-19T06:59:08.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.850+0000 7f20a3e00640 1 -- 172.21.15.46:0/132111634 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f20ac13a500 con 0x7f20ac071000 2024-02-19T06:59:08.852 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:08.852 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T06:59:08.852 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2024-02-19T06:59:08.852 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.852 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2024-02-19T06:59:08.852 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCt+9JlWPf2FRAADy8CvIJ6R6hilRbwRsDetw==", 2024-02-19T06:59:08.852 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.852 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-02-19T06:59:08.852 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2024-02-19T06:59:08.852 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2024-02-19T06:59:08.852 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCt+9Jl6ri7ORAAYiLMnhgMt4KRWUji0/RN1A==", 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCt+9JloHoKKBAAIto0p8ISw1bsliHW4XlhxA==", 2024-02-19T06:59:08.853 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.854 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-02-19T06:59:08.854 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2024-02-19T06:59:08.854 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2024-02-19T06:59:08.854 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.854 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.854 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.854 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.854 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2024-02-19T06:59:08.854 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCu+9JlI+6wDhAAPGbxaekSaMp4JM6hDwLS/Q==", 2024-02-19T06:59:08.854 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.854 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-02-19T06:59:08.854 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2024-02-19T06:59:08.855 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2024-02-19T06:59:08.856 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.856 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.856 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.856 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.856 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2024-02-19T06:59:08.856 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCx+9JlLaLWABAAr/aqeynIX+3LXH/LdHxtxQ==", 2024-02-19T06:59:08.856 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.856 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-02-19T06:59:08.856 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-02-19T06:59:08.856 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.856 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQC0+9JlZ4i1CxAAYMh4PGXVgbyTvbcRJgibig==", 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQC3+9JlWxMaJhAA0WqdQ3DKPD+3SGZAjXrWOA==", 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.857 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQC7+9JlxCScAxAANQcgw4OSY+W9S2UGcBIBFQ==", 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.858 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQDC+9JlitcFChAATt3HmxFhwfWKF2+pyFKVbw==", 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQDF+9JlPKNRIxAA3DGL79ZFVr1C7zE8jjbGNQ==", 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-02-19T06:59:08.859 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQDJ+9Jls0VjABAAMe0SoBm2wfIELsg2aWOJUg==", 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.860 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQDM+9JlcEhjGRAApMith0g9UEIHOo39T8iwEA==", 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCu+9JlV/odHRAAsbrC4WBcXYprN1RbsTyFWA==", 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2024-02-19T06:59:08.861 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCu+9Jlw7OfNBAAGkbmZTqIo3aQZqhnSo34cw==", 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCu+9JlquUWKRAA/O5D7DaL9e+akuPEU9taFA==", 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCv+9JlqowOAxAA1xht2AsVeHgsgho8LAj5uQ==", 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.863 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCs+9Jl4qPICRAAplZvaPVZaIfjsMshl8skYA==", 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.864 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-mds", 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQDa+9Jl6hGRHxAAjJxtHh/ieGoWQCf6XhZhcw==", 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-mds" 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-mgr", 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQDa+9JlCDCRHxAAzg8lx2itvWtUOHgHgZU91Q==", 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-mgr" 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.865 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-osd", 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQDa+9JltUiRHxAAwUb7lyXaEXXMBV9A39jXOg==", 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-osd" 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rbd", 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQDa+9JlS2KRHxAAsy8loxtU8osXPKtaRZairQ==", 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rbd" 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.866 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQDa+9JlyXuRHxAAUUhROD7Sz6N0XsAgfLJ62w==", 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rgw", 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQDa+9JlyZSRHxAAAeY3+vqdwaCzchL9Mkq5/Q==", 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rgw" 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.867 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCt+9Jlu9g2CRAARKEGi9TYB5n7ybtD5cDMtg==", 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCs+9JlaS21OBAAGN7RdD9qajdAUx/oSt4rTg==", 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2024-02-19T06:59:08.868 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-02-19T06:59:08.869 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.869 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:08.869 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-02-19T06:59:08.869 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T06:59:08.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.853+0000 7f20b1e00640 1 -- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f208806b810 msgr2=0x7f208806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:08.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.853+0000 7f20b1e00640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f208806b810 0x7f208806dcd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f209c036000 tx=0x7f209c03d040 comp rx=0 tx=0).stop 2024-02-19T06:59:08.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.853+0000 7f20b1e00640 1 -- 172.21.15.46:0/132111634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20ac071000 msgr2=0x7f20ac1f6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:08.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.853+0000 7f20b1e00640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20ac071000 0x7f20ac1f6390 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f209400c430 tx=0x7f209400c8f0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.853+0000 7f20b1e00640 1 -- 172.21.15.46:0/132111634 shutdown_connections 2024-02-19T06:59:08.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.853+0000 7f20b1e00640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f208806b810 0x7f208806dcd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.853+0000 7f20b1e00640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20ac145260 0x7f20ac0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.853+0000 7f20b1e00640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20ac071000 0x7f20ac1f6390 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.853+0000 7f20b1e00640 1 --2- 172.21.15.46:0/132111634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20ac06e500 0x7f20ac142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:08.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.853+0000 7f20b1e00640 1 -- 172.21.15.46:0/132111634 >> 172.21.15.46:0/132111634 conn(0x7f20ac066f70 msgr2=0x7f20ac0b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:08.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.854+0000 7f20b1e00640 1 -- 172.21.15.46:0/132111634 shutdown_connections 2024-02-19T06:59:08.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:08.854+0000 7f20b1e00640 1 -- 172.21.15.46:0/132111634 wait complete. 2024-02-19T06:59:08.875 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-02-19T06:59:09.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.103+0000 7fc3b7800640 1 Processor -- start 2024-02-19T06:59:09.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.104+0000 7fc3b7800640 1 -- start start 2024-02-19T06:59:09.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.106+0000 7fc3b7800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b0071000 0x7fc3b0071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.106+0000 7fc3b7800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b00cbde0 con 0x7fc3b006d4f0 2024-02-19T06:59:09.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.106+0000 7fc3b7800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b00cc080 con 0x7fc3b0145260 2024-02-19T06:59:09.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.106+0000 7fc3b7800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00719c0 con 0x7fc3b0071000 2024-02-19T06:59:09.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.106+0000 7fc3b5800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc3b006d4f0 0x7fc3b006d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42090/0 (socket says 172.21.15.46:42090) 2024-02-19T06:59:09.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.106+0000 7fc3b5800640 1 -- 172.21.15.46:0/664624908 learned_addr learned my addr 172.21.15.46:0/664624908 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3afe00640 1 --2- 172.21.15.46:0/664624908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b0071000 0x7fc3b0071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645876630 0 0) 0x7fc3b00cbde0 con 0x7fc3b006d4f0 2024-02-19T06:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc394003520 con 0x7fc3b006d4f0 2024-02-19T06:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 909612227 0 0) 0x7fc394003520 con 0x7fc3b006d4f0 2024-02-19T06:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b0071000 msgr2=0x7fc3b0071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 --2- 172.21.15.46:0/664624908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b0071000 0x7fc3b0071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 >> v1:172.21.15.142:6789/0 conn(0x7fc3b0145260 legacy=0x7fc3b015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b00cc360 con 0x7fc3b006d4f0 2024-02-19T06:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fc3a8001670 con 0x7fc3b006d4f0 2024-02-19T06:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 >> v1:172.21.15.46:6789/0 conn(0x7fc3b006d4f0 legacy=0x7fc3b006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 --2- 172.21.15.46:0/664624908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b0071000 0x7fc3940039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 --2- 172.21.15.46:0/664624908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394003f20 0x7fc3940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 --2- 172.21.15.46:0/664624908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394004d00 0x7fc394005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00719c0 con 0x7fc394004d00 2024-02-19T06:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39400bb10 con 0x7fc394003f20 2024-02-19T06:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.107+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39400bcd0 con 0x7fc3b0071000 2024-02-19T06:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.108+0000 7fc3b5800640 1 --2- 172.21.15.46:0/664624908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394004d00 0x7fc394005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.108+0000 7fc3b4e00640 1 --2- 172.21.15.46:0/664624908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b0071000 0x7fc3940039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.108+0000 7fc3afe00640 1 --2- 172.21.15.46:0/664624908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394003f20 0x7fc3940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.108+0000 7fc3b5800640 1 -- 172.21.15.46:0/664624908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b0071000 msgr2=0x7fc3940039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.108+0000 7fc3b5800640 1 --2- 172.21.15.46:0/664624908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b0071000 0x7fc3940039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.108+0000 7fc3b5800640 1 -- 172.21.15.46:0/664624908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394003f20 msgr2=0x7fc3940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.108+0000 7fc3b5800640 1 --2- 172.21.15.46:0/664624908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394003f20 0x7fc3940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.108+0000 7fc3b5800640 1 -- 172.21.15.46:0/664624908 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394003520 con 0x7fc394004d00 2024-02-19T06:59:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.109+0000 7fc3b5800640 1 --2- 172.21.15.46:0/664624908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394004d00 0x7fc394005180 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800c240 tx=0x7fc3940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7128962a7d8e84 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.110+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8005ad0 con 0x7fc394004d00 2024-02-19T06:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.110+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a8005c30 con 0x7fc394004d00 2024-02-19T06:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.110+0000 7fc3af400640 1 -- 172.21.15.46:0/664624908 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a802c8b0 con 0x7fc394004d00 2024-02-19T06:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.110+0000 7fc3b7800640 1 -- 172.21.15.46:0/664624908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394004d00 msgr2=0x7fc394005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.110+0000 7fc3b7800640 1 --2- 172.21.15.46:0/664624908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394004d00 0x7fc394005180 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800c240 tx=0x7fc3940057f0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.110+0000 7fc3b5800640 1 -- 172.21.15.46:0/664624908 reap_dead start 2024-02-19T06:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.110+0000 7fc3b7800640 1 -- 172.21.15.46:0/664624908 shutdown_connections 2024-02-19T06:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.110+0000 7fc3b7800640 1 -- 172.21.15.46:0/664624908 >> 172.21.15.46:0/664624908 conn(0x7fc3b0066f70 msgr2=0x7fc3b006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.110+0000 7fc3b7800640 1 -- 172.21.15.46:0/664624908 shutdown_connections 2024-02-19T06:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.110+0000 7fc3b7800640 1 -- 172.21.15.46:0/664624908 wait complete. 2024-02-19T06:59:09.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.112+0000 7fc3b7800640 1 Processor -- start 2024-02-19T06:59:09.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.112+0000 7fc3b7800640 1 -- start start 2024-02-19T06:59:09.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.113+0000 7fc3b7800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394004d00 0x7fc3b0142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.113+0000 7fc3b7800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b013f740 0x7fc3b0136bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.113+0000 7fc3b7800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b015dab0 0x7fc3b015df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.113+0000 7fc3b7800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b01578f0 con 0x7fc3b013f740 2024-02-19T06:59:09.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.113+0000 7fc3b7800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b015caa0 con 0x7fc394004d00 2024-02-19T06:59:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.113+0000 7fc3b7800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b013fba0 con 0x7fc3b015dab0 2024-02-19T06:59:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.113+0000 7fc3afe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b013f740 0x7fc3b0136bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.114+0000 7fc3afe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b013f740 0x7fc3b0136bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32996/0 (socket says 172.21.15.46:32996) 2024-02-19T06:59:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.114+0000 7fc3afe00640 1 -- 172.21.15.46:0/412598385 learned_addr learned my addr 172.21.15.46:0/412598385 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.114+0000 7fc3b4e00640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394004d00 0x7fc3b0142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.114+0000 7fc3b5800640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b015dab0 0x7fc3b015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.114+0000 7fc3afe00640 1 -- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b015dab0 msgr2=0x7fc3b015df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.114+0000 7fc3afe00640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b015dab0 0x7fc3b015df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.114+0000 7fc3afe00640 1 -- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394004d00 msgr2=0x7fc3b0142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.114+0000 7fc3afe00640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394004d00 0x7fc3b0142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.114+0000 7fc3afe00640 1 -- 172.21.15.46:0/412598385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b015ccf0 con 0x7fc3b013f740 2024-02-19T06:59:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.114+0000 7fc3b5800640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b015dab0 0x7fc3b015df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:09.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.114+0000 7fc3afe00640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b013f740 0x7fc3b0136bd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc39c011600 tx=0x7fc39c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:09.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.115+0000 7fc3acc00640 1 -- 172.21.15.46:0/412598385 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c00f920 con 0x7fc3b013f740 2024-02-19T06:59:09.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.115+0000 7fc3acc00640 1 -- 172.21.15.46:0/412598385 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c00fa80 con 0x7fc3b013f740 2024-02-19T06:59:09.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.115+0000 7fc3acc00640 1 -- 172.21.15.46:0/412598385 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c00fdf0 con 0x7fc3b013f740 2024-02-19T06:59:09.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.115+0000 7fc3b7800640 1 -- 172.21.15.46:0/412598385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b015cfd0 con 0x7fc3b013f740 2024-02-19T06:59:09.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.115+0000 7fc3b7800640 1 -- 172.21.15.46:0/412598385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b015d590 con 0x7fc3b013f740 2024-02-19T06:59:09.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.116+0000 7fc3b7800640 1 -- 172.21.15.46:0/412598385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b0067ba0 con 0x7fc3b013f740 2024-02-19T06:59:09.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.117+0000 7fc3acc00640 1 -- 172.21.15.46:0/412598385 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc39c015460 con 0x7fc3b013f740 2024-02-19T06:59:09.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.118+0000 7fc3acc00640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc39006b890 0x7fc39006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.118+0000 7fc3acc00640 1 -- 172.21.15.46:0/412598385 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc39c08a770 con 0x7fc3b013f740 2024-02-19T06:59:09.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.119+0000 7fc3b4e00640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc39006b890 0x7fc39006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.120+0000 7fc3b4e00640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc39006b890 0x7fc39006dd50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0007fd0 tx=0x7fc3a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:09.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.122+0000 7fc3acc00640 1 -- 172.21.15.46:0/412598385 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc39c0554c0 con 0x7fc3b013f740 2024-02-19T06:59:09.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.395+0000 7fc3b7800640 1 -- 172.21.15.46:0/412598385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc3b006e300 con 0x7fc3b013f740 2024-02-19T06:59:09.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.399+0000 7fc3acc00640 1 -- 172.21.15.46:0/412598385 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc39c058b80 con 0x7fc3b013f740 2024-02-19T06:59:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.402+0000 7fc3b7800640 1 -- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc39006b890 msgr2=0x7fc39006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.402+0000 7fc3b7800640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc39006b890 0x7fc39006dd50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0007fd0 tx=0x7fc3a0009040 comp rx=0 tx=0).stop 2024-02-19T06:59:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.402+0000 7fc3b7800640 1 -- 172.21.15.46:0/412598385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b013f740 msgr2=0x7fc3b0136bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.402+0000 7fc3b7800640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b013f740 0x7fc3b0136bd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc39c011600 tx=0x7fc39c011ac0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.402+0000 7fc3b7800640 1 -- 172.21.15.46:0/412598385 shutdown_connections 2024-02-19T06:59:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.402+0000 7fc3b7800640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc39006b890 0x7fc39006dd50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.402+0000 7fc3b7800640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b015dab0 0x7fc3b015df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.402+0000 7fc3b7800640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b013f740 0x7fc3b0136bd0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.402+0000 7fc3b7800640 1 --2- 172.21.15.46:0/412598385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394004d00 0x7fc3b0142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.402+0000 7fc3b7800640 1 -- 172.21.15.46:0/412598385 >> 172.21.15.46:0/412598385 conn(0x7fc3b0066f70 msgr2=0x7fc3b006d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.402+0000 7fc3b7800640 1 -- 172.21.15.46:0/412598385 shutdown_connections 2024-02-19T06:59:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.402+0000 7fc3b7800640 1 -- 172.21.15.46:0/412598385 wait complete. 2024-02-19T06:59:09.421 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-02-19T06:59:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.639+0000 7fd60d200640 1 Processor -- start 2024-02-19T06:59:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.639+0000 7fd60d200640 1 -- start start 2024-02-19T06:59:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.641+0000 7fd60d200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd6080b3550 0x7fd608168680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.641+0000 7fd60d200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6080ad000 con 0x7fd6080acb80 2024-02-19T06:59:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.641+0000 7fd60d200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6080ad260 con 0x7fd6080ae3f0 2024-02-19T06:59:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.641+0000 7fd60d200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6080adee0 con 0x7fd6080b3550 2024-02-19T06:59:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.641+0000 7fd605400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd6080acb80 0x7fd60815ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42100/0 (socket says 172.21.15.46:42100) 2024-02-19T06:59:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.641+0000 7fd605400640 1 -- 172.21.15.46:0/1601619936 learned_addr learned my addr 172.21.15.46:0/1601619936 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:09.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd606800640 1 --2- 172.21.15.46:0/1601619936 >> v2:172.21.15.142:3300/0 conn(0x7fd6080b3550 0x7fd608168680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288739575 0 0) 0x7fd6080ad000 con 0x7fd6080acb80 2024-02-19T06:59:09.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5ec003520 con 0x7fd6080acb80 2024-02-19T06:59:09.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2516922438 0 0) 0x7fd5ec003520 con 0x7fd6080acb80 2024-02-19T06:59:09.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 >> v2:172.21.15.142:3300/0 conn(0x7fd6080b3550 msgr2=0x7fd608168680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:09.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 --2- 172.21.15.46:0/1601619936 >> v2:172.21.15.142:3300/0 conn(0x7fd6080b3550 0x7fd608168680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 >> v1:172.21.15.142:6789/0 conn(0x7fd6080ae3f0 legacy=0x7fd6080ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080ad540 con 0x7fd6080acb80 2024-02-19T06:59:09.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fd5f4001670 con 0x7fd6080acb80 2024-02-19T06:59:09.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 >> v1:172.21.15.46:6789/0 conn(0x7fd6080acb80 legacy=0x7fd60815ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 --2- 172.21.15.46:0/1601619936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5ec003970 0x7fd5ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 --2- 172.21.15.46:0/1601619936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5ec0047c0 0x7fd5ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 --2- 172.21.15.46:0/1601619936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5ec005180 0x7fd5ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080adee0 con 0x7fd5ec005180 2024-02-19T06:59:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec00c020 con 0x7fd5ec003970 2024-02-19T06:59:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.642+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec00c1e0 con 0x7fd5ec0047c0 2024-02-19T06:59:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.643+0000 7fd606800640 1 --2- 172.21.15.46:0/1601619936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5ec005180 0x7fd5ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.643+0000 7fd605e00640 1 --2- 172.21.15.46:0/1601619936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5ec003970 0x7fd5ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.643+0000 7fd605400640 1 --2- 172.21.15.46:0/1601619936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5ec0047c0 0x7fd5ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.643+0000 7fd606800640 1 -- 172.21.15.46:0/1601619936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5ec0047c0 msgr2=0x7fd5ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.643+0000 7fd606800640 1 --2- 172.21.15.46:0/1601619936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5ec0047c0 0x7fd5ec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.643+0000 7fd606800640 1 -- 172.21.15.46:0/1601619936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5ec003970 msgr2=0x7fd5ec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.643+0000 7fd606800640 1 --2- 172.21.15.46:0/1601619936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5ec003970 0x7fd5ec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.643+0000 7fd606800640 1 -- 172.21.15.46:0/1601619936 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec003520 con 0x7fd5ec005180 2024-02-19T06:59:09.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.644+0000 7fd606800640 1 -- 172.21.15.46:0/1601619936 reap_dead start 2024-02-19T06:59:09.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.644+0000 7fd606800640 1 --2- 172.21.15.46:0/1601619936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5ec005180 0x7fd5ec00b980 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd600009f90 tx=0x7fd5ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9664548c5046bbec server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:09.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.645+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60002cc20 con 0x7fd5ec005180 2024-02-19T06:59:09.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.645+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60000f040 con 0x7fd5ec005180 2024-02-19T06:59:09.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.645+0000 7fd604a00640 1 -- 172.21.15.46:0/1601619936 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600003990 con 0x7fd5ec005180 2024-02-19T06:59:09.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.645+0000 7fd60d200640 1 -- 172.21.15.46:0/1601619936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5ec005180 msgr2=0x7fd5ec00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.645+0000 7fd60d200640 1 --2- 172.21.15.46:0/1601619936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5ec005180 0x7fd5ec00b980 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd600009f90 tx=0x7fd5ec0057f0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.645+0000 7fd60d200640 1 -- 172.21.15.46:0/1601619936 shutdown_connections 2024-02-19T06:59:09.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.645+0000 7fd60d200640 1 --2- 172.21.15.46:0/1601619936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5ec005180 0x7fd5ec00b980 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.645+0000 7fd60d200640 1 -- 172.21.15.46:0/1601619936 >> 172.21.15.46:0/1601619936 conn(0x7fd608066f70 msgr2=0x7fd60806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:09.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.645+0000 7fd60d200640 1 -- 172.21.15.46:0/1601619936 shutdown_connections 2024-02-19T06:59:09.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.645+0000 7fd60d200640 1 -- 172.21.15.46:0/1601619936 wait complete. 2024-02-19T06:59:09.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.647+0000 7fd60d200640 1 Processor -- start 2024-02-19T06:59:09.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.647+0000 7fd60d200640 1 -- start start 2024-02-19T06:59:09.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.648+0000 7fd60d200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5ec005180 0x7fd6080cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.648+0000 7fd60d200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6080cd190 0x7fd608146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.648+0000 7fd60d200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd60815db00 0x7fd60815df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.648+0000 7fd60d200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60815e4c0 con 0x7fd5ec005180 2024-02-19T06:59:09.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.648+0000 7fd60d200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080cbc40 con 0x7fd60815db00 2024-02-19T06:59:09.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.648+0000 7fd60d200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd608147430 con 0x7fd6080cd190 2024-02-19T06:59:09.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.648+0000 7fd605e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5ec005180 0x7fd6080cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.648+0000 7fd605e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5ec005180 0x7fd6080cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33022/0 (socket says 172.21.15.46:33022) 2024-02-19T06:59:09.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.648+0000 7fd605e00640 1 -- 172.21.15.46:0/4289044304 learned_addr learned my addr 172.21.15.46:0/4289044304 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:09.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.649+0000 7fd606800640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd60815db00 0x7fd60815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.649+0000 7fd605400640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6080cd190 0x7fd608146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.649+0000 7fd605e00640 1 -- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6080cd190 msgr2=0x7fd608146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.649+0000 7fd605e00640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6080cd190 0x7fd608146ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.649+0000 7fd605e00640 1 -- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd60815db00 msgr2=0x7fd60815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.649+0000 7fd605e00640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd60815db00 0x7fd60815df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.649+0000 7fd605e00640 1 -- 172.21.15.46:0/4289044304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080cdda0 con 0x7fd5ec005180 2024-02-19T06:59:09.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.649+0000 7fd606800640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd60815db00 0x7fd60815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:09.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.649+0000 7fd605e00640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5ec005180 0x7fd6080cb700 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800e480 tx=0x7fd5f800e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:09.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.649+0000 7fd5fe000640 1 -- 172.21.15.46:0/4289044304 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f80052e0 con 0x7fd5ec005180 2024-02-19T06:59:09.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.649+0000 7fd5fe000640 1 -- 172.21.15.46:0/4289044304 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8005440 con 0x7fd5ec005180 2024-02-19T06:59:09.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.650+0000 7fd5fe000640 1 -- 172.21.15.46:0/4289044304 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8003830 con 0x7fd5ec005180 2024-02-19T06:59:09.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.650+0000 7fd60d200640 1 -- 172.21.15.46:0/4289044304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6080cbe70 con 0x7fd5ec005180 2024-02-19T06:59:09.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.650+0000 7fd60d200640 1 -- 172.21.15.46:0/4289044304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6080cc430 con 0x7fd5ec005180 2024-02-19T06:59:09.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.651+0000 7fd60d200640 1 -- 172.21.15.46:0/4289044304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd608067ba0 con 0x7fd5ec005180 2024-02-19T06:59:09.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.652+0000 7fd5fe000640 1 -- 172.21.15.46:0/4289044304 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd5f8003990 con 0x7fd5ec005180 2024-02-19T06:59:09.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.653+0000 7fd5fe000640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5e806b810 0x7fd5e806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:09.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.653+0000 7fd5fe000640 1 -- 172.21.15.46:0/4289044304 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd5f8089bc0 con 0x7fd5ec005180 2024-02-19T06:59:09.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.654+0000 7fd605400640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5e806b810 0x7fd5e806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:09.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.655+0000 7fd605400640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5e806b810 0x7fd5e806dcd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4001200 tx=0x7fd5f4000f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:09.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.658+0000 7fd5fe000640 1 -- 172.21.15.46:0/4289044304 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd5f80549c0 con 0x7fd5ec005180 2024-02-19T06:59:09.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.932+0000 7fd60d200640 1 -- 172.21.15.46:0/4289044304 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd608157900 con 0x7fd5ec005180 2024-02-19T06:59:09.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.937+0000 7fd5fe000640 1 -- 172.21.15.46:0/4289044304 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd5f8058080 con 0x7fd5ec005180 2024-02-19T06:59:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.940+0000 7fd60d200640 1 -- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5e806b810 msgr2=0x7fd5e806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.940+0000 7fd60d200640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5e806b810 0x7fd5e806dcd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4001200 tx=0x7fd5f4000f30 comp rx=0 tx=0).stop 2024-02-19T06:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.940+0000 7fd60d200640 1 -- 172.21.15.46:0/4289044304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5ec005180 msgr2=0x7fd6080cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.940+0000 7fd60d200640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5ec005180 0x7fd6080cb700 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800e480 tx=0x7fd5f800e940 comp rx=0 tx=0).stop 2024-02-19T06:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.940+0000 7fd60d200640 1 -- 172.21.15.46:0/4289044304 shutdown_connections 2024-02-19T06:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.940+0000 7fd60d200640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd5e806b810 0x7fd5e806dcd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.940+0000 7fd60d200640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd60815db00 0x7fd60815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.940+0000 7fd60d200640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6080cd190 0x7fd608146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.940+0000 7fd60d200640 1 --2- 172.21.15.46:0/4289044304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5ec005180 0x7fd6080cb700 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.940+0000 7fd60d200640 1 -- 172.21.15.46:0/4289044304 >> 172.21.15.46:0/4289044304 conn(0x7fd608066f70 msgr2=0x7fd60815f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.940+0000 7fd60d200640 1 -- 172.21.15.46:0/4289044304 shutdown_connections 2024-02-19T06:59:09.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:09.940+0000 7fd60d200640 1 -- 172.21.15.46:0/4289044304 wait complete. 2024-02-19T06:59:09.960 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-02-19T06:59:10.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.179+0000 7f8775800640 1 Processor -- start 2024-02-19T06:59:10.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.180+0000 7f8775800640 1 -- start start 2024-02-19T06:59:10.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.181+0000 7f8775800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f877015a670 0x7f87700ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:10.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.181+0000 7f8775800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f877006da30 0x7f87700b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:10.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.181+0000 7f8775800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87700cdde0 con 0x7f87700ce7b0 2024-02-19T06:59:10.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.181+0000 7f8775800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877006df10 con 0x7f877015a670 2024-02-19T06:59:10.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.181+0000 7f8775800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87700cd4b0 con 0x7f877006da30 2024-02-19T06:59:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.182+0000 7f876ea00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f877015a670 0x7f87700ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.182+0000 7f876f400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f87700ce7b0 0x7f87700cf250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42102/0 (socket says 172.21.15.46:42102) 2024-02-19T06:59:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.182+0000 7f876f400640 1 -- 172.21.15.46:0/1326912991 learned_addr learned my addr 172.21.15.46:0/1326912991 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.182+0000 7f876d600640 1 -- 172.21.15.46:0/1326912991 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569358188 0 0) 0x7f87700cdde0 con 0x7f87700ce7b0 2024-02-19T06:59:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.182+0000 7f876ea00640 1 -- 172.21.15.46:0/1326912991 >> v2:172.21.15.142:3300/0 conn(0x7f877006da30 msgr2=0x7f87700b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.182+0000 7f876e000640 1 --2- 172.21.15.46:0/1326912991 >> v2:172.21.15.142:3300/0 conn(0x7f877006da30 0x7f87700b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.182+0000 7f876ea00640 1 --2- 172.21.15.46:0/1326912991 >> v2:172.21.15.142:3300/0 conn(0x7f877006da30 0x7f87700b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.182+0000 7f876ea00640 1 -- 172.21.15.46:0/1326912991 >> v1:172.21.15.46:6789/0 conn(0x7f87700ce7b0 legacy=0x7f87700cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.182+0000 7f876ea00640 1 -- 172.21.15.46:0/1326912991 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87700cd790 con 0x7f877015a670 2024-02-19T06:59:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.182+0000 7f876e000640 1 --2- 172.21.15.46:0/1326912991 >> v2:172.21.15.142:3300/0 conn(0x7f877006da30 0x7f87700b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.184+0000 7f876ea00640 1 --2- 172.21.15.46:0/1326912991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f877015a670 0x7f87700ce270 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f87700b4b50 tx=0x7f876002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56ca7ac6b38743d server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:10.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.184+0000 7f876d600640 1 -- 172.21.15.46:0/1326912991 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760031830 con 0x7f877015a670 2024-02-19T06:59:10.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.184+0000 7f876d600640 1 -- 172.21.15.46:0/1326912991 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8760031990 con 0x7f877015a670 2024-02-19T06:59:10.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.184+0000 7f876d600640 1 -- 172.21.15.46:0/1326912991 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760031d20 con 0x7f877015a670 2024-02-19T06:59:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.185+0000 7f8775800640 1 -- 172.21.15.46:0/1326912991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f877015a670 msgr2=0x7f87700ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.185+0000 7f8775800640 1 --2- 172.21.15.46:0/1326912991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f877015a670 0x7f87700ce270 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f87700b4b50 tx=0x7f876002b8d0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.185+0000 7f8775800640 1 -- 172.21.15.46:0/1326912991 shutdown_connections 2024-02-19T06:59:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.185+0000 7f8775800640 1 --2- 172.21.15.46:0/1326912991 >> v2:172.21.15.142:3300/0 conn(0x7f877006da30 0x7f87700b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.185+0000 7f8775800640 1 --2- 172.21.15.46:0/1326912991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f877015a670 0x7f87700ce270 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.185+0000 7f8775800640 1 -- 172.21.15.46:0/1326912991 >> 172.21.15.46:0/1326912991 conn(0x7f8770066f70 msgr2=0x7f877006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.185+0000 7f8775800640 1 -- 172.21.15.46:0/1326912991 shutdown_connections 2024-02-19T06:59:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.185+0000 7f8775800640 1 -- 172.21.15.46:0/1326912991 wait complete. 2024-02-19T06:59:10.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.187+0000 7f8775800640 1 Processor -- start 2024-02-19T06:59:10.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.187+0000 7f8775800640 1 -- start start 2024-02-19T06:59:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.188+0000 7f8775800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f877006da30 0x7f87700ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.188+0000 7f8775800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87700ce7b0 0x7f87701597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.188+0000 7f8775800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f877015a670 0x7f87701576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.188+0000 7f8775800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8770159d10 con 0x7f87700ce7b0 2024-02-19T06:59:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.188+0000 7f8775800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8770156ed0 con 0x7f877006da30 2024-02-19T06:59:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.188+0000 7f8775800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8770158fe0 con 0x7f877015a670 2024-02-19T06:59:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.188+0000 7f876e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87700ce7b0 0x7f87701597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:10.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.189+0000 7f876e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87700ce7b0 0x7f87701597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33036/0 (socket says 172.21.15.46:33036) 2024-02-19T06:59:10.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.189+0000 7f876e000640 1 -- 172.21.15.46:0/1241502360 learned_addr learned my addr 172.21.15.46:0/1241502360 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:10.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.189+0000 7f876ea00640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f877006da30 0x7f87700ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:10.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.189+0000 7f876f400640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f877015a670 0x7f87701576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:10.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.189+0000 7f876e000640 1 -- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f877015a670 msgr2=0x7f87701576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:10.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.189+0000 7f876e000640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f877015a670 0x7f87701576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.189+0000 7f876e000640 1 -- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f877006da30 msgr2=0x7f87700ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:10.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.189+0000 7f876e000640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f877006da30 0x7f87700ae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.189+0000 7f876e000640 1 -- 172.21.15.46:0/1241502360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760009400 con 0x7f87700ce7b0 2024-02-19T06:59:10.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.189+0000 7f876ea00640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f877006da30 0x7f87700ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:10.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.189+0000 7f876e000640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87700ce7b0 0x7f87701597d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f875c00cf30 tx=0x7f875c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:10.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.189+0000 7f8766a00640 1 -- 172.21.15.46:0/1241502360 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c00d840 con 0x7f87700ce7b0 2024-02-19T06:59:10.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.190+0000 7f8766a00640 1 -- 172.21.15.46:0/1241502360 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c00d9a0 con 0x7f87700ce7b0 2024-02-19T06:59:10.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.190+0000 7f8766a00640 1 -- 172.21.15.46:0/1241502360 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c00dd30 con 0x7f87700ce7b0 2024-02-19T06:59:10.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.190+0000 7f8775800640 1 -- 172.21.15.46:0/1241502360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87701592c0 con 0x7f87700ce7b0 2024-02-19T06:59:10.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.190+0000 7f8775800640 1 -- 172.21.15.46:0/1241502360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8770157bf0 con 0x7f87700ce7b0 2024-02-19T06:59:10.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.191+0000 7f8775800640 1 -- 172.21.15.46:0/1241502360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87701573d0 con 0x7f87700ce7b0 2024-02-19T06:59:10.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.192+0000 7f8766a00640 1 -- 172.21.15.46:0/1241502360 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f875c015440 con 0x7f87700ce7b0 2024-02-19T06:59:10.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.193+0000 7f8766a00640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f875006b840 0x7f875006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:10.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.193+0000 7f8766a00640 1 -- 172.21.15.46:0/1241502360 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f875c08a7e0 con 0x7f87700ce7b0 2024-02-19T06:59:10.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.193+0000 7f876ea00640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f875006b840 0x7f875006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:10.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.195+0000 7f876ea00640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f875006b840 0x7f875006dd00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8760036000 tx=0x7f8760008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:10.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.197+0000 7f8766a00640 1 -- 172.21.15.46:0/1241502360 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f87701573d0 con 0x7f87700ce7b0 2024-02-19T06:59:10.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.472+0000 7f8775800640 1 -- 172.21.15.46:0/1241502360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f87701573d0 con 0x7f87700ce7b0 2024-02-19T06:59:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.475+0000 7f8766a00640 1 -- 172.21.15.46:0/1241502360 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f87701573d0 con 0x7f87700ce7b0 2024-02-19T06:59:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.478+0000 7f8775800640 1 -- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f875006b840 msgr2=0x7f875006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.478+0000 7f8775800640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f875006b840 0x7f875006dd00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8760036000 tx=0x7f8760008030 comp rx=0 tx=0).stop 2024-02-19T06:59:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.478+0000 7f8775800640 1 -- 172.21.15.46:0/1241502360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87700ce7b0 msgr2=0x7f87701597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.478+0000 7f8775800640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87700ce7b0 0x7f87701597d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f875c00cf30 tx=0x7f875c00a7d0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.478+0000 7f8775800640 1 -- 172.21.15.46:0/1241502360 shutdown_connections 2024-02-19T06:59:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.478+0000 7f8775800640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f875006b840 0x7f875006dd00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.478+0000 7f8775800640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f877015a670 0x7f87701576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.478+0000 7f8775800640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87700ce7b0 0x7f87701597d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.478+0000 7f8775800640 1 --2- 172.21.15.46:0/1241502360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f877006da30 0x7f87700ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.478+0000 7f8775800640 1 -- 172.21.15.46:0/1241502360 >> 172.21.15.46:0/1241502360 conn(0x7f8770066f70 msgr2=0x7f8770071000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.478+0000 7f8775800640 1 -- 172.21.15.46:0/1241502360 shutdown_connections 2024-02-19T06:59:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.479+0000 7f8775800640 1 -- 172.21.15.46:0/1241502360 wait complete. 2024-02-19T06:59:10.500 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-02-19T06:59:10.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.719+0000 7f2221200640 1 Processor -- start 2024-02-19T06:59:10.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.719+0000 7f2221200640 1 -- start start 2024-02-19T06:59:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.721+0000 7f2221200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f221c0acb80 0x7f221c15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.721+0000 7f2221200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f221c0b2540 0x7f221c0b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:10.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.721+0000 7f2221200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221c0ad000 con 0x7f221c0ae3f0 2024-02-19T06:59:10.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.721+0000 7f2221200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221c0adee0 con 0x7f221c0b2540 2024-02-19T06:59:10.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.721+0000 7f2221200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221c15efc0 con 0x7f221c0acb80 2024-02-19T06:59:10.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.721+0000 7f221a800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f221c0b2540 0x7f221c0b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:10.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.721+0000 7f2213e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f221c0acb80 0x7f221c15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:10.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.721+0000 7f221a800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f221c0b2540 0x7f221c0b29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33042/0 (socket says 172.21.15.46:33042) 2024-02-19T06:59:10.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.721+0000 7f221a800640 1 -- 172.21.15.46:0/3261533495 learned_addr learned my addr 172.21.15.46:0/3261533495 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:10.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.722+0000 7f221a800640 1 -- 172.21.15.46:0/3261533495 >> v2:172.21.15.142:3300/0 conn(0x7f221c0acb80 msgr2=0x7f221c15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:10.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.722+0000 7f221a800640 1 --2- 172.21.15.46:0/3261533495 >> v2:172.21.15.142:3300/0 conn(0x7f221c0acb80 0x7f221c15ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.722+0000 7f221a800640 1 -- 172.21.15.46:0/3261533495 >> v1:172.21.15.142:6789/0 conn(0x7f221c0ae3f0 legacy=0x7f221c0ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:10.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.722+0000 7f221a800640 1 -- 172.21.15.46:0/3261533495 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c0ad260 con 0x7f221c0b2540 2024-02-19T06:59:10.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.723+0000 7f221a800640 1 --2- 172.21.15.46:0/3261533495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f221c0b2540 0x7f221c0b29f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f221c06f350 tx=0x7f221402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbc411d0dbd5b98 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:10.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.724+0000 7f2219400640 1 -- 172.21.15.46:0/3261533495 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221402cb20 con 0x7f221c0b2540 2024-02-19T06:59:10.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.724+0000 7f2219400640 1 -- 172.21.15.46:0/3261533495 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221402cc80 con 0x7f221c0b2540 2024-02-19T06:59:10.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.724+0000 7f2219400640 1 -- 172.21.15.46:0/3261533495 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140343f0 con 0x7f221c0b2540 2024-02-19T06:59:10.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.724+0000 7f2221200640 1 -- 172.21.15.46:0/3261533495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f221c0b2540 msgr2=0x7f221c0b29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:10.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.724+0000 7f2221200640 1 --2- 172.21.15.46:0/3261533495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f221c0b2540 0x7f221c0b29f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f221c06f350 tx=0x7f221402bf80 comp rx=0 tx=0).stop 2024-02-19T06:59:10.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.724+0000 7f2221200640 1 -- 172.21.15.46:0/3261533495 shutdown_connections 2024-02-19T06:59:10.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.724+0000 7f2221200640 1 --2- 172.21.15.46:0/3261533495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f221c0b2540 0x7f221c0b29f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.724+0000 7f2221200640 1 --2- 172.21.15.46:0/3261533495 >> v2:172.21.15.142:3300/0 conn(0x7f221c0acb80 0x7f221c15ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.724+0000 7f2221200640 1 -- 172.21.15.46:0/3261533495 >> 172.21.15.46:0/3261533495 conn(0x7f221c066f70 msgr2=0x7f221c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:10.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.725+0000 7f2221200640 1 -- 172.21.15.46:0/3261533495 shutdown_connections 2024-02-19T06:59:10.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.725+0000 7f2221200640 1 -- 172.21.15.46:0/3261533495 wait complete. 2024-02-19T06:59:10.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.726+0000 7f2221200640 1 Processor -- start 2024-02-19T06:59:10.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.727+0000 7f2221200640 1 -- start start 2024-02-19T06:59:10.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.727+0000 7f2221200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f221c0acb80 0x7f221c160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:10.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.728+0000 7f2221200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c0ae3f0 0x7f221c145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:10.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.728+0000 7f2221200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f221c0b2540 0x7f221c154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:10.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.728+0000 7f2221200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c146490 con 0x7f221c0acb80 2024-02-19T06:59:10.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.728+0000 7f2221200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c158690 con 0x7f221c0b2540 2024-02-19T06:59:10.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.728+0000 7f2221200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c14f2c0 con 0x7f221c0ae3f0 2024-02-19T06:59:10.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.728+0000 7f2219e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f221c0acb80 0x7f221c160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.728+0000 7f2219e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f221c0acb80 0x7f221c160560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33054/0 (socket says 172.21.15.46:33054) 2024-02-19T06:59:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.728+0000 7f2219e00640 1 -- 172.21.15.46:0/2206988821 learned_addr learned my addr 172.21.15.46:0/2206988821 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.728+0000 7f2219e00640 1 -- 172.21.15.46:0/2206988821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c0ae3f0 msgr2=0x7f221c145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.728+0000 7f2219e00640 1 --2- 172.21.15.46:0/2206988821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c0ae3f0 0x7f221c145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.728+0000 7f2219e00640 1 -- 172.21.15.46:0/2206988821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f221c0b2540 msgr2=0x7f221c154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:10.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.728+0000 7f2219e00640 1 --2- 172.21.15.46:0/2206988821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f221c0b2540 0x7f221c154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.728+0000 7f2219e00640 1 -- 172.21.15.46:0/2206988821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2214009b30 con 0x7f221c0acb80 2024-02-19T06:59:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.729+0000 7f2219e00640 1 --2- 172.21.15.46:0/2206988821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f221c0acb80 0x7f221c160560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f220c00c400 tx=0x7f220c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.729+0000 7f2212000640 1 -- 172.21.15.46:0/2206988821 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c0052d0 con 0x7f221c0acb80 2024-02-19T06:59:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.729+0000 7f2212000640 1 -- 172.21.15.46:0/2206988821 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220c005450 con 0x7f221c0acb80 2024-02-19T06:59:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.729+0000 7f2212000640 1 -- 172.21.15.46:0/2206988821 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c007260 con 0x7f221c0acb80 2024-02-19T06:59:10.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.729+0000 7f2221200640 1 -- 172.21.15.46:0/2206988821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c15fe10 con 0x7f221c0acb80 2024-02-19T06:59:10.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.729+0000 7f2221200640 1 -- 172.21.15.46:0/2206988821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c1588e0 con 0x7f221c0acb80 2024-02-19T06:59:10.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.730+0000 7f2221200640 1 -- 172.21.15.46:0/2206988821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c067ba0 con 0x7f221c0acb80 2024-02-19T06:59:10.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.731+0000 7f2212000640 1 -- 172.21.15.46:0/2206988821 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f220c0073c0 con 0x7f221c0acb80 2024-02-19T06:59:10.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.732+0000 7f2212000640 1 --2- 172.21.15.46:0/2206988821 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f21f806b810 0x7f21f806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:10.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.732+0000 7f2212000640 1 -- 172.21.15.46:0/2206988821 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f220c0892b0 con 0x7f221c0acb80 2024-02-19T06:59:10.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.733+0000 7f2213e00640 1 --2- 172.21.15.46:0/2206988821 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f21f806b810 0x7f21f806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:10.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.734+0000 7f2213e00640 1 --2- 172.21.15.46:0/2206988821 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f21f806b810 0x7f21f806dcd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f221c154140 tx=0x7f22040095a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:10.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:10.736+0000 7f2212000640 1 -- 172.21.15.46:0/2206988821 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f220c054010 con 0x7f221c0acb80 2024-02-19T06:59:11.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.000+0000 7f2221200640 1 -- 172.21.15.46:0/2206988821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f221c0b0e70 con 0x7f221c0acb80 2024-02-19T06:59:11.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.003+0000 7f2212000640 1 -- 172.21.15.46:0/2206988821 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f220c0576d0 con 0x7f221c0acb80 2024-02-19T06:59:11.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.006+0000 7f2221200640 1 -- 172.21.15.46:0/2206988821 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f21f806b810 msgr2=0x7f21f806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:11.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.006+0000 7f2221200640 1 --2- 172.21.15.46:0/2206988821 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f21f806b810 0x7f21f806dcd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f221c154140 tx=0x7f22040095a0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.006+0000 7f2221200640 1 -- 172.21.15.46:0/2206988821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f221c0acb80 msgr2=0x7f221c160560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:11.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.006+0000 7f2221200640 1 --2- 172.21.15.46:0/2206988821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f221c0acb80 0x7f221c160560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f220c00c400 tx=0x7f220c00c8c0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.007+0000 7f2221200640 1 -- 172.21.15.46:0/2206988821 shutdown_connections 2024-02-19T06:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.007+0000 7f2221200640 1 --2- 172.21.15.46:0/2206988821 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f21f806b810 0x7f21f806dcd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.007+0000 7f2221200640 1 --2- 172.21.15.46:0/2206988821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f221c0b2540 0x7f221c154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.007+0000 7f2221200640 1 --2- 172.21.15.46:0/2206988821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c0ae3f0 0x7f221c145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.007+0000 7f2221200640 1 --2- 172.21.15.46:0/2206988821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f221c0acb80 0x7f221c160560 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.007+0000 7f2221200640 1 -- 172.21.15.46:0/2206988821 >> 172.21.15.46:0/2206988821 conn(0x7f221c066f70 msgr2=0x7f221c06d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.007+0000 7f2221200640 1 -- 172.21.15.46:0/2206988821 shutdown_connections 2024-02-19T06:59:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.007+0000 7f2221200640 1 -- 172.21.15.46:0/2206988821 wait complete. 2024-02-19T06:59:11.025 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-02-19T06:59:11.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.238+0000 7fee36e00640 1 Processor -- start 2024-02-19T06:59:11.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.238+0000 7fee36e00640 1 -- start start 2024-02-19T06:59:11.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.240+0000 7fee36e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee3006ea20 0x7fee300cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:11.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.240+0000 7fee36e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fee300cf890 0x7fee3006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:11.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.240+0000 7fee36e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3015fec0 con 0x7fee301452d0 2024-02-19T06:59:11.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.240+0000 7fee36e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee300ccf00 con 0x7fee300cf890 2024-02-19T06:59:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.240+0000 7fee36e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee30160350 con 0x7fee3006ea20 2024-02-19T06:59:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.241+0000 7fee34e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fee300cf890 0x7fee3006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.241+0000 7fee2f400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee3006ea20 0x7fee300cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.241+0000 7fee34e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fee300cf890 0x7fee3006d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:36646/0 (socket says 172.21.15.46:36646) 2024-02-19T06:59:11.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.241+0000 7fee34e00640 1 -- 172.21.15.46:0/369496051 learned_addr learned my addr 172.21.15.46:0/369496051 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:11.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.241+0000 7fee34e00640 1 -- 172.21.15.46:0/369496051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee3006ea20 msgr2=0x7fee300cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:11.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.241+0000 7fee34e00640 1 --2- 172.21.15.46:0/369496051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee3006ea20 0x7fee300cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.241+0000 7fee34e00640 1 -- 172.21.15.46:0/369496051 >> v1:172.21.15.142:6789/0 conn(0x7fee301452d0 legacy=0x7fee300cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:11.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.242+0000 7fee34e00640 1 -- 172.21.15.46:0/369496051 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee300cfcf0 con 0x7fee300cf890 2024-02-19T06:59:11.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.242+0000 7fee2f400640 1 --2- 172.21.15.46:0/369496051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee3006ea20 0x7fee300cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:59:11.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.243+0000 7fee34e00640 1 --2- 172.21.15.46:0/369496051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee300cf890 0x7fee3006d230 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fee28009e80 tx=0x7fee2802bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abaa021c9e3bef03 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:11.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.244+0000 7fee2ea00640 1 -- 172.21.15.46:0/369496051 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2802cae0 con 0x7fee300cf890 2024-02-19T06:59:11.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.244+0000 7fee2ea00640 1 -- 172.21.15.46:0/369496051 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2802cc40 con 0x7fee300cf890 2024-02-19T06:59:11.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.244+0000 7fee2ea00640 1 -- 172.21.15.46:0/369496051 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee280343f0 con 0x7fee300cf890 2024-02-19T06:59:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.244+0000 7fee36e00640 1 -- 172.21.15.46:0/369496051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee300cf890 msgr2=0x7fee3006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.244+0000 7fee36e00640 1 --2- 172.21.15.46:0/369496051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee300cf890 0x7fee3006d230 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fee28009e80 tx=0x7fee2802bf40 comp rx=0 tx=0).stop 2024-02-19T06:59:11.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.245+0000 7fee36e00640 1 -- 172.21.15.46:0/369496051 shutdown_connections 2024-02-19T06:59:11.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.245+0000 7fee36e00640 1 --2- 172.21.15.46:0/369496051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee3006ea20 0x7fee300cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.245+0000 7fee36e00640 1 --2- 172.21.15.46:0/369496051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee300cf890 0x7fee3006d230 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.245+0000 7fee36e00640 1 -- 172.21.15.46:0/369496051 >> 172.21.15.46:0/369496051 conn(0x7fee30066f70 msgr2=0x7fee3006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:11.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.245+0000 7fee36e00640 1 -- 172.21.15.46:0/369496051 shutdown_connections 2024-02-19T06:59:11.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.245+0000 7fee36e00640 1 -- 172.21.15.46:0/369496051 wait complete. 2024-02-19T06:59:11.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.247+0000 7fee36e00640 1 Processor -- start 2024-02-19T06:59:11.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.247+0000 7fee36e00640 1 -- start start 2024-02-19T06:59:11.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.248+0000 7fee36e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee3006ea20 0x7fee3015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:11.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.248+0000 7fee36e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee300cf890 0x7fee301425f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:11.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.248+0000 7fee36e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee301452d0 0x7fee300b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:11.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.249+0000 7fee36e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee300c44d0 con 0x7fee301452d0 2024-02-19T06:59:11.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.249+0000 7fee36e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3015b780 con 0x7fee300cf890 2024-02-19T06:59:11.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.249+0000 7fee36e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee30143fe0 con 0x7fee3006ea20 2024-02-19T06:59:11.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.249+0000 7fee34e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee301452d0 0x7fee300b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:11.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.249+0000 7fee34e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee301452d0 0x7fee300b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33068/0 (socket says 172.21.15.46:33068) 2024-02-19T06:59:11.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.249+0000 7fee34e00640 1 -- 172.21.15.46:0/3957336143 learned_addr learned my addr 172.21.15.46:0/3957336143 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:11.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.249+0000 7fee2f400640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee300cf890 0x7fee301425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:11.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.249+0000 7fee2fe00640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee3006ea20 0x7fee3015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:11.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.249+0000 7fee34e00640 1 -- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee3006ea20 msgr2=0x7fee3015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:11.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.249+0000 7fee34e00640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee3006ea20 0x7fee3015b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.249+0000 7fee34e00640 1 -- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee300cf890 msgr2=0x7fee301425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:11.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.249+0000 7fee34e00640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee300cf890 0x7fee301425f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.249+0000 7fee34e00640 1 -- 172.21.15.46:0/3957336143 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c009400 con 0x7fee301452d0 2024-02-19T06:59:11.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.250+0000 7fee34e00640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee301452d0 0x7fee300b3330 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fee28036040 tx=0x7fee28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:11.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.250+0000 7fee27e00640 1 -- 172.21.15.46:0/3957336143 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28009510 con 0x7fee301452d0 2024-02-19T06:59:11.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.250+0000 7fee27e00640 1 -- 172.21.15.46:0/3957336143 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2803e450 con 0x7fee301452d0 2024-02-19T06:59:11.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.250+0000 7fee27e00640 1 -- 172.21.15.46:0/3957336143 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2803e800 con 0x7fee301452d0 2024-02-19T06:59:11.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.250+0000 7fee36e00640 1 -- 172.21.15.46:0/3957336143 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee28009b30 con 0x7fee301452d0 2024-02-19T06:59:11.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.250+0000 7fee36e00640 1 -- 172.21.15.46:0/3957336143 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee30143220 con 0x7fee301452d0 2024-02-19T06:59:11.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.252+0000 7fee36e00640 1 -- 172.21.15.46:0/3957336143 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee30067ba0 con 0x7fee301452d0 2024-02-19T06:59:11.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.253+0000 7fee27e00640 1 -- 172.21.15.46:0/3957336143 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fee2803e960 con 0x7fee301452d0 2024-02-19T06:59:11.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.254+0000 7fee27e00640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fee1006b810 0x7fee1006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:11.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.254+0000 7fee27e00640 1 -- 172.21.15.46:0/3957336143 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fee280acc30 con 0x7fee301452d0 2024-02-19T06:59:11.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.254+0000 7fee2fe00640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fee1006b810 0x7fee1006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:11.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.255+0000 7fee2fe00640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fee1006b810 0x7fee1006dcd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee20007fd0 tx=0x7fee20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:11.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.258+0000 7fee27e00640 1 -- 172.21.15.46:0/3957336143 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fee28077900 con 0x7fee301452d0 2024-02-19T06:59:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.527+0000 7fee36e00640 1 -- 172.21.15.46:0/3957336143 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fee300d0270 con 0x7fee301452d0 2024-02-19T06:59:11.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.531+0000 7fee27e00640 1 -- 172.21.15.46:0/3957336143 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fee2807afc0 con 0x7fee301452d0 2024-02-19T06:59:11.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.534+0000 7fee36e00640 1 -- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fee1006b810 msgr2=0x7fee1006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:11.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.534+0000 7fee36e00640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fee1006b810 0x7fee1006dcd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee20007fd0 tx=0x7fee20009040 comp rx=0 tx=0).stop 2024-02-19T06:59:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.534+0000 7fee36e00640 1 -- 172.21.15.46:0/3957336143 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee301452d0 msgr2=0x7fee300b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.534+0000 7fee36e00640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee301452d0 0x7fee300b3330 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fee28036040 tx=0x7fee28004a40 comp rx=0 tx=0).stop 2024-02-19T06:59:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.534+0000 7fee36e00640 1 -- 172.21.15.46:0/3957336143 shutdown_connections 2024-02-19T06:59:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.534+0000 7fee36e00640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fee1006b810 0x7fee1006dcd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.534+0000 7fee36e00640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee301452d0 0x7fee300b3330 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.534+0000 7fee36e00640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee300cf890 0x7fee301425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.534+0000 7fee36e00640 1 --2- 172.21.15.46:0/3957336143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee3006ea20 0x7fee3015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.534+0000 7fee36e00640 1 -- 172.21.15.46:0/3957336143 >> 172.21.15.46:0/3957336143 conn(0x7fee30066f70 msgr2=0x7fee3015d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.534+0000 7fee36e00640 1 -- 172.21.15.46:0/3957336143 shutdown_connections 2024-02-19T06:59:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.534+0000 7fee36e00640 1 -- 172.21.15.46:0/3957336143 wait complete. 2024-02-19T06:59:11.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-02-19T06:59:11.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T06:59:11.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T06:59:11.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.765+0000 7fa7cd600640 1 Processor -- start 2024-02-19T06:59:11.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.765+0000 7fa7cd600640 1 -- start start 2024-02-19T06:59:11.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.766+0000 7fa7cd600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7c815bc40 0x7fa7c80b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:11.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.766+0000 7fa7cd600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa7c80cd520 0x7fa7c8165620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:11.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.766+0000 7fa7cd600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c806b830 con 0x7fa7c80b1430 2024-02-19T06:59:11.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.766+0000 7fa7cd600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c806ac20 con 0x7fa7c815bc40 2024-02-19T06:59:11.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.766+0000 7fa7cd600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c806af00 con 0x7fa7c80cd520 2024-02-19T06:59:11.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.767+0000 7fa7c6000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7c815bc40 0x7fa7c80b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:11.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.767+0000 7fa7c6a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa7c80b1430 0x7fa7c80b1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42116/0 (socket says 172.21.15.46:42116) 2024-02-19T06:59:11.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.767+0000 7fa7c6a00640 1 -- 172.21.15.46:0/889079936 learned_addr learned my addr 172.21.15.46:0/889079936 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:11.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.767+0000 7fa7c7400640 1 --2- 172.21.15.46:0/889079936 >> v2:172.21.15.142:3300/0 conn(0x7fa7c80cd520 0x7fa7c8165620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:11.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.767+0000 7fa7c6000640 1 -- 172.21.15.46:0/889079936 >> v2:172.21.15.142:3300/0 conn(0x7fa7c80cd520 msgr2=0x7fa7c8165620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:11.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.767+0000 7fa7c6000640 1 --2- 172.21.15.46:0/889079936 >> v2:172.21.15.142:3300/0 conn(0x7fa7c80cd520 0x7fa7c8165620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.767+0000 7fa7c6000640 1 -- 172.21.15.46:0/889079936 >> v1:172.21.15.46:6789/0 conn(0x7fa7c80b1430 legacy=0x7fa7c80b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:11.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.767+0000 7fa7c6000640 1 -- 172.21.15.46:0/889079936 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c806b1e0 con 0x7fa7c815bc40 2024-02-19T06:59:11.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.767+0000 7fa7c5600640 1 -- 172.21.15.46:0/889079936 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824457487 0 0) 0x7fa7c806b830 con 0x7fa7c80b1430 2024-02-19T06:59:11.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.768+0000 7fa7c6000640 1 --2- 172.21.15.46:0/889079936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c815bc40 0x7fa7c80b08d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa7c806bc40 tx=0x7fa7b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284b31c3a03419a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:11.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.768+0000 7fa7c5600640 1 -- 172.21.15.46:0/889079936 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4031830 con 0x7fa7c815bc40 2024-02-19T06:59:11.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.769+0000 7fa7c5600640 1 -- 172.21.15.46:0/889079936 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b4031990 con 0x7fa7c815bc40 2024-02-19T06:59:11.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.769+0000 7fa7c5600640 1 -- 172.21.15.46:0/889079936 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4031d20 con 0x7fa7c815bc40 2024-02-19T06:59:11.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.769+0000 7fa7cd600640 1 -- 172.21.15.46:0/889079936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c815bc40 msgr2=0x7fa7c80b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:11.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.769+0000 7fa7cd600640 1 --2- 172.21.15.46:0/889079936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c815bc40 0x7fa7c80b08d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa7c806bc40 tx=0x7fa7b402b8d0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.769+0000 7fa7cd600640 1 -- 172.21.15.46:0/889079936 shutdown_connections 2024-02-19T06:59:11.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.769+0000 7fa7cd600640 1 --2- 172.21.15.46:0/889079936 >> v2:172.21.15.142:3300/0 conn(0x7fa7c80cd520 0x7fa7c8165620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.769+0000 7fa7cd600640 1 --2- 172.21.15.46:0/889079936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c815bc40 0x7fa7c80b08d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.769+0000 7fa7cd600640 1 -- 172.21.15.46:0/889079936 >> 172.21.15.46:0/889079936 conn(0x7fa7c80d0560 msgr2=0x7fa7c80d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:11.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.769+0000 7fa7cd600640 1 -- 172.21.15.46:0/889079936 shutdown_connections 2024-02-19T06:59:11.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.769+0000 7fa7cd600640 1 -- 172.21.15.46:0/889079936 wait complete. 2024-02-19T06:59:11.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.771+0000 7fa7cd600640 1 Processor -- start 2024-02-19T06:59:11.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.771+0000 7fa7cd600640 1 -- start start 2024-02-19T06:59:11.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.772+0000 7fa7cd600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80b1430 0x7fa7c80b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:11.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.772+0000 7fa7cd600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c80cd520 0x7fa7c8157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:11.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.772+0000 7fa7cd600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c815bc40 0x7fa7c806f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:11.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.772+0000 7fa7cd600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c815c910 con 0x7fa7c815bc40 2024-02-19T06:59:11.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.772+0000 7fa7cd600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c815cb60 con 0x7fa7c80cd520 2024-02-19T06:59:11.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.772+0000 7fa7cd600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c815ce40 con 0x7fa7c80b1430 2024-02-19T06:59:11.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.772+0000 7fa7c7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c815bc40 0x7fa7c806f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:11.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.772+0000 7fa7c7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c815bc40 0x7fa7c806f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33084/0 (socket says 172.21.15.46:33084) 2024-02-19T06:59:11.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.772+0000 7fa7c7400640 1 -- 172.21.15.46:0/401066147 learned_addr learned my addr 172.21.15.46:0/401066147 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:11.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.772+0000 7fa7c6000640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c80cd520 0x7fa7c8157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:11.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.772+0000 7fa7c6a00640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80b1430 0x7fa7c80b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:11.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.773+0000 7fa7c7400640 1 -- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80b1430 msgr2=0x7fa7c80b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:11.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.773+0000 7fa7c7400640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80b1430 0x7fa7c80b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.773+0000 7fa7c7400640 1 -- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c80cd520 msgr2=0x7fa7c8157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:11.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.773+0000 7fa7c7400640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c80cd520 0x7fa7c8157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:11.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.773+0000 7fa7c7400640 1 -- 172.21.15.46:0/401066147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b4009400 con 0x7fa7c815bc40 2024-02-19T06:59:11.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.773+0000 7fa7c7400640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c815bc40 0x7fa7c806f220 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007e40 tx=0x7fa7c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:11.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.773+0000 7fa7bea00640 1 -- 172.21.15.46:0/401066147 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0014620 con 0x7fa7c815bc40 2024-02-19T06:59:11.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.773+0000 7fa7bea00640 1 -- 172.21.15.46:0/401066147 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c000ee90 con 0x7fa7c815bc40 2024-02-19T06:59:11.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.773+0000 7fa7bea00640 1 -- 172.21.15.46:0/401066147 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c00149e0 con 0x7fa7c815bc40 2024-02-19T06:59:11.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.773+0000 7fa7cd600640 1 -- 172.21.15.46:0/401066147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c815d120 con 0x7fa7c815bc40 2024-02-19T06:59:11.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.774+0000 7fa7cd600640 1 -- 172.21.15.46:0/401066147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c80c5530 con 0x7fa7c815bc40 2024-02-19T06:59:11.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.775+0000 7fa7cd600640 1 -- 172.21.15.46:0/401066147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c80682b0 con 0x7fa7c815bc40 2024-02-19T06:59:11.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.776+0000 7fa7bea00640 1 -- 172.21.15.46:0/401066147 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa7c0014b40 con 0x7fa7c815bc40 2024-02-19T06:59:11.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.777+0000 7fa7bea00640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa7a806b810 0x7fa7a806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:11.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.777+0000 7fa7bea00640 1 -- 172.21.15.46:0/401066147 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa7c008a770 con 0x7fa7c815bc40 2024-02-19T06:59:11.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.777+0000 7fa7c6a00640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa7a806b810 0x7fa7a806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:11.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.778+0000 7fa7c6a00640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa7a806b810 0x7fa7a806dcd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8000f60 tx=0x7fa7b8007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:11.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:11.781+0000 7fa7bea00640 1 -- 172.21.15.46:0/401066147 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa7c00554d0 con 0x7fa7c815bc40 2024-02-19T06:59:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.046+0000 7fa7cd600640 1 -- 172.21.15.46:0/401066147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fa7c80cb1c0 con 0x7fa7c815bc40 2024-02-19T06:59:12.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.051+0000 7fa7bea00640 1 -- 172.21.15.46:0/401066147 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa7c0058b90 con 0x7fa7c815bc40 2024-02-19T06:59:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.054+0000 7fa7cd600640 1 -- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa7a806b810 msgr2=0x7fa7a806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.054+0000 7fa7cd600640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa7a806b810 0x7fa7a806dcd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8000f60 tx=0x7fa7b8007b50 comp rx=0 tx=0).stop 2024-02-19T06:59:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.054+0000 7fa7cd600640 1 -- 172.21.15.46:0/401066147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c815bc40 msgr2=0x7fa7c806f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.054+0000 7fa7cd600640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c815bc40 0x7fa7c806f220 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007e40 tx=0x7fa7c000e4b0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.054+0000 7fa7cd600640 1 -- 172.21.15.46:0/401066147 shutdown_connections 2024-02-19T06:59:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.054+0000 7fa7cd600640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa7a806b810 0x7fa7a806dcd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.054+0000 7fa7cd600640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7c815bc40 0x7fa7c806f220 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.054+0000 7fa7cd600640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c80cd520 0x7fa7c8157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.054+0000 7fa7cd600640 1 --2- 172.21.15.46:0/401066147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80b1430 0x7fa7c80b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.054+0000 7fa7cd600640 1 -- 172.21.15.46:0/401066147 >> 172.21.15.46:0/401066147 conn(0x7fa7c80d0560 msgr2=0x7fa7c815af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:12.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.054+0000 7fa7cd600640 1 -- 172.21.15.46:0/401066147 shutdown_connections 2024-02-19T06:59:12.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.054+0000 7fa7cd600640 1 -- 172.21.15.46:0/401066147 wait complete. 2024-02-19T06:59:12.073 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:59:12.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.337+0000 7f65d0800640 1 Processor -- start 2024-02-19T06:59:12.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.337+0000 7f65d0800640 1 -- start start 2024-02-19T06:59:12.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.339+0000 7f65d0800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f65c806d6d0 0x7f65c80cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.339+0000 7f65d0800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f65c815e860 0x7f65c815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.339+0000 7f65d0800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c80cc930 con 0x7f65c815e480 2024-02-19T06:59:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.339+0000 7f65d0800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c806c630 con 0x7f65c806d6d0 2024-02-19T06:59:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.339+0000 7f65d0800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c806c910 con 0x7f65c815e860 2024-02-19T06:59:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.339+0000 7f65cde00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f65c815e480 0x7f65c80cbce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42130/0 (socket says 172.21.15.46:42130) 2024-02-19T06:59:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.339+0000 7f65cde00640 1 -- 172.21.15.46:0/2835835663 learned_addr learned my addr 172.21.15.46:0/2835835663 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.339+0000 7f65cd400640 1 --2- 172.21.15.46:0/2835835663 >> v2:172.21.15.46:3300/0 conn(0x7f65c806d6d0 0x7f65c80cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.340+0000 7f65ce800640 1 --2- 172.21.15.46:0/2835835663 >> v2:172.21.15.142:3300/0 conn(0x7f65c815e860 0x7f65c815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.340+0000 7f65cca00640 1 -- 172.21.15.46:0/2835835663 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161500668 0 0) 0x7f65c80cc930 con 0x7f65c815e480 2024-02-19T06:59:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.340+0000 7f65cca00640 1 -- 172.21.15.46:0/2835835663 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65b0003520 con 0x7f65c815e480 2024-02-19T06:59:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.340+0000 7f65cd400640 1 -- 172.21.15.46:0/2835835663 >> v2:172.21.15.142:3300/0 conn(0x7f65c815e860 msgr2=0x7f65c815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.340+0000 7f65cd400640 1 --2- 172.21.15.46:0/2835835663 >> v2:172.21.15.142:3300/0 conn(0x7f65c815e860 0x7f65c815ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.340+0000 7f65cd400640 1 -- 172.21.15.46:0/2835835663 >> v1:172.21.15.46:6789/0 conn(0x7f65c815e480 legacy=0x7f65c80cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.340+0000 7f65cd400640 1 -- 172.21.15.46:0/2835835663 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c806cbf0 con 0x7f65c806d6d0 2024-02-19T06:59:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.341+0000 7f65cd400640 1 --2- 172.21.15.46:0/2835835663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65c806d6d0 0x7f65c80cc3f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f65c80727d0 tx=0x7f65b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc91cf2ebf2e1144 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.341+0000 7f65cca00640 1 -- 172.21.15.46:0/2835835663 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8031830 con 0x7f65c806d6d0 2024-02-19T06:59:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.342+0000 7f65cca00640 1 -- 172.21.15.46:0/2835835663 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b8031990 con 0x7f65c806d6d0 2024-02-19T06:59:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.342+0000 7f65cca00640 1 -- 172.21.15.46:0/2835835663 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8031d00 con 0x7f65c806d6d0 2024-02-19T06:59:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.342+0000 7f65d0800640 1 -- 172.21.15.46:0/2835835663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65c806d6d0 msgr2=0x7f65c80cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.342+0000 7f65d0800640 1 --2- 172.21.15.46:0/2835835663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65c806d6d0 0x7f65c80cc3f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f65c80727d0 tx=0x7f65b802b8d0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.342+0000 7f65d0800640 1 -- 172.21.15.46:0/2835835663 shutdown_connections 2024-02-19T06:59:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.342+0000 7f65d0800640 1 --2- 172.21.15.46:0/2835835663 >> v2:172.21.15.142:3300/0 conn(0x7f65c815e860 0x7f65c815ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.342+0000 7f65d0800640 1 --2- 172.21.15.46:0/2835835663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65c806d6d0 0x7f65c80cc3f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.342+0000 7f65d0800640 1 -- 172.21.15.46:0/2835835663 >> 172.21.15.46:0/2835835663 conn(0x7f65c80b3180 msgr2=0x7f65c80b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.342+0000 7f65d0800640 1 -- 172.21.15.46:0/2835835663 shutdown_connections 2024-02-19T06:59:12.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.342+0000 7f65d0800640 1 -- 172.21.15.46:0/2835835663 wait complete. 2024-02-19T06:59:12.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.344+0000 7f65d0800640 1 Processor -- start 2024-02-19T06:59:12.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.344+0000 7f65d0800640 1 -- start start 2024-02-19T06:59:12.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.345+0000 7f65d0800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c806d6d0 0x7f65c815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:12.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.345+0000 7f65d0800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c815e480 0x7f65c80c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.345+0000 7f65d0800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65c815e860 0x7f65c81f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.345+0000 7f65d0800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c81f4620 con 0x7f65c815e860 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.345+0000 7f65d0800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80c7f50 con 0x7f65c815e480 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.345+0000 7f65d0800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c81f4850 con 0x7f65c806d6d0 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.346+0000 7f65ce800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65c815e860 0x7f65c81f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.346+0000 7f65ce800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65c815e860 0x7f65c81f40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33094/0 (socket says 172.21.15.46:33094) 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.346+0000 7f65ce800640 1 -- 172.21.15.46:0/3315807979 learned_addr learned my addr 172.21.15.46:0/3315807979 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.346+0000 7f65cde00640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c806d6d0 0x7f65c815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.346+0000 7f65cd400640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c815e480 0x7f65c80c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.346+0000 7f65ce800640 1 -- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c806d6d0 msgr2=0x7f65c815ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.346+0000 7f65ce800640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c806d6d0 0x7f65c815ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.346+0000 7f65ce800640 1 -- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c815e480 msgr2=0x7f65c80c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.346+0000 7f65ce800640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c815e480 0x7f65c80c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.346+0000 7f65ce800640 1 -- 172.21.15.46:0/3315807979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b8009400 con 0x7f65c815e860 2024-02-19T06:59:12.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.346+0000 7f65ce800640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65c815e860 0x7f65c81f40e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f65c4007e40 tx=0x7f65c400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:12.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.347+0000 7f65c2000640 1 -- 172.21.15.46:0/3315807979 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4014620 con 0x7f65c815e860 2024-02-19T06:59:12.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.347+0000 7f65c2000640 1 -- 172.21.15.46:0/3315807979 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c400ee90 con 0x7f65c815e860 2024-02-19T06:59:12.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.347+0000 7f65d0800640 1 -- 172.21.15.46:0/3315807979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c81f4b30 con 0x7f65c815e860 2024-02-19T06:59:12.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.347+0000 7f65c2000640 1 -- 172.21.15.46:0/3315807979 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c40149e0 con 0x7f65c815e860 2024-02-19T06:59:12.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.347+0000 7f65d0800640 1 -- 172.21.15.46:0/3315807979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c81f50f0 con 0x7f65c815e860 2024-02-19T06:59:12.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.348+0000 7f65d0800640 1 -- 172.21.15.46:0/3315807979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c8067ba0 con 0x7f65c815e860 2024-02-19T06:59:12.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.349+0000 7f65c2000640 1 -- 172.21.15.46:0/3315807979 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f65c4014b40 con 0x7f65c815e860 2024-02-19T06:59:12.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.350+0000 7f65c2000640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f65ac06b810 0x7f65ac06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:12.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.350+0000 7f65c2000640 1 -- 172.21.15.46:0/3315807979 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f65c408a790 con 0x7f65c815e860 2024-02-19T06:59:12.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.350+0000 7f65cde00640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f65ac06b810 0x7f65ac06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:12.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.351+0000 7f65cde00640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f65ac06b810 0x7f65ac06dcd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f65bc007fd0 tx=0x7f65bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:12.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.354+0000 7f65c2000640 1 -- 172.21.15.46:0/3315807979 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f65c4055590 con 0x7f65c815e860 2024-02-19T06:59:12.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.556+0000 7f65d0800640 1 -- 172.21.15.46:0/3315807979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65c80d0f30 con 0x7f65c815e860 2024-02-19T06:59:12.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.557+0000 7f65c2000640 1 -- 172.21.15.46:0/3315807979 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12891 (secure 0 0 0) 0x7f65c4058c50 con 0x7f65c815e860 2024-02-19T06:59:12.559 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:12.559 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:59:08.339129+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:59:12.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.560+0000 7f65d0800640 1 -- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f65ac06b810 msgr2=0x7f65ac06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:12.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.560+0000 7f65d0800640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f65ac06b810 0x7f65ac06dcd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f65bc007fd0 tx=0x7f65bc009040 comp rx=0 tx=0).stop 2024-02-19T06:59:12.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.560+0000 7f65d0800640 1 -- 172.21.15.46:0/3315807979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65c815e860 msgr2=0x7f65c81f40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:12.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.560+0000 7f65d0800640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65c815e860 0x7f65c81f40e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f65c4007e40 tx=0x7f65c400e4b0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.561+0000 7f65d0800640 1 -- 172.21.15.46:0/3315807979 shutdown_connections 2024-02-19T06:59:12.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.561+0000 7f65d0800640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f65ac06b810 0x7f65ac06dcd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.561+0000 7f65d0800640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65c815e860 0x7f65c81f40e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.561+0000 7f65d0800640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c815e480 0x7f65c80c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.561+0000 7f65d0800640 1 --2- 172.21.15.46:0/3315807979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c806d6d0 0x7f65c815ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.561+0000 7f65d0800640 1 -- 172.21.15.46:0/3315807979 >> 172.21.15.46:0/3315807979 conn(0x7f65c80b3180 msgr2=0x7f65c809a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:12.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.561+0000 7f65d0800640 1 -- 172.21.15.46:0/3315807979 shutdown_connections 2024-02-19T06:59:12.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.561+0000 7f65d0800640 1 -- 172.21.15.46:0/3315807979 wait complete. 2024-02-19T06:59:12.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T06:59:12.579 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T06:59:12.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.805+0000 7f8aa9a00640 1 Processor -- start 2024-02-19T06:59:12.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.805+0000 7f8aa9a00640 1 -- start start 2024-02-19T06:59:12.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.807+0000 7f8aa9a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa40aec10 0x7f8aa4161d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:12.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.807+0000 7f8aa9a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8aa4162260 0x7f8aa40cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:12.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.807+0000 7f8aa9a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa4161560 con 0x7f8aa415dc00 2024-02-19T06:59:12.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.807+0000 7f8aa9a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa406ef90 con 0x7f8aa4162260 2024-02-19T06:59:12.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.807+0000 7f8aa9a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa415e830 con 0x7f8aa40aec10 2024-02-19T06:59:12.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.808+0000 7f8aa3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8aa4162260 0x7f8aa40cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:12.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.808+0000 7f8aa3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8aa4162260 0x7f8aa40cf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33106/0 (socket says 172.21.15.46:33106) 2024-02-19T06:59:12.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.808+0000 7f8aa3400640 1 -- 172.21.15.46:0/2996095566 learned_addr learned my addr 172.21.15.46:0/2996095566 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:12.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.808+0000 7f8aa2000640 1 --2- 172.21.15.46:0/2996095566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa40aec10 0x7f8aa4161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:12.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.808+0000 7f8aa3400640 1 -- 172.21.15.46:0/2996095566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa40aec10 msgr2=0x7f8aa4161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:12.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.808+0000 7f8aa3400640 1 --2- 172.21.15.46:0/2996095566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa40aec10 0x7f8aa4161d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.808+0000 7f8aa3400640 1 -- 172.21.15.46:0/2996095566 >> v1:172.21.15.46:6789/0 conn(0x7f8aa415dc00 legacy=0x7f8aa415dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:12.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.808+0000 7f8aa3400640 1 -- 172.21.15.46:0/2996095566 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa415eb10 con 0x7f8aa4162260 2024-02-19T06:59:12.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.809+0000 7f8aa3400640 1 --2- 172.21.15.46:0/2996095566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4162260 0x7f8aa40cf160 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009e50 tx=0x7f8a9c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433ba892f6833f0e server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:12.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.810+0000 7f8aa1600640 1 -- 172.21.15.46:0/2996095566 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c02cb00 con 0x7f8aa4162260 2024-02-19T06:59:12.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.810+0000 7f8aa1600640 1 -- 172.21.15.46:0/2996095566 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c02cc60 con 0x7f8aa4162260 2024-02-19T06:59:12.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.810+0000 7f8aa1600640 1 -- 172.21.15.46:0/2996095566 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c0343f0 con 0x7f8aa4162260 2024-02-19T06:59:12.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.810+0000 7f8aa9a00640 1 -- 172.21.15.46:0/2996095566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4162260 msgr2=0x7f8aa40cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:12.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.810+0000 7f8aa9a00640 1 --2- 172.21.15.46:0/2996095566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4162260 0x7f8aa40cf160 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009e50 tx=0x7f8a9c02bf60 comp rx=0 tx=0).stop 2024-02-19T06:59:12.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.811+0000 7f8aa9a00640 1 -- 172.21.15.46:0/2996095566 shutdown_connections 2024-02-19T06:59:12.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.811+0000 7f8aa9a00640 1 --2- 172.21.15.46:0/2996095566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4162260 0x7f8aa40cf160 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.811+0000 7f8aa9a00640 1 --2- 172.21.15.46:0/2996095566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa40aec10 0x7f8aa4161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.811+0000 7f8aa9a00640 1 -- 172.21.15.46:0/2996095566 >> 172.21.15.46:0/2996095566 conn(0x7f8aa4066fc0 msgr2=0x7f8aa406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:12.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.811+0000 7f8aa9a00640 1 -- 172.21.15.46:0/2996095566 shutdown_connections 2024-02-19T06:59:12.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.811+0000 7f8aa9a00640 1 -- 172.21.15.46:0/2996095566 wait complete. 2024-02-19T06:59:12.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.812+0000 7f8aa9a00640 1 Processor -- start 2024-02-19T06:59:12.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.813+0000 7f8aa9a00640 1 -- start start 2024-02-19T06:59:12.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.813+0000 7f8aa9a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa40aec10 0x7f8aa41482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:12.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.813+0000 7f8aa9a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa415dc00 0x7f8aa41605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:12.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa9a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4162260 0x7f8aa414a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa9a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa4148fb0 con 0x7f8aa4162260 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa9a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa4149290 con 0x7f8aa40aec10 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa9a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa4149570 con 0x7f8aa415dc00 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4162260 0x7f8aa414a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4162260 0x7f8aa414a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33118/0 (socket says 172.21.15.46:33118) 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa3400640 1 -- 172.21.15.46:0/397935570 learned_addr learned my addr 172.21.15.46:0/397935570 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa2000640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa415dc00 0x7f8aa41605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa3400640 1 -- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa415dc00 msgr2=0x7f8aa41605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa2a00640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa40aec10 0x7f8aa41482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa3400640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa415dc00 0x7f8aa41605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa3400640 1 -- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa40aec10 msgr2=0x7f8aa41482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa3400640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa40aec10 0x7f8aa41482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa3400640 1 -- 172.21.15.46:0/397935570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c009b30 con 0x7f8aa4162260 2024-02-19T06:59:12.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.814+0000 7f8aa2a00640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa40aec10 0x7f8aa41482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:12.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.815+0000 7f8aa3400640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4162260 0x7f8aa414a050 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009e50 tx=0x7f8a9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:12.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.815+0000 7f8a9aa00640 1 -- 172.21.15.46:0/397935570 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c009510 con 0x7f8aa4162260 2024-02-19T06:59:12.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.815+0000 7f8a9aa00640 1 -- 172.21.15.46:0/397935570 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c03e450 con 0x7f8aa4162260 2024-02-19T06:59:12.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.815+0000 7f8aa9a00640 1 -- 172.21.15.46:0/397935570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa4149850 con 0x7f8aa4162260 2024-02-19T06:59:12.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.815+0000 7f8a9aa00640 1 -- 172.21.15.46:0/397935570 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c03e800 con 0x7f8aa4162260 2024-02-19T06:59:12.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.815+0000 7f8aa9a00640 1 -- 172.21.15.46:0/397935570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa4160b20 con 0x7f8aa4162260 2024-02-19T06:59:12.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.816+0000 7f8aa9a00640 1 -- 172.21.15.46:0/397935570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa4149d70 con 0x7f8aa4162260 2024-02-19T06:59:12.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.818+0000 7f8a9aa00640 1 -- 172.21.15.46:0/397935570 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8a9c03e960 con 0x7f8aa4162260 2024-02-19T06:59:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.818+0000 7f8a9aa00640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8a8406b840 0x7f8a8406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.819+0000 7f8a9aa00640 1 -- 172.21.15.46:0/397935570 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8a9c0acc40 con 0x7f8aa4162260 2024-02-19T06:59:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.819+0000 7f8aa2a00640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8a8406b840 0x7f8a8406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:12.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.820+0000 7f8aa2a00640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8a8406b840 0x7f8a8406dd00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8a94001680 tx=0x7f8a94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:12.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:12.824+0000 7f8a9aa00640 1 -- 172.21.15.46:0/397935570 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8aa4149d70 con 0x7f8aa4162260 2024-02-19T06:59:13.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.025+0000 7f8aa9a00640 1 -- 172.21.15.46:0/397935570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8aa4149d70 con 0x7f8aa4162260 2024-02-19T06:59:13.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.026+0000 7f8a9aa00640 1 -- 172.21.15.46:0/397935570 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8aa4149d70 con 0x7f8aa4162260 2024-02-19T06:59:13.027 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T06:59:13.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.028+0000 7f8aa9a00640 1 -- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8a8406b840 msgr2=0x7f8a8406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:13.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.028+0000 7f8aa9a00640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8a8406b840 0x7f8a8406dd00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8a94001680 tx=0x7f8a94009040 comp rx=0 tx=0).stop 2024-02-19T06:59:13.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.028+0000 7f8aa9a00640 1 -- 172.21.15.46:0/397935570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4162260 msgr2=0x7f8aa414a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:13.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.028+0000 7f8aa9a00640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4162260 0x7f8aa414a050 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009e50 tx=0x7f8a9c004a40 comp rx=0 tx=0).stop 2024-02-19T06:59:13.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.028+0000 7f8aa9a00640 1 -- 172.21.15.46:0/397935570 shutdown_connections 2024-02-19T06:59:13.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.028+0000 7f8aa9a00640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8a8406b840 0x7f8a8406dd00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.028+0000 7f8aa9a00640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4162260 0x7f8aa414a050 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.028+0000 7f8aa9a00640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa415dc00 0x7f8aa41605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.028+0000 7f8aa9a00640 1 --2- 172.21.15.46:0/397935570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa40aec10 0x7f8aa41482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.028+0000 7f8aa9a00640 1 -- 172.21.15.46:0/397935570 >> 172.21.15.46:0/397935570 conn(0x7f8aa4066fc0 msgr2=0x7f8aa406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:13.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.029+0000 7f8aa9a00640 1 -- 172.21.15.46:0/397935570 shutdown_connections 2024-02-19T06:59:13.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.029+0000 7f8aa9a00640 1 -- 172.21.15.46:0/397935570 wait complete. 2024-02-19T06:59:13.051 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-19T06:59:13.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.275+0000 7f93c2800640 1 Processor -- start 2024-02-19T06:59:13.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.275+0000 7f93c2800640 1 -- start start 2024-02-19T06:59:13.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.276+0000 7f93c2800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93bc099a30 0x7f93bc099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.276+0000 7f93c2800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93bc0b19a0 0x7f93bc0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.276+0000 7f93c2800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93bc09a3d0 con 0x7f93bc15f2e0 2024-02-19T06:59:13.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.276+0000 7f93c2800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93bc0b0920 con 0x7f93bc0b19a0 2024-02-19T06:59:13.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.276+0000 7f93c2800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc0b1510 con 0x7f93bc099a30 2024-02-19T06:59:13.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.276+0000 7f93bbe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93bc0b19a0 0x7f93bc0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.276+0000 7f93bbe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93bc0b19a0 0x7f93bc0b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33124/0 (socket says 172.21.15.46:33124) 2024-02-19T06:59:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.276+0000 7f93bbe00640 1 -- 172.21.15.46:0/2646657189 learned_addr learned my addr 172.21.15.46:0/2646657189 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.277+0000 7f93baa00640 1 --2- 172.21.15.46:0/2646657189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93bc099a30 0x7f93bc099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.277+0000 7f93bbe00640 1 -- 172.21.15.46:0/2646657189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93bc099a30 msgr2=0x7f93bc099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.277+0000 7f93bbe00640 1 --2- 172.21.15.46:0/2646657189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93bc099a30 0x7f93bc099e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.277+0000 7f93bbe00640 1 -- 172.21.15.46:0/2646657189 >> v1:172.21.15.142:6789/0 conn(0x7f93bc15f2e0 legacy=0x7f93bc0cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.277+0000 7f93bbe00640 1 -- 172.21.15.46:0/2646657189 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc0d06b0 con 0x7f93bc0b19a0 2024-02-19T06:59:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.277+0000 7f93baa00640 1 --2- 172.21.15.46:0/2646657189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93bc099a30 0x7f93bc099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:13.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.278+0000 7f93bbe00640 1 --2- 172.21.15.46:0/2646657189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93bc0b19a0 0x7f93bc0b1e30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009870 tx=0x7f93b402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259a0a4931cafdf8 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:13.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.278+0000 7f93ba000640 1 -- 172.21.15.46:0/2646657189 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4030840 con 0x7f93bc0b19a0 2024-02-19T06:59:13.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.278+0000 7f93ba000640 1 -- 172.21.15.46:0/2646657189 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b40309a0 con 0x7f93bc0b19a0 2024-02-19T06:59:13.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.279+0000 7f93ba000640 1 -- 172.21.15.46:0/2646657189 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4030d30 con 0x7f93bc0b19a0 2024-02-19T06:59:13.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.279+0000 7f93c2800640 1 -- 172.21.15.46:0/2646657189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93bc0b19a0 msgr2=0x7f93bc0b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:13.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.279+0000 7f93c2800640 1 --2- 172.21.15.46:0/2646657189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93bc0b19a0 0x7f93bc0b1e30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009870 tx=0x7f93b402b980 comp rx=0 tx=0).stop 2024-02-19T06:59:13.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.279+0000 7f93c2800640 1 -- 172.21.15.46:0/2646657189 shutdown_connections 2024-02-19T06:59:13.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.279+0000 7f93c2800640 1 --2- 172.21.15.46:0/2646657189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93bc0b19a0 0x7f93bc0b1e30 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.279+0000 7f93c2800640 1 --2- 172.21.15.46:0/2646657189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93bc099a30 0x7f93bc099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.279+0000 7f93c2800640 1 -- 172.21.15.46:0/2646657189 >> 172.21.15.46:0/2646657189 conn(0x7f93bc0b3180 msgr2=0x7f93bc0b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:13.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.279+0000 7f93c2800640 1 -- 172.21.15.46:0/2646657189 shutdown_connections 2024-02-19T06:59:13.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.279+0000 7f93c2800640 1 -- 172.21.15.46:0/2646657189 wait complete. 2024-02-19T06:59:13.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.281+0000 7f93c2800640 1 Processor -- start 2024-02-19T06:59:13.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.281+0000 7f93c2800640 1 -- start start 2024-02-19T06:59:13.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.282+0000 7f93c2800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93bc099a30 0x7f93bc0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.282+0000 7f93c2800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93bc0b19a0 0x7f93bc0b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.282+0000 7f93c2800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93bc15f2e0 0x7f93bc155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.282+0000 7f93c2800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc152c80 con 0x7f93bc15f2e0 2024-02-19T06:59:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.282+0000 7f93c2800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc1f77f0 con 0x7f93bc0b19a0 2024-02-19T06:59:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.282+0000 7f93c2800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc1f7ad0 con 0x7f93bc099a30 2024-02-19T06:59:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.282+0000 7f93bbe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93bc15f2e0 0x7f93bc155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.282+0000 7f93bbe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93bc15f2e0 0x7f93bc155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33132/0 (socket says 172.21.15.46:33132) 2024-02-19T06:59:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.282+0000 7f93bbe00640 1 -- 172.21.15.46:0/3650864198 learned_addr learned my addr 172.21.15.46:0/3650864198 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.283+0000 7f93baa00640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93bc0b19a0 0x7f93bc0b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.283+0000 7f93bb400640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93bc099a30 0x7f93bc0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.283+0000 7f93bbe00640 1 -- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93bc099a30 msgr2=0x7f93bc0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.283+0000 7f93bbe00640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93bc099a30 0x7f93bc0b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.283+0000 7f93bbe00640 1 -- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93bc0b19a0 msgr2=0x7f93bc0b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.283+0000 7f93bbe00640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93bc0b19a0 0x7f93bc0b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.283+0000 7f93bbe00640 1 -- 172.21.15.46:0/3650864198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b40094d0 con 0x7f93bc15f2e0 2024-02-19T06:59:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.283+0000 7f93bbe00640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93bc15f2e0 0x7f93bc155520 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009870 tx=0x7f93b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.284+0000 7f93b3400640 1 -- 172.21.15.46:0/3650864198 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b40307d0 con 0x7f93bc15f2e0 2024-02-19T06:59:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.284+0000 7f93b3400640 1 -- 172.21.15.46:0/3650864198 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b4039d90 con 0x7f93bc15f2e0 2024-02-19T06:59:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.284+0000 7f93b3400640 1 -- 172.21.15.46:0/3650864198 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4043650 con 0x7f93bc15f2e0 2024-02-19T06:59:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.284+0000 7f93c2800640 1 -- 172.21.15.46:0/3650864198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc1f7db0 con 0x7f93bc15f2e0 2024-02-19T06:59:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.284+0000 7f93c2800640 1 -- 172.21.15.46:0/3650864198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc0b7040 con 0x7f93bc15f2e0 2024-02-19T06:59:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.285+0000 7f93c2800640 1 -- 172.21.15.46:0/3650864198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93bc0b7220 con 0x7f93bc15f2e0 2024-02-19T06:59:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.286+0000 7f93b3400640 1 -- 172.21.15.46:0/3650864198 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f93b402f390 con 0x7f93bc15f2e0 2024-02-19T06:59:13.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.287+0000 7f93b3400640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f939c06b810 0x7f939c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.287+0000 7f93b3400640 1 -- 172.21.15.46:0/3650864198 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f93b40ac2a0 con 0x7f93bc15f2e0 2024-02-19T06:59:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.288+0000 7f93bb400640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f939c06b810 0x7f939c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.289+0000 7f93bb400640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f939c06b810 0x7f939c06dcd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f93ac001ca0 tx=0x7f93ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:13.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.291+0000 7f93b3400640 1 -- 172.21.15.46:0/3650864198 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f93bc0b7220 con 0x7f93bc15f2e0 2024-02-19T06:59:13.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.493+0000 7f93c2800640 1 -- 172.21.15.46:0/3650864198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f93bc0b71d0 con 0x7f93bc15f2e0 2024-02-19T06:59:13.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.494+0000 7f93b3400640 1 -- 172.21.15.46:0/3650864198 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7f93b4076f70 con 0x7f93bc15f2e0 2024-02-19T06:59:13.495 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:13.495 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-02-19T06:59:13.495 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-02-19T06:59:13.495 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2024-02-19T06:59:13.495 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2024-02-19T06:59:13.495 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:13.495 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-02-19T06:59:13.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.496+0000 7f93c2800640 1 -- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f939c06b810 msgr2=0x7f939c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:13.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.496+0000 7f93c2800640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f939c06b810 0x7f939c06dcd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f93ac001ca0 tx=0x7f93ac009040 comp rx=0 tx=0).stop 2024-02-19T06:59:13.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.496+0000 7f93c2800640 1 -- 172.21.15.46:0/3650864198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93bc15f2e0 msgr2=0x7f93bc155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:13.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.496+0000 7f93c2800640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93bc15f2e0 0x7f93bc155520 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009870 tx=0x7f93b4004730 comp rx=0 tx=0).stop 2024-02-19T06:59:13.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.497+0000 7f93c2800640 1 -- 172.21.15.46:0/3650864198 shutdown_connections 2024-02-19T06:59:13.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.497+0000 7f93c2800640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f939c06b810 0x7f939c06dcd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.497+0000 7f93c2800640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93bc15f2e0 0x7f93bc155520 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.497+0000 7f93c2800640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93bc0b19a0 0x7f93bc0b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.497+0000 7f93c2800640 1 --2- 172.21.15.46:0/3650864198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93bc099a30 0x7f93bc0b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.497+0000 7f93c2800640 1 -- 172.21.15.46:0/3650864198 >> 172.21.15.46:0/3650864198 conn(0x7f93bc0b3180 msgr2=0x7f93bc0ae6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:13.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.497+0000 7f93c2800640 1 -- 172.21.15.46:0/3650864198 shutdown_connections 2024-02-19T06:59:13.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.497+0000 7f93c2800640 1 -- 172.21.15.46:0/3650864198 wait complete. 2024-02-19T06:59:13.516 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-19T06:59:13.516 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-19T06:59:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.743+0000 7f022aa00640 1 Processor -- start 2024-02-19T06:59:13.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.743+0000 7f022aa00640 1 -- start start 2024-02-19T06:59:13.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.745+0000 7f022aa00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f02240cf520 0x7f02240cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.745+0000 7f022aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02240ce540 0x7f02240ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.745+0000 7f022aa00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02240b41f0 con 0x7f02240cceb0 2024-02-19T06:59:13.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.745+0000 7f022aa00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022415dd40 con 0x7f02240cf520 2024-02-19T06:59:13.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.745+0000 7f022aa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02240cfe40 con 0x7f02240ce540 2024-02-19T06:59:13.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.745+0000 7f022a000640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f02240cceb0 0x7f02240cd340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42146/0 (socket says 172.21.15.46:42146) 2024-02-19T06:59:13.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.745+0000 7f022a000640 1 -- 172.21.15.46:0/4060840300 learned_addr learned my addr 172.21.15.46:0/4060840300 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:13.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0228c00640 1 --2- 172.21.15.46:0/4060840300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02240ce540 0x7f02240ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0229600640 1 --2- 172.21.15.46:0/4060840300 >> v2:172.21.15.142:3300/0 conn(0x7f02240cf520 0x7f02240cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196454657 0 0) 0x7f02240b41f0 con 0x7f02240cceb0 2024-02-19T06:59:13.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f020c003520 con 0x7f02240cceb0 2024-02-19T06:59:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 601915772 0 0) 0x7f020c003520 con 0x7f02240cceb0 2024-02-19T06:59:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02240ce540 msgr2=0x7f02240ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0223e00640 1 --2- 172.21.15.46:0/4060840300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02240ce540 0x7f02240ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 >> v2:172.21.15.142:3300/0 conn(0x7f02240cf520 msgr2=0x7f02240cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0223e00640 1 --2- 172.21.15.46:0/4060840300 >> v2:172.21.15.142:3300/0 conn(0x7f02240cf520 0x7f02240cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022415df30 con 0x7f02240cceb0 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f021c0019f0 con 0x7f02240cceb0 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 >> v1:172.21.15.46:6789/0 conn(0x7f02240cceb0 legacy=0x7f02240cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0223e00640 1 --2- 172.21.15.46:0/4060840300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f020c003970 0x7f020c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.746+0000 7f0223e00640 1 --2- 172.21.15.46:0/4060840300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02240ce540 0x7f020c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.747+0000 7f0223e00640 1 --2- 172.21.15.46:0/4060840300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f020c004d00 0x7f020c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.747+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02240cfe40 con 0x7f020c004d00 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.747+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c00b980 con 0x7f020c003970 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.747+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c00bac0 con 0x7f02240ce540 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.747+0000 7f022a000640 1 --2- 172.21.15.46:0/4060840300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f020c004d00 0x7f020c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.747+0000 7f0228c00640 1 --2- 172.21.15.46:0/4060840300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02240ce540 0x7f020c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.747+0000 7f0229600640 1 --2- 172.21.15.46:0/4060840300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f020c003970 0x7f020c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.748+0000 7f022a000640 1 -- 172.21.15.46:0/4060840300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02240ce540 msgr2=0x7f020c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.748+0000 7f022a000640 1 --2- 172.21.15.46:0/4060840300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02240ce540 0x7f020c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.748+0000 7f022a000640 1 -- 172.21.15.46:0/4060840300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f020c003970 msgr2=0x7f020c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.748+0000 7f022a000640 1 --2- 172.21.15.46:0/4060840300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f020c003970 0x7f020c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.748+0000 7f022a000640 1 -- 172.21.15.46:0/4060840300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c003520 con 0x7f020c004d00 2024-02-19T06:59:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.748+0000 7f0228c00640 1 --2- 172.21.15.46:0/4060840300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02240ce540 0x7f020c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:59:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.749+0000 7f022a000640 1 --2- 172.21.15.46:0/4060840300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f020c004d00 0x7f020c005180 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f021c00a8d0 tx=0x7f020c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89d33ab0ee4df1c server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.749+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c034630 con 0x7f020c004d00 2024-02-19T06:59:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.750+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c02f070 con 0x7f020c004d00 2024-02-19T06:59:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.750+0000 7f0223e00640 1 -- 172.21.15.46:0/4060840300 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c0349d0 con 0x7f020c004d00 2024-02-19T06:59:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.750+0000 7f022aa00640 1 -- 172.21.15.46:0/4060840300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f020c004d00 msgr2=0x7f020c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.750+0000 7f022aa00640 1 --2- 172.21.15.46:0/4060840300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f020c004d00 0x7f020c005180 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f021c00a8d0 tx=0x7f020c0057f0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.750+0000 7f022a000640 1 -- 172.21.15.46:0/4060840300 reap_dead start 2024-02-19T06:59:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.750+0000 7f022aa00640 1 -- 172.21.15.46:0/4060840300 shutdown_connections 2024-02-19T06:59:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.750+0000 7f022aa00640 1 -- 172.21.15.46:0/4060840300 >> 172.21.15.46:0/4060840300 conn(0x7f022406ad60 msgr2=0x7f022406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:13.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.751+0000 7f022aa00640 1 -- 172.21.15.46:0/4060840300 shutdown_connections 2024-02-19T06:59:13.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.751+0000 7f022aa00640 1 -- 172.21.15.46:0/4060840300 wait complete. 2024-02-19T06:59:13.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.752+0000 7f022aa00640 1 Processor -- start 2024-02-19T06:59:13.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.753+0000 7f022aa00640 1 -- start start 2024-02-19T06:59:13.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.754+0000 7f022aa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f020c004d00 0x7f02241545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.754+0000 7f022aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0224071e10 0x7f02240c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.754+0000 7f022aa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02240c4ee0 0x7f02240c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.754+0000 7f022aa00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0224154b10 con 0x7f02240c4ee0 2024-02-19T06:59:13.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.754+0000 7f022aa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02240cab20 con 0x7f020c004d00 2024-02-19T06:59:13.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.754+0000 7f022aa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02240c35c0 con 0x7f0224071e10 2024-02-19T06:59:13.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.754+0000 7f022a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02240c4ee0 0x7f02240c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.754+0000 7f022a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02240c4ee0 0x7f02240c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33146/0 (socket says 172.21.15.46:33146) 2024-02-19T06:59:13.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.754+0000 7f022a000640 1 -- 172.21.15.46:0/518948233 learned_addr learned my addr 172.21.15.46:0/518948233 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:13.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.754+0000 7f0229600640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f020c004d00 0x7f02241545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.754+0000 7f0228c00640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0224071e10 0x7f02240c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.754+0000 7f022a000640 1 -- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0224071e10 msgr2=0x7f02240c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:13.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.754+0000 7f022a000640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0224071e10 0x7f02240c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.755+0000 7f022a000640 1 -- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f020c004d00 msgr2=0x7f02241545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:13.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.755+0000 7f022a000640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f020c004d00 0x7f02241545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:13.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.755+0000 7f022a000640 1 -- 172.21.15.46:0/518948233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02240c38a0 con 0x7f02240c4ee0 2024-02-19T06:59:13.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.755+0000 7f0228c00640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0224071e10 0x7f02240c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:13.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.755+0000 7f0229600640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f020c004d00 0x7f02241545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:13.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.755+0000 7f022a000640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02240c4ee0 0x7f02240c5360 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f021c00a8d0 tx=0x7f021c001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:13.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.755+0000 7f0221600640 1 -- 172.21.15.46:0/518948233 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c034840 con 0x7f02240c4ee0 2024-02-19T06:59:13.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.755+0000 7f0221600640 1 -- 172.21.15.46:0/518948233 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c0349a0 con 0x7f02240c4ee0 2024-02-19T06:59:13.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.755+0000 7f022aa00640 1 -- 172.21.15.46:0/518948233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02240cadc0 con 0x7f02240c4ee0 2024-02-19T06:59:13.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.755+0000 7f0221600640 1 -- 172.21.15.46:0/518948233 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c034d50 con 0x7f02240c4ee0 2024-02-19T06:59:13.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.755+0000 7f022aa00640 1 -- 172.21.15.46:0/518948233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02240c58a0 con 0x7f02240c4ee0 2024-02-19T06:59:13.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.757+0000 7f022aa00640 1 -- 172.21.15.46:0/518948233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02240680c0 con 0x7f02240c4ee0 2024-02-19T06:59:13.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.758+0000 7f0221600640 1 -- 172.21.15.46:0/518948233 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f021c031030 con 0x7f02240c4ee0 2024-02-19T06:59:13.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.758+0000 7f0221600640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f020406b840 0x7f020406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:13.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.759+0000 7f0221600640 1 -- 172.21.15.46:0/518948233 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f021c0ac210 con 0x7f02240c4ee0 2024-02-19T06:59:13.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.759+0000 7f0229600640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f020406b840 0x7f020406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:13.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.760+0000 7f0229600640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f020406b840 0x7f020406dd00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0218009a00 tx=0x7f0218008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:13.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.763+0000 7f0221600640 1 -- 172.21.15.46:0/518948233 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f021c076f80 con 0x7f02240c4ee0 2024-02-19T06:59:13.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:13.961+0000 7f022aa00640 1 -- 172.21.15.46:0/518948233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f02240680c0 con 0x7f02240c4ee0 2024-02-19T06:59:14.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.552+0000 7f0221600640 1 -- 172.21.15.46:0/518948233 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f021c002000 con 0x7f02240c4ee0 2024-02-19T06:59:14.554 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2024-02-19T06:59:14.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.556+0000 7f022aa00640 1 -- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f020406b840 msgr2=0x7f020406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:14.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.556+0000 7f022aa00640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f020406b840 0x7f020406dd00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0218009a00 tx=0x7f0218008040 comp rx=0 tx=0).stop 2024-02-19T06:59:14.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.556+0000 7f022aa00640 1 -- 172.21.15.46:0/518948233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02240c4ee0 msgr2=0x7f02240c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:14.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.556+0000 7f022aa00640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02240c4ee0 0x7f02240c5360 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f021c00a8d0 tx=0x7f021c001360 comp rx=0 tx=0).stop 2024-02-19T06:59:14.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.556+0000 7f022aa00640 1 -- 172.21.15.46:0/518948233 shutdown_connections 2024-02-19T06:59:14.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.556+0000 7f022aa00640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f020406b840 0x7f020406dd00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:14.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.556+0000 7f022aa00640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02240c4ee0 0x7f02240c5360 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:14.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.556+0000 7f022aa00640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0224071e10 0x7f02240c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:14.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.556+0000 7f022aa00640 1 --2- 172.21.15.46:0/518948233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f020c004d00 0x7f02241545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:14.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.556+0000 7f022aa00640 1 -- 172.21.15.46:0/518948233 >> 172.21.15.46:0/518948233 conn(0x7f022406ad60 msgr2=0x7f022406db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:14.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.557+0000 7f022aa00640 1 -- 172.21.15.46:0/518948233 shutdown_connections 2024-02-19T06:59:14.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.557+0000 7f022aa00640 1 -- 172.21.15.46:0/518948233 wait complete. 2024-02-19T06:59:14.583 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-19T06:59:14.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.801+0000 7fd9c3000640 1 Processor -- start 2024-02-19T06:59:14.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.801+0000 7fd9c3000640 1 -- start start 2024-02-19T06:59:14.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.803+0000 7fd9c3000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd9bc155b20 0x7fd9bc0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:14.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.803+0000 7fd9c3000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9bc0cfa70 0x7fd9bc0b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:14.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.803+0000 7fd9c3000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9bc0cfed0 con 0x7fd9bc0b2a20 2024-02-19T06:59:14.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.803+0000 7fd9c3000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9bc0b2e50 con 0x7fd9bc155b20 2024-02-19T06:59:14.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.803+0000 7fd9c3000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc15be60 con 0x7fd9bc0cfa70 2024-02-19T06:59:14.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.803+0000 7fd9c1c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd9bc155b20 0x7fd9bc0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:14.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.803+0000 7fd9c1c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd9bc155b20 0x7fd9bc0cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33158/0 (socket says 172.21.15.46:33158) 2024-02-19T06:59:14.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.803+0000 7fd9c1c00640 1 -- 172.21.15.46:0/3361948250 learned_addr learned my addr 172.21.15.46:0/3361948250 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:14.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.804+0000 7fd9c1200640 1 --2- 172.21.15.46:0/3361948250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9bc0cfa70 0x7fd9bc0b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:14.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.804+0000 7fd9c1c00640 1 -- 172.21.15.46:0/3361948250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9bc0cfa70 msgr2=0x7fd9bc0b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:14.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.804+0000 7fd9c1c00640 1 --2- 172.21.15.46:0/3361948250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9bc0cfa70 0x7fd9bc0b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:14.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.804+0000 7fd9c1c00640 1 -- 172.21.15.46:0/3361948250 >> v1:172.21.15.142:6789/0 conn(0x7fd9bc0b2a20 legacy=0x7fd9bc15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:14.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.804+0000 7fd9c1c00640 1 -- 172.21.15.46:0/3361948250 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc15c140 con 0x7fd9bc155b20 2024-02-19T06:59:14.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.804+0000 7fd9c1200640 1 --2- 172.21.15.46:0/3361948250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9bc0cfa70 0x7fd9bc0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:14.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.805+0000 7fd9c1c00640 1 --2- 172.21.15.46:0/3361948250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9bc155b20 0x7fd9bc0cf530 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009e50 tx=0x7fd9b002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6dad7455787bb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:14.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.805+0000 7fd9bbe00640 1 -- 172.21.15.46:0/3361948250 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b002ca70 con 0x7fd9bc155b20 2024-02-19T06:59:14.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.805+0000 7fd9bbe00640 1 -- 172.21.15.46:0/3361948250 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b002cbd0 con 0x7fd9bc155b20 2024-02-19T06:59:14.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.805+0000 7fd9bbe00640 1 -- 172.21.15.46:0/3361948250 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00343f0 con 0x7fd9bc155b20 2024-02-19T06:59:14.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.806+0000 7fd9c3000640 1 -- 172.21.15.46:0/3361948250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9bc155b20 msgr2=0x7fd9bc0cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:14.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.806+0000 7fd9c3000640 1 --2- 172.21.15.46:0/3361948250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9bc155b20 0x7fd9bc0cf530 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009e50 tx=0x7fd9b002bed0 comp rx=0 tx=0).stop 2024-02-19T06:59:14.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.806+0000 7fd9c3000640 1 -- 172.21.15.46:0/3361948250 shutdown_connections 2024-02-19T06:59:14.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.806+0000 7fd9c3000640 1 --2- 172.21.15.46:0/3361948250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9bc0cfa70 0x7fd9bc0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:14.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.806+0000 7fd9c3000640 1 --2- 172.21.15.46:0/3361948250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9bc155b20 0x7fd9bc0cf530 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:14.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.806+0000 7fd9c3000640 1 -- 172.21.15.46:0/3361948250 >> 172.21.15.46:0/3361948250 conn(0x7fd9bc06ad60 msgr2=0x7fd9bc06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:14.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.806+0000 7fd9c3000640 1 -- 172.21.15.46:0/3361948250 shutdown_connections 2024-02-19T06:59:14.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.806+0000 7fd9c3000640 1 -- 172.21.15.46:0/3361948250 wait complete. 2024-02-19T06:59:14.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.808+0000 7fd9c3000640 1 Processor -- start 2024-02-19T06:59:14.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.808+0000 7fd9c3000640 1 -- start start 2024-02-19T06:59:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.809+0000 7fd9c3000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9bc0b2a20 0x7fd9bc154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.809+0000 7fd9c3000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9bc0cfa70 0x7fd9bc0ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.809+0000 7fd9c3000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9bc155b20 0x7fd9bc0ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:14.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.809+0000 7fd9c3000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0cdd50 con 0x7fd9bc155b20 2024-02-19T06:59:14.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.809+0000 7fd9c3000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0ccea0 con 0x7fd9bc0cfa70 2024-02-19T06:59:14.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.809+0000 7fd9c3000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0ced30 con 0x7fd9bc0b2a20 2024-02-19T06:59:14.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.810+0000 7fd9c2600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9bc155b20 0x7fd9bc0ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:14.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.810+0000 7fd9c2600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9bc155b20 0x7fd9bc0ac920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33166/0 (socket says 172.21.15.46:33166) 2024-02-19T06:59:14.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.810+0000 7fd9c2600640 1 -- 172.21.15.46:0/666145755 learned_addr learned my addr 172.21.15.46:0/666145755 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:14.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.810+0000 7fd9c1200640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9bc0cfa70 0x7fd9bc0ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.810+0000 7fd9c1c00640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9bc0b2a20 0x7fd9bc154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.810+0000 7fd9c2600640 1 -- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9bc0b2a20 msgr2=0x7fd9bc154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.810+0000 7fd9c2600640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9bc0b2a20 0x7fd9bc154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.810+0000 7fd9c2600640 1 -- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9bc0cfa70 msgr2=0x7fd9bc0ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.810+0000 7fd9c2600640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9bc0cfa70 0x7fd9bc0ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.810+0000 7fd9c2600640 1 -- 172.21.15.46:0/666145755 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0009b30 con 0x7fd9bc155b20 2024-02-19T06:59:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.811+0000 7fd9c2600640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9bc155b20 0x7fd9bc0ac920 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400b410 tx=0x7fd9b400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.811+0000 7fd9b9600640 1 -- 172.21.15.46:0/666145755 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4004020 con 0x7fd9bc155b20 2024-02-19T06:59:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.811+0000 7fd9b9600640 1 -- 172.21.15.46:0/666145755 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b4004180 con 0x7fd9bc155b20 2024-02-19T06:59:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.811+0000 7fd9b9600640 1 -- 172.21.15.46:0/666145755 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4011630 con 0x7fd9bc155b20 2024-02-19T06:59:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.811+0000 7fd9c3000640 1 -- 172.21.15.46:0/666145755 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9bc0cd0d0 con 0x7fd9bc155b20 2024-02-19T06:59:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.811+0000 7fd9c3000640 1 -- 172.21.15.46:0/666145755 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9bc0cd690 con 0x7fd9bc155b20 2024-02-19T06:59:14.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.812+0000 7fd9c3000640 1 -- 172.21.15.46:0/666145755 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9bc0cde90 con 0x7fd9bc155b20 2024-02-19T06:59:14.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.814+0000 7fd9b9600640 1 -- 172.21.15.46:0/666145755 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd9b4011790 con 0x7fd9bc155b20 2024-02-19T06:59:14.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.815+0000 7fd9b9600640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd99c06b810 0x7fd99c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:14.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.815+0000 7fd9b9600640 1 -- 172.21.15.46:0/666145755 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd9b4089c30 con 0x7fd9bc155b20 2024-02-19T06:59:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.815+0000 7fd9c1c00640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd99c06b810 0x7fd99c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.817+0000 7fd9c1c00640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd99c06b810 0x7fd99c06dcd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0035000 tx=0x7fd9b0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:14.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:14.820+0000 7fd9b9600640 1 -- 172.21.15.46:0/666145755 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9bc0cde90 con 0x7fd9bc155b20 2024-02-19T06:59:15.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.023+0000 7fd9c3000640 1 -- 172.21.15.46:0/666145755 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd9bc0cde90 con 0x7fd9bc155b20 2024-02-19T06:59:15.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.568+0000 7fd9b9600640 1 -- 172.21.15.46:0/666145755 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd9bc0cde90 con 0x7fd9bc155b20 2024-02-19T06:59:15.569 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2024-02-19T06:59:15.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.572+0000 7fd9c3000640 1 -- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd99c06b810 msgr2=0x7fd99c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:15.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.572+0000 7fd9c3000640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd99c06b810 0x7fd99c06dcd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0035000 tx=0x7fd9b0030000 comp rx=0 tx=0).stop 2024-02-19T06:59:15.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.572+0000 7fd9c3000640 1 -- 172.21.15.46:0/666145755 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9bc155b20 msgr2=0x7fd9bc0ac920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:15.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.572+0000 7fd9c3000640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9bc155b20 0x7fd9bc0ac920 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400b410 tx=0x7fd9b400b8d0 comp rx=0 tx=0).stop 2024-02-19T06:59:15.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.573+0000 7fd9c3000640 1 -- 172.21.15.46:0/666145755 shutdown_connections 2024-02-19T06:59:15.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.573+0000 7fd9c3000640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fd99c06b810 0x7fd99c06dcd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:15.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.573+0000 7fd9c3000640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9bc155b20 0x7fd9bc0ac920 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:15.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.573+0000 7fd9c3000640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9bc0cfa70 0x7fd9bc0ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:15.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.573+0000 7fd9c3000640 1 --2- 172.21.15.46:0/666145755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9bc0b2a20 0x7fd9bc154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:15.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.573+0000 7fd9c3000640 1 -- 172.21.15.46:0/666145755 >> 172.21.15.46:0/666145755 conn(0x7fd9bc06ad60 msgr2=0x7fd9bc15ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:15.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.574+0000 7fd9c3000640 1 -- 172.21.15.46:0/666145755 shutdown_connections 2024-02-19T06:59:15.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.574+0000 7fd9c3000640 1 -- 172.21.15.46:0/666145755 wait complete. 2024-02-19T06:59:15.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-19T06:59:15.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.799+0000 7fdacc800640 1 Processor -- start 2024-02-19T06:59:15.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.800+0000 7fdacc800640 1 -- start start 2024-02-19T06:59:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.801+0000 7fdacc800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdac415b760 0x7fdac4099a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.801+0000 7fdacc800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac40cfff0 con 0x7fdac40cd4a0 2024-02-19T06:59:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.801+0000 7fdacc800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac40cf3e0 con 0x7fdac40d0480 2024-02-19T06:59:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.801+0000 7fdacc800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac40cf6c0 con 0x7fdac415b760 2024-02-19T06:59:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.802+0000 7fdaca800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdac40cd4a0 0x7fdac40c72b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39418/0 (socket says 172.21.15.46:39418) 2024-02-19T06:59:15.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.802+0000 7fdaca800640 1 -- 172.21.15.46:0/4086706239 learned_addr learned my addr 172.21.15.46:0/4086706239 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:15.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.802+0000 7fdac9e00640 1 --2- 172.21.15.46:0/4086706239 >> v2:172.21.15.142:3300/0 conn(0x7fdac415b760 0x7fdac4099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:15.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.802+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591080953 0 0) 0x7fdac40cfff0 con 0x7fdac40cd4a0 2024-02-19T06:59:15.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.802+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaac003520 con 0x7fdac40cd4a0 2024-02-19T06:59:15.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 912165204 0 0) 0x7fdaac003520 con 0x7fdac40cd4a0 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 >> v2:172.21.15.142:3300/0 conn(0x7fdac415b760 msgr2=0x7fdac4099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac8a00640 1 --2- 172.21.15.46:0/4086706239 >> v2:172.21.15.142:3300/0 conn(0x7fdac415b760 0x7fdac4099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 >> v1:172.21.15.142:6789/0 conn(0x7fdac40d0480 legacy=0x7fdac40ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40cf9a0 con 0x7fdac40cd4a0 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fdac00019f0 con 0x7fdac40cd4a0 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 >> v1:172.21.15.46:6789/0 conn(0x7fdac40cd4a0 legacy=0x7fdac40c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac8a00640 1 --2- 172.21.15.46:0/4086706239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaac003970 0x7fdaac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac8a00640 1 --2- 172.21.15.46:0/4086706239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaac0047c0 0x7fdaac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac8a00640 1 --2- 172.21.15.46:0/4086706239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaac005180 0x7fdaac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40cf6c0 con 0x7fdaac0047c0 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac00c120 con 0x7fdaac003970 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac00c2e0 con 0x7fdaac005180 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac9400640 1 --2- 172.21.15.46:0/4086706239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaac0047c0 0x7fdaac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.803+0000 7fdac9e00640 1 --2- 172.21.15.46:0/4086706239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaac003970 0x7fdaac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:15.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.804+0000 7fdac9400640 1 -- 172.21.15.46:0/4086706239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaac005180 msgr2=0x7fdaac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:15.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.804+0000 7fdac9400640 1 --2- 172.21.15.46:0/4086706239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaac005180 0x7fdaac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:15.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.804+0000 7fdac9400640 1 -- 172.21.15.46:0/4086706239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaac003970 msgr2=0x7fdaac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:15.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.804+0000 7fdac9400640 1 --2- 172.21.15.46:0/4086706239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaac003970 0x7fdaac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:15.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.804+0000 7fdac9400640 1 -- 172.21.15.46:0/4086706239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac003520 con 0x7fdaac0047c0 2024-02-19T06:59:15.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.804+0000 7fdaca800640 1 -- 172.21.15.46:0/4086706239 reap_dead start 2024-02-19T06:59:15.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.805+0000 7fdac9400640 1 --2- 172.21.15.46:0/4086706239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaac0047c0 0x7fdaac004c40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdab4001720 tx=0x7fdaac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8800860194bbd7fb server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:15.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.805+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab40052d0 con 0x7fdaac0047c0 2024-02-19T06:59:15.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.805+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab402e050 con 0x7fdaac0047c0 2024-02-19T06:59:15.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.805+0000 7fdac8a00640 1 -- 172.21.15.46:0/4086706239 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4003830 con 0x7fdaac0047c0 2024-02-19T06:59:15.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.806+0000 7fdacc800640 1 -- 172.21.15.46:0/4086706239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaac0047c0 msgr2=0x7fdaac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:15.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.806+0000 7fdacc800640 1 --2- 172.21.15.46:0/4086706239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaac0047c0 0x7fdaac004c40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdab4001720 tx=0x7fdaac0057f0 comp rx=0 tx=0).stop 2024-02-19T06:59:15.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.806+0000 7fdacc800640 1 -- 172.21.15.46:0/4086706239 shutdown_connections 2024-02-19T06:59:15.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.806+0000 7fdacc800640 1 --2- 172.21.15.46:0/4086706239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaac0047c0 0x7fdaac004c40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:15.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.806+0000 7fdacc800640 1 -- 172.21.15.46:0/4086706239 >> 172.21.15.46:0/4086706239 conn(0x7fdac40b3160 msgr2=0x7fdac40b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:15.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.806+0000 7fdacc800640 1 -- 172.21.15.46:0/4086706239 shutdown_connections 2024-02-19T06:59:15.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.806+0000 7fdacc800640 1 -- 172.21.15.46:0/4086706239 wait complete. 2024-02-19T06:59:15.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.808+0000 7fdacc800640 1 Processor -- start 2024-02-19T06:59:15.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.808+0000 7fdacc800640 1 -- start start 2024-02-19T06:59:15.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.809+0000 7fdacc800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaac0047c0 0x7fdac4151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:15.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.809+0000 7fdacc800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdac41517d0 0x7fdac415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:15.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.809+0000 7fdacc800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdac415c500 0x7fdac406ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:15.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.809+0000 7fdacc800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac406c8d0 con 0x7fdaac0047c0 2024-02-19T06:59:15.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.809+0000 7fdacc800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac406bc90 con 0x7fdac415c500 2024-02-19T06:59:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.809+0000 7fdacc800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac406bf30 con 0x7fdac41517d0 2024-02-19T06:59:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.809+0000 7fdac9e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaac0047c0 0x7fdac4151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.809+0000 7fdac9e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaac0047c0 0x7fdac4151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54052/0 (socket says 172.21.15.46:54052) 2024-02-19T06:59:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.809+0000 7fdac9e00640 1 -- 172.21.15.46:0/743807397 learned_addr learned my addr 172.21.15.46:0/743807397 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.810+0000 7fdac9400640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdac41517d0 0x7fdac415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.810+0000 7fdaca800640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdac415c500 0x7fdac406ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.810+0000 7fdac9e00640 1 -- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdac41517d0 msgr2=0x7fdac415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.810+0000 7fdac9e00640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdac41517d0 0x7fdac415bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.810+0000 7fdac9e00640 1 -- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdac415c500 msgr2=0x7fdac406ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.810+0000 7fdac9e00640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdac415c500 0x7fdac406ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.810+0000 7fdac9e00640 1 -- 172.21.15.46:0/743807397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac406c210 con 0x7fdaac0047c0 2024-02-19T06:59:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.810+0000 7fdac9400640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdac41517d0 0x7fdac415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.810+0000 7fdac9e00640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaac0047c0 0x7fdac4151020 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fdab80116d0 tx=0x7fdab8011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:15.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.810+0000 7fdabe000640 1 -- 172.21.15.46:0/743807397 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab800f9c0 con 0x7fdaac0047c0 2024-02-19T06:59:15.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.810+0000 7fdabe000640 1 -- 172.21.15.46:0/743807397 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab800fb20 con 0x7fdaac0047c0 2024-02-19T06:59:15.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.810+0000 7fdabe000640 1 -- 172.21.15.46:0/743807397 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab800fe90 con 0x7fdaac0047c0 2024-02-19T06:59:15.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.811+0000 7fdacc800640 1 -- 172.21.15.46:0/743807397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac406c4f0 con 0x7fdaac0047c0 2024-02-19T06:59:15.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.811+0000 7fdacc800640 1 -- 172.21.15.46:0/743807397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac40cb470 con 0x7fdaac0047c0 2024-02-19T06:59:15.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.812+0000 7fdacc800640 1 -- 172.21.15.46:0/743807397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac406cb40 con 0x7fdaac0047c0 2024-02-19T06:59:15.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.813+0000 7fdabe000640 1 -- 172.21.15.46:0/743807397 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fdab8015460 con 0x7fdaac0047c0 2024-02-19T06:59:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.814+0000 7fdabe000640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdaa806b840 0x7fdaa806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.814+0000 7fdabe000640 1 -- 172.21.15.46:0/743807397 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fdab808a670 con 0x7fdaac0047c0 2024-02-19T06:59:15.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.815+0000 7fdac9400640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdaa806b840 0x7fdaa806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:15.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.816+0000 7fdac9400640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdaa806b840 0x7fdaa806dd00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdab4033000 tx=0x7fdab4009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:15.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:15.820+0000 7fdabe000640 1 -- 172.21.15.46:0/743807397 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdab8055190 con 0x7fdaac0047c0 2024-02-19T06:59:16.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.063+0000 7fdacc800640 1 -- 172.21.15.46:0/743807397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdac4067ba0 con 0x7fdaac0047c0 2024-02-19T06:59:16.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.572+0000 7fdabe000640 1 -- 172.21.15.46:0/743807397 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdab8058850 con 0x7fdaac0047c0 2024-02-19T06:59:16.574 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 4 and data pool 5 2024-02-19T06:59:16.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.576+0000 7fdacc800640 1 -- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdaa806b840 msgr2=0x7fdaa806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:16.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.576+0000 7fdacc800640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdaa806b840 0x7fdaa806dd00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdab4033000 tx=0x7fdab4009030 comp rx=0 tx=0).stop 2024-02-19T06:59:16.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.576+0000 7fdacc800640 1 -- 172.21.15.46:0/743807397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaac0047c0 msgr2=0x7fdac4151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:16.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.576+0000 7fdacc800640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaac0047c0 0x7fdac4151020 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fdab80116d0 tx=0x7fdab8011b90 comp rx=0 tx=0).stop 2024-02-19T06:59:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.576+0000 7fdacc800640 1 -- 172.21.15.46:0/743807397 shutdown_connections 2024-02-19T06:59:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.576+0000 7fdacc800640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdaa806b840 0x7fdaa806dd00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.576+0000 7fdacc800640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdac415c500 0x7fdac406ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:16.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.576+0000 7fdacc800640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdac41517d0 0x7fdac415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:16.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.576+0000 7fdacc800640 1 --2- 172.21.15.46:0/743807397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaac0047c0 0x7fdac4151020 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:16.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.576+0000 7fdacc800640 1 -- 172.21.15.46:0/743807397 >> 172.21.15.46:0/743807397 conn(0x7fdac40b3160 msgr2=0x7fdac40c51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:16.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.577+0000 7fdacc800640 1 -- 172.21.15.46:0/743807397 shutdown_connections 2024-02-19T06:59:16.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.577+0000 7fdacc800640 1 -- 172.21.15.46:0/743807397 wait complete. 2024-02-19T06:59:16.626 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:59:16.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.806+0000 7f116be00640 1 Processor -- start 2024-02-19T06:59:16.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.806+0000 7f116be00640 1 -- start start 2024-02-19T06:59:16.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.808+0000 7f116be00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11640d1950 0x7f11640b9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:16.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.808+0000 7f116be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ce5a0 0x7f11640cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:16.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.808+0000 7f116be00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11640b9880 con 0x7f116415da50 2024-02-19T06:59:16.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.808+0000 7f116be00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11640d3770 con 0x7f11640d1950 2024-02-19T06:59:16.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.808+0000 7f116be00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11640d1dc0 con 0x7f11640ce5a0 2024-02-19T06:59:16.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.808+0000 7f1169400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f116415da50 0x7f11640d3060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39424/0 (socket says 172.21.15.46:39424) 2024-02-19T06:59:16.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.808+0000 7f1169400640 1 -- 172.21.15.46:0/1514468265 learned_addr learned my addr 172.21.15.46:0/1514468265 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:16.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.808+0000 7f1168a00640 1 --2- 172.21.15.46:0/1514468265 >> v2:172.21.15.142:3300/0 conn(0x7f11640d1950 0x7f11640b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:16.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.808+0000 7f1169e00640 1 --2- 172.21.15.46:0/1514468265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ce5a0 0x7f11640cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:16.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408810399 0 0) 0x7f1158001110 con 0x7f116415da50 2024-02-19T06:59:16.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f114c003520 con 0x7f116415da50 2024-02-19T06:59:16.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 685160847 0 0) 0x7f114c003520 con 0x7f116415da50 2024-02-19T06:59:16.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ce5a0 msgr2=0x7f11640cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:16.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 --2- 172.21.15.46:0/1514468265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ce5a0 0x7f11640cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:16.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 >> v2:172.21.15.142:3300/0 conn(0x7f11640d1950 msgr2=0x7f11640b9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:16.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 --2- 172.21.15.46:0/1514468265 >> v2:172.21.15.142:3300/0 conn(0x7f11640d1950 0x7f11640b9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:16.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11640d1fc0 con 0x7f116415da50 2024-02-19T06:59:16.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f1158001800 con 0x7f116415da50 2024-02-19T06:59:16.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 >> v1:172.21.15.46:6789/0 conn(0x7f116415da50 legacy=0x7f11640d3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:16.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 --2- 172.21.15.46:0/1514468265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c003970 0x7f114c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:16.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 --2- 172.21.15.46:0/1514468265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ce5a0 0x7f114c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:16.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 --2- 172.21.15.46:0/1514468265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f114c004d00 0x7f114c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11640d3770 con 0x7f114c004d00 2024-02-19T06:59:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11640d1dc0 con 0x7f114c003970 2024-02-19T06:59:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.809+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c00b980 con 0x7f11640ce5a0 2024-02-19T06:59:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.810+0000 7f1169e00640 1 --2- 172.21.15.46:0/1514468265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f114c004d00 0x7f114c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.810+0000 7f1169400640 1 --2- 172.21.15.46:0/1514468265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c003970 0x7f114c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.810+0000 7f1168a00640 1 --2- 172.21.15.46:0/1514468265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ce5a0 0x7f114c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.810+0000 7f1169e00640 1 -- 172.21.15.46:0/1514468265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ce5a0 msgr2=0x7f114c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.810+0000 7f1169e00640 1 --2- 172.21.15.46:0/1514468265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ce5a0 0x7f114c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.810+0000 7f1169e00640 1 -- 172.21.15.46:0/1514468265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c003970 msgr2=0x7f114c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.810+0000 7f1169e00640 1 --2- 172.21.15.46:0/1514468265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c003970 0x7f114c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.810+0000 7f1169e00640 1 -- 172.21.15.46:0/1514468265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c003520 con 0x7f114c004d00 2024-02-19T06:59:16.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.810+0000 7f1169400640 1 --2- 172.21.15.46:0/1514468265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c003970 0x7f114c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:16.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.811+0000 7f1169e00640 1 --2- 172.21.15.46:0/1514468265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f114c004d00 0x7f114c005180 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f115c00e170 tx=0x7f114c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2f0975a173a1e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:16.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.811+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c02cbf0 con 0x7f114c004d00 2024-02-19T06:59:16.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.811+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c00f040 con 0x7f114c004d00 2024-02-19T06:59:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.811+0000 7f1163e00640 1 -- 172.21.15.46:0/1514468265 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c034440 con 0x7f114c004d00 2024-02-19T06:59:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.812+0000 7f116be00640 1 -- 172.21.15.46:0/1514468265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f114c004d00 msgr2=0x7f114c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.812+0000 7f116be00640 1 --2- 172.21.15.46:0/1514468265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f114c004d00 0x7f114c005180 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f115c00e170 tx=0x7f114c0057f0 comp rx=0 tx=0).stop 2024-02-19T06:59:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.812+0000 7f1169e00640 1 -- 172.21.15.46:0/1514468265 reap_dead start 2024-02-19T06:59:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.812+0000 7f116be00640 1 -- 172.21.15.46:0/1514468265 shutdown_connections 2024-02-19T06:59:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.812+0000 7f116be00640 1 -- 172.21.15.46:0/1514468265 >> 172.21.15.46:0/1514468265 conn(0x7f11640668b0 msgr2=0x7f1164066c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.812+0000 7f116be00640 1 -- 172.21.15.46:0/1514468265 shutdown_connections 2024-02-19T06:59:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.812+0000 7f116be00640 1 -- 172.21.15.46:0/1514468265 wait complete. 2024-02-19T06:59:16.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.814+0000 7f116be00640 1 Processor -- start 2024-02-19T06:59:16.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.814+0000 7f116be00640 1 -- start start 2024-02-19T06:59:16.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.815+0000 7f116be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f114c004d00 0x7f11640cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:16.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.815+0000 7f116be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11640cc060 0x7f116415aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:16.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.815+0000 7f116be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f116415b600 0x7f116415af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:16.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.815+0000 7f116be00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11640aa260 con 0x7f114c004d00 2024-02-19T06:59:16.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.815+0000 7f116be00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11641e7370 con 0x7f11640cc060 2024-02-19T06:59:16.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.815+0000 7f116be00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11640cd370 con 0x7f116415b600 2024-02-19T06:59:16.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.815+0000 7f1169400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f114c004d00 0x7f11640cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:16.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.815+0000 7f1169400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f114c004d00 0x7f11640cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54070/0 (socket says 172.21.15.46:54070) 2024-02-19T06:59:16.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.815+0000 7f1169400640 1 -- 172.21.15.46:0/3856549997 learned_addr learned my addr 172.21.15.46:0/3856549997 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:16.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.816+0000 7f1169400640 1 -- 172.21.15.46:0/3856549997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f116415b600 msgr2=0x7f116415af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:16.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.816+0000 7f1169400640 1 --2- 172.21.15.46:0/3856549997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f116415b600 0x7f116415af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:16.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.816+0000 7f1169400640 1 -- 172.21.15.46:0/3856549997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11640cc060 msgr2=0x7f116415aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:16.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.816+0000 7f1168a00640 1 --2- 172.21.15.46:0/3856549997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11640cc060 0x7f116415aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:16.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.816+0000 7f1169400640 1 --2- 172.21.15.46:0/3856549997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11640cc060 0x7f116415aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.816+0000 7f1169400640 1 -- 172.21.15.46:0/3856549997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11640cb3b0 con 0x7f114c004d00 2024-02-19T06:59:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.816+0000 7f1169400640 1 --2- 172.21.15.46:0/3856549997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f114c004d00 0x7f11640cbb20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f115800d850 tx=0x7f115800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.816+0000 7f1161600640 1 -- 172.21.15.46:0/3856549997 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580074e0 con 0x7f114c004d00 2024-02-19T06:59:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.816+0000 7f1161600640 1 -- 172.21.15.46:0/3856549997 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1158007640 con 0x7f114c004d00 2024-02-19T06:59:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.816+0000 7f1161600640 1 -- 172.21.15.46:0/3856549997 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580049e0 con 0x7f114c004d00 2024-02-19T06:59:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.816+0000 7f116be00640 1 -- 172.21.15.46:0/3856549997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11640cd5c0 con 0x7f114c004d00 2024-02-19T06:59:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.816+0000 7f116be00640 1 -- 172.21.15.46:0/3856549997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11640cb600 con 0x7f114c004d00 2024-02-19T06:59:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.817+0000 7f116be00640 1 -- 172.21.15.46:0/3856549997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1164067ba0 con 0x7f114c004d00 2024-02-19T06:59:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.819+0000 7f1161600640 1 -- 172.21.15.46:0/3856549997 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1158004b40 con 0x7f114c004d00 2024-02-19T06:59:16.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.820+0000 7f1161600640 1 --2- 172.21.15.46:0/3856549997 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f114406b810 0x7f114406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:16.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.820+0000 7f1161600640 1 -- 172.21.15.46:0/3856549997 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1158089dc0 con 0x7f114c004d00 2024-02-19T06:59:16.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.820+0000 7f1168a00640 1 --2- 172.21.15.46:0/3856549997 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f114406b810 0x7f114406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.822+0000 7f1168a00640 1 --2- 172.21.15.46:0/3856549997 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f114406b810 0x7f114406dcd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f116415cd40 tx=0x7f1150008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:16.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:16.825+0000 7f1161600640 1 -- 172.21.15.46:0/3856549997 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f11580547d0 con 0x7f114c004d00 2024-02-19T06:59:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.016+0000 7f116be00640 1 -- 172.21.15.46:0/3856549997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11640b9880 con 0x7f114c004d00 2024-02-19T06:59:17.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.019+0000 7f1161600640 1 -- 172.21.15.46:0/3856549997 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16682 (secure 0 0 0) 0x7f11640b9880 con 0x7f114c004d00 2024-02-19T06:59:17.021 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:17.021 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":34,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:59:16.064323+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:59:14.017896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-19T06:59:15.078011+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:59:17.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.022+0000 7f116be00640 1 -- 172.21.15.46:0/3856549997 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f114406b810 msgr2=0x7f114406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.022+0000 7f116be00640 1 --2- 172.21.15.46:0/3856549997 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f114406b810 0x7f114406dcd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f116415cd40 tx=0x7f1150008040 comp rx=0 tx=0).stop 2024-02-19T06:59:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.022+0000 7f116be00640 1 -- 172.21.15.46:0/3856549997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f114c004d00 msgr2=0x7f11640cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.022+0000 7f116be00640 1 --2- 172.21.15.46:0/3856549997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f114c004d00 0x7f11640cbb20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f115800d850 tx=0x7f115800dd10 comp rx=0 tx=0).stop 2024-02-19T06:59:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.022+0000 7f116be00640 1 -- 172.21.15.46:0/3856549997 shutdown_connections 2024-02-19T06:59:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.022+0000 7f116be00640 1 --2- 172.21.15.46:0/3856549997 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f114406b810 0x7f114406dcd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.022+0000 7f116be00640 1 --2- 172.21.15.46:0/3856549997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f116415b600 0x7f116415af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.022+0000 7f116be00640 1 --2- 172.21.15.46:0/3856549997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11640cc060 0x7f116415aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.022+0000 7f116be00640 1 --2- 172.21.15.46:0/3856549997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f114c004d00 0x7f11640cbb20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.022+0000 7f116be00640 1 -- 172.21.15.46:0/3856549997 >> 172.21.15.46:0/3856549997 conn(0x7f11640668b0 msgr2=0x7f116415e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.022+0000 7f116be00640 1 -- 172.21.15.46:0/3856549997 shutdown_connections 2024-02-19T06:59:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.022+0000 7f116be00640 1 -- 172.21.15.46:0/3856549997 wait complete. 2024-02-19T06:59:17.042 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:59:17.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.255+0000 7fc27f000640 1 Processor -- start 2024-02-19T06:59:17.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.256+0000 7fc27f000640 1 -- start start 2024-02-19T06:59:17.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.257+0000 7fc27f000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc27815d7f0 0x7fc2780d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.258+0000 7fc27f000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc27815dbd0 0x7fc2780d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.258+0000 7fc27f000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2780cf770 con 0x7fc278162230 2024-02-19T06:59:17.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.258+0000 7fc27f000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2780cf4e0 con 0x7fc27815dbd0 2024-02-19T06:59:17.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.258+0000 7fc27f000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780d1400 con 0x7fc27815d7f0 2024-02-19T06:59:17.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.258+0000 7fc27d200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc278162230 0x7fc2780cedd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39438/0 (socket says 172.21.15.46:39438) 2024-02-19T06:59:17.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.258+0000 7fc27d200640 1 -- 172.21.15.46:0/3618981100 learned_addr learned my addr 172.21.15.46:0/3618981100 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.258+0000 7fc27dc00640 1 --2- 172.21.15.46:0/3618981100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc27815d7f0 0x7fc2780d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.258+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110434397 0 0) 0x7fc2780cf770 con 0x7fc278162230 2024-02-19T06:59:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.258+0000 7fc27e600640 1 --2- 172.21.15.46:0/3618981100 >> v2:172.21.15.142:3300/0 conn(0x7fc27815dbd0 0x7fc2780d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc260003520 con 0x7fc278162230 2024-02-19T06:59:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 525940602 0 0) 0x7fc260003520 con 0x7fc278162230 2024-02-19T06:59:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc27815d7f0 msgr2=0x7fc2780d21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 --2- 172.21.15.46:0/3618981100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc27815d7f0 0x7fc2780d21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 >> v2:172.21.15.142:3300/0 conn(0x7fc27815dbd0 msgr2=0x7fc2780d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 --2- 172.21.15.46:0/3618981100 >> v2:172.21.15.142:3300/0 conn(0x7fc27815dbd0 0x7fc2780d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2780d16e0 con 0x7fc278162230 2024-02-19T06:59:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fc264001670 con 0x7fc278162230 2024-02-19T06:59:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 >> v1:172.21.15.46:6789/0 conn(0x7fc278162230 legacy=0x7fc2780cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 --2- 172.21.15.46:0/3618981100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc27815d7f0 0x7fc260003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 --2- 172.21.15.46:0/3618981100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc260003f40 0x7fc2600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 --2- 172.21.15.46:0/3618981100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc260004d00 0x7fc260005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780cf4e0 con 0x7fc260003f40 2024-02-19T06:59:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780d1400 con 0x7fc260004d00 2024-02-19T06:59:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26000ba30 con 0x7fc27815d7f0 2024-02-19T06:59:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.259+0000 7fc27d200640 1 --2- 172.21.15.46:0/3618981100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc260003f40 0x7fc2600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.260+0000 7fc27e600640 1 --2- 172.21.15.46:0/3618981100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc260004d00 0x7fc260005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.260+0000 7fc27dc00640 1 --2- 172.21.15.46:0/3618981100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc27815d7f0 0x7fc260003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.260+0000 7fc27d200640 1 -- 172.21.15.46:0/3618981100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc27815d7f0 msgr2=0x7fc260003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.260+0000 7fc27d200640 1 --2- 172.21.15.46:0/3618981100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc27815d7f0 0x7fc260003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.260+0000 7fc27d200640 1 -- 172.21.15.46:0/3618981100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc260004d00 msgr2=0x7fc260005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:17.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.260+0000 7fc27d200640 1 --2- 172.21.15.46:0/3618981100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc260004d00 0x7fc260005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.260+0000 7fc27d200640 1 -- 172.21.15.46:0/3618981100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc260003520 con 0x7fc260003f40 2024-02-19T06:59:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.261+0000 7fc27d200640 1 --2- 172.21.15.46:0/3618981100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc260003f40 0x7fc2600047c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc26400c160 tx=0x7fc2600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbf82994f33bfcb server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.261+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264005ad0 con 0x7fc260003f40 2024-02-19T06:59:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.261+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc264005c30 con 0x7fc260003f40 2024-02-19T06:59:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.261+0000 7fc277e00640 1 -- 172.21.15.46:0/3618981100 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26402c810 con 0x7fc260003f40 2024-02-19T06:59:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.262+0000 7fc27f000640 1 -- 172.21.15.46:0/3618981100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc260003f40 msgr2=0x7fc2600047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.262+0000 7fc27f000640 1 --2- 172.21.15.46:0/3618981100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc260003f40 0x7fc2600047c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc26400c160 tx=0x7fc2600057f0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.262+0000 7fc27e600640 1 -- 172.21.15.46:0/3618981100 reap_dead start 2024-02-19T06:59:17.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.262+0000 7fc27f000640 1 -- 172.21.15.46:0/3618981100 shutdown_connections 2024-02-19T06:59:17.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.262+0000 7fc27f000640 1 -- 172.21.15.46:0/3618981100 >> 172.21.15.46:0/3618981100 conn(0x7fc27809ca70 msgr2=0x7fc27808afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:17.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.262+0000 7fc27f000640 1 -- 172.21.15.46:0/3618981100 shutdown_connections 2024-02-19T06:59:17.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.262+0000 7fc27f000640 1 -- 172.21.15.46:0/3618981100 wait complete. 2024-02-19T06:59:17.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.264+0000 7fc27f000640 1 Processor -- start 2024-02-19T06:59:17.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.264+0000 7fc27f000640 1 -- start start 2024-02-19T06:59:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.265+0000 7fc27f000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc260003f40 0x7fc2781600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.265+0000 7fc27f000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2780b03f0 0x7fc2780b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.265+0000 7fc27f000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2780cb890 0x7fc2780cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.265+0000 7fc27f000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780b0db0 con 0x7fc2780b03f0 2024-02-19T06:59:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.265+0000 7fc27f000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2781605e0 con 0x7fc2780cb890 2024-02-19T06:59:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.265+0000 7fc27f000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780cc600 con 0x7fc260003f40 2024-02-19T06:59:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.265+0000 7fc27d200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2780b03f0 0x7fc2780b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.265+0000 7fc27d200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2780b03f0 0x7fc2780b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54092/0 (socket says 172.21.15.46:54092) 2024-02-19T06:59:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.265+0000 7fc27d200640 1 -- 172.21.15.46:0/1180265242 learned_addr learned my addr 172.21.15.46:0/1180265242 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:17.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.266+0000 7fc27e600640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2780cb890 0x7fc2780cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.266+0000 7fc27dc00640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc260003f40 0x7fc2781600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.266+0000 7fc27d200640 1 -- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc260003f40 msgr2=0x7fc2781600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.266+0000 7fc27d200640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc260003f40 0x7fc2781600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.266+0000 7fc27d200640 1 -- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2780cb890 msgr2=0x7fc2780cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.266+0000 7fc27d200640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2780cb890 0x7fc2780cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.266+0000 7fc27d200640 1 -- 172.21.15.46:0/1180265242 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2780cc8e0 con 0x7fc2780b03f0 2024-02-19T06:59:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.266+0000 7fc27d200640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2780b03f0 0x7fc2780b0870 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc264000fb0 tx=0x7fc264000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.267+0000 7fc275600640 1 -- 172.21.15.46:0/1180265242 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264039070 con 0x7fc2780b03f0 2024-02-19T06:59:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.267+0000 7fc275600640 1 -- 172.21.15.46:0/1180265242 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26402dcb0 con 0x7fc2780b03f0 2024-02-19T06:59:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.267+0000 7fc275600640 1 -- 172.21.15.46:0/1180265242 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2640072b0 con 0x7fc2780b03f0 2024-02-19T06:59:17.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.267+0000 7fc27f000640 1 -- 172.21.15.46:0/1180265242 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2780ccbc0 con 0x7fc2780b03f0 2024-02-19T06:59:17.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.267+0000 7fc27f000640 1 -- 172.21.15.46:0/1180265242 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2780cc250 con 0x7fc2780b03f0 2024-02-19T06:59:17.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.268+0000 7fc27f000640 1 -- 172.21.15.46:0/1180265242 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27804eee0 con 0x7fc2780b03f0 2024-02-19T06:59:17.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.269+0000 7fc275600640 1 -- 172.21.15.46:0/1180265242 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc264032070 con 0x7fc2780b03f0 2024-02-19T06:59:17.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.270+0000 7fc275600640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc25806b810 0x7fc25806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.270+0000 7fc275600640 1 -- 172.21.15.46:0/1180265242 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc26403c040 con 0x7fc2780b03f0 2024-02-19T06:59:17.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.270+0000 7fc27dc00640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc25806b810 0x7fc25806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.271+0000 7fc27dc00640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc25806b810 0x7fc25806dcd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc26c007440 tx=0x7fc26c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:17.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.274+0000 7fc275600640 1 -- 172.21.15.46:0/1180265242 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc2640760a0 con 0x7fc2780b03f0 2024-02-19T06:59:17.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.477+0000 7fc27f000640 1 -- 172.21.15.46:0/1180265242 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2780cfd30 con 0x7fc2780b03f0 2024-02-19T06:59:17.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.480+0000 7fc275600640 1 -- 172.21.15.46:0/1180265242 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16682 (secure 0 0 0) 0x7fc264079760 con 0x7fc2780b03f0 2024-02-19T06:59:17.483 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:17.483 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":34,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:59:16.064323+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:59:14.017896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-19T06:59:15.078011+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:59:17.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.483+0000 7fc27f000640 1 -- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc25806b810 msgr2=0x7fc25806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:17.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.483+0000 7fc27f000640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc25806b810 0x7fc25806dcd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc26c007440 tx=0x7fc26c00b040 comp rx=0 tx=0).stop 2024-02-19T06:59:17.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.483+0000 7fc27f000640 1 -- 172.21.15.46:0/1180265242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2780b03f0 msgr2=0x7fc2780b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:17.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.483+0000 7fc27f000640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2780b03f0 0x7fc2780b0870 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc264000fb0 tx=0x7fc264000fe0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.483+0000 7fc27f000640 1 -- 172.21.15.46:0/1180265242 shutdown_connections 2024-02-19T06:59:17.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.483+0000 7fc27f000640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc25806b810 0x7fc25806dcd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.483+0000 7fc27f000640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2780cb890 0x7fc2780cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.483+0000 7fc27f000640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2780b03f0 0x7fc2780b0870 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.483+0000 7fc27f000640 1 --2- 172.21.15.46:0/1180265242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc260003f40 0x7fc2781600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.483+0000 7fc27f000640 1 -- 172.21.15.46:0/1180265242 >> 172.21.15.46:0/1180265242 conn(0x7fc27809ca70 msgr2=0x7fc27815b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:17.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.484+0000 7fc27f000640 1 -- 172.21.15.46:0/1180265242 shutdown_connections 2024-02-19T06:59:17.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.484+0000 7fc27f000640 1 -- 172.21.15.46:0/1180265242 wait complete. 2024-02-19T06:59:17.506 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-19T06:59:17.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.730+0000 7fcda7e00640 1 Processor -- start 2024-02-19T06:59:17.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.730+0000 7fcda7e00640 1 -- start start 2024-02-19T06:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.731+0000 7fcda7e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcda815a770 0x7fcda80b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.731+0000 7fcda7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcda80b27d0 0x7fcda806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.731+0000 7fcda7e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda80b4290 con 0x7fcda80cf530 2024-02-19T06:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.731+0000 7fcda7e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda80b38c0 con 0x7fcda815a770 2024-02-19T06:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.731+0000 7fcda7e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda80b2cb0 con 0x7fcda80b27d0 2024-02-19T06:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.732+0000 7fcda7400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcda80b27d0 0x7fcda806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.732+0000 7fcda6000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcda815a770 0x7fcda80b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.732+0000 7fcda6000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcda815a770 0x7fcda80b3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:39550/0 (socket says 172.21.15.46:39550) 2024-02-19T06:59:17.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.732+0000 7fcda6000640 1 -- 172.21.15.46:0/518651861 learned_addr learned my addr 172.21.15.46:0/518651861 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:17.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.732+0000 7fcda7400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcda80b27d0 0x7fcda806e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:44178/0 (socket says 172.21.15.46:44178) 2024-02-19T06:59:17.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.732+0000 7fcda6a00640 1 --1- 172.21.15.46:0/518651861 >> v1:172.21.15.142:6789/0 conn(0x7fcda80cf530 0x7fcda80cf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:49074/0 (socket says 172.21.15.46:49074) 2024-02-19T06:59:17.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.733+0000 7fcda6000640 1 -- 172.21.15.46:0/518651861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcda80b27d0 msgr2=0x7fcda806e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:17.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.733+0000 7fcda6000640 1 --2- 172.21.15.46:0/518651861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcda80b27d0 0x7fcda806e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.733+0000 7fcda6000640 1 -- 172.21.15.46:0/518651861 >> v1:172.21.15.142:6789/0 conn(0x7fcda80cf530 legacy=0x7fcda80cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:17.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.733+0000 7fcda6000640 1 -- 172.21.15.46:0/518651861 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda80b2f90 con 0x7fcda815a770 2024-02-19T06:59:17.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.734+0000 7fcda6000640 1 --2- 172.21.15.46:0/518651861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcda815a770 0x7fcda80b3d50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009870 tx=0x7fcd9402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e0bc96d577cfb47 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:17.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.735+0000 7fcda5600640 1 -- 172.21.15.46:0/518651861 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94030840 con 0x7fcda815a770 2024-02-19T06:59:17.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.735+0000 7fcda5600640 1 -- 172.21.15.46:0/518651861 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd940309a0 con 0x7fcda815a770 2024-02-19T06:59:17.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.735+0000 7fcda5600640 1 -- 172.21.15.46:0/518651861 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94030d30 con 0x7fcda815a770 2024-02-19T06:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.736+0000 7fcda7e00640 1 -- 172.21.15.46:0/518651861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcda815a770 msgr2=0x7fcda80b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.736+0000 7fcda7e00640 1 --2- 172.21.15.46:0/518651861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcda815a770 0x7fcda80b3d50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009870 tx=0x7fcd9402b980 comp rx=0 tx=0).stop 2024-02-19T06:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.736+0000 7fcda7e00640 1 -- 172.21.15.46:0/518651861 shutdown_connections 2024-02-19T06:59:17.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.736+0000 7fcda7e00640 1 --2- 172.21.15.46:0/518651861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcda80b27d0 0x7fcda806e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.736+0000 7fcda7e00640 1 --2- 172.21.15.46:0/518651861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcda815a770 0x7fcda80b3d50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.736+0000 7fcda7e00640 1 -- 172.21.15.46:0/518651861 >> 172.21.15.46:0/518651861 conn(0x7fcda806ad60 msgr2=0x7fcda806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.736+0000 7fcda7e00640 1 -- 172.21.15.46:0/518651861 shutdown_connections 2024-02-19T06:59:17.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.736+0000 7fcda7e00640 1 -- 172.21.15.46:0/518651861 wait complete. 2024-02-19T06:59:17.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.737+0000 7fcda7e00640 1 Processor -- start 2024-02-19T06:59:17.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.738+0000 7fcda7e00640 1 -- start start 2024-02-19T06:59:17.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.739+0000 7fcda7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda80b27d0 0x7fcda8157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.739+0000 7fcda7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcda80cf530 0x7fcda8159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.739+0000 7fcda7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcda815a770 0x7fcda815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.739+0000 7fcda7e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda8158d90 con 0x7fcda80b27d0 2024-02-19T06:59:17.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.739+0000 7fcda7e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda80c2e80 con 0x7fcda80cf530 2024-02-19T06:59:17.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.739+0000 7fcda7e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda8159760 con 0x7fcda815a770 2024-02-19T06:59:17.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.739+0000 7fcda6a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda80b27d0 0x7fcda8157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.739+0000 7fcda6a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda80b27d0 0x7fcda8157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54096/0 (socket says 172.21.15.46:54096) 2024-02-19T06:59:17.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.739+0000 7fcda6a00640 1 -- 172.21.15.46:0/2076717551 learned_addr learned my addr 172.21.15.46:0/2076717551 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:17.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.739+0000 7fcda6000640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcda80cf530 0x7fcda8159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.739+0000 7fcda7400640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcda815a770 0x7fcda815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.740+0000 7fcda6a00640 1 -- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcda815a770 msgr2=0x7fcda815ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:17.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.740+0000 7fcda6a00640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcda815a770 0x7fcda815ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.740+0000 7fcda6a00640 1 -- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcda80cf530 msgr2=0x7fcda8159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:17.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.740+0000 7fcda6a00640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcda80cf530 0x7fcda8159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:17.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.740+0000 7fcda6a00640 1 -- 172.21.15.46:0/2076717551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940094d0 con 0x7fcda80b27d0 2024-02-19T06:59:17.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.740+0000 7fcda6000640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcda80cf530 0x7fcda8159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T06:59:17.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.740+0000 7fcda6a00640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda80b27d0 0x7fcda8157a80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c790 tx=0x7fcd9800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:17.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.740+0000 7fcd9ea00640 1 -- 172.21.15.46:0/2076717551 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9800cea0 con 0x7fcda80b27d0 2024-02-19T06:59:17.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.740+0000 7fcd9ea00640 1 -- 172.21.15.46:0/2076717551 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9800a640 con 0x7fcda80b27d0 2024-02-19T06:59:17.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.740+0000 7fcd9ea00640 1 -- 172.21.15.46:0/2076717551 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9800a9b0 con 0x7fcda80b27d0 2024-02-19T06:59:17.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.740+0000 7fcda7e00640 1 -- 172.21.15.46:0/2076717551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda8158180 con 0x7fcda80b27d0 2024-02-19T06:59:17.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.740+0000 7fcda7e00640 1 -- 172.21.15.46:0/2076717551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda8158740 con 0x7fcda80b27d0 2024-02-19T06:59:17.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.742+0000 7fcda7e00640 1 -- 172.21.15.46:0/2076717551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda804eee0 con 0x7fcda80b27d0 2024-02-19T06:59:17.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.743+0000 7fcd9ea00640 1 -- 172.21.15.46:0/2076717551 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcd9800ab10 con 0x7fcda80b27d0 2024-02-19T06:59:17.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.743+0000 7fcd9ea00640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcd8806b810 0x7fcd8806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:17.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.744+0000 7fcd9ea00640 1 -- 172.21.15.46:0/2076717551 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd98089780 con 0x7fcda80b27d0 2024-02-19T06:59:17.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.744+0000 7fcda6000640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcd8806b810 0x7fcd8806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:17.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.746+0000 7fcda6000640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcd8806b810 0x7fcd8806dcd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcd94036000 tx=0x7fcd9403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:17.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.748+0000 7fcd9ea00640 1 -- 172.21.15.46:0/2076717551 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd98054240 con 0x7fcda80b27d0 2024-02-19T06:59:17.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:17.983+0000 7fcda7e00640 1 -- 172.21.15.46:0/2076717551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcda80b4290 con 0x7fcda80b27d0 2024-02-19T06:59:18.336 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-02-19T06:59:18.335+0000 7fb701c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-19T06:59:18.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.603+0000 7fcd9ea00640 1 -- 172.21.15.46:0/2076717551 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcda80b4290 con 0x7fcda80b27d0 2024-02-19T06:59:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.609+0000 7fcda7e00640 1 -- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcd8806b810 msgr2=0x7fcd8806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.609+0000 7fcda7e00640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcd8806b810 0x7fcd8806dcd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcd94036000 tx=0x7fcd9403b040 comp rx=0 tx=0).stop 2024-02-19T06:59:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.609+0000 7fcda7e00640 1 -- 172.21.15.46:0/2076717551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda80b27d0 msgr2=0x7fcda8157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.609+0000 7fcda7e00640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda80b27d0 0x7fcda8157a80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c790 tx=0x7fcd9800cc50 comp rx=0 tx=0).stop 2024-02-19T06:59:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.609+0000 7fcda7e00640 1 -- 172.21.15.46:0/2076717551 shutdown_connections 2024-02-19T06:59:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.609+0000 7fcda7e00640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcd8806b810 0x7fcd8806dcd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.609+0000 7fcda7e00640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcda815a770 0x7fcda815ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.609+0000 7fcda7e00640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcda80cf530 0x7fcda8159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.609+0000 7fcda7e00640 1 --2- 172.21.15.46:0/2076717551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda80b27d0 0x7fcda8157a80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.609+0000 7fcda7e00640 1 -- 172.21.15.46:0/2076717551 >> 172.21.15.46:0/2076717551 conn(0x7fcda806ad60 msgr2=0x7fcda80b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.609+0000 7fcda7e00640 1 -- 172.21.15.46:0/2076717551 shutdown_connections 2024-02-19T06:59:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.609+0000 7fcda7e00640 1 -- 172.21.15.46:0/2076717551 wait complete. 2024-02-19T06:59:18.630 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-19T06:59:18.630 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-19T06:59:18.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.839+0000 7f7dd9e00640 1 Processor -- start 2024-02-19T06:59:18.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.840+0000 7f7dd9e00640 1 -- start start 2024-02-19T06:59:18.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.841+0000 7f7dd9e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7dd415d950 0x7f7dd409a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:18.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.841+0000 7f7dd9e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7dd409ab80 0x7f7dd406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:18.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.841+0000 7f7dd9e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dd406cbe0 0x7f7dd4161600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:18.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.841+0000 7f7dd9e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd40b3000 con 0x7f7dd409ab80 2024-02-19T06:59:18.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.841+0000 7f7dd9e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd40d0df0 con 0x7f7dd415d950 2024-02-19T06:59:18.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.841+0000 7f7dd9e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd406d070 con 0x7f7dd406cbe0 2024-02-19T06:59:18.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.841+0000 7f7dd2000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7dd409ab80 0x7f7dd406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.842+0000 7f7dd2000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7dd409ab80 0x7f7dd406c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54106/0 (socket says 172.21.15.46:54106) 2024-02-19T06:59:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.842+0000 7f7dd2000640 1 -- 172.21.15.46:0/1018800051 learned_addr learned my addr 172.21.15.46:0/1018800051 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.842+0000 7f7dd2a00640 1 --2- 172.21.15.46:0/1018800051 >> v2:172.21.15.142:3300/0 conn(0x7f7dd415d950 0x7f7dd409a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.842+0000 7f7dd3400640 1 --2- 172.21.15.46:0/1018800051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dd406cbe0 0x7f7dd4161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.842+0000 7f7dd2000640 1 -- 172.21.15.46:0/1018800051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dd406cbe0 msgr2=0x7f7dd4161600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.842+0000 7f7dd2000640 1 --2- 172.21.15.46:0/1018800051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dd406cbe0 0x7f7dd4161600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.842+0000 7f7dd2000640 1 -- 172.21.15.46:0/1018800051 >> v2:172.21.15.142:3300/0 conn(0x7f7dd415d950 msgr2=0x7f7dd409a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.842+0000 7f7dd2000640 1 --2- 172.21.15.46:0/1018800051 >> v2:172.21.15.142:3300/0 conn(0x7f7dd415d950 0x7f7dd409a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.842+0000 7f7dd2000640 1 -- 172.21.15.46:0/1018800051 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40cfd50 con 0x7f7dd409ab80 2024-02-19T06:59:18.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.843+0000 7f7dd2000640 1 --2- 172.21.15.46:0/1018800051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd409ab80 0x7f7dd406c6a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40723b0 tx=0x7f7dbc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f9658cf111fa0a server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.843+0000 7f7dd1600640 1 -- 172.21.15.46:0/1018800051 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc02cb00 con 0x7f7dd409ab80 2024-02-19T06:59:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.844+0000 7f7dd1600640 1 -- 172.21.15.46:0/1018800051 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc02cc60 con 0x7f7dd409ab80 2024-02-19T06:59:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.844+0000 7f7dd1600640 1 -- 172.21.15.46:0/1018800051 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0343f0 con 0x7f7dd409ab80 2024-02-19T06:59:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.844+0000 7f7dd9e00640 1 -- 172.21.15.46:0/1018800051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd409ab80 msgr2=0x7f7dd406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.844+0000 7f7dd9e00640 1 --2- 172.21.15.46:0/1018800051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd409ab80 0x7f7dd406c6a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40723b0 tx=0x7f7dbc02bf60 comp rx=0 tx=0).stop 2024-02-19T06:59:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.844+0000 7f7dd9e00640 1 -- 172.21.15.46:0/1018800051 shutdown_connections 2024-02-19T06:59:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.844+0000 7f7dd9e00640 1 --2- 172.21.15.46:0/1018800051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dd406cbe0 0x7f7dd4161600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.844+0000 7f7dd9e00640 1 --2- 172.21.15.46:0/1018800051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd409ab80 0x7f7dd406c6a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.844+0000 7f7dd9e00640 1 --2- 172.21.15.46:0/1018800051 >> v2:172.21.15.142:3300/0 conn(0x7f7dd415d950 0x7f7dd409a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.844+0000 7f7dd9e00640 1 -- 172.21.15.46:0/1018800051 >> 172.21.15.46:0/1018800051 conn(0x7f7dd40b3180 msgr2=0x7f7dd40b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.844+0000 7f7dd9e00640 1 -- 172.21.15.46:0/1018800051 shutdown_connections 2024-02-19T06:59:18.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.844+0000 7f7dd9e00640 1 -- 172.21.15.46:0/1018800051 wait complete. 2024-02-19T06:59:18.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.846+0000 7f7dd9e00640 1 Processor -- start 2024-02-19T06:59:18.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.846+0000 7f7dd9e00640 1 -- start start 2024-02-19T06:59:18.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.847+0000 7f7dd9e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dd406cbe0 0x7f7dd409ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:18.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.847+0000 7f7dd9e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dd409ab80 0x7f7dd41f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:18.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.847+0000 7f7dd9e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd415d950 0x7f7dd415fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:18.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.847+0000 7f7dd9e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd415f730 con 0x7f7dd415d950 2024-02-19T06:59:18.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.847+0000 7f7dd9e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd415eb20 con 0x7f7dd406cbe0 2024-02-19T06:59:18.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.847+0000 7f7dd9e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd415ee00 con 0x7f7dd409ab80 2024-02-19T06:59:18.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.847+0000 7f7dd3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd415d950 0x7f7dd415fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:18.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.847+0000 7f7dd3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd415d950 0x7f7dd415fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54108/0 (socket says 172.21.15.46:54108) 2024-02-19T06:59:18.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.847+0000 7f7dd3400640 1 -- 172.21.15.46:0/450320400 learned_addr learned my addr 172.21.15.46:0/450320400 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:18.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.848+0000 7f7dd2a00640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dd406cbe0 0x7f7dd409ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:18.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.848+0000 7f7dd3400640 1 -- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dd409ab80 msgr2=0x7f7dd41f3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:18.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.848+0000 7f7dd3400640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dd409ab80 0x7f7dd41f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:18.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.848+0000 7f7dd3400640 1 -- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dd406cbe0 msgr2=0x7f7dd409ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:18.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.848+0000 7f7dd3400640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dd406cbe0 0x7f7dd409ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:18.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.848+0000 7f7dd3400640 1 -- 172.21.15.46:0/450320400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc009b30 con 0x7f7dd415d950 2024-02-19T06:59:18.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.848+0000 7f7dd2a00640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dd406cbe0 0x7f7dd409ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:18.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.848+0000 7f7dd3400640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd415d950 0x7f7dd415fbc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00d800 tx=0x7f7dcc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:18.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.848+0000 7f7dcb400640 1 -- 172.21.15.46:0/450320400 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0096c0 con 0x7f7dd415d950 2024-02-19T06:59:18.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.848+0000 7f7dcb400640 1 -- 172.21.15.46:0/450320400 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc009840 con 0x7f7dd415d950 2024-02-19T06:59:18.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.848+0000 7f7dcb400640 1 -- 172.21.15.46:0/450320400 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc009bf0 con 0x7f7dd415d950 2024-02-19T06:59:18.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.849+0000 7f7dd9e00640 1 -- 172.21.15.46:0/450320400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd415f0e0 con 0x7f7dd415d950 2024-02-19T06:59:18.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.849+0000 7f7dd9e00640 1 -- 172.21.15.46:0/450320400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd415e740 con 0x7f7dd415d950 2024-02-19T06:59:18.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.850+0000 7f7dd9e00640 1 -- 172.21.15.46:0/450320400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd415f8a0 con 0x7f7dd415d950 2024-02-19T06:59:18.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.851+0000 7f7dcb400640 1 -- 172.21.15.46:0/450320400 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7dcc009d50 con 0x7f7dd415d950 2024-02-19T06:59:18.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.852+0000 7f7dcb400640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7db006b890 0x7f7db006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:18.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.852+0000 7f7dcb400640 1 -- 172.21.15.46:0/450320400 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dcc08a5b0 con 0x7f7dd415d950 2024-02-19T06:59:18.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.852+0000 7f7dd2a00640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7db006b890 0x7f7db006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:18.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.853+0000 7f7dd2a00640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7db006b890 0x7f7db006dd50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4006fd0 tx=0x7f7dc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:18.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:18.856+0000 7f7dcb400640 1 -- 172.21.15.46:0/450320400 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7dcc054fb0 con 0x7f7dd415d950 2024-02-19T06:59:19.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.095+0000 7f7dd9e00640 1 -- 172.21.15.46:0/450320400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7dd415d190 con 0x7f7dd415d950 2024-02-19T06:59:19.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.624+0000 7f7dcb400640 1 -- 172.21.15.46:0/450320400 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7dcc058670 con 0x7f7dd415d950 2024-02-19T06:59:19.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.629+0000 7f7dd9e00640 1 -- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7db006b890 msgr2=0x7f7db006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:19.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.629+0000 7f7dd9e00640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7db006b890 0x7f7db006dd50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4006fd0 tx=0x7f7dc4008040 comp rx=0 tx=0).stop 2024-02-19T06:59:19.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.629+0000 7f7dd9e00640 1 -- 172.21.15.46:0/450320400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd415d950 msgr2=0x7f7dd415fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:19.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.629+0000 7f7dd9e00640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd415d950 0x7f7dd415fbc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00d800 tx=0x7f7dcc00dcc0 comp rx=0 tx=0).stop 2024-02-19T06:59:19.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.629+0000 7f7dd9e00640 1 -- 172.21.15.46:0/450320400 shutdown_connections 2024-02-19T06:59:19.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.629+0000 7f7dd9e00640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7db006b890 0x7f7db006dd50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:19.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.629+0000 7f7dd9e00640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd415d950 0x7f7dd415fbc0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:19.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.629+0000 7f7dd9e00640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dd409ab80 0x7f7dd41f3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:19.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.629+0000 7f7dd9e00640 1 --2- 172.21.15.46:0/450320400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dd406cbe0 0x7f7dd409ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:19.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.629+0000 7f7dd9e00640 1 -- 172.21.15.46:0/450320400 >> 172.21.15.46:0/450320400 conn(0x7f7dd40b3180 msgr2=0x7f7dd4070710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:19.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.630+0000 7f7dd9e00640 1 -- 172.21.15.46:0/450320400 shutdown_connections 2024-02-19T06:59:19.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.630+0000 7f7dd9e00640 1 -- 172.21.15.46:0/450320400 wait complete. 2024-02-19T06:59:19.656 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-19T06:59:19.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T06:59:19.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.883+0000 7fb116400640 1 Processor -- start 2024-02-19T06:59:19.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.883+0000 7fb116400640 1 -- start start 2024-02-19T06:59:19.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.884+0000 7fb116400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1101611c0 0x7fb1100d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:19.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.884+0000 7fb116400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1100d2370 0x7fb1100b7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:19.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.884+0000 7fb116400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1100d2900 con 0x7fb1100d0810 2024-02-19T06:59:19.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.884+0000 7fb116400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1100d0c80 con 0x7fb1101611c0 2024-02-19T06:59:19.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.884+0000 7fb116400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100d2be0 con 0x7fb1100d2370 2024-02-19T06:59:19.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.885+0000 7fb10fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1100d2370 0x7fb1100b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:19.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.885+0000 7fb10f400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1101611c0 0x7fb1100d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:19.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.885+0000 7fb10f400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1101611c0 0x7fb1100d02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:39588/0 (socket says 172.21.15.46:39588) 2024-02-19T06:59:19.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.885+0000 7fb10f400640 1 -- 172.21.15.46:0/2119010109 learned_addr learned my addr 172.21.15.46:0/2119010109 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:19.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.885+0000 7fb10ea00640 1 --1- 172.21.15.46:0/2119010109 >> v1:172.21.15.142:6789/0 conn(0x7fb1100d0810 0x7fb1100d1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:49088/0 (socket says 172.21.15.46:49088) 2024-02-19T06:59:19.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.886+0000 7fb10e000640 1 -- 172.21.15.46:0/2119010109 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453239107 0 0) 0x7fb1100d2900 con 0x7fb1100d0810 2024-02-19T06:59:19.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.886+0000 7fb10e000640 1 -- 172.21.15.46:0/2119010109 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0f4003520 con 0x7fb1100d0810 2024-02-19T06:59:19.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.886+0000 7fb10f400640 1 -- 172.21.15.46:0/2119010109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1100d2370 msgr2=0x7fb1100b7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:19.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.886+0000 7fb10f400640 1 --2- 172.21.15.46:0/2119010109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1100d2370 0x7fb1100b7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:19.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.886+0000 7fb10f400640 1 -- 172.21.15.46:0/2119010109 >> v1:172.21.15.142:6789/0 conn(0x7fb1100d0810 legacy=0x7fb1100d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:19.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.886+0000 7fb10f400640 1 -- 172.21.15.46:0/2119010109 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1100d2ec0 con 0x7fb1101611c0 2024-02-19T06:59:19.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.886+0000 7fb10fe00640 1 --2- 172.21.15.46:0/2119010109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1100d2370 0x7fb1100b7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T06:59:19.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.887+0000 7fb10f400640 1 --2- 172.21.15.46:0/2119010109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1101611c0 0x7fb1100d02d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb100009e50 tx=0x7fb10002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3b52d5ec899d20d server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:19.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.888+0000 7fb10e000640 1 -- 172.21.15.46:0/2119010109 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10002cb00 con 0x7fb1101611c0 2024-02-19T06:59:19.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.888+0000 7fb10e000640 1 -- 172.21.15.46:0/2119010109 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10002cc60 con 0x7fb1101611c0 2024-02-19T06:59:19.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.888+0000 7fb10e000640 1 -- 172.21.15.46:0/2119010109 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000343f0 con 0x7fb1101611c0 2024-02-19T06:59:19.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.888+0000 7fb116400640 1 -- 172.21.15.46:0/2119010109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1101611c0 msgr2=0x7fb1100d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:19.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.888+0000 7fb116400640 1 --2- 172.21.15.46:0/2119010109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1101611c0 0x7fb1100d02d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb100009e50 tx=0x7fb10002bf60 comp rx=0 tx=0).stop 2024-02-19T06:59:19.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.888+0000 7fb116400640 1 -- 172.21.15.46:0/2119010109 shutdown_connections 2024-02-19T06:59:19.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.888+0000 7fb116400640 1 --2- 172.21.15.46:0/2119010109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1100d2370 0x7fb1100b7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:19.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.888+0000 7fb116400640 1 --2- 172.21.15.46:0/2119010109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1101611c0 0x7fb1100d02d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:19.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.888+0000 7fb116400640 1 -- 172.21.15.46:0/2119010109 >> 172.21.15.46:0/2119010109 conn(0x7fb1100b53d0 msgr2=0x7fb1100b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:19.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.888+0000 7fb116400640 1 -- 172.21.15.46:0/2119010109 shutdown_connections 2024-02-19T06:59:19.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.888+0000 7fb116400640 1 -- 172.21.15.46:0/2119010109 wait complete. 2024-02-19T06:59:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.890+0000 7fb116400640 1 Processor -- start 2024-02-19T06:59:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.890+0000 7fb116400640 1 -- start start 2024-02-19T06:59:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.891+0000 7fb116400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100d0810 0x7fb110159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.891+0000 7fb116400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1100d2370 0x7fb11015af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.891+0000 7fb116400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1101611c0 0x7fb1100cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.891+0000 7fb116400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100aa610 con 0x7fb1100d0810 2024-02-19T06:59:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.891+0000 7fb116400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100cd920 con 0x7fb1101611c0 2024-02-19T06:59:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.891+0000 7fb116400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100c85c0 con 0x7fb1100d2370 2024-02-19T06:59:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.892+0000 7fb10f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100d0810 0x7fb110159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.892+0000 7fb10f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100d0810 0x7fb110159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54118/0 (socket says 172.21.15.46:54118) 2024-02-19T06:59:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.892+0000 7fb10f400640 1 -- 172.21.15.46:0/1742463185 learned_addr learned my addr 172.21.15.46:0/1742463185 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.892+0000 7fb10ea00640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1100d2370 0x7fb11015af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.892+0000 7fb10fe00640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1101611c0 0x7fb1100cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.892+0000 7fb10f400640 1 -- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1100d2370 msgr2=0x7fb11015af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.892+0000 7fb10f400640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1100d2370 0x7fb11015af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.892+0000 7fb10f400640 1 -- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1101611c0 msgr2=0x7fb1100cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.892+0000 7fb10f400640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1101611c0 0x7fb1100cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.892+0000 7fb10f400640 1 -- 172.21.15.46:0/1742463185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb108009400 con 0x7fb1100d0810 2024-02-19T06:59:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.892+0000 7fb10f400640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100d0810 0x7fb110159200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb100000f80 tx=0x7fb100004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.893+0000 7fb107400640 1 -- 172.21.15.46:0/1742463185 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100009510 con 0x7fb1100d0810 2024-02-19T06:59:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.893+0000 7fb107400640 1 -- 172.21.15.46:0/1742463185 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10003e450 con 0x7fb1100d0810 2024-02-19T06:59:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.893+0000 7fb107400640 1 -- 172.21.15.46:0/1742463185 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10003e800 con 0x7fb1100d0810 2024-02-19T06:59:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.893+0000 7fb116400640 1 -- 172.21.15.46:0/1742463185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb100009b30 con 0x7fb1100d0810 2024-02-19T06:59:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.893+0000 7fb116400640 1 -- 172.21.15.46:0/1742463185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1100cc0d0 con 0x7fb1100d0810 2024-02-19T06:59:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.894+0000 7fb116400640 1 -- 172.21.15.46:0/1742463185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb110067ba0 con 0x7fb1100d0810 2024-02-19T06:59:19.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.895+0000 7fb107400640 1 -- 172.21.15.46:0/1742463185 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb10003e960 con 0x7fb1100d0810 2024-02-19T06:59:19.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.896+0000 7fb107400640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb0f006b810 0x7fb0f006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:19.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.896+0000 7fb107400640 1 -- 172.21.15.46:0/1742463185 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1000ace50 con 0x7fb1100d0810 2024-02-19T06:59:19.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.897+0000 7fb10ea00640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb0f006b810 0x7fb0f006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:19.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.898+0000 7fb10ea00640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb0f006b810 0x7fb0f006dcd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb1101f7bd0 tx=0x7fb0fc007b00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:19.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:19.902+0000 7fb107400640 1 -- 172.21.15.46:0/1742463185 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb100077860 con 0x7fb1100d0810 2024-02-19T06:59:20.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.138+0000 7fb116400640 1 -- 172.21.15.46:0/1742463185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb11015b770 con 0x7fb1100d0810 2024-02-19T06:59:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.139+0000 7fb107400640 1 -- 172.21.15.46:0/1742463185 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fb10007af20 con 0x7fb1100d0810 2024-02-19T06:59:20.142 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:20.142 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2121507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2121507890},{"type":"v1","addr":"172.21.15.142:6835","nonce":2121507890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3952092655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3952092655},{"type":"v1","addr":"172.21.15.46:6835","nonce":3952092655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1741774776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1741774776},{"type":"v1","addr":"172.21.15.142:6837","nonce":1741774776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:59:16.065049+0000","modified":"2024-02-19T06:59:19.096312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6834/1322569769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1322569769},{"type":"v1","addr":"172.21.15.46:6834","nonce":1322569769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-19T06:59:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-02-19T06:59:20.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.142+0000 7fb116400640 1 -- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb0f006b810 msgr2=0x7fb0f006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:20.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.142+0000 7fb116400640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb0f006b810 0x7fb0f006dcd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb1101f7bd0 tx=0x7fb0fc007b00 comp rx=0 tx=0).stop 2024-02-19T06:59:20.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.142+0000 7fb116400640 1 -- 172.21.15.46:0/1742463185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100d0810 msgr2=0x7fb110159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:20.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.142+0000 7fb116400640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100d0810 0x7fb110159200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb100000f80 tx=0x7fb100004a40 comp rx=0 tx=0).stop 2024-02-19T06:59:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.142+0000 7fb116400640 1 -- 172.21.15.46:0/1742463185 shutdown_connections 2024-02-19T06:59:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.142+0000 7fb116400640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb0f006b810 0x7fb0f006dcd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.142+0000 7fb116400640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1101611c0 0x7fb1100cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.142+0000 7fb116400640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1100d2370 0x7fb11015af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.142+0000 7fb116400640 1 --2- 172.21.15.46:0/1742463185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1100d0810 0x7fb110159200 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.142+0000 7fb116400640 1 -- 172.21.15.46:0/1742463185 >> 172.21.15.46:0/1742463185 conn(0x7fb1100b53d0 msgr2=0x7fb1100b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.142+0000 7fb116400640 1 -- 172.21.15.46:0/1742463185 shutdown_connections 2024-02-19T06:59:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.143+0000 7fb116400640 1 -- 172.21.15.46:0/1742463185 wait complete. 2024-02-19T06:59:20.166 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T06:59:20.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.381+0000 7fb223200640 1 Processor -- start 2024-02-19T06:59:20.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.381+0000 7fb223200640 1 -- start start 2024-02-19T06:59:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.382+0000 7fb223200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb21c15b540 0x7fb21c0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.382+0000 7fb223200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21c0cb5f0 con 0x7fb21c0cfe50 2024-02-19T06:59:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.382+0000 7fb223200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21c15f270 con 0x7fb21c0cb150 2024-02-19T06:59:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.382+0000 7fb223200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb21c15f550 con 0x7fb21c15b540 2024-02-19T06:59:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.382+0000 7fb222800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb21c0cfe50 0x7fb21c0c99a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39452/0 (socket says 172.21.15.46:39452) 2024-02-19T06:59:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.383+0000 7fb222800640 1 -- 172.21.15.46:0/1426271076 learned_addr learned my addr 172.21.15.46:0/1426271076 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:20.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.383+0000 7fb221e00640 1 --2- 172.21.15.46:0/1426271076 >> v2:172.21.15.142:3300/0 conn(0x7fb21c15b540 0x7fb21c0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.383+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181598570 0 0) 0x7fb21c0cb5f0 con 0x7fb21c0cfe50 2024-02-19T06:59:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.383+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb204003520 con 0x7fb21c0cfe50 2024-02-19T06:59:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.383+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3389495913 0 0) 0x7fb204003520 con 0x7fb21c0cfe50 2024-02-19T06:59:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.383+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 >> v2:172.21.15.142:3300/0 conn(0x7fb21c15b540 msgr2=0x7fb21c0cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.383+0000 7fb220a00640 1 --2- 172.21.15.46:0/1426271076 >> v2:172.21.15.142:3300/0 conn(0x7fb21c15b540 0x7fb21c0cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.383+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 >> v1:172.21.15.142:6789/0 conn(0x7fb21c0cb150 legacy=0x7fb21c0cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.383+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c15f830 con 0x7fb21c0cfe50 2024-02-19T06:59:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.383+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fb2180019f0 con 0x7fb21c0cfe50 2024-02-19T06:59:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 >> v1:172.21.15.46:6789/0 conn(0x7fb21c0cfe50 legacy=0x7fb21c0c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb220a00640 1 --2- 172.21.15.46:0/1426271076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204003970 0x7fb204003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb220a00640 1 --2- 172.21.15.46:0/1426271076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2040047c0 0x7fb204004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb220a00640 1 --2- 172.21.15.46:0/1426271076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb204005180 0x7fb20400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c15f550 con 0x7fb204003970 2024-02-19T06:59:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20400c020 con 0x7fb2040047c0 2024-02-19T06:59:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20400c1e0 con 0x7fb204005180 2024-02-19T06:59:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb221e00640 1 --2- 172.21.15.46:0/1426271076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204003970 0x7fb204003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb221400640 1 --2- 172.21.15.46:0/1426271076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2040047c0 0x7fb204004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb221e00640 1 -- 172.21.15.46:0/1426271076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb204005180 msgr2=0x7fb20400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb221e00640 1 --2- 172.21.15.46:0/1426271076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb204005180 0x7fb20400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb221e00640 1 -- 172.21.15.46:0/1426271076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2040047c0 msgr2=0x7fb204004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb221e00640 1 --2- 172.21.15.46:0/1426271076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2040047c0 0x7fb204004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb221e00640 1 -- 172.21.15.46:0/1426271076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb204003520 con 0x7fb204003970 2024-02-19T06:59:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb221400640 1 --2- 172.21.15.46:0/1426271076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2040047c0 0x7fb204004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.384+0000 7fb222800640 1 -- 172.21.15.46:0/1426271076 reap_dead start 2024-02-19T06:59:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.385+0000 7fb221e00640 1 --2- 172.21.15.46:0/1426271076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204003970 0x7fb204003d90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb210009ac0 tx=0x7fb2040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290f9e785c9c25c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:20.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.386+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21002c6b0 con 0x7fb204003970 2024-02-19T06:59:20.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.386+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21002c810 con 0x7fb204003970 2024-02-19T06:59:20.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.386+0000 7fb220a00640 1 -- 172.21.15.46:0/1426271076 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21002cba0 con 0x7fb204003970 2024-02-19T06:59:20.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.386+0000 7fb223200640 1 -- 172.21.15.46:0/1426271076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204003970 msgr2=0x7fb204003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:20.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.386+0000 7fb223200640 1 --2- 172.21.15.46:0/1426271076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204003970 0x7fb204003d90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb210009ac0 tx=0x7fb2040057f0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.386+0000 7fb223200640 1 -- 172.21.15.46:0/1426271076 shutdown_connections 2024-02-19T06:59:20.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.386+0000 7fb223200640 1 --2- 172.21.15.46:0/1426271076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204003970 0x7fb204003d90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.386+0000 7fb223200640 1 -- 172.21.15.46:0/1426271076 >> 172.21.15.46:0/1426271076 conn(0x7fb21c06afa0 msgr2=0x7fb21c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:20.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.386+0000 7fb223200640 1 -- 172.21.15.46:0/1426271076 shutdown_connections 2024-02-19T06:59:20.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.386+0000 7fb223200640 1 -- 172.21.15.46:0/1426271076 wait complete. 2024-02-19T06:59:20.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.388+0000 7fb223200640 1 Processor -- start 2024-02-19T06:59:20.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.388+0000 7fb223200640 1 -- start start 2024-02-19T06:59:20.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.389+0000 7fb223200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb204003970 0x7fb21c1f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.389+0000 7fb223200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb21c0c33a0 0x7fb21c1f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.389+0000 7fb223200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb21c0c55a0 0x7fb21c1f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.389+0000 7fb223200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0cd8c0 con 0x7fb21c0c33a0 2024-02-19T06:59:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.389+0000 7fb223200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0c5f40 con 0x7fb204003970 2024-02-19T06:59:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.389+0000 7fb223200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0ccf20 con 0x7fb21c0c55a0 2024-02-19T06:59:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.390+0000 7fb221400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb21c0c33a0 0x7fb21c1f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.390+0000 7fb221400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb21c0c33a0 0x7fb21c1f4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54136/0 (socket says 172.21.15.46:54136) 2024-02-19T06:59:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.390+0000 7fb221400640 1 -- 172.21.15.46:0/4230314064 learned_addr learned my addr 172.21.15.46:0/4230314064 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.390+0000 7fb222800640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb21c0c55a0 0x7fb21c1f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.390+0000 7fb221e00640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb204003970 0x7fb21c1f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.390+0000 7fb221400640 1 -- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb21c0c55a0 msgr2=0x7fb21c1f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.390+0000 7fb221400640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb21c0c55a0 0x7fb21c1f6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.390+0000 7fb221400640 1 -- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb204003970 msgr2=0x7fb21c1f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.390+0000 7fb221400640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb204003970 0x7fb21c1f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.390+0000 7fb221400640 1 -- 172.21.15.46:0/4230314064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c0cd200 con 0x7fb21c0c33a0 2024-02-19T06:59:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.390+0000 7fb222800640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb21c0c55a0 0x7fb21c1f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.390+0000 7fb221e00640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb204003970 0x7fb21c1f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.390+0000 7fb221400640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb21c0c33a0 0x7fb21c1f4870 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00d480 tx=0x7fb20c00d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.391+0000 7fb216000640 1 -- 172.21.15.46:0/4230314064 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c005480 con 0x7fb21c0c33a0 2024-02-19T06:59:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.391+0000 7fb216000640 1 -- 172.21.15.46:0/4230314064 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c003610 con 0x7fb21c0c33a0 2024-02-19T06:59:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.391+0000 7fb216000640 1 -- 172.21.15.46:0/4230314064 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c003a00 con 0x7fb21c0c33a0 2024-02-19T06:59:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.391+0000 7fb223200640 1 -- 172.21.15.46:0/4230314064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21c0cd4e0 con 0x7fb21c0c33a0 2024-02-19T06:59:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.391+0000 7fb223200640 1 -- 172.21.15.46:0/4230314064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21c0c5a50 con 0x7fb21c0c33a0 2024-02-19T06:59:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.392+0000 7fb223200640 1 -- 172.21.15.46:0/4230314064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21c04eee0 con 0x7fb21c0c33a0 2024-02-19T06:59:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.393+0000 7fb216000640 1 -- 172.21.15.46:0/4230314064 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb20c003b60 con 0x7fb21c0c33a0 2024-02-19T06:59:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.395+0000 7fb216000640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb20006b810 0x7fb20006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.395+0000 7fb216000640 1 -- 172.21.15.46:0/4230314064 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb20c08a100 con 0x7fb21c0c33a0 2024-02-19T06:59:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.395+0000 7fb221e00640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb20006b810 0x7fb20006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.396+0000 7fb221e00640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb20006b810 0x7fb20006dcd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb210036000 tx=0x7fb210030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.399+0000 7fb216000640 1 -- 172.21.15.46:0/4230314064 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb20c054bd0 con 0x7fb21c0c33a0 2024-02-19T06:59:20.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.601+0000 7fb223200640 1 -- 172.21.15.46:0/4230314064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb21c06e120 con 0x7fb21c0c33a0 2024-02-19T06:59:20.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.602+0000 7fb216000640 1 -- 172.21.15.46:0/4230314064 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16669 (secure 0 0 0) 0x7fb20c058290 con 0x7fb21c0c33a0 2024-02-19T06:59:20.605 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:20.605 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":35,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:59:17.589125+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:59:14.017896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-19T06:59:15.078011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T06:59:20.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.605+0000 7fb223200640 1 -- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb20006b810 msgr2=0x7fb20006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:20.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.605+0000 7fb223200640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb20006b810 0x7fb20006dcd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb210036000 tx=0x7fb210030000 comp rx=0 tx=0).stop 2024-02-19T06:59:20.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.605+0000 7fb223200640 1 -- 172.21.15.46:0/4230314064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb21c0c33a0 msgr2=0x7fb21c1f4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:20.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.605+0000 7fb223200640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb21c0c33a0 0x7fb21c1f4870 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00d480 tx=0x7fb20c00d940 comp rx=0 tx=0).stop 2024-02-19T06:59:20.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.605+0000 7fb223200640 1 -- 172.21.15.46:0/4230314064 shutdown_connections 2024-02-19T06:59:20.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.605+0000 7fb223200640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb20006b810 0x7fb20006dcd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.605+0000 7fb223200640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb21c0c55a0 0x7fb21c1f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.605+0000 7fb223200640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb21c0c33a0 0x7fb21c1f4870 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.605+0000 7fb223200640 1 --2- 172.21.15.46:0/4230314064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb204003970 0x7fb21c1f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.605+0000 7fb223200640 1 -- 172.21.15.46:0/4230314064 >> 172.21.15.46:0/4230314064 conn(0x7fb21c06afa0 msgr2=0x7fb21c0ae1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:20.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.605+0000 7fb223200640 1 -- 172.21.15.46:0/4230314064 shutdown_connections 2024-02-19T06:59:20.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.605+0000 7fb223200640 1 -- 172.21.15.46:0/4230314064 wait complete. 2024-02-19T06:59:20.626 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-19T06:59:20.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-19T06:59:20.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.847+0000 7fbf64a00640 1 Processor -- start 2024-02-19T06:59:20.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.847+0000 7fbf64a00640 1 -- start start 2024-02-19T06:59:20.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.849+0000 7fbf64a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbf6015fd50 0x7fbf600cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.849+0000 7fbf64a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf600cfc80 0x7fbf600c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.849+0000 7fbf64a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf600cb320 con 0x7fbf6015b540 2024-02-19T06:59:20.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.849+0000 7fbf64a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf600d0110 con 0x7fbf6015fd50 2024-02-19T06:59:20.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.849+0000 7fbf64a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600cb5f0 con 0x7fbf600cfc80 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.849+0000 7fbf5e800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbf6015b540 0x7fbf600cac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39460/0 (socket says 172.21.15.46:39460) 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.849+0000 7fbf5e800640 1 -- 172.21.15.46:0/2230490831 learned_addr learned my addr 172.21.15.46:0/2230490831 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf55e00640 1 --2- 172.21.15.46:0/2230490831 >> v2:172.21.15.142:3300/0 conn(0x7fbf6015fd50 0x7fbf600cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5f200640 1 --2- 172.21.15.46:0/2230490831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf600cfc80 0x7fbf600c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307780369 0 0) 0x7fbf600cb320 con 0x7fbf6015b540 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf44003520 con 0x7fbf6015b540 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2888923670 0 0) 0x7fbf44003520 con 0x7fbf6015b540 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf600cfc80 msgr2=0x7fbf600c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 --2- 172.21.15.46:0/2230490831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf600cfc80 0x7fbf600c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 >> v2:172.21.15.142:3300/0 conn(0x7fbf6015fd50 msgr2=0x7fbf600cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 --2- 172.21.15.46:0/2230490831 >> v2:172.21.15.142:3300/0 conn(0x7fbf6015fd50 0x7fbf600cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6015f270 con 0x7fbf6015b540 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fbf500019f0 con 0x7fbf6015b540 2024-02-19T06:59:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 >> v1:172.21.15.46:6789/0 conn(0x7fbf6015b540 legacy=0x7fbf600cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 --2- 172.21.15.46:0/2230490831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf44003970 0x7fbf44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 --2- 172.21.15.46:0/2230490831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf440047c0 0x7fbf44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 --2- 172.21.15.46:0/2230490831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf600cfc80 0x7fbf44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600d0110 con 0x7fbf440047c0 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600cb5f0 con 0x7fbf44003970 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.850+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4400b980 con 0x7fbf600cfc80 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.851+0000 7fbf55e00640 1 --2- 172.21.15.46:0/2230490831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf440047c0 0x7fbf44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.851+0000 7fbf5f200640 1 --2- 172.21.15.46:0/2230490831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf600cfc80 0x7fbf44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.851+0000 7fbf5e800640 1 --2- 172.21.15.46:0/2230490831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf44003970 0x7fbf44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.851+0000 7fbf55e00640 1 -- 172.21.15.46:0/2230490831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf600cfc80 msgr2=0x7fbf44005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.851+0000 7fbf55e00640 1 --2- 172.21.15.46:0/2230490831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf600cfc80 0x7fbf44005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.851+0000 7fbf55e00640 1 -- 172.21.15.46:0/2230490831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf44003970 msgr2=0x7fbf44003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.851+0000 7fbf55e00640 1 --2- 172.21.15.46:0/2230490831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf44003970 0x7fbf44003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.851+0000 7fbf55e00640 1 -- 172.21.15.46:0/2230490831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf44003520 con 0x7fbf440047c0 2024-02-19T06:59:20.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.852+0000 7fbf55e00640 1 --2- 172.21.15.46:0/2230490831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf440047c0 0x7fbf44004c40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009ac0 tx=0x7fbf440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ea002453b772a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.853+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4802c710 con 0x7fbf440047c0 2024-02-19T06:59:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.853+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4802c870 con 0x7fbf440047c0 2024-02-19T06:59:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.853+0000 7fbf5de00640 1 -- 172.21.15.46:0/2230490831 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4802cc00 con 0x7fbf440047c0 2024-02-19T06:59:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.853+0000 7fbf64a00640 1 -- 172.21.15.46:0/2230490831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf440047c0 msgr2=0x7fbf44004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.853+0000 7fbf64a00640 1 --2- 172.21.15.46:0/2230490831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf440047c0 0x7fbf44004c40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009ac0 tx=0x7fbf440057f0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.853+0000 7fbf5f200640 1 -- 172.21.15.46:0/2230490831 reap_dead start 2024-02-19T06:59:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.853+0000 7fbf64a00640 1 -- 172.21.15.46:0/2230490831 shutdown_connections 2024-02-19T06:59:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.853+0000 7fbf64a00640 1 -- 172.21.15.46:0/2230490831 >> 172.21.15.46:0/2230490831 conn(0x7fbf6006afa0 msgr2=0x7fbf6006b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.853+0000 7fbf64a00640 1 -- 172.21.15.46:0/2230490831 shutdown_connections 2024-02-19T06:59:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.853+0000 7fbf64a00640 1 -- 172.21.15.46:0/2230490831 wait complete. 2024-02-19T06:59:20.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.855+0000 7fbf64a00640 1 Processor -- start 2024-02-19T06:59:20.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.856+0000 7fbf64a00640 1 -- start start 2024-02-19T06:59:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.856+0000 7fbf64a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf440047c0 0x7fbf60152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf64a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf6006e850 0x7fbf60151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf64a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf6006b560 0x7fbf600af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf64a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf60151480 con 0x7fbf440047c0 2024-02-19T06:59:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf64a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf60152b40 con 0x7fbf6006b560 2024-02-19T06:59:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf64a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf601521a0 con 0x7fbf6006e850 2024-02-19T06:59:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf5e800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf440047c0 0x7fbf60152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf5e800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf440047c0 0x7fbf60152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54150/0 (socket says 172.21.15.46:54150) 2024-02-19T06:59:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf5e800640 1 -- 172.21.15.46:0/928460050 learned_addr learned my addr 172.21.15.46:0/928460050 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf5f200640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf6006b560 0x7fbf600af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf55e00640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf6006e850 0x7fbf60151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf5e800640 1 -- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf6006e850 msgr2=0x7fbf60151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf5e800640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf6006e850 0x7fbf60151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf5e800640 1 -- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf6006b560 msgr2=0x7fbf600af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:20.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.857+0000 7fbf5e800640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf6006b560 0x7fbf600af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:20.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.858+0000 7fbf5e800640 1 -- 172.21.15.46:0/928460050 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf60152480 con 0x7fbf440047c0 2024-02-19T06:59:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.858+0000 7fbf5e800640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf440047c0 0x7fbf60152f60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbf50001b70 tx=0x7fbf5000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.858+0000 7fbf57400640 1 -- 172.21.15.46:0/928460050 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50004b60 con 0x7fbf440047c0 2024-02-19T06:59:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.858+0000 7fbf57400640 1 -- 172.21.15.46:0/928460050 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf50004cc0 con 0x7fbf440047c0 2024-02-19T06:59:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.858+0000 7fbf57400640 1 -- 172.21.15.46:0/928460050 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf500072f0 con 0x7fbf440047c0 2024-02-19T06:59:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.858+0000 7fbf64a00640 1 -- 172.21.15.46:0/928460050 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf60152760 con 0x7fbf440047c0 2024-02-19T06:59:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.858+0000 7fbf64a00640 1 -- 172.21.15.46:0/928460050 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf60151d70 con 0x7fbf440047c0 2024-02-19T06:59:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.860+0000 7fbf64a00640 1 -- 172.21.15.46:0/928460050 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf601534a0 con 0x7fbf440047c0 2024-02-19T06:59:20.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.861+0000 7fbf57400640 1 -- 172.21.15.46:0/928460050 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbf50007450 con 0x7fbf440047c0 2024-02-19T06:59:20.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.862+0000 7fbf57400640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbf3c06b840 0x7fbf3c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:20.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.862+0000 7fbf57400640 1 -- 172.21.15.46:0/928460050 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf5008a220 con 0x7fbf440047c0 2024-02-19T06:59:20.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.862+0000 7fbf55e00640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbf3c06b840 0x7fbf3c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:20.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.864+0000 7fbf55e00640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbf3c06b840 0x7fbf3c06dd00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbf48036000 tx=0x7fbf48030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:20.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:20.867+0000 7fbf57400640 1 -- 172.21.15.46:0/928460050 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbf50054ba0 con 0x7fbf440047c0 2024-02-19T06:59:21.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.062+0000 7fbf64a00640 1 -- 172.21.15.46:0/928460050 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf600cb8d0 con 0x7fbf3c06b840 2024-02-19T06:59:21.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.090+0000 7fbf57400640 1 -- 172.21.15.46:0/928460050 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287322 (secure 0 0 0) 0x7fbf48004040 con 0x7fbf3c06b840 2024-02-19T06:59:21.097 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:21.099 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-02-19T06:59:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.097+0000 7fbf64a00640 1 -- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbf3c06b840 msgr2=0x7fbf3c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.097+0000 7fbf64a00640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbf3c06b840 0x7fbf3c06dd00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbf48036000 tx=0x7fbf48030000 comp rx=0 tx=0).stop 2024-02-19T06:59:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.097+0000 7fbf64a00640 1 -- 172.21.15.46:0/928460050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf440047c0 msgr2=0x7fbf60152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.097+0000 7fbf64a00640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf440047c0 0x7fbf60152f60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbf50001b70 tx=0x7fbf5000b4a0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.097+0000 7fbf64a00640 1 -- 172.21.15.46:0/928460050 shutdown_connections 2024-02-19T06:59:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.097+0000 7fbf64a00640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbf3c06b840 0x7fbf3c06dd00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.097+0000 7fbf64a00640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf6006b560 0x7fbf600af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.097+0000 7fbf64a00640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf6006e850 0x7fbf60151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.097+0000 7fbf64a00640 1 --2- 172.21.15.46:0/928460050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf440047c0 0x7fbf60152f60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.097+0000 7fbf64a00640 1 -- 172.21.15.46:0/928460050 >> 172.21.15.46:0/928460050 conn(0x7fbf6006afa0 msgr2=0x7fbf600b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.097+0000 7fbf64a00640 1 -- 172.21.15.46:0/928460050 shutdown_connections 2024-02-19T06:59:21.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.098+0000 7fbf64a00640 1 -- 172.21.15.46:0/928460050 wait complete. 2024-02-19T06:59:21.120 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-02-19T06:59:19.697075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237048,"kb_used_data":4192,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737672,"statfs":{"total":773094113280,"available":772851376128,"internally_reserved":0,"allocated":4292608,"data_stored":2378284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.142232"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.606821+0000","last_change":"2024-02-19T06:59:16.614999+0000","last_active":"2024-02-19T06:59:17.606821+0000","last_peered":"2024-02-19T06:59:17.606821+0000","last_clean":"2024-02-19T06:59:17.606821+0000","last_became_active":"2024-02-19T06:59:16.614731+0000","last_became_peered":"2024-02-19T06:59:16.614731+0000","last_unstale":"2024-02-19T06:59:17.606821+0000","last_undegraded":"2024-02-19T06:59:17.606821+0000","last_fullsized":"2024-02-19T06:59:17.606821+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:30:56.834213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.603314+0000","last_change":"2024-02-19T06:59:16.601056+0000","last_active":"2024-02-19T06:59:16.603314+0000","last_peered":"2024-02-19T06:59:16.603314+0000","last_clean":"2024-02-19T06:59:16.603314+0000","last_became_active":"2024-02-19T06:59:16.600781+0000","last_became_peered":"2024-02-19T06:59:16.600781+0000","last_unstale":"2024-02-19T06:59:16.603314+0000","last_undegraded":"2024-02-19T06:59:16.603314+0000","last_fullsized":"2024-02-19T06:59:16.603314+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:12:37.175897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.605899+0000","last_change":"2024-02-19T06:59:16.622379+0000","last_active":"2024-02-19T06:59:17.605899+0000","last_peered":"2024-02-19T06:59:17.605899+0000","last_clean":"2024-02-19T06:59:17.605899+0000","last_became_active":"2024-02-19T06:59:16.622068+0000","last_became_peered":"2024-02-19T06:59:16.622068+0000","last_unstale":"2024-02-19T06:59:17.605899+0000","last_undegraded":"2024-02-19T06:59:17.605899+0000","last_fullsized":"2024-02-19T06:59:17.605899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:25:52.195320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625842+0000","last_change":"2024-02-19T06:59:16.621784+0000","last_active":"2024-02-19T06:59:16.625842+0000","last_peered":"2024-02-19T06:59:16.625842+0000","last_clean":"2024-02-19T06:59:16.625842+0000","last_became_active":"2024-02-19T06:59:16.621500+0000","last_became_peered":"2024-02-19T06:59:16.621500+0000","last_unstale":"2024-02-19T06:59:16.625842+0000","last_undegraded":"2024-02-19T06:59:16.625842+0000","last_fullsized":"2024-02-19T06:59:16.625842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:56:22.383042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.599896+0000","last_change":"2024-02-19T06:59:16.596543+0000","last_active":"2024-02-19T06:59:16.599896+0000","last_peered":"2024-02-19T06:59:16.599896+0000","last_clean":"2024-02-19T06:59:16.599896+0000","last_became_active":"2024-02-19T06:59:16.595720+0000","last_became_peered":"2024-02-19T06:59:16.595720+0000","last_unstale":"2024-02-19T06:59:16.599896+0000","last_undegraded":"2024-02-19T06:59:16.599896+0000","last_fullsized":"2024-02-19T06:59:16.599896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:23:40.168999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.611034+0000","last_change":"2024-02-19T06:59:16.606730+0000","last_active":"2024-02-19T06:59:16.611034+0000","last_peered":"2024-02-19T06:59:16.611034+0000","last_clean":"2024-02-19T06:59:16.611034+0000","last_became_active":"2024-02-19T06:59:16.606443+0000","last_became_peered":"2024-02-19T06:59:16.606443+0000","last_unstale":"2024-02-19T06:59:16.611034+0000","last_undegraded":"2024-02-19T06:59:16.611034+0000","last_fullsized":"2024-02-19T06:59:16.611034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:00:19.035230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609328+0000","last_change":"2024-02-19T06:59:16.617357+0000","last_active":"2024-02-19T06:59:17.609328+0000","last_peered":"2024-02-19T06:59:17.609328+0000","last_clean":"2024-02-19T06:59:17.609328+0000","last_became_active":"2024-02-19T06:59:16.617042+0000","last_became_peered":"2024-02-19T06:59:16.617042+0000","last_unstale":"2024-02-19T06:59:17.609328+0000","last_undegraded":"2024-02-19T06:59:17.609328+0000","last_fullsized":"2024-02-19T06:59:17.609328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:37:31.320578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609061+0000","last_change":"2024-02-19T06:59:16.613254+0000","last_active":"2024-02-19T06:59:17.609061+0000","last_peered":"2024-02-19T06:59:17.609061+0000","last_clean":"2024-02-19T06:59:17.609061+0000","last_became_active":"2024-02-19T06:59:16.612493+0000","last_became_peered":"2024-02-19T06:59:16.612493+0000","last_unstale":"2024-02-19T06:59:17.609061+0000","last_undegraded":"2024-02-19T06:59:17.609061+0000","last_fullsized":"2024-02-19T06:59:17.609061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:16:35.264556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.626758+0000","last_change":"2024-02-19T06:59:16.623579+0000","last_active":"2024-02-19T06:59:16.626758+0000","last_peered":"2024-02-19T06:59:16.626758+0000","last_clean":"2024-02-19T06:59:16.626758+0000","last_became_active":"2024-02-19T06:59:16.623333+0000","last_became_peered":"2024-02-19T06:59:16.623333+0000","last_unstale":"2024-02-19T06:59:16.626758+0000","last_undegraded":"2024-02-19T06:59:16.626758+0000","last_fullsized":"2024-02-19T06:59:16.626758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:53:33.828896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620304+0000","last_change":"2024-02-19T06:59:16.617560+0000","last_active":"2024-02-19T06:59:16.620304+0000","last_peered":"2024-02-19T06:59:16.620304+0000","last_clean":"2024-02-19T06:59:16.620304+0000","last_became_active":"2024-02-19T06:59:16.617287+0000","last_became_peered":"2024-02-19T06:59:16.617287+0000","last_unstale":"2024-02-19T06:59:16.620304+0000","last_undegraded":"2024-02-19T06:59:16.620304+0000","last_fullsized":"2024-02-19T06:59:16.620304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:46:45.507501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609965+0000","last_change":"2024-02-19T06:59:16.622853+0000","last_active":"2024-02-19T06:59:17.609965+0000","last_peered":"2024-02-19T06:59:17.609965+0000","last_clean":"2024-02-19T06:59:17.609965+0000","last_became_active":"2024-02-19T06:59:16.622188+0000","last_became_peered":"2024-02-19T06:59:16.622188+0000","last_unstale":"2024-02-19T06:59:17.609965+0000","last_undegraded":"2024-02-19T06:59:17.609965+0000","last_fullsized":"2024-02-19T06:59:17.609965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:17:58.395014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.608501+0000","last_change":"2024-02-19T06:59:16.602254+0000","last_active":"2024-02-19T06:59:17.608501+0000","last_peered":"2024-02-19T06:59:17.608501+0000","last_clean":"2024-02-19T06:59:17.608501+0000","last_became_active":"2024-02-19T06:59:16.598694+0000","last_became_peered":"2024-02-19T06:59:16.598694+0000","last_unstale":"2024-02-19T06:59:17.608501+0000","last_undegraded":"2024-02-19T06:59:17.608501+0000","last_fullsized":"2024-02-19T06:59:17.608501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:58:17.749755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625143+0000","last_change":"2024-02-19T06:59:16.623393+0000","last_active":"2024-02-19T06:59:16.625143+0000","last_peered":"2024-02-19T06:59:16.625143+0000","last_clean":"2024-02-19T06:59:16.625143+0000","last_became_active":"2024-02-19T06:59:16.623054+0000","last_became_peered":"2024-02-19T06:59:16.623054+0000","last_unstale":"2024-02-19T06:59:16.625143+0000","last_undegraded":"2024-02-19T06:59:16.625143+0000","last_fullsized":"2024-02-19T06:59:16.625143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:36:03.829212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.604559+0000","last_change":"2024-02-19T06:59:16.597854+0000","last_active":"2024-02-19T06:59:16.604559+0000","last_peered":"2024-02-19T06:59:16.604559+0000","last_clean":"2024-02-19T06:59:16.604559+0000","last_became_active":"2024-02-19T06:59:16.597525+0000","last_became_peered":"2024-02-19T06:59:16.597525+0000","last_unstale":"2024-02-19T06:59:16.604559+0000","last_undegraded":"2024-02-19T06:59:16.604559+0000","last_fullsized":"2024-02-19T06:59:16.604559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:54:18.881973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.606441+0000","last_change":"2024-02-19T06:59:16.607039+0000","last_active":"2024-02-19T06:59:17.606441+0000","last_peered":"2024-02-19T06:59:17.606441+0000","last_clean":"2024-02-19T06:59:17.606441+0000","last_became_active":"2024-02-19T06:59:16.606750+0000","last_became_peered":"2024-02-19T06:59:16.606750+0000","last_unstale":"2024-02-19T06:59:17.606441+0000","last_undegraded":"2024-02-19T06:59:17.606441+0000","last_fullsized":"2024-02-19T06:59:17.606441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:25:43.377284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609862+0000","last_change":"2024-02-19T06:59:16.614422+0000","last_active":"2024-02-19T06:59:17.609862+0000","last_peered":"2024-02-19T06:59:17.609862+0000","last_clean":"2024-02-19T06:59:17.609862+0000","last_became_active":"2024-02-19T06:59:16.614116+0000","last_became_peered":"2024-02-19T06:59:16.614116+0000","last_unstale":"2024-02-19T06:59:17.609862+0000","last_undegraded":"2024-02-19T06:59:17.609862+0000","last_fullsized":"2024-02-19T06:59:17.609862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:51:24.960932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.610838+0000","last_change":"2024-02-19T06:59:16.618366+0000","last_active":"2024-02-19T06:59:17.610838+0000","last_peered":"2024-02-19T06:59:17.610838+0000","last_clean":"2024-02-19T06:59:17.610838+0000","last_became_active":"2024-02-19T06:59:16.618049+0000","last_became_peered":"2024-02-19T06:59:16.618049+0000","last_unstale":"2024-02-19T06:59:17.610838+0000","last_undegraded":"2024-02-19T06:59:17.610838+0000","last_fullsized":"2024-02-19T06:59:17.610838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:58:25.612872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.626584+0000","last_change":"2024-02-19T06:59:16.624908+0000","last_active":"2024-02-19T06:59:16.626584+0000","last_peered":"2024-02-19T06:59:16.626584+0000","last_clean":"2024-02-19T06:59:16.626584+0000","last_became_active":"2024-02-19T06:59:16.624608+0000","last_became_peered":"2024-02-19T06:59:16.624608+0000","last_unstale":"2024-02-19T06:59:16.626584+0000","last_undegraded":"2024-02-19T06:59:16.626584+0000","last_fullsized":"2024-02-19T06:59:16.626584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:25:52.195320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.617313+0000","last_change":"2024-02-19T06:59:16.616083+0000","last_active":"2024-02-19T06:59:16.617313+0000","last_peered":"2024-02-19T06:59:16.617313+0000","last_clean":"2024-02-19T06:59:16.617313+0000","last_became_active":"2024-02-19T06:59:16.615784+0000","last_became_peered":"2024-02-19T06:59:16.615784+0000","last_unstale":"2024-02-19T06:59:16.617313+0000","last_undegraded":"2024-02-19T06:59:16.617313+0000","last_fullsized":"2024-02-19T06:59:16.617313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:30:44.271078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.611617+0000","last_change":"2024-02-19T06:59:16.605909+0000","last_active":"2024-02-19T06:59:16.611617+0000","last_peered":"2024-02-19T06:59:16.611617+0000","last_clean":"2024-02-19T06:59:16.611617+0000","last_became_active":"2024-02-19T06:59:16.605491+0000","last_became_peered":"2024-02-19T06:59:16.605491+0000","last_unstale":"2024-02-19T06:59:16.611617+0000","last_undegraded":"2024-02-19T06:59:16.611617+0000","last_fullsized":"2024-02-19T06:59:16.611617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:08:21.294315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620749+0000","last_change":"2024-02-19T06:59:16.611079+0000","last_active":"2024-02-19T06:59:16.620749+0000","last_peered":"2024-02-19T06:59:16.620749+0000","last_clean":"2024-02-19T06:59:16.620749+0000","last_became_active":"2024-02-19T06:59:16.607487+0000","last_became_peered":"2024-02-19T06:59:16.607487+0000","last_unstale":"2024-02-19T06:59:16.620749+0000","last_undegraded":"2024-02-19T06:59:16.620749+0000","last_fullsized":"2024-02-19T06:59:16.620749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:13:59.938298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.621224+0000","last_change":"2024-02-19T06:59:16.612527+0000","last_active":"2024-02-19T06:59:16.621224+0000","last_peered":"2024-02-19T06:59:16.621224+0000","last_clean":"2024-02-19T06:59:16.621224+0000","last_became_active":"2024-02-19T06:59:16.612142+0000","last_became_peered":"2024-02-19T06:59:16.612142+0000","last_unstale":"2024-02-19T06:59:16.621224+0000","last_undegraded":"2024-02-19T06:59:16.621224+0000","last_fullsized":"2024-02-19T06:59:16.621224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:14:51.554854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.610845+0000","last_change":"2024-02-19T06:59:16.607562+0000","last_active":"2024-02-19T06:59:16.610845+0000","last_peered":"2024-02-19T06:59:16.610845+0000","last_clean":"2024-02-19T06:59:16.610845+0000","last_became_active":"2024-02-19T06:59:16.607294+0000","last_became_peered":"2024-02-19T06:59:16.607294+0000","last_unstale":"2024-02-19T06:59:16.610845+0000","last_undegraded":"2024-02-19T06:59:16.610845+0000","last_fullsized":"2024-02-19T06:59:16.610845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:59:56.563183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.605572+0000","last_change":"2024-02-19T06:59:16.600282+0000","last_active":"2024-02-19T06:59:17.605572+0000","last_peered":"2024-02-19T06:59:17.605572+0000","last_clean":"2024-02-19T06:59:17.605572+0000","last_became_active":"2024-02-19T06:59:16.599991+0000","last_became_peered":"2024-02-19T06:59:16.599991+0000","last_unstale":"2024-02-19T06:59:17.605572+0000","last_undegraded":"2024-02-19T06:59:17.605572+0000","last_fullsized":"2024-02-19T06:59:17.605572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:39:20.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.622018+0000","last_change":"2024-02-19T06:59:16.620388+0000","last_active":"2024-02-19T06:59:16.622018+0000","last_peered":"2024-02-19T06:59:16.622018+0000","last_clean":"2024-02-19T06:59:16.622018+0000","last_became_active":"2024-02-19T06:59:16.620064+0000","last_became_peered":"2024-02-19T06:59:16.620064+0000","last_unstale":"2024-02-19T06:59:16.622018+0000","last_undegraded":"2024-02-19T06:59:16.622018+0000","last_fullsized":"2024-02-19T06:59:16.622018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:32:57.707149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.612950+0000","last_change":"2024-02-19T06:59:16.609694+0000","last_active":"2024-02-19T06:59:16.612950+0000","last_peered":"2024-02-19T06:59:16.612950+0000","last_clean":"2024-02-19T06:59:16.612950+0000","last_became_active":"2024-02-19T06:59:16.607605+0000","last_became_peered":"2024-02-19T06:59:16.607605+0000","last_unstale":"2024-02-19T06:59:16.612950+0000","last_undegraded":"2024-02-19T06:59:16.612950+0000","last_fullsized":"2024-02-19T06:59:16.612950+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:10:34.530720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.627138+0000","last_change":"2024-02-19T06:59:16.623177+0000","last_active":"2024-02-19T06:59:16.627138+0000","last_peered":"2024-02-19T06:59:16.627138+0000","last_clean":"2024-02-19T06:59:16.627138+0000","last_became_active":"2024-02-19T06:59:16.622456+0000","last_became_peered":"2024-02-19T06:59:16.622456+0000","last_unstale":"2024-02-19T06:59:16.627138+0000","last_undegraded":"2024-02-19T06:59:16.627138+0000","last_fullsized":"2024-02-19T06:59:16.627138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:50:07.482949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.608614+0000","last_change":"2024-02-19T06:59:16.596710+0000","last_active":"2024-02-19T06:59:17.608614+0000","last_peered":"2024-02-19T06:59:17.608614+0000","last_clean":"2024-02-19T06:59:17.608614+0000","last_became_active":"2024-02-19T06:59:16.596248+0000","last_became_peered":"2024-02-19T06:59:16.596248+0000","last_unstale":"2024-02-19T06:59:17.608614+0000","last_undegraded":"2024-02-19T06:59:17.608614+0000","last_fullsized":"2024-02-19T06:59:17.608614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:25:08.895201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620727+0000","last_change":"2024-02-19T06:59:16.610005+0000","last_active":"2024-02-19T06:59:16.620727+0000","last_peered":"2024-02-19T06:59:16.620727+0000","last_clean":"2024-02-19T06:59:16.620727+0000","last_became_active":"2024-02-19T06:59:16.607044+0000","last_became_peered":"2024-02-19T06:59:16.607044+0000","last_unstale":"2024-02-19T06:59:16.620727+0000","last_undegraded":"2024-02-19T06:59:16.620727+0000","last_fullsized":"2024-02-19T06:59:16.620727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:13:17.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609636+0000","last_change":"2024-02-19T06:59:16.618442+0000","last_active":"2024-02-19T06:59:17.609636+0000","last_peered":"2024-02-19T06:59:17.609636+0000","last_clean":"2024-02-19T06:59:17.609636+0000","last_became_active":"2024-02-19T06:59:16.618153+0000","last_became_peered":"2024-02-19T06:59:16.618153+0000","last_unstale":"2024-02-19T06:59:17.609636+0000","last_undegraded":"2024-02-19T06:59:17.609636+0000","last_fullsized":"2024-02-19T06:59:17.609636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:14:19.596111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607525+0000","last_change":"2024-02-19T06:59:16.621417+0000","last_active":"2024-02-19T06:59:17.607525+0000","last_peered":"2024-02-19T06:59:17.607525+0000","last_clean":"2024-02-19T06:59:17.607525+0000","last_became_active":"2024-02-19T06:59:16.620816+0000","last_became_peered":"2024-02-19T06:59:16.620816+0000","last_unstale":"2024-02-19T06:59:17.607525+0000","last_undegraded":"2024-02-19T06:59:17.607525+0000","last_fullsized":"2024-02-19T06:59:17.607525+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:36:17.261654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609075+0000","last_change":"2024-02-19T06:59:16.621869+0000","last_active":"2024-02-19T06:59:17.609075+0000","last_peered":"2024-02-19T06:59:17.609075+0000","last_clean":"2024-02-19T06:59:17.609075+0000","last_became_active":"2024-02-19T06:59:16.621249+0000","last_became_peered":"2024-02-19T06:59:16.621249+0000","last_unstale":"2024-02-19T06:59:17.609075+0000","last_undegraded":"2024-02-19T06:59:17.609075+0000","last_fullsized":"2024-02-19T06:59:17.609075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:01:19.447375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.614387+0000","last_change":"2024-02-19T06:59:16.613240+0000","last_active":"2024-02-19T06:59:16.614387+0000","last_peered":"2024-02-19T06:59:16.614387+0000","last_clean":"2024-02-19T06:59:16.614387+0000","last_became_active":"2024-02-19T06:59:16.612724+0000","last_became_peered":"2024-02-19T06:59:16.612724+0000","last_unstale":"2024-02-19T06:59:16.614387+0000","last_undegraded":"2024-02-19T06:59:16.614387+0000","last_fullsized":"2024-02-19T06:59:16.614387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:41:10.862856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607719+0000","last_change":"2024-02-19T06:59:15.606353+0000","last_active":"2024-02-19T06:59:17.607719+0000","last_peered":"2024-02-19T06:59:17.607719+0000","last_clean":"2024-02-19T06:59:17.607719+0000","last_became_active":"2024-02-19T06:59:15.606022+0000","last_became_peered":"2024-02-19T06:59:15.606022+0000","last_unstale":"2024-02-19T06:59:17.607719+0000","last_undegraded":"2024-02-19T06:59:17.607719+0000","last_fullsized":"2024-02-19T06:59:17.607719+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:22:28.887251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607527+0000","last_change":"2024-02-19T06:59:16.622546+0000","last_active":"2024-02-19T06:59:17.607527+0000","last_peered":"2024-02-19T06:59:17.607527+0000","last_clean":"2024-02-19T06:59:17.607527+0000","last_became_active":"2024-02-19T06:59:16.622254+0000","last_became_peered":"2024-02-19T06:59:16.622254+0000","last_unstale":"2024-02-19T06:59:17.607527+0000","last_undegraded":"2024-02-19T06:59:17.607527+0000","last_fullsized":"2024-02-19T06:59:17.607527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:56:22.383042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.612977+0000","last_change":"2024-02-19T06:59:15.602275+0000","last_active":"2024-02-19T06:59:16.612977+0000","last_peered":"2024-02-19T06:59:16.612977+0000","last_clean":"2024-02-19T06:59:16.612977+0000","last_became_active":"2024-02-19T06:59:15.601958+0000","last_became_peered":"2024-02-19T06:59:15.601958+0000","last_unstale":"2024-02-19T06:59:16.612977+0000","last_undegraded":"2024-02-19T06:59:16.612977+0000","last_fullsized":"2024-02-19T06:59:16.612977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:13:16.565181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620310+0000","last_change":"2024-02-19T06:59:16.606982+0000","last_active":"2024-02-19T06:59:16.620310+0000","last_peered":"2024-02-19T06:59:16.620310+0000","last_clean":"2024-02-19T06:59:16.620310+0000","last_became_active":"2024-02-19T06:59:16.606714+0000","last_became_peered":"2024-02-19T06:59:16.606714+0000","last_unstale":"2024-02-19T06:59:16.620310+0000","last_undegraded":"2024-02-19T06:59:16.620310+0000","last_fullsized":"2024-02-19T06:59:16.620310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:44:46.593095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.612829+0000","last_change":"2024-02-19T06:59:15.598949+0000","last_active":"2024-02-19T06:59:16.612829+0000","last_peered":"2024-02-19T06:59:16.612829+0000","last_clean":"2024-02-19T06:59:16.612829+0000","last_became_active":"2024-02-19T06:59:15.598584+0000","last_became_peered":"2024-02-19T06:59:15.598584+0000","last_unstale":"2024-02-19T06:59:16.612829+0000","last_undegraded":"2024-02-19T06:59:16.612829+0000","last_fullsized":"2024-02-19T06:59:16.612829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:27:51.204367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.627159+0000","last_change":"2024-02-19T06:59:16.623420+0000","last_active":"2024-02-19T06:59:16.627159+0000","last_peered":"2024-02-19T06:59:16.627159+0000","last_clean":"2024-02-19T06:59:16.627159+0000","last_became_active":"2024-02-19T06:59:16.622789+0000","last_became_peered":"2024-02-19T06:59:16.622789+0000","last_unstale":"2024-02-19T06:59:16.627159+0000","last_undegraded":"2024-02-19T06:59:16.627159+0000","last_fullsized":"2024-02-19T06:59:16.627159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:27:52.219701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.623733+0000","last_change":"2024-02-19T06:59:15.607083+0000","last_active":"2024-02-19T06:59:16.623733+0000","last_peered":"2024-02-19T06:59:16.623733+0000","last_clean":"2024-02-19T06:59:16.623733+0000","last_became_active":"2024-02-19T06:59:15.606783+0000","last_became_peered":"2024-02-19T06:59:15.606783+0000","last_unstale":"2024-02-19T06:59:16.623733+0000","last_undegraded":"2024-02-19T06:59:16.623733+0000","last_fullsized":"2024-02-19T06:59:16.623733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:43:05.744006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.610034+0000","last_change":"2024-02-19T06:59:16.610423+0000","last_active":"2024-02-19T06:59:17.610034+0000","last_peered":"2024-02-19T06:59:17.610034+0000","last_clean":"2024-02-19T06:59:17.610034+0000","last_became_active":"2024-02-19T06:59:16.609925+0000","last_became_peered":"2024-02-19T06:59:16.609925+0000","last_unstale":"2024-02-19T06:59:17.610034+0000","last_undegraded":"2024-02-19T06:59:17.610034+0000","last_fullsized":"2024-02-19T06:59:17.610034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:19:56.263930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.613034+0000","last_change":"2024-02-19T06:59:15.598136+0000","last_active":"2024-02-19T06:59:16.613034+0000","last_peered":"2024-02-19T06:59:16.613034+0000","last_clean":"2024-02-19T06:59:16.613034+0000","last_became_active":"2024-02-19T06:59:15.597728+0000","last_became_peered":"2024-02-19T06:59:15.597728+0000","last_unstale":"2024-02-19T06:59:16.613034+0000","last_undegraded":"2024-02-19T06:59:16.613034+0000","last_fullsized":"2024-02-19T06:59:16.613034+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:09:36.350656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609025+0000","last_change":"2024-02-19T06:59:16.603386+0000","last_active":"2024-02-19T06:59:17.609025+0000","last_peered":"2024-02-19T06:59:17.609025+0000","last_clean":"2024-02-19T06:59:17.609025+0000","last_became_active":"2024-02-19T06:59:16.601504+0000","last_became_peered":"2024-02-19T06:59:16.601504+0000","last_unstale":"2024-02-19T06:59:17.609025+0000","last_undegraded":"2024-02-19T06:59:17.609025+0000","last_fullsized":"2024-02-19T06:59:17.609025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:14:48.011270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.611999+0000","last_change":"2024-02-19T06:59:15.598129+0000","last_active":"2024-02-19T06:59:16.611999+0000","last_peered":"2024-02-19T06:59:16.611999+0000","last_clean":"2024-02-19T06:59:16.611999+0000","last_became_active":"2024-02-19T06:59:15.597702+0000","last_became_peered":"2024-02-19T06:59:15.597702+0000","last_unstale":"2024-02-19T06:59:16.611999+0000","last_undegraded":"2024-02-19T06:59:16.611999+0000","last_fullsized":"2024-02-19T06:59:16.611999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:36:02.813878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.623202+0000","last_change":"2024-02-19T06:59:16.619194+0000","last_active":"2024-02-19T06:59:16.623202+0000","last_peered":"2024-02-19T06:59:16.623202+0000","last_clean":"2024-02-19T06:59:16.623202+0000","last_became_active":"2024-02-19T06:59:16.618840+0000","last_became_peered":"2024-02-19T06:59:16.618840+0000","last_unstale":"2024-02-19T06:59:16.623202+0000","last_undegraded":"2024-02-19T06:59:16.623202+0000","last_fullsized":"2024-02-19T06:59:16.623202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:41:10.862856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.588098+0000","last_change":"2024-02-19T06:59:15.601383+0000","last_active":"2024-02-19T06:59:16.588098+0000","last_peered":"2024-02-19T06:59:16.588098+0000","last_clean":"2024-02-19T06:59:16.588098+0000","last_became_active":"2024-02-19T06:59:15.599495+0000","last_became_peered":"2024-02-19T06:59:15.599495+0000","last_unstale":"2024-02-19T06:59:16.588098+0000","last_undegraded":"2024-02-19T06:59:16.588098+0000","last_fullsized":"2024-02-19T06:59:16.588098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:56:21.367708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620482+0000","last_change":"2024-02-19T06:59:16.618242+0000","last_active":"2024-02-19T06:59:16.620482+0000","last_peered":"2024-02-19T06:59:16.620482+0000","last_clean":"2024-02-19T06:59:16.620482+0000","last_became_active":"2024-02-19T06:59:16.617961+0000","last_became_peered":"2024-02-19T06:59:16.617961+0000","last_unstale":"2024-02-19T06:59:16.620482+0000","last_undegraded":"2024-02-19T06:59:16.620482+0000","last_fullsized":"2024-02-19T06:59:16.620482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:35:23.862031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.595899+0000","last_change":"2024-02-19T06:59:15.603506+0000","last_active":"2024-02-19T06:59:16.595899+0000","last_peered":"2024-02-19T06:59:16.595899+0000","last_clean":"2024-02-19T06:59:16.595899+0000","last_became_active":"2024-02-19T06:59:15.602450+0000","last_became_peered":"2024-02-19T06:59:15.602450+0000","last_unstale":"2024-02-19T06:59:16.595899+0000","last_undegraded":"2024-02-19T06:59:16.595899+0000","last_fullsized":"2024-02-19T06:59:16.595899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:50:32.187320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607271+0000","last_change":"2024-02-19T06:59:16.599055+0000","last_active":"2024-02-19T06:59:17.607271+0000","last_peered":"2024-02-19T06:59:17.607271+0000","last_clean":"2024-02-19T06:59:17.607271+0000","last_became_active":"2024-02-19T06:59:16.598653+0000","last_became_peered":"2024-02-19T06:59:16.598653+0000","last_unstale":"2024-02-19T06:59:17.607271+0000","last_undegraded":"2024-02-19T06:59:17.607271+0000","last_fullsized":"2024-02-19T06:59:17.607271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:51:35.337383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.590890+0000","last_change":"2024-02-19T06:59:15.606346+0000","last_active":"2024-02-19T06:59:16.590890+0000","last_peered":"2024-02-19T06:59:16.590890+0000","last_clean":"2024-02-19T06:59:16.590890+0000","last_became_active":"2024-02-19T06:59:15.605932+0000","last_became_peered":"2024-02-19T06:59:15.605932+0000","last_unstale":"2024-02-19T06:59:16.590890+0000","last_undegraded":"2024-02-19T06:59:16.590890+0000","last_fullsized":"2024-02-19T06:59:16.590890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:28:46.999389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625393+0000","last_change":"2024-02-19T06:59:16.622636+0000","last_active":"2024-02-19T06:59:16.625393+0000","last_peered":"2024-02-19T06:59:16.625393+0000","last_clean":"2024-02-19T06:59:16.625393+0000","last_became_active":"2024-02-19T06:59:16.622347+0000","last_became_peered":"2024-02-19T06:59:16.622347+0000","last_unstale":"2024-02-19T06:59:16.625393+0000","last_undegraded":"2024-02-19T06:59:16.625393+0000","last_fullsized":"2024-02-19T06:59:16.625393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:28:51.433258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.582317+0000","last_change":"2024-02-19T06:59:15.599246+0000","last_active":"2024-02-19T06:59:16.582317+0000","last_peered":"2024-02-19T06:59:16.582317+0000","last_clean":"2024-02-19T06:59:16.582317+0000","last_became_active":"2024-02-19T06:59:15.598953+0000","last_became_peered":"2024-02-19T06:59:15.598953+0000","last_unstale":"2024-02-19T06:59:16.582317+0000","last_undegraded":"2024-02-19T06:59:16.582317+0000","last_fullsized":"2024-02-19T06:59:16.582317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:13:58.922965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.616758+0000","last_change":"2024-02-19T06:59:16.614417+0000","last_active":"2024-02-19T06:59:16.616758+0000","last_peered":"2024-02-19T06:59:16.616758+0000","last_clean":"2024-02-19T06:59:16.616758+0000","last_became_active":"2024-02-19T06:59:16.614109+0000","last_became_peered":"2024-02-19T06:59:16.614109+0000","last_unstale":"2024-02-19T06:59:16.616758+0000","last_undegraded":"2024-02-19T06:59:16.616758+0000","last_fullsized":"2024-02-19T06:59:16.616758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:47:23.431021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.606164+0000","last_change":"2024-02-19T06:59:15.603090+0000","last_active":"2024-02-19T06:59:17.606164+0000","last_peered":"2024-02-19T06:59:17.606164+0000","last_clean":"2024-02-19T06:59:17.606164+0000","last_became_active":"2024-02-19T06:59:15.602796+0000","last_became_peered":"2024-02-19T06:59:15.602796+0000","last_unstale":"2024-02-19T06:59:17.606164+0000","last_undegraded":"2024-02-19T06:59:17.606164+0000","last_fullsized":"2024-02-19T06:59:17.606164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:56:21.367708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.605524+0000","last_change":"2024-02-19T06:59:16.616689+0000","last_active":"2024-02-19T06:59:17.605524+0000","last_peered":"2024-02-19T06:59:17.605524+0000","last_clean":"2024-02-19T06:59:17.605524+0000","last_became_active":"2024-02-19T06:59:16.616025+0000","last_became_peered":"2024-02-19T06:59:16.616025+0000","last_unstale":"2024-02-19T06:59:17.605524+0000","last_undegraded":"2024-02-19T06:59:17.605524+0000","last_fullsized":"2024-02-19T06:59:17.605524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:28:51.433258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.629632+0000","last_change":"2024-02-19T06:59:15.599041+0000","last_active":"2024-02-19T06:59:16.629632+0000","last_peered":"2024-02-19T06:59:16.629632+0000","last_clean":"2024-02-19T06:59:16.629632+0000","last_became_active":"2024-02-19T06:59:15.598762+0000","last_became_peered":"2024-02-19T06:59:15.598762+0000","last_unstale":"2024-02-19T06:59:16.629632+0000","last_undegraded":"2024-02-19T06:59:16.629632+0000","last_fullsized":"2024-02-19T06:59:16.629632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:50:06.467616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625091+0000","last_change":"2024-02-19T06:59:16.619233+0000","last_active":"2024-02-19T06:59:16.625091+0000","last_peered":"2024-02-19T06:59:16.625091+0000","last_clean":"2024-02-19T06:59:16.625091+0000","last_became_active":"2024-02-19T06:59:16.618898+0000","last_became_peered":"2024-02-19T06:59:16.618898+0000","last_unstale":"2024-02-19T06:59:16.625091+0000","last_undegraded":"2024-02-19T06:59:16.625091+0000","last_fullsized":"2024-02-19T06:59:16.625091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:30:56.834213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.618881+0000","last_change":"2024-02-19T06:59:15.601998+0000","last_active":"2024-02-19T06:59:16.618881+0000","last_peered":"2024-02-19T06:59:16.618881+0000","last_clean":"2024-02-19T06:59:16.618881+0000","last_became_active":"2024-02-19T06:59:15.601256+0000","last_became_peered":"2024-02-19T06:59:15.601256+0000","last_unstale":"2024-02-19T06:59:16.618881+0000","last_undegraded":"2024-02-19T06:59:16.618881+0000","last_fullsized":"2024-02-19T06:59:16.618881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:24:35.836971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.603295+0000","last_change":"2024-02-19T06:59:16.601182+0000","last_active":"2024-02-19T06:59:16.603295+0000","last_peered":"2024-02-19T06:59:16.603295+0000","last_clean":"2024-02-19T06:59:16.603295+0000","last_became_active":"2024-02-19T06:59:16.600828+0000","last_became_peered":"2024-02-19T06:59:16.600828+0000","last_unstale":"2024-02-19T06:59:16.603295+0000","last_undegraded":"2024-02-19T06:59:16.603295+0000","last_fullsized":"2024-02-19T06:59:16.603295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:02:31.479591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.603726+0000","last_change":"2024-02-19T06:59:15.597482+0000","last_active":"2024-02-19T06:59:16.603726+0000","last_peered":"2024-02-19T06:59:16.603726+0000","last_clean":"2024-02-19T06:59:16.603726+0000","last_became_active":"2024-02-19T06:59:15.597208+0000","last_became_peered":"2024-02-19T06:59:15.597208+0000","last_unstale":"2024-02-19T06:59:16.603726+0000","last_undegraded":"2024-02-19T06:59:16.603726+0000","last_fullsized":"2024-02-19T06:59:16.603726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:22:28.887251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.610523+0000","last_change":"2024-02-19T06:59:16.620106+0000","last_active":"2024-02-19T06:59:17.610523+0000","last_peered":"2024-02-19T06:59:17.610523+0000","last_clean":"2024-02-19T06:59:17.610523+0000","last_became_active":"2024-02-19T06:59:16.619823+0000","last_became_peered":"2024-02-19T06:59:16.619823+0000","last_unstale":"2024-02-19T06:59:17.610523+0000","last_undegraded":"2024-02-19T06:59:17.610523+0000","last_fullsized":"2024-02-19T06:59:17.610523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:14:46.597153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.588090+0000","last_change":"2024-02-19T06:59:15.606247+0000","last_active":"2024-02-19T06:59:16.588090+0000","last_peered":"2024-02-19T06:59:16.588090+0000","last_clean":"2024-02-19T06:59:16.588090+0000","last_became_active":"2024-02-19T06:59:15.605298+0000","last_became_peered":"2024-02-19T06:59:15.605298+0000","last_unstale":"2024-02-19T06:59:16.588090+0000","last_undegraded":"2024-02-19T06:59:16.588090+0000","last_fullsized":"2024-02-19T06:59:16.588090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:36:16.246321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607933+0000","last_change":"2024-02-19T06:59:16.624173+0000","last_active":"2024-02-19T06:59:17.607933+0000","last_peered":"2024-02-19T06:59:17.607933+0000","last_clean":"2024-02-19T06:59:17.607933+0000","last_became_active":"2024-02-19T06:59:16.623925+0000","last_became_peered":"2024-02-19T06:59:16.623925+0000","last_unstale":"2024-02-19T06:59:17.607933+0000","last_undegraded":"2024-02-19T06:59:17.607933+0000","last_fullsized":"2024-02-19T06:59:17.607933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:50:07.482949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625906+0000","last_change":"2024-02-19T06:59:15.601689+0000","last_active":"2024-02-19T06:59:16.625906+0000","last_peered":"2024-02-19T06:59:16.625906+0000","last_clean":"2024-02-19T06:59:16.625906+0000","last_became_active":"2024-02-19T06:59:15.598200+0000","last_became_peered":"2024-02-19T06:59:15.598200+0000","last_unstale":"2024-02-19T06:59:16.625906+0000","last_undegraded":"2024-02-19T06:59:16.625906+0000","last_fullsized":"2024-02-19T06:59:16.625906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:30:55.818879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.621211+0000","last_change":"2024-02-19T06:59:16.613946+0000","last_active":"2024-02-19T06:59:16.621211+0000","last_peered":"2024-02-19T06:59:16.621211+0000","last_clean":"2024-02-19T06:59:16.621211+0000","last_became_active":"2024-02-19T06:59:16.613633+0000","last_became_peered":"2024-02-19T06:59:16.613633+0000","last_unstale":"2024-02-19T06:59:16.621211+0000","last_undegraded":"2024-02-19T06:59:16.621211+0000","last_fullsized":"2024-02-19T06:59:16.621211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:48:21.918964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620628+0000","last_change":"2024-02-19T06:59:15.606281+0000","last_active":"2024-02-19T06:59:16.620628+0000","last_peered":"2024-02-19T06:59:16.620628+0000","last_clean":"2024-02-19T06:59:16.620628+0000","last_became_active":"2024-02-19T06:59:15.604575+0000","last_became_peered":"2024-02-19T06:59:15.604575+0000","last_unstale":"2024-02-19T06:59:16.620628+0000","last_undegraded":"2024-02-19T06:59:16.620628+0000","last_fullsized":"2024-02-19T06:59:16.620628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:15:17.813037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.608278+0000","last_change":"2024-02-19T06:59:16.608948+0000","last_active":"2024-02-19T06:59:17.608278+0000","last_peered":"2024-02-19T06:59:17.608278+0000","last_clean":"2024-02-19T06:59:17.608278+0000","last_became_active":"2024-02-19T06:59:16.605425+0000","last_became_peered":"2024-02-19T06:59:16.605425+0000","last_unstale":"2024-02-19T06:59:17.608278+0000","last_undegraded":"2024-02-19T06:59:17.608278+0000","last_fullsized":"2024-02-19T06:59:17.608278+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:00:00.956581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.618591+0000","last_change":"2024-02-19T06:59:15.600438+0000","last_active":"2024-02-19T06:59:16.618591+0000","last_peered":"2024-02-19T06:59:16.618591+0000","last_clean":"2024-02-19T06:59:16.618591+0000","last_became_active":"2024-02-19T06:59:15.600111+0000","last_became_peered":"2024-02-19T06:59:15.600111+0000","last_unstale":"2024-02-19T06:59:16.618591+0000","last_undegraded":"2024-02-19T06:59:16.618591+0000","last_fullsized":"2024-02-19T06:59:16.618591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:39:41.756163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625820+0000","last_change":"2024-02-19T06:59:16.621041+0000","last_active":"2024-02-19T06:59:16.625820+0000","last_peered":"2024-02-19T06:59:16.625820+0000","last_clean":"2024-02-19T06:59:16.625820+0000","last_became_active":"2024-02-19T06:59:16.620735+0000","last_became_peered":"2024-02-19T06:59:16.620735+0000","last_unstale":"2024-02-19T06:59:16.625820+0000","last_undegraded":"2024-02-19T06:59:16.625820+0000","last_fullsized":"2024-02-19T06:59:16.625820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:36:17.261654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.613096+0000","last_change":"2024-02-19T06:59:15.598102+0000","last_active":"2024-02-19T06:59:16.613096+0000","last_peered":"2024-02-19T06:59:16.613096+0000","last_clean":"2024-02-19T06:59:16.613096+0000","last_became_active":"2024-02-19T06:59:15.597222+0000","last_became_peered":"2024-02-19T06:59:15.597222+0000","last_unstale":"2024-02-19T06:59:16.613096+0000","last_undegraded":"2024-02-19T06:59:16.613096+0000","last_fullsized":"2024-02-19T06:59:16.613096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:55:34.434160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.611936+0000","last_change":"2024-02-19T06:59:16.606768+0000","last_active":"2024-02-19T06:59:16.611936+0000","last_peered":"2024-02-19T06:59:16.611936+0000","last_clean":"2024-02-19T06:59:16.611936+0000","last_became_active":"2024-02-19T06:59:16.606446+0000","last_became_peered":"2024-02-19T06:59:16.606446+0000","last_unstale":"2024-02-19T06:59:16.611936+0000","last_undegraded":"2024-02-19T06:59:16.611936+0000","last_fullsized":"2024-02-19T06:59:16.611936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:50:33.202653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.598067+0000","last_change":"2024-02-19T06:59:15.595828+0000","last_active":"2024-02-19T06:59:16.598067+0000","last_peered":"2024-02-19T06:59:16.598067+0000","last_clean":"2024-02-19T06:59:16.598067+0000","last_became_active":"2024-02-19T06:59:15.595494+0000","last_became_peered":"2024-02-19T06:59:15.595494+0000","last_unstale":"2024-02-19T06:59:16.598067+0000","last_undegraded":"2024-02-19T06:59:16.598067+0000","last_fullsized":"2024-02-19T06:59:16.598067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:04:51.206145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.611699+0000","last_change":"2024-02-19T06:59:16.605845+0000","last_active":"2024-02-19T06:59:16.611699+0000","last_peered":"2024-02-19T06:59:16.611699+0000","last_clean":"2024-02-19T06:59:16.611699+0000","last_became_active":"2024-02-19T06:59:16.605096+0000","last_became_peered":"2024-02-19T06:59:16.605096+0000","last_unstale":"2024-02-19T06:59:16.611699+0000","last_undegraded":"2024-02-19T06:59:16.611699+0000","last_fullsized":"2024-02-19T06:59:16.611699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:23:43.437725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.623119+0000","last_change":"2024-02-19T06:59:15.600437+0000","last_active":"2024-02-19T06:59:16.623119+0000","last_peered":"2024-02-19T06:59:16.623119+0000","last_clean":"2024-02-19T06:59:16.623119+0000","last_became_active":"2024-02-19T06:59:15.600133+0000","last_became_peered":"2024-02-19T06:59:15.600133+0000","last_unstale":"2024-02-19T06:59:16.623119+0000","last_undegraded":"2024-02-19T06:59:16.623119+0000","last_fullsized":"2024-02-19T06:59:16.623119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:55:34.434160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.601264+0000","last_change":"2024-02-19T06:59:16.598224+0000","last_active":"2024-02-19T06:59:16.601264+0000","last_peered":"2024-02-19T06:59:16.601264+0000","last_clean":"2024-02-19T06:59:16.601264+0000","last_became_active":"2024-02-19T06:59:16.597864+0000","last_became_peered":"2024-02-19T06:59:16.597864+0000","last_unstale":"2024-02-19T06:59:16.601264+0000","last_undegraded":"2024-02-19T06:59:16.601264+0000","last_fullsized":"2024-02-19T06:59:16.601264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:44:14.718617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607265+0000","last_change":"2024-02-19T06:59:15.604430+0000","last_active":"2024-02-19T06:59:17.607265+0000","last_peered":"2024-02-19T06:59:17.607265+0000","last_clean":"2024-02-19T06:59:17.607265+0000","last_became_active":"2024-02-19T06:59:15.601192+0000","last_became_peered":"2024-02-19T06:59:15.601192+0000","last_unstale":"2024-02-19T06:59:17.607265+0000","last_undegraded":"2024-02-19T06:59:17.607265+0000","last_fullsized":"2024-02-19T06:59:17.607265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:15:44.799861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.595206+0000","last_change":"2024-02-19T06:59:16.590300+0000","last_active":"2024-02-19T06:59:16.595206+0000","last_peered":"2024-02-19T06:59:16.595206+0000","last_clean":"2024-02-19T06:59:16.595206+0000","last_became_active":"2024-02-19T06:59:16.589992+0000","last_became_peered":"2024-02-19T06:59:16.589992+0000","last_unstale":"2024-02-19T06:59:16.595206+0000","last_undegraded":"2024-02-19T06:59:16.595206+0000","last_fullsized":"2024-02-19T06:59:16.595206+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:43:14.429364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.599691+0000","last_change":"2024-02-19T06:59:15.601181+0000","last_active":"2024-02-19T06:59:16.599691+0000","last_peered":"2024-02-19T06:59:16.599691+0000","last_clean":"2024-02-19T06:59:16.599691+0000","last_became_active":"2024-02-19T06:59:15.600910+0000","last_became_peered":"2024-02-19T06:59:15.600910+0000","last_unstale":"2024-02-19T06:59:16.599691+0000","last_undegraded":"2024-02-19T06:59:16.599691+0000","last_fullsized":"2024-02-19T06:59:16.599691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:22:36.174546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609345+0000","last_change":"2024-02-19T06:59:16.618562+0000","last_active":"2024-02-19T06:59:17.609345+0000","last_peered":"2024-02-19T06:59:17.609345+0000","last_clean":"2024-02-19T06:59:17.609345+0000","last_became_active":"2024-02-19T06:59:16.616589+0000","last_became_peered":"2024-02-19T06:59:16.616589+0000","last_unstale":"2024-02-19T06:59:17.609345+0000","last_undegraded":"2024-02-19T06:59:17.609345+0000","last_fullsized":"2024-02-19T06:59:17.609345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:41:03.148622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.604782+0000","last_change":"2024-02-19T06:59:15.603035+0000","last_active":"2024-02-19T06:59:17.604782+0000","last_peered":"2024-02-19T06:59:17.604782+0000","last_clean":"2024-02-19T06:59:17.604782+0000","last_became_active":"2024-02-19T06:59:15.602749+0000","last_became_peered":"2024-02-19T06:59:15.602749+0000","last_unstale":"2024-02-19T06:59:17.604782+0000","last_undegraded":"2024-02-19T06:59:17.604782+0000","last_fullsized":"2024-02-19T06:59:17.604782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:36:16.246321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.610661+0000","last_change":"2024-02-19T06:59:16.604556+0000","last_active":"2024-02-19T06:59:16.610661+0000","last_peered":"2024-02-19T06:59:16.610661+0000","last_clean":"2024-02-19T06:59:16.610661+0000","last_became_active":"2024-02-19T06:59:16.604243+0000","last_became_peered":"2024-02-19T06:59:16.604243+0000","last_unstale":"2024-02-19T06:59:16.610661+0000","last_undegraded":"2024-02-19T06:59:16.610661+0000","last_fullsized":"2024-02-19T06:59:16.610661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:19:22.177370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.627031+0000","last_change":"2024-02-19T06:59:15.604234+0000","last_active":"2024-02-19T06:59:16.627031+0000","last_peered":"2024-02-19T06:59:16.627031+0000","last_clean":"2024-02-19T06:59:16.627031+0000","last_became_active":"2024-02-19T06:59:15.603910+0000","last_became_peered":"2024-02-19T06:59:15.603910+0000","last_unstale":"2024-02-19T06:59:16.627031+0000","last_undegraded":"2024-02-19T06:59:16.627031+0000","last_fullsized":"2024-02-19T06:59:16.627031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:26:36.035812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.608645+0000","last_change":"2024-02-19T06:59:16.622588+0000","last_active":"2024-02-19T06:59:17.608645+0000","last_peered":"2024-02-19T06:59:17.608645+0000","last_clean":"2024-02-19T06:59:17.608645+0000","last_became_active":"2024-02-19T06:59:16.622264+0000","last_became_peered":"2024-02-19T06:59:16.622264+0000","last_unstale":"2024-02-19T06:59:17.608645+0000","last_undegraded":"2024-02-19T06:59:17.608645+0000","last_fullsized":"2024-02-19T06:59:17.608645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:09:08.349438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.582383+0000","last_change":"2024-02-19T06:59:15.601257+0000","last_active":"2024-02-19T06:59:16.582383+0000","last_peered":"2024-02-19T06:59:16.582383+0000","last_clean":"2024-02-19T06:59:16.582383+0000","last_became_active":"2024-02-19T06:59:15.600437+0000","last_became_peered":"2024-02-19T06:59:15.600437+0000","last_unstale":"2024-02-19T06:59:16.582383+0000","last_undegraded":"2024-02-19T06:59:16.582383+0000","last_fullsized":"2024-02-19T06:59:16.582383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:14:50.539521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.621739+0000","last_change":"2024-02-19T06:59:16.619557+0000","last_active":"2024-02-19T06:59:16.621739+0000","last_peered":"2024-02-19T06:59:16.621739+0000","last_clean":"2024-02-19T06:59:16.621739+0000","last_became_active":"2024-02-19T06:59:16.619269+0000","last_became_peered":"2024-02-19T06:59:16.619269+0000","last_unstale":"2024-02-19T06:59:16.621739+0000","last_undegraded":"2024-02-19T06:59:16.621739+0000","last_fullsized":"2024-02-19T06:59:16.621739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:53:33.828896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.611444+0000","last_change":"2024-02-19T06:59:15.603509+0000","last_active":"2024-02-19T06:59:16.611444+0000","last_peered":"2024-02-19T06:59:16.611444+0000","last_clean":"2024-02-19T06:59:16.611444+0000","last_became_active":"2024-02-19T06:59:15.603186+0000","last_became_peered":"2024-02-19T06:59:15.603186+0000","last_unstale":"2024-02-19T06:59:16.611444+0000","last_undegraded":"2024-02-19T06:59:16.611444+0000","last_fullsized":"2024-02-19T06:59:16.611444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:37:24.394516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607360+0000","last_change":"2024-02-19T06:59:16.615949+0000","last_active":"2024-02-19T06:59:17.607360+0000","last_peered":"2024-02-19T06:59:17.607360+0000","last_clean":"2024-02-19T06:59:17.607360+0000","last_became_active":"2024-02-19T06:59:16.612673+0000","last_became_peered":"2024-02-19T06:59:16.612673+0000","last_unstale":"2024-02-19T06:59:17.607360+0000","last_undegraded":"2024-02-19T06:59:17.607360+0000","last_fullsized":"2024-02-19T06:59:17.607360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:32:57.707149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.580490+0000","last_change":"2024-02-19T06:59:15.598046+0000","last_active":"2024-02-19T06:59:16.580490+0000","last_peered":"2024-02-19T06:59:16.580490+0000","last_clean":"2024-02-19T06:59:16.580490+0000","last_became_active":"2024-02-19T06:59:15.597716+0000","last_became_peered":"2024-02-19T06:59:15.597716+0000","last_unstale":"2024-02-19T06:59:16.580490+0000","last_undegraded":"2024-02-19T06:59:16.580490+0000","last_fullsized":"2024-02-19T06:59:16.580490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:44:45.577762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.613549+0000","last_change":"2024-02-19T06:59:16.611981+0000","last_active":"2024-02-19T06:59:16.613549+0000","last_peered":"2024-02-19T06:59:16.613549+0000","last_clean":"2024-02-19T06:59:16.613549+0000","last_became_active":"2024-02-19T06:59:16.611546+0000","last_became_peered":"2024-02-19T06:59:16.611546+0000","last_unstale":"2024-02-19T06:59:16.613549+0000","last_undegraded":"2024-02-19T06:59:16.613549+0000","last_fullsized":"2024-02-19T06:59:16.613549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:48:21.918964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.603865+0000","last_change":"2024-02-19T06:59:15.600815+0000","last_active":"2024-02-19T06:59:16.603865+0000","last_peered":"2024-02-19T06:59:16.603865+0000","last_clean":"2024-02-19T06:59:16.603865+0000","last_became_active":"2024-02-19T06:59:15.600545+0000","last_became_peered":"2024-02-19T06:59:15.600545+0000","last_unstale":"2024-02-19T06:59:16.603865+0000","last_undegraded":"2024-02-19T06:59:16.603865+0000","last_fullsized":"2024-02-19T06:59:16.603865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:27:12.616942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625556+0000","last_change":"2024-02-19T06:59:16.623104+0000","last_active":"2024-02-19T06:59:16.625556+0000","last_peered":"2024-02-19T06:59:16.625556+0000","last_clean":"2024-02-19T06:59:16.625556+0000","last_became_active":"2024-02-19T06:59:16.622494+0000","last_became_peered":"2024-02-19T06:59:16.622494+0000","last_unstale":"2024-02-19T06:59:16.625556+0000","last_undegraded":"2024-02-19T06:59:16.625556+0000","last_fullsized":"2024-02-19T06:59:16.625556+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:39:20.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.601437+0000","last_change":"2024-02-19T06:59:15.593199+0000","last_active":"2024-02-19T06:59:16.601437+0000","last_peered":"2024-02-19T06:59:16.601437+0000","last_clean":"2024-02-19T06:59:16.601437+0000","last_became_active":"2024-02-19T06:59:15.592903+0000","last_became_peered":"2024-02-19T06:59:15.592903+0000","last_unstale":"2024-02-19T06:59:16.601437+0000","last_undegraded":"2024-02-19T06:59:16.601437+0000","last_fullsized":"2024-02-19T06:59:16.601437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:32:59.341697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620949+0000","last_change":"2024-02-19T06:59:16.613089+0000","last_active":"2024-02-19T06:59:16.620949+0000","last_peered":"2024-02-19T06:59:16.620949+0000","last_clean":"2024-02-19T06:59:16.620949+0000","last_became_active":"2024-02-19T06:59:16.610885+0000","last_became_peered":"2024-02-19T06:59:16.610885+0000","last_unstale":"2024-02-19T06:59:16.620949+0000","last_undegraded":"2024-02-19T06:59:16.620949+0000","last_fullsized":"2024-02-19T06:59:16.620949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:59:56.563183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.587944+0000","last_change":"2024-02-19T06:59:15.608188+0000","last_active":"2024-02-19T06:59:16.587944+0000","last_peered":"2024-02-19T06:59:16.587944+0000","last_clean":"2024-02-19T06:59:16.587944+0000","last_became_active":"2024-02-19T06:59:15.607906+0000","last_became_peered":"2024-02-19T06:59:15.607906+0000","last_unstale":"2024-02-19T06:59:16.587944+0000","last_undegraded":"2024-02-19T06:59:16.587944+0000","last_fullsized":"2024-02-19T06:59:16.587944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:32:56.691816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609615+0000","last_change":"2024-02-19T06:59:16.613034+0000","last_active":"2024-02-19T06:59:17.609615+0000","last_peered":"2024-02-19T06:59:17.609615+0000","last_clean":"2024-02-19T06:59:17.609615+0000","last_became_active":"2024-02-19T06:59:16.612730+0000","last_became_peered":"2024-02-19T06:59:16.612730+0000","last_unstale":"2024-02-19T06:59:17.609615+0000","last_undegraded":"2024-02-19T06:59:17.609615+0000","last_fullsized":"2024-02-19T06:59:17.609615+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:52:37.096369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.606126+0000","last_change":"2024-02-19T06:59:15.599408+0000","last_active":"2024-02-19T06:59:17.606126+0000","last_peered":"2024-02-19T06:59:17.606126+0000","last_clean":"2024-02-19T06:59:17.606126+0000","last_became_active":"2024-02-19T06:59:15.599069+0000","last_became_peered":"2024-02-19T06:59:15.599069+0000","last_unstale":"2024-02-19T06:59:17.606126+0000","last_undegraded":"2024-02-19T06:59:17.606126+0000","last_fullsized":"2024-02-19T06:59:17.606126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:08:21.931183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609996+0000","last_change":"2024-02-19T06:57:45.353063+0000","last_active":"2024-02-19T06:59:17.609996+0000","last_peered":"2024-02-19T06:59:17.609996+0000","last_clean":"2024-02-19T06:59:17.609996+0000","last_became_active":"2024-02-19T06:57:45.350602+0000","last_became_peered":"2024-02-19T06:57:45.350602+0000","last_unstale":"2024-02-19T06:59:17.609996+0000","last_undegraded":"2024-02-19T06:59:17.609996+0000","last_fullsized":"2024-02-19T06:59:17.609996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_clean_scrub_stamp":"2024-02-19T06:57:44.230095+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:04:42.513180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":154432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.55}]},{"osd":1,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.3009999999999999}]},{"osd":2,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.246},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"last":1.6719999999999999}]},{"osd":3,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.7689999999999999}]},{"osd":4,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.0910000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.413},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":1.615}]},{"osd":5,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.224,"5min":1.224,"15min":1.224},"max":{"1min":3.2709999999999999,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":1.855},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.8460000000000001,"5min":2.8460000000000001,"15min":2.8460000000000001},"last":1.4610000000000001}]},{"osd":7,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":3.0089999999999999,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":1.8160000000000001},{"interface":"front","average":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":1.9039999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":154488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.946},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.876}]},{"osd":1,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":1.4570000000000001}]},{"osd":2,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.847},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.9929999999999999,"5min":2.9929999999999999,"15min":2.9929999999999999},"last":1.238}]},{"osd":3,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.6459999999999999,"5min":2.6459999999999999,"15min":2.6459999999999999},"last":2.1080000000000001},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.6760000000000002,"5min":3.6760000000000002,"15min":3.6760000000000002},"last":1.5069999999999999}]},{"osd":4,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":3.0950000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.355}]},{"osd":6,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":3.7269999999999999,"5min":3.7269999999999999,"15min":3.7269999999999999},"last":1.161},{"interface":"front","average":{"1min":1.7,"5min":1.7,"15min":1.7},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":3.367,"5min":3.367,"15min":3.367},"last":1.399}]},{"osd":7,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.7549999999999999},{"interface":"front","average":{"1min":1.851,"5min":1.851,"15min":1.851},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":3.5979999999999999,"5min":3.5979999999999999,"15min":3.5979999999999999},"last":1.3340000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":737974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.7270000000000001}]},{"osd":1,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.109},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.7}]},{"osd":2,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.629},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.379}]},{"osd":3,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.4870000000000001}]},{"osd":4,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.3799999999999999,"5min":3.3799999999999999,"15min":3.3799999999999999},"last":1.2410000000000001}]},{"osd":5,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.3199999999999998,"5min":3.3199999999999998,"15min":3.3199999999999998},"last":1.667},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.2810000000000001,"5min":3.2810000000000001,"15min":3.2810000000000001},"last":1.756}]},{"osd":6,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":1.657,"15min":1.657},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.78},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":1.804}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":147620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.88100000000000001}]},{"osd":1,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":1.456}]},{"osd":3,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.272},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.3859999999999999}]},{"osd":5,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.234,"5min":1.234,"15min":1.234},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.2310000000000001}]},{"osd":6,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.349},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.5069999999999999}]},{"osd":7,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.643,"15min":1.643},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4299999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":149150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.66700000000000004}]},{"osd":1,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.72699999999999998}]},{"osd":4,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":0.89600000000000002}]},{"osd":5,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.876},{"interface":"front","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":1.0609999999999999}]},{"osd":6,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.1359999999999999}]},{"osd":7,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.96099999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":380928,"data_stored":147586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.2709999999999999,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":0.77800000000000002}]},{"osd":1,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":3.4950000000000001,"5min":3.4950000000000001,"15min":3.4950000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.7970000000000002,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":1.004}]},{"osd":3,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.3069999999999999,"5min":3.3069999999999999,"15min":3.3069999999999999},"last":1.181},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":4.0700000000000003,"5min":4.0700000000000003,"15min":4.0700000000000003},"last":1.329}]},{"osd":4,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.1539999999999999,"5min":4.1539999999999999,"15min":4.1539999999999999},"last":1.415},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.25}]},{"osd":5,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":3.9390000000000001,"5min":3.9390000000000001,"15min":3.9390000000000001},"last":1.294},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":4.1120000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.4730000000000001}]},{"osd":6,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":3.9780000000000002,"5min":3.9780000000000002,"15min":3.9780000000000002},"last":1.383}]},{"osd":7,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.589,"5min":1.589,"15min":1.589},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":3.8959999999999999,"5min":3.8959999999999999,"15min":3.8959999999999999},"last":1.4510000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":149150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.302}]},{"osd":2,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.5}]},{"osd":3,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.585},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.103}]},{"osd":4,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.55},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.26}]},{"osd":5,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.4390000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.6799999999999999}]},{"osd":6,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.6970000000000001,"5min":2.6970000000000001,"15min":2.6970000000000001},"last":1.45},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":1.74}]},{"osd":7,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":1.625},{"interface":"front","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":1.841}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":737884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 06:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":5.4290000000000003,"5min":5.4290000000000003,"15min":5.4290000000000003},"last":1.1279999999999999}]},{"osd":2,"last update":"Mon Feb 19 06:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":5.3140000000000001,"5min":5.3140000000000001,"15min":5.3140000000000001},"last":1.399}]},{"osd":3,"last update":"Mon Feb 19 06:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":10.504,"5min":10.504,"15min":10.504},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.998}]},{"osd":4,"last update":"Mon Feb 19 06:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.365},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":1.609}]},{"osd":5,"last update":"Mon Feb 19 06:58:48 2024","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":4.4740000000000002,"5min":4.4740000000000002,"15min":4.4740000000000002},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":1.4399999999999999}]},{"osd":6,"last update":"Mon Feb 19 06:58:48 2024","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":4.5780000000000003,"5min":4.5780000000000003,"15min":4.5780000000000003},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.234}]},{"osd":7,"last update":"Mon Feb 19 06:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.79,"5min":1.79,"15min":1.79},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":4.532,"5min":4.532,"15min":4.532},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.6379999999999999,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.508}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T06:59:21.126 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-19T06:59:21.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.378+0000 7f9e1fe00640 1 Processor -- start 2024-02-19T06:59:21.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.379+0000 7f9e1fe00640 1 -- start start 2024-02-19T06:59:21.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.380+0000 7f9e1fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e2015d7f0 0x7f9e200d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.380+0000 7f9e1fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9e2015dbd0 0x7f9e200d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.380+0000 7f9e1fe00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e200cf770 con 0x7f9e20162230 2024-02-19T06:59:21.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.380+0000 7f9e1fe00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e200cf4e0 con 0x7f9e2015dbd0 2024-02-19T06:59:21.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.380+0000 7f9e1fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200d1400 con 0x7f9e2015d7f0 2024-02-19T06:59:21.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.381+0000 7f9e1e000640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9e20162230 0x7f9e200cedd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39462/0 (socket says 172.21.15.46:39462) 2024-02-19T06:59:21.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.381+0000 7f9e1e000640 1 -- 172.21.15.46:0/2728731464 learned_addr learned my addr 172.21.15.46:0/2728731464 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:21.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.381+0000 7f9e1f400640 1 --2- 172.21.15.46:0/2728731464 >> v2:172.21.15.142:3300/0 conn(0x7f9e2015dbd0 0x7f9e200d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:21.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.381+0000 7f9e1ea00640 1 --2- 172.21.15.46:0/2728731464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e2015d7f0 0x7f9e200d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:21.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.381+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873677005 0 0) 0x7f9e200cf770 con 0x7f9e20162230 2024-02-19T06:59:21.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.381+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e00003520 con 0x7f9e20162230 2024-02-19T06:59:21.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.381+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2719437423 0 0) 0x7f9e00003520 con 0x7f9e20162230 2024-02-19T06:59:21.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.381+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e2015d7f0 msgr2=0x7f9e200d21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.381+0000 7f9e1d600640 1 --2- 172.21.15.46:0/2728731464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e2015d7f0 0x7f9e200d21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.381+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 >> v2:172.21.15.142:3300/0 conn(0x7f9e2015dbd0 msgr2=0x7f9e200d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.381+0000 7f9e1d600640 1 --2- 172.21.15.46:0/2728731464 >> v2:172.21.15.142:3300/0 conn(0x7f9e2015dbd0 0x7f9e200d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.381+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200d16e0 con 0x7f9e20162230 2024-02-19T06:59:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.381+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f9e08001670 con 0x7f9e20162230 2024-02-19T06:59:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 >> v1:172.21.15.46:6789/0 conn(0x7f9e20162230 legacy=0x7f9e200cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1d600640 1 --2- 172.21.15.46:0/2728731464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e2015d7f0 0x7f9e00003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1d600640 1 --2- 172.21.15.46:0/2728731464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e00003ef0 0x7f9e000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1d600640 1 --2- 172.21.15.46:0/2728731464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e00004d00 0x7f9e00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200cf4e0 con 0x7f9e00003ef0 2024-02-19T06:59:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200d1400 con 0x7f9e00004d00 2024-02-19T06:59:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0000b9d0 con 0x7f9e2015d7f0 2024-02-19T06:59:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1e000640 1 --2- 172.21.15.46:0/2728731464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e00003ef0 0x7f9e000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:21.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1ea00640 1 --2- 172.21.15.46:0/2728731464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e2015d7f0 0x7f9e00003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:21.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1e000640 1 -- 172.21.15.46:0/2728731464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e2015d7f0 msgr2=0x7f9e00003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:21.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1e000640 1 --2- 172.21.15.46:0/2728731464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e2015d7f0 0x7f9e00003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1e000640 1 -- 172.21.15.46:0/2728731464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e00004d00 msgr2=0x7f9e00005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:21.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1e000640 1 --2- 172.21.15.46:0/2728731464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e00004d00 0x7f9e00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.382+0000 7f9e1e000640 1 -- 172.21.15.46:0/2728731464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00003520 con 0x7f9e00003ef0 2024-02-19T06:59:21.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.383+0000 7f9e1e000640 1 --2- 172.21.15.46:0/2728731464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e00003ef0 0x7f9e000047c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800c2c0 tx=0x7f9e000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b8553452e5943a server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:21.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.384+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e08005ad0 con 0x7f9e00003ef0 2024-02-19T06:59:21.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.384+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e08005c30 con 0x7f9e00003ef0 2024-02-19T06:59:21.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.384+0000 7f9e1d600640 1 -- 172.21.15.46:0/2728731464 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0802c8b0 con 0x7f9e00003ef0 2024-02-19T06:59:21.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.384+0000 7f9e1fe00640 1 -- 172.21.15.46:0/2728731464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e00003ef0 msgr2=0x7f9e000047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:21.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.384+0000 7f9e1fe00640 1 --2- 172.21.15.46:0/2728731464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e00003ef0 0x7f9e000047c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800c2c0 tx=0x7f9e000057f0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.384+0000 7f9e1f400640 1 -- 172.21.15.46:0/2728731464 reap_dead start 2024-02-19T06:59:21.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.384+0000 7f9e1fe00640 1 -- 172.21.15.46:0/2728731464 shutdown_connections 2024-02-19T06:59:21.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.384+0000 7f9e1fe00640 1 -- 172.21.15.46:0/2728731464 >> 172.21.15.46:0/2728731464 conn(0x7f9e2009ca70 msgr2=0x7f9e2008afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:21.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.385+0000 7f9e1fe00640 1 -- 172.21.15.46:0/2728731464 shutdown_connections 2024-02-19T06:59:21.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.385+0000 7f9e1fe00640 1 -- 172.21.15.46:0/2728731464 wait complete. 2024-02-19T06:59:21.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.386+0000 7f9e1fe00640 1 Processor -- start 2024-02-19T06:59:21.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.386+0000 7f9e1fe00640 1 -- start start 2024-02-19T06:59:21.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.387+0000 7f9e1fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e00003ef0 0x7f9e20160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.387+0000 7f9e1fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201f0a20 0x7f9e200b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.387+0000 7f9e1fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e200b3f40 0x7f9e201f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.387+0000 7f9e1fe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200b43f0 con 0x7f9e200b3f40 2024-02-19T06:59:21.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.387+0000 7f9e1fe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e201f43e0 con 0x7f9e00003ef0 2024-02-19T06:59:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.387+0000 7f9e1fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e201600a0 con 0x7f9e201f0a20 2024-02-19T06:59:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.388+0000 7f9e1f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e200b3f40 0x7f9e201f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.388+0000 7f9e1f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e200b3f40 0x7f9e201f3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54160/0 (socket says 172.21.15.46:54160) 2024-02-19T06:59:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.388+0000 7f9e1f400640 1 -- 172.21.15.46:0/1086224672 learned_addr learned my addr 172.21.15.46:0/1086224672 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.388+0000 7f9e1e000640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201f0a20 0x7f9e200b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.388+0000 7f9e1ea00640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e00003ef0 0x7f9e20160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.388+0000 7f9e1f400640 1 -- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201f0a20 msgr2=0x7f9e200b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.388+0000 7f9e1f400640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201f0a20 0x7f9e200b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.388+0000 7f9e1f400640 1 -- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e00003ef0 msgr2=0x7f9e20160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.388+0000 7f9e1f400640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e00003ef0 0x7f9e20160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.388+0000 7f9e1f400640 1 -- 172.21.15.46:0/1086224672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e20160380 con 0x7f9e200b3f40 2024-02-19T06:59:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.388+0000 7f9e1ea00640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e00003ef0 0x7f9e20160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.389+0000 7f9e1f400640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e200b3f40 0x7f9e201f3690 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9e200cde60 tx=0x7f9e1800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:21.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.389+0000 7f9e16a00640 1 -- 172.21.15.46:0/1086224672 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18010040 con 0x7f9e200b3f40 2024-02-19T06:59:21.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.389+0000 7f9e16a00640 1 -- 172.21.15.46:0/1086224672 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800bce0 con 0x7f9e200b3f40 2024-02-19T06:59:21.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.389+0000 7f9e16a00640 1 -- 172.21.15.46:0/1086224672 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18014640 con 0x7f9e200b3f40 2024-02-19T06:59:21.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.389+0000 7f9e1fe00640 1 -- 172.21.15.46:0/1086224672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e20160660 con 0x7f9e200b3f40 2024-02-19T06:59:21.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.389+0000 7f9e1fe00640 1 -- 172.21.15.46:0/1086224672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e201f0e80 con 0x7f9e200b3f40 2024-02-19T06:59:21.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.390+0000 7f9e1fe00640 1 -- 172.21.15.46:0/1086224672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e20160850 con 0x7f9e200b3f40 2024-02-19T06:59:21.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.391+0000 7f9e16a00640 1 -- 172.21.15.46:0/1086224672 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9e180147a0 con 0x7f9e200b3f40 2024-02-19T06:59:21.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.392+0000 7f9e16a00640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9dfc06b840 0x7f9dfc06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.392+0000 7f9e16a00640 1 -- 172.21.15.46:0/1086224672 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e1808a9f0 con 0x7f9e200b3f40 2024-02-19T06:59:21.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.393+0000 7f9e1ea00640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9dfc06b840 0x7f9dfc06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:21.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.394+0000 7f9e1ea00640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9dfc06b840 0x7f9dfc06dd00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009910 tx=0x7f9e10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:21.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.396+0000 7f9e16a00640 1 -- 172.21.15.46:0/1086224672 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9e18055400 con 0x7f9e200b3f40 2024-02-19T06:59:21.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.589+0000 7f9e1fe00640 1 -- 172.21.15.46:0/1086224672 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9e2015ff30 con 0x7f9dfc06b840 2024-02-19T06:59:21.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.612+0000 7f9e16a00640 1 -- 172.21.15.46:0/1086224672 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287322 (secure 0 0 0) 0x7f9e2015ff30 con 0x7f9dfc06b840 2024-02-19T06:59:21.619 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-02-19T06:59:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.618+0000 7f9e1fe00640 1 -- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9dfc06b840 msgr2=0x7f9dfc06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.618+0000 7f9e1fe00640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9dfc06b840 0x7f9dfc06dd00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009910 tx=0x7f9e10008040 comp rx=0 tx=0).stop 2024-02-19T06:59:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.618+0000 7f9e1fe00640 1 -- 172.21.15.46:0/1086224672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e200b3f40 msgr2=0x7f9e201f3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.618+0000 7f9e1fe00640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e200b3f40 0x7f9e201f3690 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9e200cde60 tx=0x7f9e1800b480 comp rx=0 tx=0).stop 2024-02-19T06:59:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.618+0000 7f9e1fe00640 1 -- 172.21.15.46:0/1086224672 shutdown_connections 2024-02-19T06:59:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.618+0000 7f9e1fe00640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9dfc06b840 0x7f9dfc06dd00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.618+0000 7f9e1fe00640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e200b3f40 0x7f9e201f3690 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.618+0000 7f9e1fe00640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201f0a20 0x7f9e200b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.618+0000 7f9e1fe00640 1 --2- 172.21.15.46:0/1086224672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e00003ef0 0x7f9e20160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.618+0000 7f9e1fe00640 1 -- 172.21.15.46:0/1086224672 >> 172.21.15.46:0/1086224672 conn(0x7f9e2009ca70 msgr2=0x7f9e2006c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.618+0000 7f9e1fe00640 1 -- 172.21.15.46:0/1086224672 shutdown_connections 2024-02-19T06:59:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.618+0000 7f9e1fe00640 1 -- 172.21.15.46:0/1086224672 wait complete. 2024-02-19T06:59:21.641 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-02-19T06:59:19.697075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237048,"kb_used_data":4192,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737672,"statfs":{"total":773094113280,"available":772851376128,"internally_reserved":0,"allocated":4292608,"data_stored":2378284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.142232"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.606821+0000","last_change":"2024-02-19T06:59:16.614999+0000","last_active":"2024-02-19T06:59:17.606821+0000","last_peered":"2024-02-19T06:59:17.606821+0000","last_clean":"2024-02-19T06:59:17.606821+0000","last_became_active":"2024-02-19T06:59:16.614731+0000","last_became_peered":"2024-02-19T06:59:16.614731+0000","last_unstale":"2024-02-19T06:59:17.606821+0000","last_undegraded":"2024-02-19T06:59:17.606821+0000","last_fullsized":"2024-02-19T06:59:17.606821+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:30:56.834213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.603314+0000","last_change":"2024-02-19T06:59:16.601056+0000","last_active":"2024-02-19T06:59:16.603314+0000","last_peered":"2024-02-19T06:59:16.603314+0000","last_clean":"2024-02-19T06:59:16.603314+0000","last_became_active":"2024-02-19T06:59:16.600781+0000","last_became_peered":"2024-02-19T06:59:16.600781+0000","last_unstale":"2024-02-19T06:59:16.603314+0000","last_undegraded":"2024-02-19T06:59:16.603314+0000","last_fullsized":"2024-02-19T06:59:16.603314+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:12:37.175897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.605899+0000","last_change":"2024-02-19T06:59:16.622379+0000","last_active":"2024-02-19T06:59:17.605899+0000","last_peered":"2024-02-19T06:59:17.605899+0000","last_clean":"2024-02-19T06:59:17.605899+0000","last_became_active":"2024-02-19T06:59:16.622068+0000","last_became_peered":"2024-02-19T06:59:16.622068+0000","last_unstale":"2024-02-19T06:59:17.605899+0000","last_undegraded":"2024-02-19T06:59:17.605899+0000","last_fullsized":"2024-02-19T06:59:17.605899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:25:52.195320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625842+0000","last_change":"2024-02-19T06:59:16.621784+0000","last_active":"2024-02-19T06:59:16.625842+0000","last_peered":"2024-02-19T06:59:16.625842+0000","last_clean":"2024-02-19T06:59:16.625842+0000","last_became_active":"2024-02-19T06:59:16.621500+0000","last_became_peered":"2024-02-19T06:59:16.621500+0000","last_unstale":"2024-02-19T06:59:16.625842+0000","last_undegraded":"2024-02-19T06:59:16.625842+0000","last_fullsized":"2024-02-19T06:59:16.625842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:56:22.383042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.599896+0000","last_change":"2024-02-19T06:59:16.596543+0000","last_active":"2024-02-19T06:59:16.599896+0000","last_peered":"2024-02-19T06:59:16.599896+0000","last_clean":"2024-02-19T06:59:16.599896+0000","last_became_active":"2024-02-19T06:59:16.595720+0000","last_became_peered":"2024-02-19T06:59:16.595720+0000","last_unstale":"2024-02-19T06:59:16.599896+0000","last_undegraded":"2024-02-19T06:59:16.599896+0000","last_fullsized":"2024-02-19T06:59:16.599896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:23:40.168999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.611034+0000","last_change":"2024-02-19T06:59:16.606730+0000","last_active":"2024-02-19T06:59:16.611034+0000","last_peered":"2024-02-19T06:59:16.611034+0000","last_clean":"2024-02-19T06:59:16.611034+0000","last_became_active":"2024-02-19T06:59:16.606443+0000","last_became_peered":"2024-02-19T06:59:16.606443+0000","last_unstale":"2024-02-19T06:59:16.611034+0000","last_undegraded":"2024-02-19T06:59:16.611034+0000","last_fullsized":"2024-02-19T06:59:16.611034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:00:19.035230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609328+0000","last_change":"2024-02-19T06:59:16.617357+0000","last_active":"2024-02-19T06:59:17.609328+0000","last_peered":"2024-02-19T06:59:17.609328+0000","last_clean":"2024-02-19T06:59:17.609328+0000","last_became_active":"2024-02-19T06:59:16.617042+0000","last_became_peered":"2024-02-19T06:59:16.617042+0000","last_unstale":"2024-02-19T06:59:17.609328+0000","last_undegraded":"2024-02-19T06:59:17.609328+0000","last_fullsized":"2024-02-19T06:59:17.609328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:37:31.320578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609061+0000","last_change":"2024-02-19T06:59:16.613254+0000","last_active":"2024-02-19T06:59:17.609061+0000","last_peered":"2024-02-19T06:59:17.609061+0000","last_clean":"2024-02-19T06:59:17.609061+0000","last_became_active":"2024-02-19T06:59:16.612493+0000","last_became_peered":"2024-02-19T06:59:16.612493+0000","last_unstale":"2024-02-19T06:59:17.609061+0000","last_undegraded":"2024-02-19T06:59:17.609061+0000","last_fullsized":"2024-02-19T06:59:17.609061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:16:35.264556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.626758+0000","last_change":"2024-02-19T06:59:16.623579+0000","last_active":"2024-02-19T06:59:16.626758+0000","last_peered":"2024-02-19T06:59:16.626758+0000","last_clean":"2024-02-19T06:59:16.626758+0000","last_became_active":"2024-02-19T06:59:16.623333+0000","last_became_peered":"2024-02-19T06:59:16.623333+0000","last_unstale":"2024-02-19T06:59:16.626758+0000","last_undegraded":"2024-02-19T06:59:16.626758+0000","last_fullsized":"2024-02-19T06:59:16.626758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:53:33.828896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620304+0000","last_change":"2024-02-19T06:59:16.617560+0000","last_active":"2024-02-19T06:59:16.620304+0000","last_peered":"2024-02-19T06:59:16.620304+0000","last_clean":"2024-02-19T06:59:16.620304+0000","last_became_active":"2024-02-19T06:59:16.617287+0000","last_became_peered":"2024-02-19T06:59:16.617287+0000","last_unstale":"2024-02-19T06:59:16.620304+0000","last_undegraded":"2024-02-19T06:59:16.620304+0000","last_fullsized":"2024-02-19T06:59:16.620304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:46:45.507501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609965+0000","last_change":"2024-02-19T06:59:16.622853+0000","last_active":"2024-02-19T06:59:17.609965+0000","last_peered":"2024-02-19T06:59:17.609965+0000","last_clean":"2024-02-19T06:59:17.609965+0000","last_became_active":"2024-02-19T06:59:16.622188+0000","last_became_peered":"2024-02-19T06:59:16.622188+0000","last_unstale":"2024-02-19T06:59:17.609965+0000","last_undegraded":"2024-02-19T06:59:17.609965+0000","last_fullsized":"2024-02-19T06:59:17.609965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:17:58.395014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.608501+0000","last_change":"2024-02-19T06:59:16.602254+0000","last_active":"2024-02-19T06:59:17.608501+0000","last_peered":"2024-02-19T06:59:17.608501+0000","last_clean":"2024-02-19T06:59:17.608501+0000","last_became_active":"2024-02-19T06:59:16.598694+0000","last_became_peered":"2024-02-19T06:59:16.598694+0000","last_unstale":"2024-02-19T06:59:17.608501+0000","last_undegraded":"2024-02-19T06:59:17.608501+0000","last_fullsized":"2024-02-19T06:59:17.608501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:58:17.749755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625143+0000","last_change":"2024-02-19T06:59:16.623393+0000","last_active":"2024-02-19T06:59:16.625143+0000","last_peered":"2024-02-19T06:59:16.625143+0000","last_clean":"2024-02-19T06:59:16.625143+0000","last_became_active":"2024-02-19T06:59:16.623054+0000","last_became_peered":"2024-02-19T06:59:16.623054+0000","last_unstale":"2024-02-19T06:59:16.625143+0000","last_undegraded":"2024-02-19T06:59:16.625143+0000","last_fullsized":"2024-02-19T06:59:16.625143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:36:03.829212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.604559+0000","last_change":"2024-02-19T06:59:16.597854+0000","last_active":"2024-02-19T06:59:16.604559+0000","last_peered":"2024-02-19T06:59:16.604559+0000","last_clean":"2024-02-19T06:59:16.604559+0000","last_became_active":"2024-02-19T06:59:16.597525+0000","last_became_peered":"2024-02-19T06:59:16.597525+0000","last_unstale":"2024-02-19T06:59:16.604559+0000","last_undegraded":"2024-02-19T06:59:16.604559+0000","last_fullsized":"2024-02-19T06:59:16.604559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:54:18.881973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.606441+0000","last_change":"2024-02-19T06:59:16.607039+0000","last_active":"2024-02-19T06:59:17.606441+0000","last_peered":"2024-02-19T06:59:17.606441+0000","last_clean":"2024-02-19T06:59:17.606441+0000","last_became_active":"2024-02-19T06:59:16.606750+0000","last_became_peered":"2024-02-19T06:59:16.606750+0000","last_unstale":"2024-02-19T06:59:17.606441+0000","last_undegraded":"2024-02-19T06:59:17.606441+0000","last_fullsized":"2024-02-19T06:59:17.606441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:25:43.377284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609862+0000","last_change":"2024-02-19T06:59:16.614422+0000","last_active":"2024-02-19T06:59:17.609862+0000","last_peered":"2024-02-19T06:59:17.609862+0000","last_clean":"2024-02-19T06:59:17.609862+0000","last_became_active":"2024-02-19T06:59:16.614116+0000","last_became_peered":"2024-02-19T06:59:16.614116+0000","last_unstale":"2024-02-19T06:59:17.609862+0000","last_undegraded":"2024-02-19T06:59:17.609862+0000","last_fullsized":"2024-02-19T06:59:17.609862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:51:24.960932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.610838+0000","last_change":"2024-02-19T06:59:16.618366+0000","last_active":"2024-02-19T06:59:17.610838+0000","last_peered":"2024-02-19T06:59:17.610838+0000","last_clean":"2024-02-19T06:59:17.610838+0000","last_became_active":"2024-02-19T06:59:16.618049+0000","last_became_peered":"2024-02-19T06:59:16.618049+0000","last_unstale":"2024-02-19T06:59:17.610838+0000","last_undegraded":"2024-02-19T06:59:17.610838+0000","last_fullsized":"2024-02-19T06:59:17.610838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:58:25.612872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.626584+0000","last_change":"2024-02-19T06:59:16.624908+0000","last_active":"2024-02-19T06:59:16.626584+0000","last_peered":"2024-02-19T06:59:16.626584+0000","last_clean":"2024-02-19T06:59:16.626584+0000","last_became_active":"2024-02-19T06:59:16.624608+0000","last_became_peered":"2024-02-19T06:59:16.624608+0000","last_unstale":"2024-02-19T06:59:16.626584+0000","last_undegraded":"2024-02-19T06:59:16.626584+0000","last_fullsized":"2024-02-19T06:59:16.626584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:25:52.195320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.617313+0000","last_change":"2024-02-19T06:59:16.616083+0000","last_active":"2024-02-19T06:59:16.617313+0000","last_peered":"2024-02-19T06:59:16.617313+0000","last_clean":"2024-02-19T06:59:16.617313+0000","last_became_active":"2024-02-19T06:59:16.615784+0000","last_became_peered":"2024-02-19T06:59:16.615784+0000","last_unstale":"2024-02-19T06:59:16.617313+0000","last_undegraded":"2024-02-19T06:59:16.617313+0000","last_fullsized":"2024-02-19T06:59:16.617313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:30:44.271078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.611617+0000","last_change":"2024-02-19T06:59:16.605909+0000","last_active":"2024-02-19T06:59:16.611617+0000","last_peered":"2024-02-19T06:59:16.611617+0000","last_clean":"2024-02-19T06:59:16.611617+0000","last_became_active":"2024-02-19T06:59:16.605491+0000","last_became_peered":"2024-02-19T06:59:16.605491+0000","last_unstale":"2024-02-19T06:59:16.611617+0000","last_undegraded":"2024-02-19T06:59:16.611617+0000","last_fullsized":"2024-02-19T06:59:16.611617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:08:21.294315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620749+0000","last_change":"2024-02-19T06:59:16.611079+0000","last_active":"2024-02-19T06:59:16.620749+0000","last_peered":"2024-02-19T06:59:16.620749+0000","last_clean":"2024-02-19T06:59:16.620749+0000","last_became_active":"2024-02-19T06:59:16.607487+0000","last_became_peered":"2024-02-19T06:59:16.607487+0000","last_unstale":"2024-02-19T06:59:16.620749+0000","last_undegraded":"2024-02-19T06:59:16.620749+0000","last_fullsized":"2024-02-19T06:59:16.620749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:13:59.938298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.621224+0000","last_change":"2024-02-19T06:59:16.612527+0000","last_active":"2024-02-19T06:59:16.621224+0000","last_peered":"2024-02-19T06:59:16.621224+0000","last_clean":"2024-02-19T06:59:16.621224+0000","last_became_active":"2024-02-19T06:59:16.612142+0000","last_became_peered":"2024-02-19T06:59:16.612142+0000","last_unstale":"2024-02-19T06:59:16.621224+0000","last_undegraded":"2024-02-19T06:59:16.621224+0000","last_fullsized":"2024-02-19T06:59:16.621224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:14:51.554854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.610845+0000","last_change":"2024-02-19T06:59:16.607562+0000","last_active":"2024-02-19T06:59:16.610845+0000","last_peered":"2024-02-19T06:59:16.610845+0000","last_clean":"2024-02-19T06:59:16.610845+0000","last_became_active":"2024-02-19T06:59:16.607294+0000","last_became_peered":"2024-02-19T06:59:16.607294+0000","last_unstale":"2024-02-19T06:59:16.610845+0000","last_undegraded":"2024-02-19T06:59:16.610845+0000","last_fullsized":"2024-02-19T06:59:16.610845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:59:56.563183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.605572+0000","last_change":"2024-02-19T06:59:16.600282+0000","last_active":"2024-02-19T06:59:17.605572+0000","last_peered":"2024-02-19T06:59:17.605572+0000","last_clean":"2024-02-19T06:59:17.605572+0000","last_became_active":"2024-02-19T06:59:16.599991+0000","last_became_peered":"2024-02-19T06:59:16.599991+0000","last_unstale":"2024-02-19T06:59:17.605572+0000","last_undegraded":"2024-02-19T06:59:17.605572+0000","last_fullsized":"2024-02-19T06:59:17.605572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:39:20.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.622018+0000","last_change":"2024-02-19T06:59:16.620388+0000","last_active":"2024-02-19T06:59:16.622018+0000","last_peered":"2024-02-19T06:59:16.622018+0000","last_clean":"2024-02-19T06:59:16.622018+0000","last_became_active":"2024-02-19T06:59:16.620064+0000","last_became_peered":"2024-02-19T06:59:16.620064+0000","last_unstale":"2024-02-19T06:59:16.622018+0000","last_undegraded":"2024-02-19T06:59:16.622018+0000","last_fullsized":"2024-02-19T06:59:16.622018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:32:57.707149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.612950+0000","last_change":"2024-02-19T06:59:16.609694+0000","last_active":"2024-02-19T06:59:16.612950+0000","last_peered":"2024-02-19T06:59:16.612950+0000","last_clean":"2024-02-19T06:59:16.612950+0000","last_became_active":"2024-02-19T06:59:16.607605+0000","last_became_peered":"2024-02-19T06:59:16.607605+0000","last_unstale":"2024-02-19T06:59:16.612950+0000","last_undegraded":"2024-02-19T06:59:16.612950+0000","last_fullsized":"2024-02-19T06:59:16.612950+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:10:34.530720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.627138+0000","last_change":"2024-02-19T06:59:16.623177+0000","last_active":"2024-02-19T06:59:16.627138+0000","last_peered":"2024-02-19T06:59:16.627138+0000","last_clean":"2024-02-19T06:59:16.627138+0000","last_became_active":"2024-02-19T06:59:16.622456+0000","last_became_peered":"2024-02-19T06:59:16.622456+0000","last_unstale":"2024-02-19T06:59:16.627138+0000","last_undegraded":"2024-02-19T06:59:16.627138+0000","last_fullsized":"2024-02-19T06:59:16.627138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:50:07.482949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.608614+0000","last_change":"2024-02-19T06:59:16.596710+0000","last_active":"2024-02-19T06:59:17.608614+0000","last_peered":"2024-02-19T06:59:17.608614+0000","last_clean":"2024-02-19T06:59:17.608614+0000","last_became_active":"2024-02-19T06:59:16.596248+0000","last_became_peered":"2024-02-19T06:59:16.596248+0000","last_unstale":"2024-02-19T06:59:17.608614+0000","last_undegraded":"2024-02-19T06:59:17.608614+0000","last_fullsized":"2024-02-19T06:59:17.608614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:25:08.895201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620727+0000","last_change":"2024-02-19T06:59:16.610005+0000","last_active":"2024-02-19T06:59:16.620727+0000","last_peered":"2024-02-19T06:59:16.620727+0000","last_clean":"2024-02-19T06:59:16.620727+0000","last_became_active":"2024-02-19T06:59:16.607044+0000","last_became_peered":"2024-02-19T06:59:16.607044+0000","last_unstale":"2024-02-19T06:59:16.620727+0000","last_undegraded":"2024-02-19T06:59:16.620727+0000","last_fullsized":"2024-02-19T06:59:16.620727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:13:17.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609636+0000","last_change":"2024-02-19T06:59:16.618442+0000","last_active":"2024-02-19T06:59:17.609636+0000","last_peered":"2024-02-19T06:59:17.609636+0000","last_clean":"2024-02-19T06:59:17.609636+0000","last_became_active":"2024-02-19T06:59:16.618153+0000","last_became_peered":"2024-02-19T06:59:16.618153+0000","last_unstale":"2024-02-19T06:59:17.609636+0000","last_undegraded":"2024-02-19T06:59:17.609636+0000","last_fullsized":"2024-02-19T06:59:17.609636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:14:19.596111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607525+0000","last_change":"2024-02-19T06:59:16.621417+0000","last_active":"2024-02-19T06:59:17.607525+0000","last_peered":"2024-02-19T06:59:17.607525+0000","last_clean":"2024-02-19T06:59:17.607525+0000","last_became_active":"2024-02-19T06:59:16.620816+0000","last_became_peered":"2024-02-19T06:59:16.620816+0000","last_unstale":"2024-02-19T06:59:17.607525+0000","last_undegraded":"2024-02-19T06:59:17.607525+0000","last_fullsized":"2024-02-19T06:59:17.607525+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:36:17.261654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609075+0000","last_change":"2024-02-19T06:59:16.621869+0000","last_active":"2024-02-19T06:59:17.609075+0000","last_peered":"2024-02-19T06:59:17.609075+0000","last_clean":"2024-02-19T06:59:17.609075+0000","last_became_active":"2024-02-19T06:59:16.621249+0000","last_became_peered":"2024-02-19T06:59:16.621249+0000","last_unstale":"2024-02-19T06:59:17.609075+0000","last_undegraded":"2024-02-19T06:59:17.609075+0000","last_fullsized":"2024-02-19T06:59:17.609075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:01:19.447375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.614387+0000","last_change":"2024-02-19T06:59:16.613240+0000","last_active":"2024-02-19T06:59:16.614387+0000","last_peered":"2024-02-19T06:59:16.614387+0000","last_clean":"2024-02-19T06:59:16.614387+0000","last_became_active":"2024-02-19T06:59:16.612724+0000","last_became_peered":"2024-02-19T06:59:16.612724+0000","last_unstale":"2024-02-19T06:59:16.614387+0000","last_undegraded":"2024-02-19T06:59:16.614387+0000","last_fullsized":"2024-02-19T06:59:16.614387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:41:10.862856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607719+0000","last_change":"2024-02-19T06:59:15.606353+0000","last_active":"2024-02-19T06:59:17.607719+0000","last_peered":"2024-02-19T06:59:17.607719+0000","last_clean":"2024-02-19T06:59:17.607719+0000","last_became_active":"2024-02-19T06:59:15.606022+0000","last_became_peered":"2024-02-19T06:59:15.606022+0000","last_unstale":"2024-02-19T06:59:17.607719+0000","last_undegraded":"2024-02-19T06:59:17.607719+0000","last_fullsized":"2024-02-19T06:59:17.607719+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:22:28.887251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607527+0000","last_change":"2024-02-19T06:59:16.622546+0000","last_active":"2024-02-19T06:59:17.607527+0000","last_peered":"2024-02-19T06:59:17.607527+0000","last_clean":"2024-02-19T06:59:17.607527+0000","last_became_active":"2024-02-19T06:59:16.622254+0000","last_became_peered":"2024-02-19T06:59:16.622254+0000","last_unstale":"2024-02-19T06:59:17.607527+0000","last_undegraded":"2024-02-19T06:59:17.607527+0000","last_fullsized":"2024-02-19T06:59:17.607527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:56:22.383042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.612977+0000","last_change":"2024-02-19T06:59:15.602275+0000","last_active":"2024-02-19T06:59:16.612977+0000","last_peered":"2024-02-19T06:59:16.612977+0000","last_clean":"2024-02-19T06:59:16.612977+0000","last_became_active":"2024-02-19T06:59:15.601958+0000","last_became_peered":"2024-02-19T06:59:15.601958+0000","last_unstale":"2024-02-19T06:59:16.612977+0000","last_undegraded":"2024-02-19T06:59:16.612977+0000","last_fullsized":"2024-02-19T06:59:16.612977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:13:16.565181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620310+0000","last_change":"2024-02-19T06:59:16.606982+0000","last_active":"2024-02-19T06:59:16.620310+0000","last_peered":"2024-02-19T06:59:16.620310+0000","last_clean":"2024-02-19T06:59:16.620310+0000","last_became_active":"2024-02-19T06:59:16.606714+0000","last_became_peered":"2024-02-19T06:59:16.606714+0000","last_unstale":"2024-02-19T06:59:16.620310+0000","last_undegraded":"2024-02-19T06:59:16.620310+0000","last_fullsized":"2024-02-19T06:59:16.620310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:44:46.593095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.612829+0000","last_change":"2024-02-19T06:59:15.598949+0000","last_active":"2024-02-19T06:59:16.612829+0000","last_peered":"2024-02-19T06:59:16.612829+0000","last_clean":"2024-02-19T06:59:16.612829+0000","last_became_active":"2024-02-19T06:59:15.598584+0000","last_became_peered":"2024-02-19T06:59:15.598584+0000","last_unstale":"2024-02-19T06:59:16.612829+0000","last_undegraded":"2024-02-19T06:59:16.612829+0000","last_fullsized":"2024-02-19T06:59:16.612829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:27:51.204367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.627159+0000","last_change":"2024-02-19T06:59:16.623420+0000","last_active":"2024-02-19T06:59:16.627159+0000","last_peered":"2024-02-19T06:59:16.627159+0000","last_clean":"2024-02-19T06:59:16.627159+0000","last_became_active":"2024-02-19T06:59:16.622789+0000","last_became_peered":"2024-02-19T06:59:16.622789+0000","last_unstale":"2024-02-19T06:59:16.627159+0000","last_undegraded":"2024-02-19T06:59:16.627159+0000","last_fullsized":"2024-02-19T06:59:16.627159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:27:52.219701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.623733+0000","last_change":"2024-02-19T06:59:15.607083+0000","last_active":"2024-02-19T06:59:16.623733+0000","last_peered":"2024-02-19T06:59:16.623733+0000","last_clean":"2024-02-19T06:59:16.623733+0000","last_became_active":"2024-02-19T06:59:15.606783+0000","last_became_peered":"2024-02-19T06:59:15.606783+0000","last_unstale":"2024-02-19T06:59:16.623733+0000","last_undegraded":"2024-02-19T06:59:16.623733+0000","last_fullsized":"2024-02-19T06:59:16.623733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:43:05.744006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.610034+0000","last_change":"2024-02-19T06:59:16.610423+0000","last_active":"2024-02-19T06:59:17.610034+0000","last_peered":"2024-02-19T06:59:17.610034+0000","last_clean":"2024-02-19T06:59:17.610034+0000","last_became_active":"2024-02-19T06:59:16.609925+0000","last_became_peered":"2024-02-19T06:59:16.609925+0000","last_unstale":"2024-02-19T06:59:17.610034+0000","last_undegraded":"2024-02-19T06:59:17.610034+0000","last_fullsized":"2024-02-19T06:59:17.610034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:19:56.263930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.613034+0000","last_change":"2024-02-19T06:59:15.598136+0000","last_active":"2024-02-19T06:59:16.613034+0000","last_peered":"2024-02-19T06:59:16.613034+0000","last_clean":"2024-02-19T06:59:16.613034+0000","last_became_active":"2024-02-19T06:59:15.597728+0000","last_became_peered":"2024-02-19T06:59:15.597728+0000","last_unstale":"2024-02-19T06:59:16.613034+0000","last_undegraded":"2024-02-19T06:59:16.613034+0000","last_fullsized":"2024-02-19T06:59:16.613034+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:09:36.350656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609025+0000","last_change":"2024-02-19T06:59:16.603386+0000","last_active":"2024-02-19T06:59:17.609025+0000","last_peered":"2024-02-19T06:59:17.609025+0000","last_clean":"2024-02-19T06:59:17.609025+0000","last_became_active":"2024-02-19T06:59:16.601504+0000","last_became_peered":"2024-02-19T06:59:16.601504+0000","last_unstale":"2024-02-19T06:59:17.609025+0000","last_undegraded":"2024-02-19T06:59:17.609025+0000","last_fullsized":"2024-02-19T06:59:17.609025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:14:48.011270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.611999+0000","last_change":"2024-02-19T06:59:15.598129+0000","last_active":"2024-02-19T06:59:16.611999+0000","last_peered":"2024-02-19T06:59:16.611999+0000","last_clean":"2024-02-19T06:59:16.611999+0000","last_became_active":"2024-02-19T06:59:15.597702+0000","last_became_peered":"2024-02-19T06:59:15.597702+0000","last_unstale":"2024-02-19T06:59:16.611999+0000","last_undegraded":"2024-02-19T06:59:16.611999+0000","last_fullsized":"2024-02-19T06:59:16.611999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:36:02.813878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.623202+0000","last_change":"2024-02-19T06:59:16.619194+0000","last_active":"2024-02-19T06:59:16.623202+0000","last_peered":"2024-02-19T06:59:16.623202+0000","last_clean":"2024-02-19T06:59:16.623202+0000","last_became_active":"2024-02-19T06:59:16.618840+0000","last_became_peered":"2024-02-19T06:59:16.618840+0000","last_unstale":"2024-02-19T06:59:16.623202+0000","last_undegraded":"2024-02-19T06:59:16.623202+0000","last_fullsized":"2024-02-19T06:59:16.623202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:41:10.862856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.588098+0000","last_change":"2024-02-19T06:59:15.601383+0000","last_active":"2024-02-19T06:59:16.588098+0000","last_peered":"2024-02-19T06:59:16.588098+0000","last_clean":"2024-02-19T06:59:16.588098+0000","last_became_active":"2024-02-19T06:59:15.599495+0000","last_became_peered":"2024-02-19T06:59:15.599495+0000","last_unstale":"2024-02-19T06:59:16.588098+0000","last_undegraded":"2024-02-19T06:59:16.588098+0000","last_fullsized":"2024-02-19T06:59:16.588098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:56:21.367708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620482+0000","last_change":"2024-02-19T06:59:16.618242+0000","last_active":"2024-02-19T06:59:16.620482+0000","last_peered":"2024-02-19T06:59:16.620482+0000","last_clean":"2024-02-19T06:59:16.620482+0000","last_became_active":"2024-02-19T06:59:16.617961+0000","last_became_peered":"2024-02-19T06:59:16.617961+0000","last_unstale":"2024-02-19T06:59:16.620482+0000","last_undegraded":"2024-02-19T06:59:16.620482+0000","last_fullsized":"2024-02-19T06:59:16.620482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:35:23.862031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.595899+0000","last_change":"2024-02-19T06:59:15.603506+0000","last_active":"2024-02-19T06:59:16.595899+0000","last_peered":"2024-02-19T06:59:16.595899+0000","last_clean":"2024-02-19T06:59:16.595899+0000","last_became_active":"2024-02-19T06:59:15.602450+0000","last_became_peered":"2024-02-19T06:59:15.602450+0000","last_unstale":"2024-02-19T06:59:16.595899+0000","last_undegraded":"2024-02-19T06:59:16.595899+0000","last_fullsized":"2024-02-19T06:59:16.595899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:50:32.187320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607271+0000","last_change":"2024-02-19T06:59:16.599055+0000","last_active":"2024-02-19T06:59:17.607271+0000","last_peered":"2024-02-19T06:59:17.607271+0000","last_clean":"2024-02-19T06:59:17.607271+0000","last_became_active":"2024-02-19T06:59:16.598653+0000","last_became_peered":"2024-02-19T06:59:16.598653+0000","last_unstale":"2024-02-19T06:59:17.607271+0000","last_undegraded":"2024-02-19T06:59:17.607271+0000","last_fullsized":"2024-02-19T06:59:17.607271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:51:35.337383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.590890+0000","last_change":"2024-02-19T06:59:15.606346+0000","last_active":"2024-02-19T06:59:16.590890+0000","last_peered":"2024-02-19T06:59:16.590890+0000","last_clean":"2024-02-19T06:59:16.590890+0000","last_became_active":"2024-02-19T06:59:15.605932+0000","last_became_peered":"2024-02-19T06:59:15.605932+0000","last_unstale":"2024-02-19T06:59:16.590890+0000","last_undegraded":"2024-02-19T06:59:16.590890+0000","last_fullsized":"2024-02-19T06:59:16.590890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T15:28:46.999389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625393+0000","last_change":"2024-02-19T06:59:16.622636+0000","last_active":"2024-02-19T06:59:16.625393+0000","last_peered":"2024-02-19T06:59:16.625393+0000","last_clean":"2024-02-19T06:59:16.625393+0000","last_became_active":"2024-02-19T06:59:16.622347+0000","last_became_peered":"2024-02-19T06:59:16.622347+0000","last_unstale":"2024-02-19T06:59:16.625393+0000","last_undegraded":"2024-02-19T06:59:16.625393+0000","last_fullsized":"2024-02-19T06:59:16.625393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:28:51.433258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.582317+0000","last_change":"2024-02-19T06:59:15.599246+0000","last_active":"2024-02-19T06:59:16.582317+0000","last_peered":"2024-02-19T06:59:16.582317+0000","last_clean":"2024-02-19T06:59:16.582317+0000","last_became_active":"2024-02-19T06:59:15.598953+0000","last_became_peered":"2024-02-19T06:59:15.598953+0000","last_unstale":"2024-02-19T06:59:16.582317+0000","last_undegraded":"2024-02-19T06:59:16.582317+0000","last_fullsized":"2024-02-19T06:59:16.582317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:13:58.922965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.616758+0000","last_change":"2024-02-19T06:59:16.614417+0000","last_active":"2024-02-19T06:59:16.616758+0000","last_peered":"2024-02-19T06:59:16.616758+0000","last_clean":"2024-02-19T06:59:16.616758+0000","last_became_active":"2024-02-19T06:59:16.614109+0000","last_became_peered":"2024-02-19T06:59:16.614109+0000","last_unstale":"2024-02-19T06:59:16.616758+0000","last_undegraded":"2024-02-19T06:59:16.616758+0000","last_fullsized":"2024-02-19T06:59:16.616758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:47:23.431021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.606164+0000","last_change":"2024-02-19T06:59:15.603090+0000","last_active":"2024-02-19T06:59:17.606164+0000","last_peered":"2024-02-19T06:59:17.606164+0000","last_clean":"2024-02-19T06:59:17.606164+0000","last_became_active":"2024-02-19T06:59:15.602796+0000","last_became_peered":"2024-02-19T06:59:15.602796+0000","last_unstale":"2024-02-19T06:59:17.606164+0000","last_undegraded":"2024-02-19T06:59:17.606164+0000","last_fullsized":"2024-02-19T06:59:17.606164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:56:21.367708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.605524+0000","last_change":"2024-02-19T06:59:16.616689+0000","last_active":"2024-02-19T06:59:17.605524+0000","last_peered":"2024-02-19T06:59:17.605524+0000","last_clean":"2024-02-19T06:59:17.605524+0000","last_became_active":"2024-02-19T06:59:16.616025+0000","last_became_peered":"2024-02-19T06:59:16.616025+0000","last_unstale":"2024-02-19T06:59:17.605524+0000","last_undegraded":"2024-02-19T06:59:17.605524+0000","last_fullsized":"2024-02-19T06:59:17.605524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:28:51.433258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.629632+0000","last_change":"2024-02-19T06:59:15.599041+0000","last_active":"2024-02-19T06:59:16.629632+0000","last_peered":"2024-02-19T06:59:16.629632+0000","last_clean":"2024-02-19T06:59:16.629632+0000","last_became_active":"2024-02-19T06:59:15.598762+0000","last_became_peered":"2024-02-19T06:59:15.598762+0000","last_unstale":"2024-02-19T06:59:16.629632+0000","last_undegraded":"2024-02-19T06:59:16.629632+0000","last_fullsized":"2024-02-19T06:59:16.629632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:50:06.467616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625091+0000","last_change":"2024-02-19T06:59:16.619233+0000","last_active":"2024-02-19T06:59:16.625091+0000","last_peered":"2024-02-19T06:59:16.625091+0000","last_clean":"2024-02-19T06:59:16.625091+0000","last_became_active":"2024-02-19T06:59:16.618898+0000","last_became_peered":"2024-02-19T06:59:16.618898+0000","last_unstale":"2024-02-19T06:59:16.625091+0000","last_undegraded":"2024-02-19T06:59:16.625091+0000","last_fullsized":"2024-02-19T06:59:16.625091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:30:56.834213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.618881+0000","last_change":"2024-02-19T06:59:15.601998+0000","last_active":"2024-02-19T06:59:16.618881+0000","last_peered":"2024-02-19T06:59:16.618881+0000","last_clean":"2024-02-19T06:59:16.618881+0000","last_became_active":"2024-02-19T06:59:15.601256+0000","last_became_peered":"2024-02-19T06:59:15.601256+0000","last_unstale":"2024-02-19T06:59:16.618881+0000","last_undegraded":"2024-02-19T06:59:16.618881+0000","last_fullsized":"2024-02-19T06:59:16.618881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:24:35.836971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.603295+0000","last_change":"2024-02-19T06:59:16.601182+0000","last_active":"2024-02-19T06:59:16.603295+0000","last_peered":"2024-02-19T06:59:16.603295+0000","last_clean":"2024-02-19T06:59:16.603295+0000","last_became_active":"2024-02-19T06:59:16.600828+0000","last_became_peered":"2024-02-19T06:59:16.600828+0000","last_unstale":"2024-02-19T06:59:16.603295+0000","last_undegraded":"2024-02-19T06:59:16.603295+0000","last_fullsized":"2024-02-19T06:59:16.603295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:02:31.479591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.603726+0000","last_change":"2024-02-19T06:59:15.597482+0000","last_active":"2024-02-19T06:59:16.603726+0000","last_peered":"2024-02-19T06:59:16.603726+0000","last_clean":"2024-02-19T06:59:16.603726+0000","last_became_active":"2024-02-19T06:59:15.597208+0000","last_became_peered":"2024-02-19T06:59:15.597208+0000","last_unstale":"2024-02-19T06:59:16.603726+0000","last_undegraded":"2024-02-19T06:59:16.603726+0000","last_fullsized":"2024-02-19T06:59:16.603726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:22:28.887251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.610523+0000","last_change":"2024-02-19T06:59:16.620106+0000","last_active":"2024-02-19T06:59:17.610523+0000","last_peered":"2024-02-19T06:59:17.610523+0000","last_clean":"2024-02-19T06:59:17.610523+0000","last_became_active":"2024-02-19T06:59:16.619823+0000","last_became_peered":"2024-02-19T06:59:16.619823+0000","last_unstale":"2024-02-19T06:59:17.610523+0000","last_undegraded":"2024-02-19T06:59:17.610523+0000","last_fullsized":"2024-02-19T06:59:17.610523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:14:46.597153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.588090+0000","last_change":"2024-02-19T06:59:15.606247+0000","last_active":"2024-02-19T06:59:16.588090+0000","last_peered":"2024-02-19T06:59:16.588090+0000","last_clean":"2024-02-19T06:59:16.588090+0000","last_became_active":"2024-02-19T06:59:15.605298+0000","last_became_peered":"2024-02-19T06:59:15.605298+0000","last_unstale":"2024-02-19T06:59:16.588090+0000","last_undegraded":"2024-02-19T06:59:16.588090+0000","last_fullsized":"2024-02-19T06:59:16.588090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:36:16.246321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607933+0000","last_change":"2024-02-19T06:59:16.624173+0000","last_active":"2024-02-19T06:59:17.607933+0000","last_peered":"2024-02-19T06:59:17.607933+0000","last_clean":"2024-02-19T06:59:17.607933+0000","last_became_active":"2024-02-19T06:59:16.623925+0000","last_became_peered":"2024-02-19T06:59:16.623925+0000","last_unstale":"2024-02-19T06:59:17.607933+0000","last_undegraded":"2024-02-19T06:59:17.607933+0000","last_fullsized":"2024-02-19T06:59:17.607933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:50:07.482949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625906+0000","last_change":"2024-02-19T06:59:15.601689+0000","last_active":"2024-02-19T06:59:16.625906+0000","last_peered":"2024-02-19T06:59:16.625906+0000","last_clean":"2024-02-19T06:59:16.625906+0000","last_became_active":"2024-02-19T06:59:15.598200+0000","last_became_peered":"2024-02-19T06:59:15.598200+0000","last_unstale":"2024-02-19T06:59:16.625906+0000","last_undegraded":"2024-02-19T06:59:16.625906+0000","last_fullsized":"2024-02-19T06:59:16.625906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:30:55.818879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.621211+0000","last_change":"2024-02-19T06:59:16.613946+0000","last_active":"2024-02-19T06:59:16.621211+0000","last_peered":"2024-02-19T06:59:16.621211+0000","last_clean":"2024-02-19T06:59:16.621211+0000","last_became_active":"2024-02-19T06:59:16.613633+0000","last_became_peered":"2024-02-19T06:59:16.613633+0000","last_unstale":"2024-02-19T06:59:16.621211+0000","last_undegraded":"2024-02-19T06:59:16.621211+0000","last_fullsized":"2024-02-19T06:59:16.621211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:48:21.918964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620628+0000","last_change":"2024-02-19T06:59:15.606281+0000","last_active":"2024-02-19T06:59:16.620628+0000","last_peered":"2024-02-19T06:59:16.620628+0000","last_clean":"2024-02-19T06:59:16.620628+0000","last_became_active":"2024-02-19T06:59:15.604575+0000","last_became_peered":"2024-02-19T06:59:15.604575+0000","last_unstale":"2024-02-19T06:59:16.620628+0000","last_undegraded":"2024-02-19T06:59:16.620628+0000","last_fullsized":"2024-02-19T06:59:16.620628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:15:17.813037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.608278+0000","last_change":"2024-02-19T06:59:16.608948+0000","last_active":"2024-02-19T06:59:17.608278+0000","last_peered":"2024-02-19T06:59:17.608278+0000","last_clean":"2024-02-19T06:59:17.608278+0000","last_became_active":"2024-02-19T06:59:16.605425+0000","last_became_peered":"2024-02-19T06:59:16.605425+0000","last_unstale":"2024-02-19T06:59:17.608278+0000","last_undegraded":"2024-02-19T06:59:17.608278+0000","last_fullsized":"2024-02-19T06:59:17.608278+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:00:00.956581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.618591+0000","last_change":"2024-02-19T06:59:15.600438+0000","last_active":"2024-02-19T06:59:16.618591+0000","last_peered":"2024-02-19T06:59:16.618591+0000","last_clean":"2024-02-19T06:59:16.618591+0000","last_became_active":"2024-02-19T06:59:15.600111+0000","last_became_peered":"2024-02-19T06:59:15.600111+0000","last_unstale":"2024-02-19T06:59:16.618591+0000","last_undegraded":"2024-02-19T06:59:16.618591+0000","last_fullsized":"2024-02-19T06:59:16.618591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:39:41.756163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625820+0000","last_change":"2024-02-19T06:59:16.621041+0000","last_active":"2024-02-19T06:59:16.625820+0000","last_peered":"2024-02-19T06:59:16.625820+0000","last_clean":"2024-02-19T06:59:16.625820+0000","last_became_active":"2024-02-19T06:59:16.620735+0000","last_became_peered":"2024-02-19T06:59:16.620735+0000","last_unstale":"2024-02-19T06:59:16.625820+0000","last_undegraded":"2024-02-19T06:59:16.625820+0000","last_fullsized":"2024-02-19T06:59:16.625820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:36:17.261654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.613096+0000","last_change":"2024-02-19T06:59:15.598102+0000","last_active":"2024-02-19T06:59:16.613096+0000","last_peered":"2024-02-19T06:59:16.613096+0000","last_clean":"2024-02-19T06:59:16.613096+0000","last_became_active":"2024-02-19T06:59:15.597222+0000","last_became_peered":"2024-02-19T06:59:15.597222+0000","last_unstale":"2024-02-19T06:59:16.613096+0000","last_undegraded":"2024-02-19T06:59:16.613096+0000","last_fullsized":"2024-02-19T06:59:16.613096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:55:34.434160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.611936+0000","last_change":"2024-02-19T06:59:16.606768+0000","last_active":"2024-02-19T06:59:16.611936+0000","last_peered":"2024-02-19T06:59:16.611936+0000","last_clean":"2024-02-19T06:59:16.611936+0000","last_became_active":"2024-02-19T06:59:16.606446+0000","last_became_peered":"2024-02-19T06:59:16.606446+0000","last_unstale":"2024-02-19T06:59:16.611936+0000","last_undegraded":"2024-02-19T06:59:16.611936+0000","last_fullsized":"2024-02-19T06:59:16.611936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:50:33.202653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.598067+0000","last_change":"2024-02-19T06:59:15.595828+0000","last_active":"2024-02-19T06:59:16.598067+0000","last_peered":"2024-02-19T06:59:16.598067+0000","last_clean":"2024-02-19T06:59:16.598067+0000","last_became_active":"2024-02-19T06:59:15.595494+0000","last_became_peered":"2024-02-19T06:59:15.595494+0000","last_unstale":"2024-02-19T06:59:16.598067+0000","last_undegraded":"2024-02-19T06:59:16.598067+0000","last_fullsized":"2024-02-19T06:59:16.598067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:04:51.206145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.611699+0000","last_change":"2024-02-19T06:59:16.605845+0000","last_active":"2024-02-19T06:59:16.611699+0000","last_peered":"2024-02-19T06:59:16.611699+0000","last_clean":"2024-02-19T06:59:16.611699+0000","last_became_active":"2024-02-19T06:59:16.605096+0000","last_became_peered":"2024-02-19T06:59:16.605096+0000","last_unstale":"2024-02-19T06:59:16.611699+0000","last_undegraded":"2024-02-19T06:59:16.611699+0000","last_fullsized":"2024-02-19T06:59:16.611699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:23:43.437725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.623119+0000","last_change":"2024-02-19T06:59:15.600437+0000","last_active":"2024-02-19T06:59:16.623119+0000","last_peered":"2024-02-19T06:59:16.623119+0000","last_clean":"2024-02-19T06:59:16.623119+0000","last_became_active":"2024-02-19T06:59:15.600133+0000","last_became_peered":"2024-02-19T06:59:15.600133+0000","last_unstale":"2024-02-19T06:59:16.623119+0000","last_undegraded":"2024-02-19T06:59:16.623119+0000","last_fullsized":"2024-02-19T06:59:16.623119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:55:34.434160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.601264+0000","last_change":"2024-02-19T06:59:16.598224+0000","last_active":"2024-02-19T06:59:16.601264+0000","last_peered":"2024-02-19T06:59:16.601264+0000","last_clean":"2024-02-19T06:59:16.601264+0000","last_became_active":"2024-02-19T06:59:16.597864+0000","last_became_peered":"2024-02-19T06:59:16.597864+0000","last_unstale":"2024-02-19T06:59:16.601264+0000","last_undegraded":"2024-02-19T06:59:16.601264+0000","last_fullsized":"2024-02-19T06:59:16.601264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:44:14.718617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607265+0000","last_change":"2024-02-19T06:59:15.604430+0000","last_active":"2024-02-19T06:59:17.607265+0000","last_peered":"2024-02-19T06:59:17.607265+0000","last_clean":"2024-02-19T06:59:17.607265+0000","last_became_active":"2024-02-19T06:59:15.601192+0000","last_became_peered":"2024-02-19T06:59:15.601192+0000","last_unstale":"2024-02-19T06:59:17.607265+0000","last_undegraded":"2024-02-19T06:59:17.607265+0000","last_fullsized":"2024-02-19T06:59:17.607265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:15:44.799861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.595206+0000","last_change":"2024-02-19T06:59:16.590300+0000","last_active":"2024-02-19T06:59:16.595206+0000","last_peered":"2024-02-19T06:59:16.595206+0000","last_clean":"2024-02-19T06:59:16.595206+0000","last_became_active":"2024-02-19T06:59:16.589992+0000","last_became_peered":"2024-02-19T06:59:16.589992+0000","last_unstale":"2024-02-19T06:59:16.595206+0000","last_undegraded":"2024-02-19T06:59:16.595206+0000","last_fullsized":"2024-02-19T06:59:16.595206+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:43:14.429364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.599691+0000","last_change":"2024-02-19T06:59:15.601181+0000","last_active":"2024-02-19T06:59:16.599691+0000","last_peered":"2024-02-19T06:59:16.599691+0000","last_clean":"2024-02-19T06:59:16.599691+0000","last_became_active":"2024-02-19T06:59:15.600910+0000","last_became_peered":"2024-02-19T06:59:15.600910+0000","last_unstale":"2024-02-19T06:59:16.599691+0000","last_undegraded":"2024-02-19T06:59:16.599691+0000","last_fullsized":"2024-02-19T06:59:16.599691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:22:36.174546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609345+0000","last_change":"2024-02-19T06:59:16.618562+0000","last_active":"2024-02-19T06:59:17.609345+0000","last_peered":"2024-02-19T06:59:17.609345+0000","last_clean":"2024-02-19T06:59:17.609345+0000","last_became_active":"2024-02-19T06:59:16.616589+0000","last_became_peered":"2024-02-19T06:59:16.616589+0000","last_unstale":"2024-02-19T06:59:17.609345+0000","last_undegraded":"2024-02-19T06:59:17.609345+0000","last_fullsized":"2024-02-19T06:59:17.609345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:41:03.148622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.604782+0000","last_change":"2024-02-19T06:59:15.603035+0000","last_active":"2024-02-19T06:59:17.604782+0000","last_peered":"2024-02-19T06:59:17.604782+0000","last_clean":"2024-02-19T06:59:17.604782+0000","last_became_active":"2024-02-19T06:59:15.602749+0000","last_became_peered":"2024-02-19T06:59:15.602749+0000","last_unstale":"2024-02-19T06:59:17.604782+0000","last_undegraded":"2024-02-19T06:59:17.604782+0000","last_fullsized":"2024-02-19T06:59:17.604782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:36:16.246321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.610661+0000","last_change":"2024-02-19T06:59:16.604556+0000","last_active":"2024-02-19T06:59:16.610661+0000","last_peered":"2024-02-19T06:59:16.610661+0000","last_clean":"2024-02-19T06:59:16.610661+0000","last_became_active":"2024-02-19T06:59:16.604243+0000","last_became_peered":"2024-02-19T06:59:16.604243+0000","last_unstale":"2024-02-19T06:59:16.610661+0000","last_undegraded":"2024-02-19T06:59:16.610661+0000","last_fullsized":"2024-02-19T06:59:16.610661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:19:22.177370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.627031+0000","last_change":"2024-02-19T06:59:15.604234+0000","last_active":"2024-02-19T06:59:16.627031+0000","last_peered":"2024-02-19T06:59:16.627031+0000","last_clean":"2024-02-19T06:59:16.627031+0000","last_became_active":"2024-02-19T06:59:15.603910+0000","last_became_peered":"2024-02-19T06:59:15.603910+0000","last_unstale":"2024-02-19T06:59:16.627031+0000","last_undegraded":"2024-02-19T06:59:16.627031+0000","last_fullsized":"2024-02-19T06:59:16.627031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:26:36.035812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.608645+0000","last_change":"2024-02-19T06:59:16.622588+0000","last_active":"2024-02-19T06:59:17.608645+0000","last_peered":"2024-02-19T06:59:17.608645+0000","last_clean":"2024-02-19T06:59:17.608645+0000","last_became_active":"2024-02-19T06:59:16.622264+0000","last_became_peered":"2024-02-19T06:59:16.622264+0000","last_unstale":"2024-02-19T06:59:17.608645+0000","last_undegraded":"2024-02-19T06:59:17.608645+0000","last_fullsized":"2024-02-19T06:59:17.608645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T07:09:08.349438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.582383+0000","last_change":"2024-02-19T06:59:15.601257+0000","last_active":"2024-02-19T06:59:16.582383+0000","last_peered":"2024-02-19T06:59:16.582383+0000","last_clean":"2024-02-19T06:59:16.582383+0000","last_became_active":"2024-02-19T06:59:15.600437+0000","last_became_peered":"2024-02-19T06:59:15.600437+0000","last_unstale":"2024-02-19T06:59:16.582383+0000","last_undegraded":"2024-02-19T06:59:16.582383+0000","last_fullsized":"2024-02-19T06:59:16.582383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T16:14:50.539521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.621739+0000","last_change":"2024-02-19T06:59:16.619557+0000","last_active":"2024-02-19T06:59:16.621739+0000","last_peered":"2024-02-19T06:59:16.621739+0000","last_clean":"2024-02-19T06:59:16.621739+0000","last_became_active":"2024-02-19T06:59:16.619269+0000","last_became_peered":"2024-02-19T06:59:16.619269+0000","last_unstale":"2024-02-19T06:59:16.621739+0000","last_undegraded":"2024-02-19T06:59:16.621739+0000","last_fullsized":"2024-02-19T06:59:16.621739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:53:33.828896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.611444+0000","last_change":"2024-02-19T06:59:15.603509+0000","last_active":"2024-02-19T06:59:16.611444+0000","last_peered":"2024-02-19T06:59:16.611444+0000","last_clean":"2024-02-19T06:59:16.611444+0000","last_became_active":"2024-02-19T06:59:15.603186+0000","last_became_peered":"2024-02-19T06:59:15.603186+0000","last_unstale":"2024-02-19T06:59:16.611444+0000","last_undegraded":"2024-02-19T06:59:16.611444+0000","last_fullsized":"2024-02-19T06:59:16.611444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T18:37:24.394516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.607360+0000","last_change":"2024-02-19T06:59:16.615949+0000","last_active":"2024-02-19T06:59:17.607360+0000","last_peered":"2024-02-19T06:59:17.607360+0000","last_clean":"2024-02-19T06:59:17.607360+0000","last_became_active":"2024-02-19T06:59:16.612673+0000","last_became_peered":"2024-02-19T06:59:16.612673+0000","last_unstale":"2024-02-19T06:59:17.607360+0000","last_undegraded":"2024-02-19T06:59:17.607360+0000","last_fullsized":"2024-02-19T06:59:17.607360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:32:57.707149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.580490+0000","last_change":"2024-02-19T06:59:15.598046+0000","last_active":"2024-02-19T06:59:16.580490+0000","last_peered":"2024-02-19T06:59:16.580490+0000","last_clean":"2024-02-19T06:59:16.580490+0000","last_became_active":"2024-02-19T06:59:15.597716+0000","last_became_peered":"2024-02-19T06:59:15.597716+0000","last_unstale":"2024-02-19T06:59:16.580490+0000","last_undegraded":"2024-02-19T06:59:16.580490+0000","last_fullsized":"2024-02-19T06:59:16.580490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:44:45.577762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.613549+0000","last_change":"2024-02-19T06:59:16.611981+0000","last_active":"2024-02-19T06:59:16.613549+0000","last_peered":"2024-02-19T06:59:16.613549+0000","last_clean":"2024-02-19T06:59:16.613549+0000","last_became_active":"2024-02-19T06:59:16.611546+0000","last_became_peered":"2024-02-19T06:59:16.611546+0000","last_unstale":"2024-02-19T06:59:16.613549+0000","last_undegraded":"2024-02-19T06:59:16.613549+0000","last_fullsized":"2024-02-19T06:59:16.613549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T11:48:21.918964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.603865+0000","last_change":"2024-02-19T06:59:15.600815+0000","last_active":"2024-02-19T06:59:16.603865+0000","last_peered":"2024-02-19T06:59:16.603865+0000","last_clean":"2024-02-19T06:59:16.603865+0000","last_became_active":"2024-02-19T06:59:15.600545+0000","last_became_peered":"2024-02-19T06:59:15.600545+0000","last_unstale":"2024-02-19T06:59:16.603865+0000","last_undegraded":"2024-02-19T06:59:16.603865+0000","last_fullsized":"2024-02-19T06:59:16.603865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T08:27:12.616942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.625556+0000","last_change":"2024-02-19T06:59:16.623104+0000","last_active":"2024-02-19T06:59:16.625556+0000","last_peered":"2024-02-19T06:59:16.625556+0000","last_clean":"2024-02-19T06:59:16.625556+0000","last_became_active":"2024-02-19T06:59:16.622494+0000","last_became_peered":"2024-02-19T06:59:16.622494+0000","last_unstale":"2024-02-19T06:59:16.625556+0000","last_undegraded":"2024-02-19T06:59:16.625556+0000","last_fullsized":"2024-02-19T06:59:16.625556+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T09:39:20.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.601437+0000","last_change":"2024-02-19T06:59:15.593199+0000","last_active":"2024-02-19T06:59:16.601437+0000","last_peered":"2024-02-19T06:59:16.601437+0000","last_clean":"2024-02-19T06:59:16.601437+0000","last_became_active":"2024-02-19T06:59:15.592903+0000","last_became_peered":"2024-02-19T06:59:15.592903+0000","last_unstale":"2024-02-19T06:59:16.601437+0000","last_undegraded":"2024-02-19T06:59:16.601437+0000","last_fullsized":"2024-02-19T06:59:16.601437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:32:59.341697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.620949+0000","last_change":"2024-02-19T06:59:16.613089+0000","last_active":"2024-02-19T06:59:16.620949+0000","last_peered":"2024-02-19T06:59:16.620949+0000","last_clean":"2024-02-19T06:59:16.620949+0000","last_became_active":"2024-02-19T06:59:16.610885+0000","last_became_peered":"2024-02-19T06:59:16.610885+0000","last_unstale":"2024-02-19T06:59:16.620949+0000","last_undegraded":"2024-02-19T06:59:16.620949+0000","last_fullsized":"2024-02-19T06:59:16.620949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T12:59:56.563183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-19T06:59:16.587944+0000","last_change":"2024-02-19T06:59:15.608188+0000","last_active":"2024-02-19T06:59:16.587944+0000","last_peered":"2024-02-19T06:59:16.587944+0000","last_clean":"2024-02-19T06:59:16.587944+0000","last_became_active":"2024-02-19T06:59:15.607906+0000","last_became_peered":"2024-02-19T06:59:15.607906+0000","last_unstale":"2024-02-19T06:59:16.587944+0000","last_undegraded":"2024-02-19T06:59:16.587944+0000","last_fullsized":"2024-02-19T06:59:16.587944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T17:32:56.691816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609615+0000","last_change":"2024-02-19T06:59:16.613034+0000","last_active":"2024-02-19T06:59:17.609615+0000","last_peered":"2024-02-19T06:59:17.609615+0000","last_clean":"2024-02-19T06:59:17.609615+0000","last_became_active":"2024-02-19T06:59:16.612730+0000","last_became_peered":"2024-02-19T06:59:16.612730+0000","last_unstale":"2024-02-19T06:59:17.609615+0000","last_undegraded":"2024-02-19T06:59:17.609615+0000","last_fullsized":"2024-02-19T06:59:17.609615+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:15.553659+0000","last_clean_scrub_stamp":"2024-02-19T06:59:15.553659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T10:52:37.096369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.606126+0000","last_change":"2024-02-19T06:59:15.599408+0000","last_active":"2024-02-19T06:59:17.606126+0000","last_peered":"2024-02-19T06:59:17.606126+0000","last_clean":"2024-02-19T06:59:17.606126+0000","last_became_active":"2024-02-19T06:59:15.599069+0000","last_became_peered":"2024-02-19T06:59:15.599069+0000","last_unstale":"2024-02-19T06:59:17.606126+0000","last_undegraded":"2024-02-19T06:59:17.606126+0000","last_fullsized":"2024-02-19T06:59:17.606126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:59:14.538326+0000","last_clean_scrub_stamp":"2024-02-19T06:59:14.538326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T13:08:21.931183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-19T06:59:17.609996+0000","last_change":"2024-02-19T06:57:45.353063+0000","last_active":"2024-02-19T06:59:17.609996+0000","last_peered":"2024-02-19T06:59:17.609996+0000","last_clean":"2024-02-19T06:59:17.609996+0000","last_became_active":"2024-02-19T06:57:45.350602+0000","last_became_peered":"2024-02-19T06:57:45.350602+0000","last_unstale":"2024-02-19T06:59:17.609996+0000","last_undegraded":"2024-02-19T06:59:17.609996+0000","last_fullsized":"2024-02-19T06:59:17.609996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_clean_scrub_stamp":"2024-02-19T06:57:44.230095+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:04:42.513180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":154432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.55}]},{"osd":1,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.3009999999999999}]},{"osd":2,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.246},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"last":1.6719999999999999}]},{"osd":3,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.7689999999999999}]},{"osd":4,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.0910000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.413},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":1.615}]},{"osd":5,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.224,"5min":1.224,"15min":1.224},"max":{"1min":3.2709999999999999,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":1.855},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.8460000000000001,"5min":2.8460000000000001,"15min":2.8460000000000001},"last":1.4610000000000001}]},{"osd":7,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":3.0089999999999999,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":1.8160000000000001},{"interface":"front","average":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":1.9039999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":154488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.946},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.876}]},{"osd":1,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":1.4570000000000001}]},{"osd":2,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.847},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.9929999999999999,"5min":2.9929999999999999,"15min":2.9929999999999999},"last":1.238}]},{"osd":3,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.6459999999999999,"5min":2.6459999999999999,"15min":2.6459999999999999},"last":2.1080000000000001},{"interface":"front","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.6760000000000002,"5min":3.6760000000000002,"15min":3.6760000000000002},"last":1.5069999999999999}]},{"osd":4,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":3.0950000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.355}]},{"osd":6,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":3.7269999999999999,"5min":3.7269999999999999,"15min":3.7269999999999999},"last":1.161},{"interface":"front","average":{"1min":1.7,"5min":1.7,"15min":1.7},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":3.367,"5min":3.367,"15min":3.367},"last":1.399}]},{"osd":7,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.7549999999999999},{"interface":"front","average":{"1min":1.851,"5min":1.851,"15min":1.851},"min":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"max":{"1min":3.5979999999999999,"5min":3.5979999999999999,"15min":3.5979999999999999},"last":1.3340000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":737974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.7270000000000001}]},{"osd":1,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.109},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.7}]},{"osd":2,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.629},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.379}]},{"osd":3,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.4870000000000001}]},{"osd":4,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.3799999999999999,"5min":3.3799999999999999,"15min":3.3799999999999999},"last":1.2410000000000001}]},{"osd":5,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.3199999999999998,"5min":3.3199999999999998,"15min":3.3199999999999998},"last":1.667},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.2810000000000001,"5min":3.2810000000000001,"15min":3.2810000000000001},"last":1.756}]},{"osd":6,"last update":"Mon Feb 19 06:58:44 2024","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":1.657,"15min":1.657},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":1.78},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":1.804}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":147620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.88100000000000001}]},{"osd":1,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":1.456}]},{"osd":3,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.272},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":1.3859999999999999}]},{"osd":5,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.234,"5min":1.234,"15min":1.234},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.2310000000000001}]},{"osd":6,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.349},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.5069999999999999}]},{"osd":7,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.643,"15min":1.643},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4299999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":149150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.66700000000000004}]},{"osd":1,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.72699999999999998}]},{"osd":4,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":0.89600000000000002}]},{"osd":5,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.876},{"interface":"front","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":1.0609999999999999}]},{"osd":6,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.1359999999999999}]},{"osd":7,"last update":"Mon Feb 19 06:58:46 2024","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.96099999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":380928,"data_stored":147586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.2709999999999999,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":0.77800000000000002}]},{"osd":1,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":3.4950000000000001,"5min":3.4950000000000001,"15min":3.4950000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.7970000000000002,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":1.004}]},{"osd":3,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.3069999999999999,"5min":3.3069999999999999,"15min":3.3069999999999999},"last":1.181},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":4.0700000000000003,"5min":4.0700000000000003,"15min":4.0700000000000003},"last":1.329}]},{"osd":4,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.1539999999999999,"5min":4.1539999999999999,"15min":4.1539999999999999},"last":1.415},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.25}]},{"osd":5,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":3.9390000000000001,"5min":3.9390000000000001,"15min":3.9390000000000001},"last":1.294},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":4.1120000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.4730000000000001}]},{"osd":6,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":3.9780000000000002,"5min":3.9780000000000002,"15min":3.9780000000000002},"last":1.383}]},{"osd":7,"last update":"Mon Feb 19 06:58:43 2024","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.589,"5min":1.589,"15min":1.589},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":3.8959999999999999,"5min":3.8959999999999999,"15min":3.8959999999999999},"last":1.4510000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":149150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.302}]},{"osd":2,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.5}]},{"osd":3,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.585},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.103}]},{"osd":4,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.55},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.26}]},{"osd":5,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.4390000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.6799999999999999}]},{"osd":6,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.6970000000000001,"5min":2.6970000000000001,"15min":2.6970000000000001},"last":1.45},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":1.74}]},{"osd":7,"last update":"Mon Feb 19 06:58:45 2024","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":1.625},{"interface":"front","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":1.841}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":737884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 06:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":5.4290000000000003,"5min":5.4290000000000003,"15min":5.4290000000000003},"last":1.1279999999999999}]},{"osd":2,"last update":"Mon Feb 19 06:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":5.3140000000000001,"5min":5.3140000000000001,"15min":5.3140000000000001},"last":1.399}]},{"osd":3,"last update":"Mon Feb 19 06:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":10.504,"5min":10.504,"15min":10.504},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.998}]},{"osd":4,"last update":"Mon Feb 19 06:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.365},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":1.609}]},{"osd":5,"last update":"Mon Feb 19 06:58:48 2024","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":4.4740000000000002,"5min":4.4740000000000002,"15min":4.4740000000000002},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":1.4399999999999999}]},{"osd":6,"last update":"Mon Feb 19 06:58:48 2024","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":4.5780000000000003,"5min":4.5780000000000003,"15min":4.5780000000000003},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.234}]},{"osd":7,"last update":"Mon Feb 19 06:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.79,"5min":1.79,"15min":1.79},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":4.532,"5min":4.532,"15min":4.532},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.6379999999999999,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.508}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T06:59:21.645 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-19T06:59:21.646 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-02-19T06:59:21.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.911+0000 7f2ce6400640 1 Processor -- start 2024-02-19T06:59:21.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.911+0000 7f2ce6400640 1 -- start start 2024-02-19T06:59:21.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.913+0000 7f2ce6400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2ce015dc00 0x7f2ce015dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.913+0000 7f2ce6400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00aec10 0x7f2ce0161d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.913+0000 7f2ce6400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce0161560 con 0x7f2ce0162260 2024-02-19T06:59:21.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.913+0000 7f2ce6400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce006ef90 con 0x7f2ce015dc00 2024-02-19T06:59:21.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.913+0000 7f2ce6400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce015e830 con 0x7f2ce00aec10 2024-02-19T06:59:21.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.914+0000 7f2cdfe00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2ce0162260 0x7f2ce00cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39478/0 (socket says 172.21.15.46:39478) 2024-02-19T06:59:21.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.914+0000 7f2cdfe00640 1 -- 172.21.15.46:0/2006007541 learned_addr learned my addr 172.21.15.46:0/2006007541 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:21.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.914+0000 7f2cdf400640 1 --2- 172.21.15.46:0/2006007541 >> v2:172.21.15.46:3300/0 conn(0x7f2ce015dc00 0x7f2ce015dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:21.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.914+0000 7f2cdea00640 1 --2- 172.21.15.46:0/2006007541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00aec10 0x7f2ce0161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:21.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.914+0000 7f2cdf400640 1 -- 172.21.15.46:0/2006007541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00aec10 msgr2=0x7f2ce0161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:21.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.914+0000 7f2cdf400640 1 --2- 172.21.15.46:0/2006007541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00aec10 0x7f2ce0161d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.914+0000 7f2cdf400640 1 -- 172.21.15.46:0/2006007541 >> v1:172.21.15.46:6789/0 conn(0x7f2ce0162260 legacy=0x7f2ce00cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:21.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.914+0000 7f2cdf400640 1 -- 172.21.15.46:0/2006007541 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce015eb10 con 0x7f2ce015dc00 2024-02-19T06:59:21.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.914+0000 7f2cde000640 1 -- 172.21.15.46:0/2006007541 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666973101 0 0) 0x7f2ce0161560 con 0x7f2ce0162260 2024-02-19T06:59:21.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.915+0000 7f2cdf400640 1 --2- 172.21.15.46:0/2006007541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce015dc00 0x7f2ce015dfe0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00097a0 tx=0x7f2cd002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9859800fd91c34 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:21.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.916+0000 7f2cde000640 1 -- 172.21.15.46:0/2006007541 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd002d040 con 0x7f2ce015dc00 2024-02-19T06:59:21.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.916+0000 7f2cde000640 1 -- 172.21.15.46:0/2006007541 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd0031810 con 0x7f2ce015dc00 2024-02-19T06:59:21.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.916+0000 7f2cde000640 1 -- 172.21.15.46:0/2006007541 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0031ba0 con 0x7f2ce015dc00 2024-02-19T06:59:21.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.916+0000 7f2ce6400640 1 -- 172.21.15.46:0/2006007541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce015dc00 msgr2=0x7f2ce015dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:21.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.916+0000 7f2ce6400640 1 --2- 172.21.15.46:0/2006007541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce015dc00 0x7f2ce015dfe0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00097a0 tx=0x7f2cd002b8b0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.916+0000 7f2ce6400640 1 -- 172.21.15.46:0/2006007541 shutdown_connections 2024-02-19T06:59:21.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.916+0000 7f2ce6400640 1 --2- 172.21.15.46:0/2006007541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00aec10 0x7f2ce0161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.916+0000 7f2ce6400640 1 --2- 172.21.15.46:0/2006007541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce015dc00 0x7f2ce015dfe0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.916+0000 7f2ce6400640 1 -- 172.21.15.46:0/2006007541 >> 172.21.15.46:0/2006007541 conn(0x7f2ce0066fc0 msgr2=0x7f2ce006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:21.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.916+0000 7f2ce6400640 1 -- 172.21.15.46:0/2006007541 shutdown_connections 2024-02-19T06:59:21.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.917+0000 7f2ce6400640 1 -- 172.21.15.46:0/2006007541 wait complete. 2024-02-19T06:59:21.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.918+0000 7f2ce6400640 1 Processor -- start 2024-02-19T06:59:21.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.918+0000 7f2ce6400640 1 -- start start 2024-02-19T06:59:21.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.919+0000 7f2ce6400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00aec10 0x7f2ce01542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.919+0000 7f2ce6400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce015dc00 0x7f2ce0152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.919+0000 7f2ce6400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce0162260 0x7f2ce0147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.919+0000 7f2ce6400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce01526c0 con 0x7f2ce015dc00 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.919+0000 7f2ce6400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce0153200 con 0x7f2ce0162260 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.919+0000 7f2ce6400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce01534e0 con 0x7f2ce00aec10 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.920+0000 7f2cdea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce015dc00 0x7f2ce0152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.920+0000 7f2cdea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce015dc00 0x7f2ce0152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54176/0 (socket says 172.21.15.46:54176) 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.920+0000 7f2cdea00640 1 -- 172.21.15.46:0/1738043122 learned_addr learned my addr 172.21.15.46:0/1738043122 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.920+0000 7f2cdf400640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00aec10 0x7f2ce01542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.920+0000 7f2cdea00640 1 -- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00aec10 msgr2=0x7f2ce01542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.920+0000 7f2cdea00640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00aec10 0x7f2ce01542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.920+0000 7f2cdea00640 1 -- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce0162260 msgr2=0x7f2ce0147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.920+0000 7f2cdea00640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce0162260 0x7f2ce0147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.920+0000 7f2cdea00640 1 -- 172.21.15.46:0/1738043122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd0009400 con 0x7f2ce015dc00 2024-02-19T06:59:21.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.920+0000 7f2cdf400640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00aec10 0x7f2ce01542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:21.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.920+0000 7f2cdea00640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce015dc00 0x7f2ce0152b70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00d800 tx=0x7f2ccc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:21.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.921+0000 7f2cd7400640 1 -- 172.21.15.46:0/1738043122 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc00b6c0 con 0x7f2ce015dc00 2024-02-19T06:59:21.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.921+0000 7f2cd7400640 1 -- 172.21.15.46:0/1738043122 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc00b820 con 0x7f2ce015dc00 2024-02-19T06:59:21.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.921+0000 7f2cd7400640 1 -- 172.21.15.46:0/1738043122 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc00bbb0 con 0x7f2ce015dc00 2024-02-19T06:59:21.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.921+0000 7f2ce6400640 1 -- 172.21.15.46:0/1738043122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce01537c0 con 0x7f2ce015dc00 2024-02-19T06:59:21.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.921+0000 7f2ce6400640 1 -- 172.21.15.46:0/1738043122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce0153d80 con 0x7f2ce015dc00 2024-02-19T06:59:21.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.922+0000 7f2ce6400640 1 -- 172.21.15.46:0/1738043122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce0153f10 con 0x7f2ce015dc00 2024-02-19T06:59:21.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.923+0000 7f2cd7400640 1 -- 172.21.15.46:0/1738043122 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2ccc00bd10 con 0x7f2ce015dc00 2024-02-19T06:59:21.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.924+0000 7f2cd7400640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2cc006b810 0x7f2cc006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:21.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.925+0000 7f2cd7400640 1 -- 172.21.15.46:0/1738043122 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ccc08a800 con 0x7f2ce015dc00 2024-02-19T06:59:21.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.925+0000 7f2cdf400640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2cc006b810 0x7f2cc006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:21.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.926+0000 7f2cdf400640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2cc006b810 0x7f2cc006dcd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0036000 tx=0x7f2cd003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:21.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:21.930+0000 7f2cd7400640 1 -- 172.21.15.46:0/1738043122 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2ccc055180 con 0x7f2ce015dc00 2024-02-19T06:59:22.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.205+0000 7f2ce6400640 1 -- 172.21.15.46:0/1738043122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2ce006b0b0 con 0x7f2ce015dc00 2024-02-19T06:59:22.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.208+0000 7f2cd7400640 1 -- 172.21.15.46:0/1738043122 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f2ccc058840 con 0x7f2ce015dc00 2024-02-19T06:59:22.211 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-02-19T06:59:22.211 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCu+9JlV/odHRAAsbrC4WBcXYprN1RbsTyFWA== 2024-02-19T06:59:22.211 INFO:teuthology.orchestra.run.smithi046.stdout: caps mds = "allow" 2024-02-19T06:59:22.211 INFO:teuthology.orchestra.run.smithi046.stdout: caps mon = "allow r" 2024-02-19T06:59:22.211 INFO:teuthology.orchestra.run.smithi046.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-02-19T06:59:22.212 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2024-02-19T06:59:22.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.212+0000 7f2ce6400640 1 -- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2cc006b810 msgr2=0x7f2cc006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:22.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.212+0000 7f2ce6400640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2cc006b810 0x7f2cc006dcd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0036000 tx=0x7f2cd003c040 comp rx=0 tx=0).stop 2024-02-19T06:59:22.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.212+0000 7f2ce6400640 1 -- 172.21.15.46:0/1738043122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce015dc00 msgr2=0x7f2ce0152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:22.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.212+0000 7f2ce6400640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce015dc00 0x7f2ce0152b70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00d800 tx=0x7f2ccc00dcc0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.212+0000 7f2ce6400640 1 -- 172.21.15.46:0/1738043122 shutdown_connections 2024-02-19T06:59:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.212+0000 7f2ce6400640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f2cc006b810 0x7f2cc006dcd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.212+0000 7f2ce6400640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce0162260 0x7f2ce0147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.212+0000 7f2ce6400640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ce015dc00 0x7f2ce0152b70 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.212+0000 7f2ce6400640 1 --2- 172.21.15.46:0/1738043122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00aec10 0x7f2ce01542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.212+0000 7f2ce6400640 1 -- 172.21.15.46:0/1738043122 >> 172.21.15.46:0/1738043122 conn(0x7f2ce0066fc0 msgr2=0x7f2ce006d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.212+0000 7f2ce6400640 1 -- 172.21.15.46:0/1738043122 shutdown_connections 2024-02-19T06:59:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.212+0000 7f2ce6400640 1 -- 172.21.15.46:0/1738043122 wait complete. 2024-02-19T06:59:22.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T06:59:22.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.460+0000 7f8e9be00640 1 Processor -- start 2024-02-19T06:59:22.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.460+0000 7f8e9be00640 1 -- start start 2024-02-19T06:59:22.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.462+0000 7f8e9be00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e9c0add30 0x7f8e9c0cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:22.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.462+0000 7f8e9be00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9c0ac1a0 con 0x7f8e9c0cf740 2024-02-19T06:59:22.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.462+0000 7f8e9be00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9c0cded0 con 0x7f8e9c0cfbc0 2024-02-19T06:59:22.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.462+0000 7f8e9be00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9c0ae110 con 0x7f8e9c0add30 2024-02-19T06:59:22.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.462+0000 7f8e92000640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8e9c0cf740 0x7f8e9c0cab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39486/0 (socket says 172.21.15.46:39486) 2024-02-19T06:59:22.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.462+0000 7f8e92000640 1 -- 172.21.15.46:0/1838482948 learned_addr learned my addr 172.21.15.46:0/1838482948 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:22.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9aa00640 1 --2- 172.21.15.46:0/1838482948 >> v2:172.21.15.142:3300/0 conn(0x7f8e9c0add30 0x7f8e9c0cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:22.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779382239 0 0) 0x7f8e9c0ac1a0 con 0x7f8e9c0cf740 2024-02-19T06:59:22.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e80003520 con 0x7f8e9c0cf740 2024-02-19T06:59:22.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4209988583 0 0) 0x7f8e80003520 con 0x7f8e9c0cf740 2024-02-19T06:59:22.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 >> v2:172.21.15.142:3300/0 conn(0x7f8e9c0add30 msgr2=0x7f8e9c0cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:22.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 --2- 172.21.15.46:0/1838482948 >> v2:172.21.15.142:3300/0 conn(0x7f8e9c0add30 0x7f8e9c0cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 >> v1:172.21.15.142:6789/0 conn(0x7f8e9c0cfbc0 legacy=0x7f8e9c0cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:22.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c0d0050 con 0x7f8e9c0cf740 2024-02-19T06:59:22.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f8e84001670 con 0x7f8e9c0cf740 2024-02-19T06:59:22.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 >> v1:172.21.15.46:6789/0 conn(0x7f8e9c0cf740 legacy=0x7f8e9c0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:22.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 --2- 172.21.15.46:0/1838482948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e80003970 0x7f8e80003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 --2- 172.21.15.46:0/1838482948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e800047c0 0x7f8e80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 --2- 172.21.15.46:0/1838482948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e80005180 0x7f8e8000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0ae110 con 0x7f8e800047c0 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8000c020 con 0x7f8e80003970 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.463+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8000c1e0 con 0x7f8e80005180 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.464+0000 7f8e92000640 1 --2- 172.21.15.46:0/1838482948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e800047c0 0x7f8e80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.464+0000 7f8e9aa00640 1 --2- 172.21.15.46:0/1838482948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e80003970 0x7f8e80003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.464+0000 7f8e92000640 1 -- 172.21.15.46:0/1838482948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e80005180 msgr2=0x7f8e8000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.464+0000 7f8e9b400640 1 --2- 172.21.15.46:0/1838482948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e80005180 0x7f8e8000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.464+0000 7f8e92000640 1 --2- 172.21.15.46:0/1838482948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e80005180 0x7f8e8000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.464+0000 7f8e92000640 1 -- 172.21.15.46:0/1838482948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e80003970 msgr2=0x7f8e80003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.464+0000 7f8e92000640 1 --2- 172.21.15.46:0/1838482948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e80003970 0x7f8e80003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.464+0000 7f8e92000640 1 -- 172.21.15.46:0/1838482948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e80003520 con 0x7f8e800047c0 2024-02-19T06:59:22.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.464+0000 7f8e9b400640 1 -- 172.21.15.46:0/1838482948 reap_dead start 2024-02-19T06:59:22.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.464+0000 7f8e9aa00640 1 --2- 172.21.15.46:0/1838482948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e80003970 0x7f8e80003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:22.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.465+0000 7f8e92000640 1 --2- 172.21.15.46:0/1838482948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e800047c0 0x7f8e80004c40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400c240 tx=0x7f8e800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b80f1a76eeeeec8 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:22.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.466+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84005ad0 con 0x7f8e800047c0 2024-02-19T06:59:22.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.466+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e84005c30 con 0x7f8e800047c0 2024-02-19T06:59:22.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.466+0000 7f8e9a000640 1 -- 172.21.15.46:0/1838482948 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8402caf0 con 0x7f8e800047c0 2024-02-19T06:59:22.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.466+0000 7f8e9be00640 1 -- 172.21.15.46:0/1838482948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e800047c0 msgr2=0x7f8e80004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:22.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.466+0000 7f8e9be00640 1 --2- 172.21.15.46:0/1838482948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e800047c0 0x7f8e80004c40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400c240 tx=0x7f8e800057f0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.466+0000 7f8e9be00640 1 -- 172.21.15.46:0/1838482948 shutdown_connections 2024-02-19T06:59:22.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.466+0000 7f8e9be00640 1 --2- 172.21.15.46:0/1838482948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e800047c0 0x7f8e80004c40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.466+0000 7f8e9be00640 1 -- 172.21.15.46:0/1838482948 >> 172.21.15.46:0/1838482948 conn(0x7f8e9c06afa0 msgr2=0x7f8e9c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:22.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.466+0000 7f8e9be00640 1 -- 172.21.15.46:0/1838482948 shutdown_connections 2024-02-19T06:59:22.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.466+0000 7f8e9be00640 1 -- 172.21.15.46:0/1838482948 wait complete. 2024-02-19T06:59:22.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.468+0000 7f8e9be00640 1 Processor -- start 2024-02-19T06:59:22.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.468+0000 7f8e9be00640 1 -- start start 2024-02-19T06:59:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.469+0000 7f8e9be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e800047c0 0x7f8e9c1f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.469+0000 7f8e9be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9c06ce40 0x7f8e9c1f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.469+0000 7f8e9be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e9c1603c0 0x7f8e9c160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.469+0000 7f8e9be00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c160d80 con 0x7f8e9c1603c0 2024-02-19T06:59:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.469+0000 7f8e9be00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0c8830 con 0x7f8e9c06ce40 2024-02-19T06:59:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.469+0000 7f8e9be00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0c7c20 con 0x7f8e800047c0 2024-02-19T06:59:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.470+0000 7f8e9b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e9c1603c0 0x7f8e9c160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.470+0000 7f8e9b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e9c1603c0 0x7f8e9c160840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54204/0 (socket says 172.21.15.46:54204) 2024-02-19T06:59:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.470+0000 7f8e9b400640 1 -- 172.21.15.46:0/4165119036 learned_addr learned my addr 172.21.15.46:0/4165119036 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.470+0000 7f8e9aa00640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e800047c0 0x7f8e9c1f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.470+0000 7f8e92000640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9c06ce40 0x7f8e9c1f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.470+0000 7f8e9b400640 1 -- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e800047c0 msgr2=0x7f8e9c1f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.470+0000 7f8e9b400640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e800047c0 0x7f8e9c1f30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.470+0000 7f8e9b400640 1 -- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9c06ce40 msgr2=0x7f8e9c1f3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:22.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.470+0000 7f8e9b400640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9c06ce40 0x7f8e9c1f3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.470+0000 7f8e9b400640 1 -- 172.21.15.46:0/4165119036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c0c7f00 con 0x7f8e9c1603c0 2024-02-19T06:59:22.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.471+0000 7f8e9b400640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e9c1603c0 0x7f8e9c160840 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0b25f0 tx=0x7f8e9400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:22.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.471+0000 7f8e93400640 1 -- 172.21.15.46:0/4165119036 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e94003b70 con 0x7f8e9c1603c0 2024-02-19T06:59:22.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.471+0000 7f8e93400640 1 -- 172.21.15.46:0/4165119036 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e94003cd0 con 0x7f8e9c1603c0 2024-02-19T06:59:22.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.471+0000 7f8e93400640 1 -- 172.21.15.46:0/4165119036 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e940052b0 con 0x7f8e9c1603c0 2024-02-19T06:59:22.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.471+0000 7f8e9be00640 1 -- 172.21.15.46:0/4165119036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9c0c81e0 con 0x7f8e9c1603c0 2024-02-19T06:59:22.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.471+0000 7f8e9be00640 1 -- 172.21.15.46:0/4165119036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9c0c77b0 con 0x7f8e9c1603c0 2024-02-19T06:59:22.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.472+0000 7f8e9be00640 1 -- 172.21.15.46:0/4165119036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9c0c79a0 con 0x7f8e9c1603c0 2024-02-19T06:59:22.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.473+0000 7f8e93400640 1 -- 172.21.15.46:0/4165119036 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8e94005410 con 0x7f8e9c1603c0 2024-02-19T06:59:22.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.474+0000 7f8e93400640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e7806b810 0x7f8e7806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:22.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.474+0000 7f8e93400640 1 -- 172.21.15.46:0/4165119036 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e94089b60 con 0x7f8e9c1603c0 2024-02-19T06:59:22.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.475+0000 7f8e9aa00640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e7806b810 0x7f8e7806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:22.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.476+0000 7f8e9aa00640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e7806b810 0x7f8e7806dcd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0507e0 tx=0x7f8e8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:22.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.479+0000 7f8e93400640 1 -- 172.21.15.46:0/4165119036 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8e940544e0 con 0x7f8e9c1603c0 2024-02-19T06:59:22.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.716+0000 7f8e9be00640 1 -- 172.21.15.46:0/4165119036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e9c0ad1b0 con 0x7f8e9c1603c0 2024-02-19T06:59:22.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.717+0000 7f8e93400640 1 -- 172.21.15.46:0/4165119036 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f8e94018070 con 0x7f8e9c1603c0 2024-02-19T06:59:22.720 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:22.720 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2121507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2121507890},{"type":"v1","addr":"172.21.15.142:6835","nonce":2121507890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3952092655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3952092655},{"type":"v1","addr":"172.21.15.46:6835","nonce":3952092655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1741774776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1741774776},{"type":"v1","addr":"172.21.15.142:6837","nonce":1741774776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:59:16.065049+0000","modified":"2024-02-19T06:59:19.096312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6834/1322569769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1322569769},{"type":"v1","addr":"172.21.15.46:6834","nonce":1322569769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-19T06:59:22.720 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-02-19T06:59:22.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.720+0000 7f8e9be00640 1 -- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e7806b810 msgr2=0x7f8e7806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:22.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.720+0000 7f8e9be00640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e7806b810 0x7f8e7806dcd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0507e0 tx=0x7f8e8c008040 comp rx=0 tx=0).stop 2024-02-19T06:59:22.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.720+0000 7f8e9be00640 1 -- 172.21.15.46:0/4165119036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e9c1603c0 msgr2=0x7f8e9c160840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:22.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.720+0000 7f8e9be00640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e9c1603c0 0x7f8e9c160840 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0b25f0 tx=0x7f8e9400dc00 comp rx=0 tx=0).stop 2024-02-19T06:59:22.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.720+0000 7f8e9be00640 1 -- 172.21.15.46:0/4165119036 shutdown_connections 2024-02-19T06:59:22.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.720+0000 7f8e9be00640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8e7806b810 0x7f8e7806dcd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.720+0000 7f8e9be00640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e9c1603c0 0x7f8e9c160840 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.720+0000 7f8e9be00640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9c06ce40 0x7f8e9c1f3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.720+0000 7f8e9be00640 1 --2- 172.21.15.46:0/4165119036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e800047c0 0x7f8e9c1f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:22.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.720+0000 7f8e9be00640 1 -- 172.21.15.46:0/4165119036 >> 172.21.15.46:0/4165119036 conn(0x7f8e9c06afa0 msgr2=0x7f8e9c070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:22.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.720+0000 7f8e9be00640 1 -- 172.21.15.46:0/4165119036 shutdown_connections 2024-02-19T06:59:22.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:22.720+0000 7f8e9be00640 1 -- 172.21.15.46:0/4165119036 wait complete. 2024-02-19T06:59:23.141 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-19T06:59:16.065049+0000', 'modified': '2024-02-19T06:59:19.096312+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5214}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5214': {'gid': 5214, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.46:6834/1322569769', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6832', 'nonce': 1322569769}, {'type': 'v1', 'addr': '172.21.15.46:6834', 'nonce': 1322569769}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-19T06:59:23.142 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-19T06:59:23.142 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-02-19T06:59:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.373+0000 7f9bb8800640 1 Processor -- start 2024-02-19T06:59:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.374+0000 7f9bb8800640 1 -- start start 2024-02-19T06:59:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.375+0000 7f9bb8800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9bb00cd280 0x7f9bb006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.375+0000 7f9bb8800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb00b4fc0 con 0x7f9bb00b4be0 2024-02-19T06:59:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.375+0000 7f9bb8800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb00ce5f0 con 0x7f9bb006e180 2024-02-19T06:59:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.375+0000 7f9bb8800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb006e610 con 0x7f9bb00cd280 2024-02-19T06:59:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.376+0000 7f9bb5400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9bb00cd280 0x7f9bb006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.376+0000 7f9bb5e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9bb00b4be0 0x7f9bb006bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39494/0 (socket says 172.21.15.46:39494) 2024-02-19T06:59:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.376+0000 7f9bb5e00640 1 -- 172.21.15.46:0/3064869203 learned_addr learned my addr 172.21.15.46:0/3064869203 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.376+0000 7f9bb5400640 1 -- 172.21.15.46:0/3064869203 >> v1:172.21.15.142:6789/0 conn(0x7f9bb006e180 legacy=0x7f9bb00b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.376+0000 7f9bb5400640 1 -- 172.21.15.46:0/3064869203 >> v1:172.21.15.46:6789/0 conn(0x7f9bb00b4be0 legacy=0x7f9bb006bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.377+0000 7f9bb4a00640 1 -- 172.21.15.46:0/3064869203 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560314047 0 0) 0x7f9bb00b4fc0 con 0x7f9bb00b4be0 2024-02-19T06:59:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.377+0000 7f9bb5400640 1 -- 172.21.15.46:0/3064869203 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb00cf600 con 0x7f9bb00cd280 2024-02-19T06:59:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.378+0000 7f9bb5400640 1 --2- 172.21.15.46:0/3064869203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb00cd280 0x7f9bb006dc40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00097a0 tx=0x7f9ba002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d62f330c10dd5f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:23.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.379+0000 7f9bb4a00640 1 -- 172.21.15.46:0/3064869203 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0031830 con 0x7f9bb00cd280 2024-02-19T06:59:23.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.379+0000 7f9bb4a00640 1 -- 172.21.15.46:0/3064869203 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba0031990 con 0x7f9bb00cd280 2024-02-19T06:59:23.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.379+0000 7f9bb4a00640 1 -- 172.21.15.46:0/3064869203 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0031d20 con 0x7f9bb00cd280 2024-02-19T06:59:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.379+0000 7f9bb8800640 1 -- 172.21.15.46:0/3064869203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb00cd280 msgr2=0x7f9bb006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.379+0000 7f9bb8800640 1 --2- 172.21.15.46:0/3064869203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb00cd280 0x7f9bb006dc40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00097a0 tx=0x7f9ba002b8d0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.379+0000 7f9bb8800640 1 -- 172.21.15.46:0/3064869203 shutdown_connections 2024-02-19T06:59:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.379+0000 7f9bb8800640 1 --2- 172.21.15.46:0/3064869203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb00cd280 0x7f9bb006dc40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.379+0000 7f9bb8800640 1 -- 172.21.15.46:0/3064869203 >> 172.21.15.46:0/3064869203 conn(0x7f9bb00cc760 msgr2=0x7f9bb00ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.380+0000 7f9bb8800640 1 -- 172.21.15.46:0/3064869203 shutdown_connections 2024-02-19T06:59:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.380+0000 7f9bb8800640 1 -- 172.21.15.46:0/3064869203 wait complete. 2024-02-19T06:59:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.381+0000 7f9bb8800640 1 Processor -- start 2024-02-19T06:59:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.381+0000 7f9bb8800640 1 -- start start 2024-02-19T06:59:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.382+0000 7f9bb8800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bb006e180 0x7f9bb0158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.382+0000 7f9bb8800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb00b4be0 0x7f9bb014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.382+0000 7f9bb8800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bb00cd280 0x7f9bb015e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.382+0000 7f9bb8800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00c5cf0 con 0x7f9bb00b4be0 2024-02-19T06:59:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.382+0000 7f9bb8800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00c50e0 con 0x7f9bb00cd280 2024-02-19T06:59:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.382+0000 7f9bb8800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00c53c0 con 0x7f9bb006e180 2024-02-19T06:59:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.383+0000 7f9bb5400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb00b4be0 0x7f9bb014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.383+0000 7f9bb5400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb00b4be0 0x7f9bb014e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54220/0 (socket says 172.21.15.46:54220) 2024-02-19T06:59:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.383+0000 7f9bb5400640 1 -- 172.21.15.46:0/85846061 learned_addr learned my addr 172.21.15.46:0/85846061 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.383+0000 7f9bb6800640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bb00cd280 0x7f9bb015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.383+0000 7f9bb5e00640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bb006e180 0x7f9bb0158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.383+0000 7f9bb5400640 1 -- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bb006e180 msgr2=0x7f9bb0158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.383+0000 7f9bb5400640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bb006e180 0x7f9bb0158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.383+0000 7f9bb5400640 1 -- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bb00cd280 msgr2=0x7f9bb015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.383+0000 7f9bb5400640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bb00cd280 0x7f9bb015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.383+0000 7f9bb5400640 1 -- 172.21.15.46:0/85846061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba0009400 con 0x7f9bb00b4be0 2024-02-19T06:59:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.383+0000 7f9bb5e00640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bb006e180 0x7f9bb0158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.383+0000 7f9bb6800640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bb00cd280 0x7f9bb015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.384+0000 7f9bb5400640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb00b4be0 0x7f9bb014e220 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00097a0 tx=0x7f9ba00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.384+0000 7f9baa000640 1 -- 172.21.15.46:0/85846061 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba003ca80 con 0x7f9bb00b4be0 2024-02-19T06:59:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.384+0000 7f9baa000640 1 -- 172.21.15.46:0/85846061 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba003cbe0 con 0x7f9bb00b4be0 2024-02-19T06:59:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.384+0000 7f9bb8800640 1 -- 172.21.15.46:0/85846061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb00c56a0 con 0x7f9bb00b4be0 2024-02-19T06:59:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.384+0000 7f9baa000640 1 -- 172.21.15.46:0/85846061 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0004030 con 0x7f9bb00b4be0 2024-02-19T06:59:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.384+0000 7f9bb8800640 1 -- 172.21.15.46:0/85846061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb014e760 con 0x7f9bb00b4be0 2024-02-19T06:59:23.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.386+0000 7f9baa000640 1 -- 172.21.15.46:0/85846061 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9ba0004190 con 0x7f9bb00b4be0 2024-02-19T06:59:23.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.387+0000 7f9baa000640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9b9406b810 0x7f9b9406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.387+0000 7f9baa000640 1 -- 172.21.15.46:0/85846061 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ba00ac9f0 con 0x7f9bb00b4be0 2024-02-19T06:59:23.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.388+0000 7f9bbb436740 1 Processor -- start 2024-02-19T06:59:23.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.388+0000 7f9bb5e00640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9b9406b810 0x7f9b9406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.388+0000 7f9bbb436740 1 -- start start 2024-02-19T06:59:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.389+0000 7f9bbb436740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39630 0x56120bc0c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.389+0000 7f9bbb436740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 0x56120bc3c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.389+0000 7f9bbb436740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc0cb10 0x56120bc3c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.389+0000 7f9bbb436740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120bb80b30 con 0x56120bc0cb10 2024-02-19T06:59:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.389+0000 7f9bbb436740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120bb7e060 con 0x56120bc39a10 2024-02-19T06:59:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.389+0000 7f9bbb436740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56120bb79840 con 0x56120bc39630 2024-02-19T06:59:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.389+0000 7f9bb5e00640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9b9406b810 0x7f9b9406dcd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4000f60 tx=0x7f9ba4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.390+0000 7f9bb6800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc0cb10 0x56120bc3c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.390+0000 7f9bb6800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc0cb10 0x56120bc3c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54228/0 (socket says 172.21.15.46:54228) 2024-02-19T06:59:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.390+0000 7f9bb6800640 1 -- 172.21.15.46:0/1163832975 learned_addr learned my addr 172.21.15.46:0/1163832975 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.390+0000 7f9bb5e00640 1 --2- 172.21.15.46:0/1163832975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39630 0x56120bc0c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.390+0000 7f9bb5400640 1 --2- 172.21.15.46:0/1163832975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 0x56120bc3c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.390+0000 7f9bb6800640 1 -- 172.21.15.46:0/1163832975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39630 msgr2=0x56120bc0c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.390+0000 7f9bb6800640 1 --2- 172.21.15.46:0/1163832975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39630 0x56120bc0c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.390+0000 7f9bb6800640 1 -- 172.21.15.46:0/1163832975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 msgr2=0x56120bc3c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.390+0000 7f9bb6800640 1 --2- 172.21.15.46:0/1163832975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 0x56120bc3c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.390+0000 7f9bb6800640 1 -- 172.21.15.46:0/1163832975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56120bb414c0 con 0x56120bc0cb10 2024-02-19T06:59:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.390+0000 7f9bb6800640 1 --2- 172.21.15.46:0/1163832975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc0cb10 0x56120bc3c900 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9bac007f40 tx=0x7f9bac00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565320b97dc7c144 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.391+0000 7f9b9e600640 1 -- 172.21.15.46:0/1163832975 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00cea0 con 0x56120bc0cb10 2024-02-19T06:59:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.391+0000 7f9b9e600640 1 -- 172.21.15.46:0/1163832975 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00f830 con 0x56120bc0cb10 2024-02-19T06:59:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.391+0000 7f9b9e600640 1 -- 172.21.15.46:0/1163832975 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00fbc0 con 0x56120bc0cb10 2024-02-19T06:59:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.391+0000 7f9bbb436740 1 -- 172.21.15.46:0/1163832975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc0cb10 msgr2=0x56120bc3c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.391+0000 7f9bbb436740 1 --2- 172.21.15.46:0/1163832975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc0cb10 0x56120bc3c900 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9bac007f40 tx=0x7f9bac00c730 comp rx=0 tx=0).stop 2024-02-19T06:59:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.391+0000 7f9bbb436740 1 -- 172.21.15.46:0/1163832975 shutdown_connections 2024-02-19T06:59:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.391+0000 7f9bbb436740 1 --2- 172.21.15.46:0/1163832975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc0cb10 0x56120bc3c900 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.391+0000 7f9bbb436740 1 --2- 172.21.15.46:0/1163832975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 0x56120bc3c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.391+0000 7f9bbb436740 1 --2- 172.21.15.46:0/1163832975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39630 0x56120bc0c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.391+0000 7f9bbb436740 1 -- 172.21.15.46:0/1163832975 >> 172.21.15.46:0/1163832975 conn(0x56120bc0e840 msgr2=0x56120bc573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.391+0000 7f9bbb436740 1 -- 172.21.15.46:0/1163832975 shutdown_connections 2024-02-19T06:59:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.391+0000 7f9bbb436740 1 -- 172.21.15.46:0/1163832975 wait complete. 2024-02-19T06:59:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.392+0000 7f9bbb436740 1 -- start start 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.392+0000 7f9bbb436740 1 Processor -- start 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.393+0000 7f9bbb436740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 0x56120bc3d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.393+0000 7f9bbb436740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39a10 0x56120bc29a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.393+0000 7f9bbb436740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc3fc80 0x56120bc40100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.393+0000 7f9bbb436740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120bb1eea0 con 0x56120bc39630 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.393+0000 7f9bbb436740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120bb1eb40 con 0x56120bc3fc80 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.393+0000 7f9bbb436740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56120b8c1f20 con 0x56120bc39a10 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.393+0000 7f9bbb436740 10 client.0 _ll_register_callbacks cb 0x56120bb32950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.394+0000 7f9bb5e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 0x56120bc3d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.394+0000 7f9bb5e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 0x56120bc3d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54238/0 (socket says 172.21.15.46:54238) 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.394+0000 7f9bb5e00640 1 -- 172.21.15.46:0/1287618342 learned_addr learned my addr 172.21.15.46:0/1287618342 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.394+0000 7f9bb5400640 1 --2- 172.21.15.46:0/1287618342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39a10 0x56120bc29a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.394+0000 7f9bb5e00640 1 -- 172.21.15.46:0/1287618342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39a10 msgr2=0x56120bc29a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.394+0000 7f9bb6800640 1 --2- 172.21.15.46:0/1287618342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc3fc80 0x56120bc40100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.394+0000 7f9bb5e00640 1 --2- 172.21.15.46:0/1287618342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39a10 0x56120bc29a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.394+0000 7f9bb5e00640 1 -- 172.21.15.46:0/1287618342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc3fc80 msgr2=0x56120bc40100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.394+0000 7f9bb5e00640 1 --2- 172.21.15.46:0/1287618342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc3fc80 0x56120bc40100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.394+0000 7f9bb5e00640 1 -- 172.21.15.46:0/1287618342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac007b40 con 0x56120bc39630 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.394+0000 7f9bb5e00640 1 --2- 172.21.15.46:0/1287618342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 0x56120bc3d560 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4005aa0 tx=0x7f9ba4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d63b33ae39c8b2 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.394+0000 7f9b92a00640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9b92a00640 1 -- 172.21.15.46:0/1287618342 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4012410 con 0x56120bc39630 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9b92a00640 1 -- 172.21.15.46:0/1287618342 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ba4021a90 con 0x56120bc39630 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9bbb436740 1 -- 172.21.15.46:0/1287618342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56120bb9dc40 con 0x56120bc39630 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9b92a00640 1 -- 172.21.15.46:0/1287618342 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ba4021480 con 0x56120bc39630 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9bbb436740 10 client.5394 fetch_fsmap learned FSMap version 17 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9bbb436740 1 -- 172.21.15.46:0/1287618342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56120bb77ec0 con 0x56120bc39630 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9b92a00640 1 -- 172.21.15.46:0/1287618342 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56120bb9dc40 con 0x56120bc39630 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9b92a00640 1 -- 172.21.15.46:0/1287618342 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9ba402a050 con 0x56120bc39630 2024-02-19T06:59:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9bbb436740 10 client.5394 fetch_fsmap finished waiting for FSMap version 17 2024-02-19T06:59:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9bbb436740 10 client.5394 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-19T06:59:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9bbb436740 20 client.5394 populate_metadata read hostname 'smithi046' 2024-02-19T06:59:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9bbb436740 1 --2- 172.21.15.46:0/1287618342 >> [v2:172.21.15.46:6832/1322569769,v1:172.21.15.46:6834/1322569769] conn(0x56120bc6b070 0x56120bc74850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9bbb436740 4 client.5394 mds_command: new command op to 5214 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-19T06:59:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.395+0000 7f9bbb436740 1 -- 172.21.15.46:0/1287618342 --> [v2:172.21.15.46:6832/1322569769,v1:172.21.15.46:6834/1322569769] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56120b8796c0 con 0x56120bc6b070 2024-02-19T06:59:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.396+0000 7f9bb5400640 1 --2- 172.21.15.46:0/1287618342 >> [v2:172.21.15.46:6832/1322569769,v1:172.21.15.46:6834/1322569769] conn(0x56120bc6b070 0x56120bc74850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.396+0000 7f9bb5400640 1 --2- 172.21.15.46:0/1287618342 >> [v2:172.21.15.46:6832/1322569769,v1:172.21.15.46:6834/1322569769] conn(0x56120bc6b070 0x56120bc74850 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=978ceea16cdc062e server_cookie=4f5a8bdfc5c166bf in_seq=0 out_seq=0 2024-02-19T06:59:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.396+0000 7f9b92a00640 10 client.5394 ms_handle_connect on v2:172.21.15.46:6832/1322569769 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.397+0000 7f9b92a00640 1 -- 172.21.15.46:0/1287618342 <== mds.0 v2:172.21.15.46:6832/1322569769 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56120b8796c0 con 0x56120bc6b070 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.397+0000 7f9b92a00640 10 client.5394 handle_command_reply: tid=0 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.397+0000 7f9bbb436740 1 client.5394 shutdown 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.397+0000 7f9bbb436740 1 -- 172.21.15.46:0/1287618342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 msgr2=0x56120bc3d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.397+0000 7f9bbb436740 1 --2- 172.21.15.46:0/1287618342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 0x56120bc3d560 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4005aa0 tx=0x7f9ba4000ed0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.397+0000 7f9bbb436740 1 -- 172.21.15.46:0/1287618342 shutdown_connections 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.397+0000 7f9bbb436740 1 --2- 172.21.15.46:0/1287618342 >> [v2:172.21.15.46:6832/1322569769,v1:172.21.15.46:6834/1322569769] conn(0x56120bc6b070 0x56120bc74850 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.397+0000 7f9bbb436740 1 --2- 172.21.15.46:0/1287618342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc3fc80 0x56120bc40100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.397+0000 7f9bbb436740 1 --2- 172.21.15.46:0/1287618342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39a10 0x56120bc29a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.397+0000 7f9bbb436740 1 --2- 172.21.15.46:0/1287618342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 0x56120bc3d560 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.397+0000 7f9bbb436740 1 -- 172.21.15.46:0/1287618342 >> 172.21.15.46:0/1287618342 conn(0x56120bc0cb10 msgr2=0x56120bc5b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.397+0000 7f9b92a00640 0 client.5394 ms_handle_reset on v2:172.21.15.46:6832/1322569769 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.397+0000 7f9bbb436740 1 -- 172.21.15.46:0/1287618342 shutdown_connections 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.398+0000 7f9bbb436740 1 -- 172.21.15.46:0/1287618342 wait complete. 2024-02-19T06:59:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.398+0000 7f9bbb436740 20 client.5394 trim_cache size 0 max 16384 2024-02-19T06:59:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.415+0000 7f9bbb436740 1 Processor -- start 2024-02-19T06:59:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.415+0000 7f9bbb436740 1 -- start start 2024-02-19T06:59:23.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.416+0000 7f9bbb436740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39630 0x56120bc57660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.416+0000 7f9bbb436740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 0x56120bc3dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.416+0000 7f9bbb436740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc3fc80 0x56120bc3e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.416+0000 7f9bbb436740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120bc57d30 con 0x56120bc3fc80 2024-02-19T06:59:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.416+0000 7f9bbb436740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120bc08560 con 0x56120bc39a10 2024-02-19T06:59:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.416+0000 7f9bbb436740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56120bc0c4f0 con 0x56120bc39630 2024-02-19T06:59:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.416+0000 7f9bb6800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc3fc80 0x56120bc3e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.416+0000 7f9bb6800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc3fc80 0x56120bc3e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54254/0 (socket says 172.21.15.46:54254) 2024-02-19T06:59:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.416+0000 7f9bb6800640 1 -- 172.21.15.46:0/3993215653 learned_addr learned my addr 172.21.15.46:0/3993215653 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:23.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.417+0000 7f9bb5400640 1 --2- 172.21.15.46:0/3993215653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 0x56120bc3dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.417+0000 7f9bb5e00640 1 --2- 172.21.15.46:0/3993215653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39630 0x56120bc57660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.417+0000 7f9bb6800640 1 -- 172.21.15.46:0/3993215653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39630 msgr2=0x56120bc57660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:23.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.417+0000 7f9bb6800640 1 --2- 172.21.15.46:0/3993215653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39630 0x56120bc57660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.417+0000 7f9bb6800640 1 -- 172.21.15.46:0/3993215653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 msgr2=0x56120bc3dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:23.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.417+0000 7f9bb6800640 1 --2- 172.21.15.46:0/3993215653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 0x56120bc3dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.417+0000 7f9bb6800640 1 -- 172.21.15.46:0/3993215653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56120bc392b0 con 0x56120bc3fc80 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.417+0000 7f9bb5400640 1 --2- 172.21.15.46:0/3993215653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 0x56120bc3dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.417+0000 7f9bb6800640 1 --2- 172.21.15.46:0/3993215653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc3fc80 0x56120bc3e120 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9bac007ee0 tx=0x7f9bac011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d1ac378fbef535 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.417+0000 7f9b9dc00640 1 -- 172.21.15.46:0/3993215653 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac007260 con 0x56120bc3fc80 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.417+0000 7f9b9dc00640 1 -- 172.21.15.46:0/3993215653 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00f9a0 con 0x56120bc3fc80 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.417+0000 7f9b9dc00640 1 -- 172.21.15.46:0/3993215653 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00fd90 con 0x56120bc3fc80 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.418+0000 7f9bbb436740 1 -- 172.21.15.46:0/3993215653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc3fc80 msgr2=0x56120bc3e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.418+0000 7f9bbb436740 1 --2- 172.21.15.46:0/3993215653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc3fc80 0x56120bc3e120 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9bac007ee0 tx=0x7f9bac011000 comp rx=0 tx=0).stop 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.418+0000 7f9bbb436740 1 -- 172.21.15.46:0/3993215653 shutdown_connections 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.418+0000 7f9bbb436740 1 --2- 172.21.15.46:0/3993215653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc3fc80 0x56120bc3e120 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.418+0000 7f9bbb436740 1 --2- 172.21.15.46:0/3993215653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 0x56120bc3dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.418+0000 7f9bbb436740 1 --2- 172.21.15.46:0/3993215653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc39630 0x56120bc57660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.418+0000 7f9bbb436740 1 -- 172.21.15.46:0/3993215653 >> 172.21.15.46:0/3993215653 conn(0x56120bc0cb10 msgr2=0x56120bc29880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.418+0000 7f9bbb436740 1 -- 172.21.15.46:0/3993215653 shutdown_connections 2024-02-19T06:59:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.418+0000 7f9bbb436740 1 -- 172.21.15.46:0/3993215653 wait complete. 2024-02-19T06:59:23.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.419+0000 7f9bbb436740 1 -- start start 2024-02-19T06:59:23.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.419+0000 7f9bbb436740 1 Processor -- start 2024-02-19T06:59:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.420+0000 7f9bbb436740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 0x56120bcc0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.420+0000 7f9bbb436740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 0x56120bc37950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.420+0000 7f9bbb436740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc3fc80 0x56120bc37e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.420+0000 7f9bbb436740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120bc12300 con 0x56120bc39630 2024-02-19T06:59:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.420+0000 7f9bbb436740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120bc693e0 con 0x56120bc39a10 2024-02-19T06:59:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.420+0000 7f9bbb436740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56120bc79600 con 0x56120bc3fc80 2024-02-19T06:59:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.420+0000 7f9bbb436740 10 client.0 _ll_register_callbacks cb 0x7f9ba40013d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-19T06:59:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.420+0000 7f9bb5e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 0x56120bcc0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.420+0000 7f9bb5e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 0x56120bcc0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54258/0 (socket says 172.21.15.46:54258) 2024-02-19T06:59:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.420+0000 7f9bb5e00640 1 -- 172.21.15.46:0/2269661972 learned_addr learned my addr 172.21.15.46:0/2269661972 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.421+0000 7f9bb6800640 1 --2- 172.21.15.46:0/2269661972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc3fc80 0x56120bc37e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.421+0000 7f9bb5400640 1 --2- 172.21.15.46:0/2269661972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 0x56120bc37950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.421+0000 7f9bb5e00640 1 -- 172.21.15.46:0/2269661972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc3fc80 msgr2=0x56120bc37e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.421+0000 7f9bb5e00640 1 --2- 172.21.15.46:0/2269661972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc3fc80 0x56120bc37e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.421+0000 7f9bb5e00640 1 -- 172.21.15.46:0/2269661972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 msgr2=0x56120bc37950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.421+0000 7f9bb5e00640 1 --2- 172.21.15.46:0/2269661972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 0x56120bc37950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.421+0000 7f9bb5e00640 1 -- 172.21.15.46:0/2269661972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56120bb414c0 con 0x56120bc39630 2024-02-19T06:59:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.421+0000 7f9bb5e00640 1 --2- 172.21.15.46:0/2269661972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 0x56120bcc0b50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4007c90 tx=0x7f9ba4007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123725117be8ffe5 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.421+0000 7f9b92a00640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-02-19T06:59:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.421+0000 7f9b92a00640 1 -- 172.21.15.46:0/2269661972 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4021480 con 0x56120bc39630 2024-02-19T06:59:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.421+0000 7f9b92a00640 1 -- 172.21.15.46:0/2269661972 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ba4021840 con 0x56120bc39630 2024-02-19T06:59:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.421+0000 7f9bbb436740 1 -- 172.21.15.46:0/2269661972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9bac00f830 con 0x56120bc39630 2024-02-19T06:59:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.422+0000 7f9b92a00640 1 -- 172.21.15.46:0/2269661972 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ba4021a10 con 0x56120bc39630 2024-02-19T06:59:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.422+0000 7f9bbb436740 10 client.5400 fetch_fsmap learned FSMap version 17 2024-02-19T06:59:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.422+0000 7f9bbb436740 1 -- 172.21.15.46:0/2269661972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56120bb148b0 con 0x56120bc39630 2024-02-19T06:59:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.422+0000 7f9b92a00640 1 -- 172.21.15.46:0/2269661972 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00f830 con 0x56120bc39630 2024-02-19T06:59:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.422+0000 7f9b92a00640 1 -- 172.21.15.46:0/2269661972 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9ba402a040 con 0x56120bc39630 2024-02-19T06:59:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.422+0000 7f9bbb436740 10 client.5400 fetch_fsmap finished waiting for FSMap version 17 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.422+0000 7f9bbb436740 10 client.5400 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.422+0000 7f9bbb436740 20 client.5400 populate_metadata read hostname 'smithi046' 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.422+0000 7f9bbb436740 1 --2- 172.21.15.46:0/2269661972 >> [v2:172.21.15.46:6832/1322569769,v1:172.21.15.46:6834/1322569769] conn(0x56120bcc4dc0 0x56120bcc51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.422+0000 7f9bbb436740 4 client.5400 mds_command: new command op to 5214 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.422+0000 7f9bbb436740 1 -- 172.21.15.46:0/2269661972 --> [v2:172.21.15.46:6832/1322569769,v1:172.21.15.46:6834/1322569769] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56120b8ca270 con 0x56120bcc4dc0 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.422+0000 7f9bb5400640 1 --2- 172.21.15.46:0/2269661972 >> [v2:172.21.15.46:6832/1322569769,v1:172.21.15.46:6834/1322569769] conn(0x56120bcc4dc0 0x56120bcc51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.423+0000 7f9bb5400640 1 --2- 172.21.15.46:0/2269661972 >> [v2:172.21.15.46:6832/1322569769,v1:172.21.15.46:6834/1322569769] conn(0x56120bcc4dc0 0x56120bcc51a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=867bdec6c2d04e5e server_cookie=544032153430d7bc in_seq=0 out_seq=0 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.423+0000 7f9b92a00640 10 client.5400 ms_handle_connect on v2:172.21.15.46:6832/1322569769 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.423+0000 7f9b92a00640 1 -- 172.21.15.46:0/2269661972 <== mds.0 v2:172.21.15.46:6832/1322569769 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56120b8ca270 con 0x56120bcc4dc0 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.423+0000 7f9b92a00640 10 client.5400 handle_command_reply: tid=0 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.423+0000 7f9bbb436740 1 client.5400 shutdown 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.423+0000 7f9bbb436740 1 -- 172.21.15.46:0/2269661972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 msgr2=0x56120bcc0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.423+0000 7f9bbb436740 1 --2- 172.21.15.46:0/2269661972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 0x56120bcc0b50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4007c90 tx=0x7f9ba4007000 comp rx=0 tx=0).stop 2024-02-19T06:59:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9bbb436740 1 -- 172.21.15.46:0/2269661972 shutdown_connections 2024-02-19T06:59:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9bbb436740 1 --2- 172.21.15.46:0/2269661972 >> [v2:172.21.15.46:6832/1322569769,v1:172.21.15.46:6834/1322569769] conn(0x56120bcc4dc0 0x56120bcc51a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9bbb436740 1 --2- 172.21.15.46:0/2269661972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56120bc3fc80 0x56120bc37e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9bbb436740 1 --2- 172.21.15.46:0/2269661972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56120bc39a10 0x56120bc37950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9bbb436740 1 --2- 172.21.15.46:0/2269661972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56120bc39630 0x56120bcc0b50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9b92a00640 0 client.5400 ms_handle_reset on v2:172.21.15.46:6832/1322569769 2024-02-19T06:59:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9bbb436740 1 -- 172.21.15.46:0/2269661972 >> 172.21.15.46:0/2269661972 conn(0x56120bc0cb10 msgr2=0x56120bc3dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9bbb436740 1 -- 172.21.15.46:0/2269661972 shutdown_connections 2024-02-19T06:59:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9bbb436740 1 -- 172.21.15.46:0/2269661972 wait complete. 2024-02-19T06:59:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9bbb436740 20 client.5400 trim_cache size 0 max 16384 2024-02-19T06:59:23.430 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T06:59:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "858a958e-c459-4ec6-89ff-1327e8665984", 2024-02-19T06:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-02-19T06:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 5214, 2024-02-19T06:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-02-19T06:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-02-19T06:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-02-19T06:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 6.8502566270000003, 2024-02-19T06:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 17, 2024-02-19T06:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 35, 2024-02-19T06:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 35, 2024-02-19T06:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 15.855992788 2024-02-19T06:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T06:59:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9bb8800640 1 -- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9b9406b810 msgr2=0x7f9b9406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9bb8800640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9b9406b810 0x7f9b9406dcd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4000f60 tx=0x7f9ba4009040 comp rx=0 tx=0).stop 2024-02-19T06:59:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9bb8800640 1 -- 172.21.15.46:0/85846061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb00b4be0 msgr2=0x7f9bb014e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.424+0000 7f9bb8800640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb00b4be0 0x7f9bb014e220 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00097a0 tx=0x7f9ba00046c0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.425+0000 7f9bb8800640 1 -- 172.21.15.46:0/85846061 shutdown_connections 2024-02-19T06:59:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.425+0000 7f9bb8800640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f9b9406b810 0x7f9b9406dcd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.425+0000 7f9bb8800640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bb00cd280 0x7f9bb015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.425+0000 7f9bb8800640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bb00b4be0 0x7f9bb014e220 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.425+0000 7f9bb8800640 1 --2- 172.21.15.46:0/85846061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bb006e180 0x7f9bb0158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.425+0000 7f9bb8800640 1 -- 172.21.15.46:0/85846061 >> 172.21.15.46:0/85846061 conn(0x7f9bb00cc760 msgr2=0x7f9bb00b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.425+0000 7f9bb8800640 1 -- 172.21.15.46:0/85846061 shutdown_connections 2024-02-19T06:59:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.425+0000 7f9bb8800640 1 -- 172.21.15.46:0/85846061 wait complete. 2024-02-19T06:59:23.444 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-19T06:59:23.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.649+0000 7fc41b200640 1 Processor -- start 2024-02-19T06:59:23.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.649+0000 7fc41b200640 1 -- start start 2024-02-19T06:59:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.651+0000 7fc41b200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc41c0cf480 0x7fc41c0cf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.651+0000 7fc41b200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc41c15e6e0 0x7fc41c070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.651+0000 7fc41b200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c0b32b0 con 0x7fc41c0cdf70 2024-02-19T06:59:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.651+0000 7fc41b200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41c0cfda0 con 0x7fc41c15e6e0 2024-02-19T06:59:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.651+0000 7fc41b200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41c0ce8a0 con 0x7fc41c0cf480 2024-02-19T06:59:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.652+0000 7fc413e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc41c15e6e0 0x7fc41c070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.652+0000 7fc41a800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc41c0cdf70 0x7fc41c0b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39498/0 (socket says 172.21.15.46:39498) 2024-02-19T06:59:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.652+0000 7fc41a800640 1 -- 172.21.15.46:0/2441301353 learned_addr learned my addr 172.21.15.46:0/2441301353 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T06:59:23.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.652+0000 7fc419e00640 1 --2- 172.21.15.46:0/2441301353 >> v2:172.21.15.142:3300/0 conn(0x7fc41c0cf480 0x7fc41c0cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.652+0000 7fc413e00640 1 -- 172.21.15.46:0/2441301353 >> v2:172.21.15.142:3300/0 conn(0x7fc41c0cf480 msgr2=0x7fc41c0cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T06:59:23.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.652+0000 7fc413e00640 1 --2- 172.21.15.46:0/2441301353 >> v2:172.21.15.142:3300/0 conn(0x7fc41c0cf480 0x7fc41c0cf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.652+0000 7fc413e00640 1 -- 172.21.15.46:0/2441301353 >> v1:172.21.15.46:6789/0 conn(0x7fc41c0cdf70 legacy=0x7fc41c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.652+0000 7fc413e00640 1 -- 172.21.15.46:0/2441301353 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c0ceb80 con 0x7fc41c15e6e0 2024-02-19T06:59:23.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.653+0000 7fc413e00640 1 --2- 172.21.15.46:0/2441301353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41c15e6e0 0x7fc41c070ed0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0ccdc0 tx=0x7fc40402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b7557aa5bdbe4d server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:23.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.654+0000 7fc419400640 1 -- 172.21.15.46:0/2441301353 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404031710 con 0x7fc41c15e6e0 2024-02-19T06:59:23.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.654+0000 7fc419400640 1 -- 172.21.15.46:0/2441301353 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40402f050 con 0x7fc41c15e6e0 2024-02-19T06:59:23.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.654+0000 7fc419400640 1 -- 172.21.15.46:0/2441301353 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404031a90 con 0x7fc41c15e6e0 2024-02-19T06:59:23.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.654+0000 7fc41b200640 1 -- 172.21.15.46:0/2441301353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41c15e6e0 msgr2=0x7fc41c070ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.654+0000 7fc41b200640 1 --2- 172.21.15.46:0/2441301353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41c15e6e0 0x7fc41c070ed0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0ccdc0 tx=0x7fc40402b7b0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.654+0000 7fc41b200640 1 -- 172.21.15.46:0/2441301353 shutdown_connections 2024-02-19T06:59:23.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.654+0000 7fc41b200640 1 --2- 172.21.15.46:0/2441301353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41c15e6e0 0x7fc41c070ed0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.654+0000 7fc41b200640 1 --2- 172.21.15.46:0/2441301353 >> v2:172.21.15.142:3300/0 conn(0x7fc41c0cf480 0x7fc41c0cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.654+0000 7fc41b200640 1 -- 172.21.15.46:0/2441301353 >> 172.21.15.46:0/2441301353 conn(0x7fc41c06ad60 msgr2=0x7fc41c06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:23.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.654+0000 7fc41b200640 1 -- 172.21.15.46:0/2441301353 shutdown_connections 2024-02-19T06:59:23.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.654+0000 7fc41b200640 1 -- 172.21.15.46:0/2441301353 wait complete. 2024-02-19T06:59:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.656+0000 7fc41b200640 1 Processor -- start 2024-02-19T06:59:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.656+0000 7fc41b200640 1 -- start start 2024-02-19T06:59:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.657+0000 7fc41b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41c0cdf70 0x7fc41c143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.657+0000 7fc41b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc41c0cf480 0x7fc41c1f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.657+0000 7fc41b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc41c15e6e0 0x7fc41c141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.657+0000 7fc41b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0c80b0 con 0x7fc41c0cdf70 2024-02-19T06:59:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.657+0000 7fc41b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c144430 con 0x7fc41c0cf480 2024-02-19T06:59:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.657+0000 7fc41b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0c66b0 con 0x7fc41c15e6e0 2024-02-19T06:59:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.657+0000 7fc419e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41c0cdf70 0x7fc41c143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.657+0000 7fc419e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41c0cdf70 0x7fc41c143ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54284/0 (socket says 172.21.15.46:54284) 2024-02-19T06:59:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.657+0000 7fc419e00640 1 -- 172.21.15.46:0/1927420063 learned_addr learned my addr 172.21.15.46:0/1927420063 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T06:59:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.658+0000 7fc413e00640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc41c0cf480 0x7fc41c1f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.658+0000 7fc41a800640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc41c15e6e0 0x7fc41c141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.658+0000 7fc419e00640 1 -- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc41c15e6e0 msgr2=0x7fc41c141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.658+0000 7fc419e00640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc41c15e6e0 0x7fc41c141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.658+0000 7fc419e00640 1 -- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc41c0cf480 msgr2=0x7fc41c1f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.658+0000 7fc419e00640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc41c0cf480 0x7fc41c1f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.658+0000 7fc419e00640 1 -- 172.21.15.46:0/1927420063 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404009400 con 0x7fc41c0cdf70 2024-02-19T06:59:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.658+0000 7fc413e00640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc41c0cf480 0x7fc41c1f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T06:59:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.658+0000 7fc419e00640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41c0cdf70 0x7fc41c143ef0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00d5f0 tx=0x7fc40c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.659+0000 7fc412000640 1 -- 172.21.15.46:0/1927420063 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c0125f0 con 0x7fc41c0cdf70 2024-02-19T06:59:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.659+0000 7fc412000640 1 -- 172.21.15.46:0/1927420063 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40c012750 con 0x7fc41c0cdf70 2024-02-19T06:59:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.659+0000 7fc412000640 1 -- 172.21.15.46:0/1927420063 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c012b00 con 0x7fc41c0cdf70 2024-02-19T06:59:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.659+0000 7fc41b200640 1 -- 172.21.15.46:0/1927420063 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41c071590 con 0x7fc41c0cdf70 2024-02-19T06:59:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.659+0000 7fc41b200640 1 -- 172.21.15.46:0/1927420063 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41c0c8630 con 0x7fc41c0cdf70 2024-02-19T06:59:23.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.660+0000 7fc41b200640 1 -- 172.21.15.46:0/1927420063 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41c0c7f10 con 0x7fc41c0cdf70 2024-02-19T06:59:23.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.661+0000 7fc412000640 1 -- 172.21.15.46:0/1927420063 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc40c012c60 con 0x7fc41c0cdf70 2024-02-19T06:59:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.662+0000 7fc412000640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc3f806b810 0x7fc3f806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T06:59:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.662+0000 7fc412000640 1 -- 172.21.15.46:0/1927420063 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc40c08a7e0 con 0x7fc41c0cdf70 2024-02-19T06:59:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.662+0000 7fc413e00640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc3f806b810 0x7fc3f806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T06:59:23.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.664+0000 7fc413e00640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc3f806b810 0x7fc3f806dcd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc404035000 tx=0x7fc404008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T06:59:23.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.666+0000 7fc412000640 1 -- 172.21.15.46:0/1927420063 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc41c0c7f10 con 0x7fc41c0cdf70 2024-02-19T06:59:23.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.902+0000 7fc41b200640 1 -- 172.21.15.46:0/1927420063 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc41c0c7f10 con 0x7fc41c0cdf70 2024-02-19T06:59:23.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.903+0000 7fc412000640 1 -- 172.21.15.46:0/1927420063 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc41c0c7f10 con 0x7fc41c0cdf70 2024-02-19T06:59:23.906 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-19T06:59:23.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.905+0000 7fc41b200640 1 -- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc3f806b810 msgr2=0x7fc3f806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.905+0000 7fc41b200640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc3f806b810 0x7fc3f806dcd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc404035000 tx=0x7fc404008030 comp rx=0 tx=0).stop 2024-02-19T06:59:23.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.905+0000 7fc41b200640 1 -- 172.21.15.46:0/1927420063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41c0cdf70 msgr2=0x7fc41c143ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T06:59:23.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.905+0000 7fc41b200640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41c0cdf70 0x7fc41c143ef0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00d5f0 tx=0x7fc40c00dab0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.906+0000 7fc41b200640 1 -- 172.21.15.46:0/1927420063 shutdown_connections 2024-02-19T06:59:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.906+0000 7fc41b200640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc3f806b810 0x7fc3f806dcd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.906+0000 7fc41b200640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc41c15e6e0 0x7fc41c141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.906+0000 7fc41b200640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc41c0cf480 0x7fc41c1f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.906+0000 7fc41b200640 1 --2- 172.21.15.46:0/1927420063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41c0cdf70 0x7fc41c143ef0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T06:59:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.906+0000 7fc41b200640 1 -- 172.21.15.46:0/1927420063 >> 172.21.15.46:0/1927420063 conn(0x7fc41c06ad60 msgr2=0x7fc41c06b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T06:59:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.906+0000 7fc41b200640 1 -- 172.21.15.46:0/1927420063 shutdown_connections 2024-02-19T06:59:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:23.906+0000 7fc41b200640 1 -- 172.21.15.46:0/1927420063 wait complete. 2024-02-19T06:59:23.928 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-19T06:59:23.928 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-19T06:59:23.929 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-02-19T06:59:23.929 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-19T06:59:23.929 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-19T06:59:23.929 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-19T06:59:23.929 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-19T06:59:23.929 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-19T06:59:23.929 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-19T06:59:23.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:23.929 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-02-19T06:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T06:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T06:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T06:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-02-19T06:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-02-19T06:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 41692sec preferred_lft 41692sec 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-19T06:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 4a:9e:dd:dc:2f:2a brd ff:ff:ff:ff:ff:ff 2024-02-19T06:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-19T06:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::506e:52ff:feda:bc5b/64 scope link proto kernel_ll 2024-02-19T06:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-19T06:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 4a:9e:dd:dc:2f:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::489e:ddff:fedc:2f2a/64 scope link proto kernel_ll 2024-02-19T06:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-19T06:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 8a:22:ca:7b:2e:8a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-19T06:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::8822:caff:fe7b:2e8a/64 scope link proto kernel_ll 2024-02-19T06:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T06:59:23.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:23.986 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-19T06:59:24.078 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-02-19T06:59:24.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:24.085 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-02-19T06:59:24.140 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-02-19T06:59:24.141 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-19T06:59:24.141 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-19T06:59:24.141 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-19T06:59:24.141 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-19T06:59:24.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:24.141 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T06:59:24.141 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T06:59:24.141 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-19T06:59:24.142 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-19T06:59:24.142 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-19T06:59:24.142 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T06:59:24.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:24.340 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-02-19T06:59:24.391 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-19T06:59:24.391 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-02-19T06:59:24.392 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-19T06:59:24.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:24.392 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-02-19T06:59:24.481 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-02-19T06:59:24.481 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T06:59:24.481 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-19T06:59:24.537 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-19T06:59:24.538 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T06:59:24.538 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-19T06:59:24.595 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-02-19T06:59:24.696 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-02-19T06:59:24.756 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-02-19T06:59:24.756 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-02-19T06:59:24.756 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-02-19T06:59:24.756 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-02-19T06:59:24.757 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-02-19T06:59:24.757 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-02-19T06:59:24.757 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-02-19T06:59:24.757 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-02-19T06:59:24.757 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-02-19T06:59:24.757 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-02-19T06:59:24.758 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-02-19T06:59:24.758 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-02-19T06:59:24.758 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-02-19T06:59:24.758 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-02-19T06:59:24.758 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-02-19T06:59:24.758 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-02-19T06:59:24.759 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-02-19T06:59:24.759 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-02-19T06:59:24.759 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-02-19T06:59:24.759 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-19T06:59:24.759 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-19T06:59:24.759 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-02-19T06:59:24.759 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-02-19T06:59:24.760 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-02-19T06:59:24.760 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-02-19T06:59:24.760 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-02-19T06:59:24.760 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-02-19T06:59:24.760 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-02-19T06:59:24.760 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-02-19T06:59:24.761 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:59:24.761 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:59:24.761 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-19T06:59:24.761 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-19T06:59:24.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:24.763 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-02-19T06:59:24.818 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-19T06:59:24.818 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-02-19T06:59:24.825 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-02-19T06:59:24.908 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-02-19T06:59:24.956 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-02-19T06:59:24.956 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-02-19T06:59:24.956 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-02-19T06:59:24.956 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-02-19T06:59:24.956 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-02-19T06:59:24.956 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-02-19T06:59:24.956 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-02-19T06:59:24.956 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-02-19T06:59:24.956 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-02-19T06:59:24.956 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-02-19T06:59:24.957 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-02-19T06:59:24.957 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-02-19T06:59:24.957 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-02-19T06:59:24.957 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-02-19T06:59:24.957 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-02-19T06:59:24.957 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-02-19T06:59:24.957 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-02-19T06:59:24.957 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-02-19T06:59:24.957 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-02-19T06:59:24.957 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-19T06:59:24.957 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-19T06:59:24.957 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-02-19T06:59:24.957 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-02-19T06:59:24.958 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-02-19T06:59:24.958 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-02-19T06:59:24.958 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-02-19T06:59:24.958 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-02-19T06:59:24.958 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-02-19T06:59:24.958 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-02-19T06:59:24.958 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:59:24.958 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:59:24.958 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-19T06:59:24.958 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-19T06:59:24.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:24.959 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-02-19T06:59:25.019 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:2024-02-19T06:59:25.017+0000 7f44fae47480 -1 init, newargv = 0x555cbc0fef00 newargc=15 2024-02-19T06:59:25.019 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[50267]: starting ceph client 2024-02-19T06:59:25.027 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[50267]: starting fuse 2024-02-19T06:59:26.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-02-19T06:59:26.209 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-02-19T06:59:26.269 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-02-19T06:59:26.270 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-02-19T06:59:26.271 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:59:26.272 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T06:59:26.272 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-19T06:59:26.272 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-19T06:59:26.272 INFO:teuthology.orchestra.run.smithi046.stdout:/home/ubuntu/cephtest/mnt.0 2024-02-19T06:59:26.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:26.273 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-02-19T06:59:26.330 INFO:teuthology.orchestra.run.smithi046.stdout:40 2024-02-19T06:59:26.330 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-02-19T06:59:26.330 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2024-02-19T06:59:26.330 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2024-02-19T06:59:26.330 DEBUG:teuthology.orchestra.run.smithi046:> import re 2024-02-19T06:59:26.330 DEBUG:teuthology.orchestra.run.smithi046:> import os 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-19T06:59:26.331 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-19T06:59:26.332 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2024-02-19T06:59:26.332 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2024-02-19T06:59:26.332 DEBUG:teuthology.orchestra.run.smithi046:> return f 2024-02-19T06:59:26.332 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-19T06:59:26.332 DEBUG:teuthology.orchestra.run.smithi046:> 2024-02-19T06:59:26.332 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.0")) 2024-02-19T06:59:26.332 DEBUG:teuthology.orchestra.run.smithi046:> ' 2024-02-19T06:59:26.522 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.0.50267.asok 2024-02-19T06:59:26.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T06:59:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-19T06:59:26.545 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50267.asok 2024-02-19T06:59:26.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:26.545 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50267.asok status 2024-02-19T06:59:26.797 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T06:59:26.797 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2024-02-19T06:59:26.797 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "25296a8f176256aea5ed8b5850b25167dce0ae33", 2024-02-19T06:59:26.797 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.0.0-1514-g25296a8f (25296a8f176256aea5ed8b5850b25167dce0ae33) squid (dev)", 2024-02-19T06:59:26.797 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "0", 2024-02-19T06:59:26.797 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2024-02-19T06:59:26.797 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-02-19T06:59:26.798 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "50267", 2024-02-19T06:59:26.798 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2024-02-19T06:59:26.798 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:26.798 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2024-02-19T06:59:26.798 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2024-02-19T06:59:26.798 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 5415, 2024-02-19T06:59:26.798 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2024-02-19T06:59:26.798 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2024-02-19T06:59:26.798 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2024-02-19T06:59:26.798 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 5415 2024-02-19T06:59:26.798 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:26.798 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-02-19T06:59:26.798 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 3553388278 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 3553388278 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.5415 192.168.0.1:0/3553388278", 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.1:0/3553388278", 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 17, 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 35, 2024-02-19T06:59:26.799 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2024-02-19T06:59:26.800 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2024-02-19T06:59:26.800 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2024-02-19T06:59:26.800 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T06:59:26.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:26.813 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2024-02-19T06:59:26.813 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.0 2024-02-19T06:59:26.872 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2024-02-19T06:59:26.872 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-02-19T06:59:26.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:26.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-19T06:59:26.975 DEBUG:teuthology.orchestra.run.smithi046:> mktemp -d --suffix=xfstests-dev 2024-02-19T06:59:27.032 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.ca873QOZoIxfstests-dev 2024-02-19T06:59:27.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:27.033 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.ca873QOZoIxfstests-dev) 2024-02-19T06:59:27.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:27.136 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.ca873QOZoIxfstests-dev) 2024-02-19T06:59:27.203 INFO:teuthology.orchestra.run.smithi046.stderr:Cloning into '/tmp/tmp.ca873QOZoIxfstests-dev'... 2024-02-19T06:59:28.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:28.222 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-02-19T06:59:28.284 DEBUG:teuthology.orchestra.run.smithi046:> mktemp -d --suffix=test 2024-02-19T06:59:28.335 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.03skzeLSgitest 2024-02-19T06:59:28.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T06:59:28.336 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-02-19T06:59:28.391 DEBUG:teuthology.orchestra.run.smithi046:> mktemp -d --suffix=scratch 2024-02-19T06:59:28.448 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.rEx5Zf47dKscratch 2024-02-19T06:59:28.448 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-02-19T06:59:28.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-02-19T06:59:29.333 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:07:52 ago on Mon 19 Feb 2024 06:51:37 AM UTC. 2024-02-19T06:59:29.458 INFO:teuthology.orchestra.run.smithi046.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-02-19T06:59:29.459 INFO:teuthology.orchestra.run.smithi046.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-02-19T06:59:29.460 INFO:teuthology.orchestra.run.smithi046.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-02-19T06:59:29.462 INFO:teuthology.orchestra.run.smithi046.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-02-19T06:59:29.463 INFO:teuthology.orchestra.run.smithi046.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-02-19T06:59:29.465 INFO:teuthology.orchestra.run.smithi046.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-02-19T06:59:29.467 INFO:teuthology.orchestra.run.smithi046.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-02-19T06:59:29.468 INFO:teuthology.orchestra.run.smithi046.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-02-19T06:59:29.470 INFO:teuthology.orchestra.run.smithi046.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-02-19T06:59:29.473 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-02-19T06:59:29.474 INFO:teuthology.orchestra.run.smithi046.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-02-19T06:59:29.476 INFO:teuthology.orchestra.run.smithi046.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-02-19T06:59:29.477 INFO:teuthology.orchestra.run.smithi046.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-02-19T06:59:29.479 INFO:teuthology.orchestra.run.smithi046.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-02-19T06:59:29.480 INFO:teuthology.orchestra.run.smithi046.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-02-19T06:59:29.481 INFO:teuthology.orchestra.run.smithi046.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-02-19T06:59:29.482 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-02-19T06:59:29.483 INFO:teuthology.orchestra.run.smithi046.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-02-19T06:59:29.484 INFO:teuthology.orchestra.run.smithi046.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-02-19T06:59:29.488 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-02-19T06:59:29.561 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T06:59:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T06:59:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-02-19T06:59:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T06:59:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T06:59:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-02-19T06:59:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-02-19T06:59:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2024-02-19T06:59:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-02-19T06:59:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-devel x86_64 5.14.0-421.el9 CentOS-AppStream 22 M 2024-02-19T06:59:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2024-02-19T06:59:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: sqlite x86_64 3.34.1-7.el9 CentOS-AppStream 747 k 2024-02-19T06:59:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2024-02-19T06:59:29.566 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-02-19T06:59:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: cpp x86_64 11.4.1-3.el9 CentOS-AppStream 11 M 2024-02-19T06:59:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: device-mapper x86_64 9:1.02.197-2.el9 CentOS-BaseOS 139 k 2024-02-19T06:59:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: device-mapper-event x86_64 9:1.02.197-2.el9 CentOS-BaseOS 33 k 2024-02-19T06:59:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: device-mapper-event-libs x86_64 9:1.02.197-2.el9 CentOS-BaseOS 31 k 2024-02-19T06:59:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: device-mapper-libs x86_64 9:1.02.197-2.el9 CentOS-BaseOS 178 k 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: e2fsprogs x86_64 1.46.5-5.el9 CentOS-BaseOS 1.0 M 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: e2fsprogs-libs x86_64 1.46.5-5.el9 CentOS-BaseOS 221 k 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: gcc x86_64 11.4.1-3.el9 CentOS-AppStream 32 M 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: gcc-c++ x86_64 11.4.1-3.el9 CentOS-AppStream 13 M 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: gcc-plugin-annobin x86_64 11.4.1-3.el9 CentOS-AppStream 46 k 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: git x86_64 2.43.0-1.el9 CentOS-AppStream 50 k 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: git-core x86_64 2.43.0-1.el9 CentOS-AppStream 4.4 M 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: git-core-doc noarch 2.43.0-1.el9 CentOS-AppStream 2.6 M 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: libcom_err x86_64 1.46.5-5.el9 CentOS-BaseOS 25 k 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: libgcc x86_64 11.4.1-3.el9 CentOS-BaseOS 91 k 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: libgomp x86_64 11.4.1-3.el9 CentOS-BaseOS 267 k 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: libss x86_64 1.46.5-5.el9 CentOS-BaseOS 31 k 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: libstdc++ x86_64 11.4.1-3.el9 CentOS-BaseOS 739 k 2024-02-19T06:59:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: libstdc++-devel x86_64 11.4.1-3.el9 CentOS-AppStream 2.2 M 2024-02-19T06:59:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: lvm2 x86_64 9:2.03.23-2.el9 CentOS-BaseOS 1.5 M 2024-02-19T06:59:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: lvm2-libs x86_64 9:2.03.23-2.el9 CentOS-BaseOS 1.0 M 2024-02-19T06:59:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: make x86_64 1:4.3-8.el9 CentOS-BaseOS 529 k 2024-02-19T06:59:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: perl-Git noarch 2.43.0-1.el9 CentOS-AppStream 37 k 2024-02-19T06:59:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: python-unversioned-command noarch 3.9.18-3.el9 CentOS-AppStream 8.3 k 2024-02-19T06:59:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: python3 x86_64 3.9.18-3.el9 CentOS-BaseOS 25 k 2024-02-19T06:59:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.18-3.el9 CentOS-AppStream 204 k 2024-02-19T06:59:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: python3-libs x86_64 3.9.18-3.el9 CentOS-BaseOS 7.3 M 2024-02-19T06:59:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: sqlite-libs x86_64 3.34.1-7.el9 CentOS-BaseOS 619 k 2024-02-19T06:59:29.568 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-02-19T06:59:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2024-02-19T06:59:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: libnbd x86_64 1.18.1-3.el9 CentOS-AppStream 165 k 2024-02-19T06:59:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2024-02-19T06:59:29.569 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-02-19T06:59:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-02-19T06:59:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-02-19T06:59:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-02-19T06:59:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-02-19T06:59:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-02-19T06:59:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-02-19T06:59:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:29.570 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T06:59:29.570 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T06:59:29.570 INFO:teuthology.orchestra.run.smithi046.stdout:Install 17 Packages 2024-02-19T06:59:29.570 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 28 Packages 2024-02-19T06:59:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T06:59:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 108 M 2024-02-19T06:59:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T06:59:30.001 INFO:teuthology.orchestra.run.smithi046.stdout:(1/45): fio-engine-http-3.35-1.el9.x86_64.rpm 80 kB/s | 17 kB 00:00 2024-02-19T06:59:30.025 INFO:teuthology.orchestra.run.smithi046.stdout:(2/45): fio-engine-libaio-3.35-1.el9.x86_64.rpm 61 kB/s | 14 kB 00:00 2024-02-19T06:59:30.084 INFO:teuthology.orchestra.run.smithi046.stdout:(3/45): fio-engine-nbd-3.35-1.el9.x86_64.rpm 169 kB/s | 13 kB 00:00 2024-02-19T06:59:30.126 INFO:teuthology.orchestra.run.smithi046.stdout:(4/45): fio-engine-rados-3.35-1.el9.x86_64.rpm 150 kB/s | 15 kB 00:00 2024-02-19T06:59:30.368 INFO:teuthology.orchestra.run.smithi046.stdout:(5/45): fio-3.35-1.el9.x86_64.rpm 11 MB/s | 6.2 MB 00:00 2024-02-19T06:59:30.393 INFO:teuthology.orchestra.run.smithi046.stdout:(6/45): fio-engine-rbd-3.35-1.el9.x86_64.rpm 50 kB/s | 15 kB 00:00 2024-02-19T06:59:30.418 INFO:teuthology.orchestra.run.smithi046.stdout:(7/45): fio-engine-rdma-3.35-1.el9.x86_64.rpm 70 kB/s | 20 kB 00:00 2024-02-19T06:59:30.452 INFO:teuthology.orchestra.run.smithi046.stdout:(8/45): libcap-devel-2.48-9.el9.x86_64.rpm 579 kB/s | 33 kB 00:00 2024-02-19T06:59:30.569 INFO:teuthology.orchestra.run.smithi046.stdout:(9/45): libnbd-1.18.1-3.el9.x86_64.rpm 1.1 MB/s | 165 kB 00:00 2024-02-19T06:59:30.661 INFO:teuthology.orchestra.run.smithi046.stdout:(10/45): sqlite-3.34.1-7.el9.x86_64.rpm 3.8 MB/s | 747 kB 00:00 2024-02-19T06:59:30.895 INFO:teuthology.orchestra.run.smithi046.stdout:(11/45): kernel-devel-5.14.0-421.el9.x86_64.rpm 43 MB/s | 22 MB 00:00 2024-02-19T06:59:30.920 INFO:teuthology.orchestra.run.smithi046.stdout:(12/45): udftools-2.2-5.el9.x86_64.rpm 420 kB/s | 144 kB 00:00 2024-02-19T06:59:30.945 INFO:teuthology.orchestra.run.smithi046.stdout:(13/45): rmt-1.6-6.el9.x86_64.rpm 164 kB/s | 45 kB 00:00 2024-02-19T06:59:31.287 INFO:teuthology.orchestra.run.smithi046.stdout:(14/45): gdbm-devel-1.19-4.el9.x86_64.rpm 161 kB/s | 59 kB 00:00 2024-02-19T06:59:31.354 INFO:teuthology.orchestra.run.smithi046.stdout:(15/45): gdbm-1.19-4.el9.x86_64.rpm 306 kB/s | 132 kB 00:00 2024-02-19T06:59:31.454 INFO:teuthology.orchestra.run.smithi046.stdout:(16/45): dump-0.4-0.51.b47.el9.x86_64.rpm 173 kB/s | 88 kB 00:00 2024-02-19T06:59:31.671 INFO:teuthology.orchestra.run.smithi046.stdout:(17/45): cpp-11.4.1-3.el9.x86_64.rpm 44 MB/s | 11 MB 00:00 2024-02-19T06:59:31.846 INFO:teuthology.orchestra.run.smithi046.stdout:(18/45): indent-2.2.13-5.el9.x86_64.rpm 322 kB/s | 179 kB 00:00 2024-02-19T06:59:32.206 INFO:teuthology.orchestra.run.smithi046.stdout:(19/45): gcc-11.4.1-3.el9.x86_64.rpm 44 MB/s | 32 MB 00:00 2024-02-19T06:59:32.389 INFO:teuthology.orchestra.run.smithi046.stdout:(20/45): gcc-c++-11.4.1-3.el9.x86_64.rpm 18 MB/s | 13 MB 00:00 2024-02-19T06:59:32.414 INFO:teuthology.orchestra.run.smithi046.stdout:(21/45): gcc-plugin-annobin-11.4.1-3.el9.x86_64 82 kB/s | 46 kB 00:00 2024-02-19T06:59:32.464 INFO:teuthology.orchestra.run.smithi046.stdout:(22/45): git-2.43.0-1.el9.x86_64.rpm 1.0 MB/s | 50 kB 00:00 2024-02-19T06:59:32.573 INFO:teuthology.orchestra.run.smithi046.stdout:(23/45): git-core-doc-2.43.0-1.el9.noarch.rpm 17 MB/s | 2.6 MB 00:00 2024-02-19T06:59:32.698 INFO:teuthology.orchestra.run.smithi046.stdout:(24/45): git-core-2.43.0-1.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-02-19T06:59:32.765 INFO:teuthology.orchestra.run.smithi046.stdout:(25/45): libstdc++-devel-11.4.1-3.el9.x86_64.rp 7.5 MB/s | 2.2 MB 00:00 2024-02-19T06:59:32.790 INFO:teuthology.orchestra.run.smithi046.stdout:(26/45): perl-Git-2.43.0-1.el9.noarch.rpm 184 kB/s | 37 kB 00:00 2024-02-19T06:59:32.815 INFO:teuthology.orchestra.run.smithi046.stdout:(27/45): python-unversioned-command-3.9.18-3.el 76 kB/s | 8.3 kB 00:00 2024-02-19T06:59:32.841 INFO:teuthology.orchestra.run.smithi046.stdout:(28/45): device-mapper-1.02.197-2.el9.x86_64.rp 2.8 MB/s | 139 kB 00:00 2024-02-19T06:59:32.874 INFO:teuthology.orchestra.run.smithi046.stdout:(29/45): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 204 kB 00:00 2024-02-19T06:59:32.900 INFO:teuthology.orchestra.run.smithi046.stdout:(30/45): device-mapper-event-1.02.197-2.el9.x86 406 kB/s | 33 kB 00:00 2024-02-19T06:59:32.925 INFO:teuthology.orchestra.run.smithi046.stdout:(31/45): device-mapper-event-libs-1.02.197-2.el 385 kB/s | 31 kB 00:00 2024-02-19T06:59:32.967 INFO:teuthology.orchestra.run.smithi046.stdout:(32/45): device-mapper-libs-1.02.197-2.el9.x86_ 2.7 MB/s | 178 kB 00:00 2024-02-19T06:59:33.009 INFO:teuthology.orchestra.run.smithi046.stdout:(33/45): e2fsprogs-1.46.5-5.el9.x86_64.rpm 9.2 MB/s | 1.0 MB 00:00 2024-02-19T06:59:33.042 INFO:teuthology.orchestra.run.smithi046.stdout:(34/45): e2fsprogs-libs-1.46.5-5.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-02-19T06:59:33.068 INFO:teuthology.orchestra.run.smithi046.stdout:(35/45): libcom_err-1.46.5-5.el9.x86_64.rpm 454 kB/s | 25 kB 00:00 2024-02-19T06:59:33.093 INFO:teuthology.orchestra.run.smithi046.stdout:(36/45): libgcc-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 91 kB 00:00 2024-02-19T06:59:33.126 INFO:teuthology.orchestra.run.smithi046.stdout:(37/45): libgomp-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 267 kB 00:00 2024-02-19T06:59:33.177 INFO:teuthology.orchestra.run.smithi046.stdout:(38/45): libstdc++-11.4.1-3.el9.x86_64.rpm 9.1 MB/s | 739 kB 00:00 2024-02-19T06:59:33.210 INFO:teuthology.orchestra.run.smithi046.stdout:(39/45): libss-1.46.5-5.el9.x86_64.rpm 270 kB/s | 31 kB 00:00 2024-02-19T06:59:33.277 INFO:teuthology.orchestra.run.smithi046.stdout:(40/45): lvm2-2.03.23-2.el9.x86_64.rpm 10 MB/s | 1.5 MB 00:00 2024-02-19T06:59:33.319 INFO:teuthology.orchestra.run.smithi046.stdout:(41/45): lvm2-libs-2.03.23-2.el9.x86_64.rpm 7.8 MB/s | 1.0 MB 00:00 2024-02-19T06:59:33.361 INFO:teuthology.orchestra.run.smithi046.stdout:(42/45): make-4.3-8.el9.x86_64.rpm 3.7 MB/s | 529 kB 00:00 2024-02-19T06:59:33.386 INFO:teuthology.orchestra.run.smithi046.stdout:(43/45): python3-3.9.18-3.el9.x86_64.rpm 412 kB/s | 25 kB 00:00 2024-02-19T06:59:33.645 INFO:teuthology.orchestra.run.smithi046.stdout:(44/45): python3-libs-3.9.18-3.el9.x86_64.rpm 23 MB/s | 7.3 MB 00:00 2024-02-19T06:59:33.678 INFO:teuthology.orchestra.run.smithi046.stdout:(45/45): sqlite-libs-3.34.1-7.el9.x86_64.rpm 1.9 MB/s | 619 kB 00:00 2024-02-19T06:59:33.692 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T06:59:33.692 INFO:teuthology.orchestra.run.smithi046.stdout:Total 26 MB/s | 108 MB 00:04 2024-02-19T06:59:33.772 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T06:59:34.205 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T06:59:34.205 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T06:59:35.652 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T06:59:35.652 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T06:59:38.795 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T06:59:38.855 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libgcc-11.4.1-3.el9.x86_64 1/73 2024-02-19T06:59:38.946 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libgcc-11.4.1-3.el9.x86_64 1/73 2024-02-19T06:59:39.043 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libcom_err-1.46.5-5.el9.x86_64 2/73 2024-02-19T06:59:39.124 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libstdc++-11.4.1-3.el9.x86_64 3/73 2024-02-19T06:59:39.194 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : e2fsprogs-libs-1.46.5-5.el9.x86_64 4/73 2024-02-19T06:59:39.285 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : device-mapper-libs-9:1.02.197-2.el9.x86_64 5/73 2024-02-19T06:59:39.326 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : device-mapper-9:1.02.197-2.el9.x86_64 6/73 2024-02-19T06:59:39.396 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 7/73 2024-02-19T06:59:41.145 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : sqlite-libs-3.34.1-7.el9.x86_64 8/73 2024-02-19T06:59:41.270 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : python3-libs-3.9.18-3.el9.x86_64 9/73 2024-02-19T06:59:41.305 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : python3-3.9.18-3.el9.x86_64 10/73 2024-02-19T06:59:41.400 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : python-unversioned-command-3.9.18-3.el9.noarch 11/73 2024-02-19T06:59:41.739 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : make-1:4.3-8.el9.x86_64 12/73 2024-02-19T06:59:41.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T06:59:41.824 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T06:59:42.964 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : git-core-2.43.0-1.el9.x86_64 13/73 2024-02-19T06:59:43.072 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : git-core-doc-2.43.0-1.el9.noarch 14/73 2024-02-19T06:59:43.121 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : perl-Git-2.43.0-1.el9.noarch 15/73 2024-02-19T06:59:43.164 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : git-2.43.0-1.el9.x86_64 16/73 2024-02-19T06:59:43.200 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-02-19T06:59:43.590 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-02-19T06:59:44.308 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : lvm2-libs-9:2.03.23-2.el9.x86_64 18/73 2024-02-19T06:59:44.413 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libstdc++-devel-11.4.1-3.el9.x86_64 19/73 2024-02-19T06:59:44.468 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libss-1.46.5-5.el9.x86_64 20/73 2024-02-19T06:59:44.785 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libgomp-11.4.1-3.el9.x86_64 21/73 2024-02-19T06:59:46.049 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : cpp-11.4.1-3.el9.x86_64 22/73 2024-02-19T06:59:46.246 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : gcc-11.4.1-3.el9.x86_64 23/73 2024-02-19T06:59:46.338 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: gcc-11.4.1-3.el9.x86_64 23/73 2024-02-19T06:59:46.381 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 24/73 2024-02-19T06:59:46.425 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rmt-2:1.6-6.el9.x86_64 25/73 2024-02-19T06:59:46.460 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 26/73 2024-02-19T06:59:46.494 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 27/73 2024-02-19T06:59:46.527 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 28/73 2024-02-19T06:59:46.561 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 29/73 2024-02-19T06:59:46.594 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 30/73 2024-02-19T06:59:46.629 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 31/73 2024-02-19T06:59:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 32/73 2024-02-19T06:59:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fio-3.35-1.el9.x86_64 33/73 2024-02-19T06:59:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 34/73 2024-02-19T06:59:58.972 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 35/73 2024-02-19T06:59:59.255 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-devel-5.14.0-421.el9.x86_64 36/73 2024-02-19T07:00:11.963 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:00:11.972 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:00:42.110 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:00:42.119 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:00:52.291 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-devel-5.14.0-421.el9.x86_64 36/73 2024-02-19T07:00:52.375 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : gcc-c++-11.4.1-3.el9.x86_64 37/73 2024-02-19T07:00:52.406 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-02-19T07:00:52.614 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-02-19T07:00:52.873 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : e2fsprogs-1.46.5-5.el9.x86_64 39/73 2024-02-19T07:00:52.873 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-02-19T07:00:52.873 INFO:teuthology.orchestra.run.smithi046.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2024-02-19T07:00:52.873 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:00:53.383 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-02-19T07:00:53.434 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : python3-devel-3.9.18-3.el9.x86_64 41/73 2024-02-19T07:00:53.497 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 42/73 2024-02-19T07:00:53.560 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : indent-2.2.13-5.el9.x86_64 43/73 2024-02-19T07:00:53.636 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : udftools-2.2-5.el9.x86_64 44/73 2024-02-19T07:00:53.669 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 45/73 2024-02-19T07:00:53.709 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : git-2.39.3-1.el9.x86_64 46/73 2024-02-19T07:00:53.748 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 47/73 2024-02-19T07:00:53.788 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 48/73 2024-02-19T07:00:53.830 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 49/73 2024-02-19T07:00:53.862 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 50/73 2024-02-19T07:00:53.897 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 51/73 2024-02-19T07:00:53.935 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 52/73 2024-02-19T07:00:53.935 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : lvm2-9:2.03.21-3.el9.x86_64 52/73 2024-02-19T07:00:54.036 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 52/73 2024-02-19T07:00:54.073 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : lvm2-libs-9:2.03.21-3.el9.x86_64 53/73 2024-02-19T07:00:54.101 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: device-mapper-event-9:1.02.195-3.el9.x86_64 54/73 2024-02-19T07:00:54.141 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : device-mapper-event-9:1.02.195-3.el9.x86_64 54/73 2024-02-19T07:00:54.174 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 55/73 2024-02-19T07:00:54.175 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 56/73 2024-02-19T07:00:54.326 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 56/73 2024-02-19T07:00:54.429 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 57/73 2024-02-19T07:00:54.482 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : git-core-doc-2.39.3-1.el9.noarch 58/73 2024-02-19T07:00:54.524 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : perl-Git-2.39.3-1.el9.noarch 59/73 2024-02-19T07:00:54.577 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 60/73 2024-02-19T07:00:54.609 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 61/73 2024-02-19T07:00:54.643 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 62/73 2024-02-19T07:00:54.676 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 63/73 2024-02-19T07:00:54.728 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : device-mapper-libs-9:1.02.195-3.el9.x86_64 64/73 2024-02-19T07:00:54.878 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : device-mapper-9:1.02.195-3.el9.x86_64 65/73 2024-02-19T07:00:54.938 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 66/73 2024-02-19T07:00:54.971 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : sqlite-libs-3.34.1-6.el9.x86_64 67/73 2024-02-19T07:00:55.005 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 68/73 2024-02-19T07:00:55.005 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-02-19T07:00:55.136 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-02-19T07:00:55.174 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 70/73 2024-02-19T07:00:55.209 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 71/73 2024-02-19T07:00:55.263 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : make-1:4.3-7.el9.x86_64 72/73 2024-02-19T07:00:55.410 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : git-core-2.39.3-1.el9.x86_64 73/73 2024-02-19T07:00:57.405 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: git-core-2.39.3-1.el9.x86_64 73/73 2024-02-19T07:00:57.405 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fio-3.35-1.el9.x86_64 1/73 2024-02-19T07:00:57.405 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/73 2024-02-19T07:00:57.405 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/73 2024-02-19T07:00:57.405 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/73 2024-02-19T07:00:57.405 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/73 2024-02-19T07:00:57.405 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/73 2024-02-19T07:00:57.405 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/73 2024-02-19T07:00:57.405 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-devel-5.14.0-421.el9.x86_64 8/73 2024-02-19T07:00:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 9/73 2024-02-19T07:00:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 10/73 2024-02-19T07:00:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 11/73 2024-02-19T07:00:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : udftools-2.2-5.el9.x86_64 12/73 2024-02-19T07:00:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 13/73 2024-02-19T07:00:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/73 2024-02-19T07:00:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/73 2024-02-19T07:00:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/73 2024-02-19T07:00:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/73 2024-02-19T07:00:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cpp-11.4.1-3.el9.x86_64 18/73 2024-02-19T07:00:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 19/73 2024-02-19T07:00:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gcc-11.4.1-3.el9.x86_64 20/73 2024-02-19T07:00:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 21/73 2024-02-19T07:00:57.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gcc-c++-11.4.1-3.el9.x86_64 22/73 2024-02-19T07:00:57.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 23/73 2024-02-19T07:00:57.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gcc-plugin-annobin-11.4.1-3.el9.x86_64 24/73 2024-02-19T07:00:57.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 25/73 2024-02-19T07:00:57.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : git-2.43.0-1.el9.x86_64 26/73 2024-02-19T07:00:57.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : git-2.39.3-1.el9.x86_64 27/73 2024-02-19T07:00:57.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : git-core-2.43.0-1.el9.x86_64 28/73 2024-02-19T07:00:57.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : git-core-2.39.3-1.el9.x86_64 29/73 2024-02-19T07:00:57.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : git-core-doc-2.43.0-1.el9.noarch 30/73 2024-02-19T07:00:57.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : git-core-doc-2.39.3-1.el9.noarch 31/73 2024-02-19T07:00:57.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libstdc++-devel-11.4.1-3.el9.x86_64 32/73 2024-02-19T07:00:57.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 33/73 2024-02-19T07:00:57.408 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : perl-Git-2.43.0-1.el9.noarch 34/73 2024-02-19T07:00:57.408 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : perl-Git-2.39.3-1.el9.noarch 35/73 2024-02-19T07:00:57.408 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python-unversioned-command-3.9.18-3.el9.noarch 36/73 2024-02-19T07:00:57.408 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 37/73 2024-02-19T07:00:57.408 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 38/73 2024-02-19T07:00:57.408 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 39/73 2024-02-19T07:00:57.408 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : device-mapper-9:1.02.197-2.el9.x86_64 40/73 2024-02-19T07:00:57.408 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : device-mapper-9:1.02.195-3.el9.x86_64 41/73 2024-02-19T07:00:57.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : device-mapper-event-9:1.02.197-2.el9.x86_64 42/73 2024-02-19T07:00:57.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : device-mapper-event-9:1.02.195-3.el9.x86_64 43/73 2024-02-19T07:00:57.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 44/73 2024-02-19T07:00:57.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 45/73 2024-02-19T07:00:57.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : device-mapper-libs-9:1.02.197-2.el9.x86_64 46/73 2024-02-19T07:00:57.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : device-mapper-libs-9:1.02.195-3.el9.x86_64 47/73 2024-02-19T07:00:57.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : e2fsprogs-1.46.5-5.el9.x86_64 48/73 2024-02-19T07:00:57.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 49/73 2024-02-19T07:00:57.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : e2fsprogs-libs-1.46.5-5.el9.x86_64 50/73 2024-02-19T07:00:57.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 51/73 2024-02-19T07:00:57.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcom_err-1.46.5-5.el9.x86_64 52/73 2024-02-19T07:00:57.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 53/73 2024-02-19T07:00:57.409 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgcc-11.4.1-3.el9.x86_64 54/73 2024-02-19T07:00:57.410 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 55/73 2024-02-19T07:00:57.410 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgomp-11.4.1-3.el9.x86_64 56/73 2024-02-19T07:00:57.410 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 57/73 2024-02-19T07:00:57.410 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libss-1.46.5-5.el9.x86_64 58/73 2024-02-19T07:00:57.410 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libss-1.46.5-3.el9.x86_64 59/73 2024-02-19T07:00:57.410 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libstdc++-11.4.1-3.el9.x86_64 60/73 2024-02-19T07:00:57.410 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 61/73 2024-02-19T07:00:57.410 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lvm2-9:2.03.23-2.el9.x86_64 62/73 2024-02-19T07:00:57.410 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lvm2-9:2.03.21-3.el9.x86_64 63/73 2024-02-19T07:00:57.410 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lvm2-libs-9:2.03.23-2.el9.x86_64 64/73 2024-02-19T07:00:57.410 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lvm2-libs-9:2.03.21-3.el9.x86_64 65/73 2024-02-19T07:00:57.410 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : make-1:4.3-8.el9.x86_64 66/73 2024-02-19T07:00:57.410 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : make-1:4.3-7.el9.x86_64 67/73 2024-02-19T07:00:57.411 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-3.9.18-3.el9.x86_64 68/73 2024-02-19T07:00:57.411 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-3.9.17-2.el9.x86_64 69/73 2024-02-19T07:00:57.411 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-libs-3.9.18-3.el9.x86_64 70/73 2024-02-19T07:00:57.411 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 71/73 2024-02-19T07:00:57.411 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : sqlite-libs-3.34.1-7.el9.x86_64 72/73 2024-02-19T07:00:58.413 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : sqlite-libs-3.34.1-6.el9.x86_64 73/73 2024-02-19T07:00:58.413 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:00:58.413 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-02-19T07:00:58.413 INFO:teuthology.orchestra.run.smithi046.stdout: cpp-11.4.1-3.el9.x86_64 2024-02-19T07:00:58.413 INFO:teuthology.orchestra.run.smithi046.stdout: device-mapper-9:1.02.197-2.el9.x86_64 2024-02-19T07:00:58.413 INFO:teuthology.orchestra.run.smithi046.stdout: device-mapper-event-9:1.02.197-2.el9.x86_64 2024-02-19T07:00:58.413 INFO:teuthology.orchestra.run.smithi046.stdout: device-mapper-event-libs-9:1.02.197-2.el9.x86_64 2024-02-19T07:00:58.413 INFO:teuthology.orchestra.run.smithi046.stdout: device-mapper-libs-9:1.02.197-2.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: e2fsprogs-1.46.5-5.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: e2fsprogs-libs-1.46.5-5.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: gcc-11.4.1-3.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: gcc-c++-11.4.1-3.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: gcc-plugin-annobin-11.4.1-3.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: git-2.43.0-1.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: git-core-2.43.0-1.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: git-core-doc-2.43.0-1.el9.noarch 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: libcom_err-1.46.5-5.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: libgcc-11.4.1-3.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: libgomp-11.4.1-3.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: libss-1.46.5-5.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: libstdc++-11.4.1-3.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: libstdc++-devel-11.4.1-3.el9.x86_64 2024-02-19T07:00:58.414 INFO:teuthology.orchestra.run.smithi046.stdout: lvm2-9:2.03.23-2.el9.x86_64 2024-02-19T07:00:58.415 INFO:teuthology.orchestra.run.smithi046.stdout: lvm2-libs-9:2.03.23-2.el9.x86_64 2024-02-19T07:00:58.415 INFO:teuthology.orchestra.run.smithi046.stdout: make-1:4.3-8.el9.x86_64 2024-02-19T07:00:58.415 INFO:teuthology.orchestra.run.smithi046.stdout: perl-Git-2.43.0-1.el9.noarch 2024-02-19T07:00:58.415 INFO:teuthology.orchestra.run.smithi046.stdout: python-unversioned-command-3.9.18-3.el9.noarch 2024-02-19T07:00:58.415 INFO:teuthology.orchestra.run.smithi046.stdout: python3-3.9.18-3.el9.x86_64 2024-02-19T07:00:58.415 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-02-19T07:00:58.415 INFO:teuthology.orchestra.run.smithi046.stdout: python3-libs-3.9.18-3.el9.x86_64 2024-02-19T07:00:58.415 INFO:teuthology.orchestra.run.smithi046.stdout: sqlite-libs-3.34.1-7.el9.x86_64 2024-02-19T07:00:58.415 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T07:00:58.415 INFO:teuthology.orchestra.run.smithi046.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-02-19T07:00:58.415 INFO:teuthology.orchestra.run.smithi046.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-02-19T07:00:58.415 INFO:teuthology.orchestra.run.smithi046.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-02-19T07:00:58.415 INFO:teuthology.orchestra.run.smithi046.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-02-19T07:00:58.416 INFO:teuthology.orchestra.run.smithi046.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2024-02-19T07:00:58.416 INFO:teuthology.orchestra.run.smithi046.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-421.el9.x86_64 2024-02-19T07:00:58.416 INFO:teuthology.orchestra.run.smithi046.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-02-19T07:00:58.416 INFO:teuthology.orchestra.run.smithi046.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-02-19T07:00:58.416 INFO:teuthology.orchestra.run.smithi046.stdout: udftools-2.2-5.el9.x86_64 2024-02-19T07:00:58.416 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:00:58.416 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T07:00:59.125 DEBUG:teuthology.orchestra.run.smithi046:> sudo useradd -m fsgqa 2024-02-19T07:00:59.207 INFO:teuthology.orchestra.run.smithi046.stderr:useradd: user 'fsgqa' already exists 2024-02-19T07:00:59.210 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-02-19T07:00:59.211 DEBUG:teuthology.orchestra.run.smithi046:> sudo groupadd fsgqa 2024-02-19T07:00:59.282 INFO:teuthology.orchestra.run.smithi046.stderr:groupadd: group 'fsgqa' already exists 2024-02-19T07:00:59.284 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-02-19T07:00:59.285 DEBUG:teuthology.orchestra.run.smithi046:> sudo useradd fsgqa2 2024-02-19T07:00:59.973 DEBUG:teuthology.orchestra.run.smithi046:> sudo useradd 123456-fsgqa 2024-02-19T07:01:00.584 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-02-19T07:01:00.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.773+0000 7f55c6000640 1 Processor -- start 2024-02-19T07:01:00.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.773+0000 7f55c6000640 1 -- start start 2024-02-19T07:01:00.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.775+0000 7f55c6000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55c00b3dd0 0x7f55c015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T07:01:00.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.775+0000 7f55c6000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f55c00cf3f0 0x7f55c0071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T07:01:00.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.775+0000 7f55c6000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55c00cf870 0x7f55c0071540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T07:01:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.775+0000 7f55c6000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c006d390 con 0x7f55c00cf870 2024-02-19T07:01:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.775+0000 7f55c6000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c006d670 con 0x7f55c00cf3f0 2024-02-19T07:01:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.775+0000 7f55c6000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c006d950 con 0x7f55c00b3dd0 2024-02-19T07:01:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.775+0000 7f55bfe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55c00cf870 0x7f55c0071540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T07:01:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.776+0000 7f55bfe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55c00cf870 0x7f55c0071540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45612/0 (socket says 172.21.15.46:45612) 2024-02-19T07:01:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.776+0000 7f55bfe00640 1 -- 172.21.15.46:0/964524043 learned_addr learned my addr 172.21.15.46:0/964524043 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T07:01:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.776+0000 7f55b6a00640 1 --2- 172.21.15.46:0/964524043 >> v2:172.21.15.142:3300/0 conn(0x7f55c00cf3f0 0x7f55c0071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T07:01:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.776+0000 7f55bf400640 1 --2- 172.21.15.46:0/964524043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55c00b3dd0 0x7f55c015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T07:01:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.776+0000 7f55bfe00640 1 -- 172.21.15.46:0/964524043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55c00b3dd0 msgr2=0x7f55c015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T07:01:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.776+0000 7f55bfe00640 1 --2- 172.21.15.46:0/964524043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55c00b3dd0 0x7f55c015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.776+0000 7f55bfe00640 1 -- 172.21.15.46:0/964524043 >> v2:172.21.15.142:3300/0 conn(0x7f55c00cf3f0 msgr2=0x7f55c0071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T07:01:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.776+0000 7f55bfe00640 1 --2- 172.21.15.46:0/964524043 >> v2:172.21.15.142:3300/0 conn(0x7f55c00cf3f0 0x7f55c0071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.776+0000 7f55bfe00640 1 -- 172.21.15.46:0/964524043 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c006dc30 con 0x7f55c00cf870 2024-02-19T07:01:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.777+0000 7f55bfe00640 1 --2- 172.21.15.46:0/964524043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55c00cf870 0x7f55c0071540 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f55c00d0550 tx=0x7f55b802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc14733714e226c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T07:01:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.778+0000 7f55bea00640 1 -- 172.21.15.46:0/964524043 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b8031870 con 0x7f55c00cf870 2024-02-19T07:01:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.778+0000 7f55bea00640 1 -- 172.21.15.46:0/964524043 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b80319d0 con 0x7f55c00cf870 2024-02-19T07:01:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.778+0000 7f55bea00640 1 -- 172.21.15.46:0/964524043 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b8031d60 con 0x7f55c00cf870 2024-02-19T07:01:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.778+0000 7f55c6000640 1 -- 172.21.15.46:0/964524043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55c00cf870 msgr2=0x7f55c0071540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T07:01:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.778+0000 7f55c6000640 1 --2- 172.21.15.46:0/964524043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55c00cf870 0x7f55c0071540 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f55c00d0550 tx=0x7f55b802b910 comp rx=0 tx=0).stop 2024-02-19T07:01:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.779+0000 7f55c6000640 1 -- 172.21.15.46:0/964524043 shutdown_connections 2024-02-19T07:01:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.779+0000 7f55c6000640 1 --2- 172.21.15.46:0/964524043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55c00cf870 0x7f55c0071540 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.779+0000 7f55c6000640 1 --2- 172.21.15.46:0/964524043 >> v2:172.21.15.142:3300/0 conn(0x7f55c00cf3f0 0x7f55c0071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.779+0000 7f55c6000640 1 --2- 172.21.15.46:0/964524043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55c00b3dd0 0x7f55c015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.779+0000 7f55c6000640 1 -- 172.21.15.46:0/964524043 >> 172.21.15.46:0/964524043 conn(0x7f55c0066f70 msgr2=0x7f55c006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T07:01:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.779+0000 7f55c6000640 1 -- 172.21.15.46:0/964524043 shutdown_connections 2024-02-19T07:01:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.779+0000 7f55c6000640 1 -- 172.21.15.46:0/964524043 wait complete. 2024-02-19T07:01:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.781+0000 7f55c6000640 1 Processor -- start 2024-02-19T07:01:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.781+0000 7f55c6000640 1 -- start start 2024-02-19T07:01:00.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.782+0000 7f55c6000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c00b3dd0 0x7f55c00cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T07:01:00.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.782+0000 7f55c6000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55c00cf3f0 0x7f55c014eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T07:01:00.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.782+0000 7f55c6000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55c00cf870 0x7f55c014aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T07:01:00.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.782+0000 7f55c6000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c01487b0 con 0x7f55c00cf870 2024-02-19T07:01:00.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.782+0000 7f55c6000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c00ad740 con 0x7f55c00b3dd0 2024-02-19T07:01:00.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.782+0000 7f55c6000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c00ada20 con 0x7f55c00cf3f0 2024-02-19T07:01:00.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.782+0000 7f55bfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55c00cf870 0x7f55c014aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T07:01:00.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.783+0000 7f55bfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55c00cf870 0x7f55c014aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45618/0 (socket says 172.21.15.46:45618) 2024-02-19T07:01:00.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.783+0000 7f55bfe00640 1 -- 172.21.15.46:0/1545797099 learned_addr learned my addr 172.21.15.46:0/1545797099 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T07:01:00.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.783+0000 7f55bf400640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c00b3dd0 0x7f55c00cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T07:01:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.783+0000 7f55b6a00640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55c00cf3f0 0x7f55c014eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T07:01:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.783+0000 7f55bfe00640 1 -- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55c00cf3f0 msgr2=0x7f55c014eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T07:01:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.783+0000 7f55bfe00640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55c00cf3f0 0x7f55c014eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.783+0000 7f55bfe00640 1 -- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c00b3dd0 msgr2=0x7f55c00cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T07:01:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.783+0000 7f55bfe00640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c00b3dd0 0x7f55c00cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.783+0000 7f55bfe00640 1 -- 172.21.15.46:0/1545797099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b80094d0 con 0x7f55c00cf870 2024-02-19T07:01:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.783+0000 7f55bfe00640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55c00cf870 0x7f55c014aab0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f55b80090b0 tx=0x7f55b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T07:01:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.784+0000 7f55b7e00640 1 -- 172.21.15.46:0/1545797099 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b803ac60 con 0x7f55c00cf870 2024-02-19T07:01:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.784+0000 7f55b7e00640 1 -- 172.21.15.46:0/1545797099 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b803adc0 con 0x7f55c00cf870 2024-02-19T07:01:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.784+0000 7f55c6000640 1 -- 172.21.15.46:0/1545797099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c00add00 con 0x7f55c00cf870 2024-02-19T07:01:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.784+0000 7f55b7e00640 1 -- 172.21.15.46:0/1545797099 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b8044630 con 0x7f55c00cf870 2024-02-19T07:01:00.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.784+0000 7f55c6000640 1 -- 172.21.15.46:0/1545797099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c014e860 con 0x7f55c00cf870 2024-02-19T07:01:00.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.785+0000 7f55c6000640 1 -- 172.21.15.46:0/1545797099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c0067ba0 con 0x7f55c00cf870 2024-02-19T07:01:00.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.786+0000 7f55b7e00640 1 -- 172.21.15.46:0/1545797099 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f55b804d450 con 0x7f55c00cf870 2024-02-19T07:01:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.788+0000 7f55b7e00640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f559c06b810 0x7f559c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T07:01:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.788+0000 7f55b7e00640 1 -- 172.21.15.46:0/1545797099 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55b802d040 con 0x7f55c00cf870 2024-02-19T07:01:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.789+0000 7f55bf400640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f559c06b810 0x7f559c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T07:01:00.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.790+0000 7f55bf400640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f559c06b810 0x7f559c06dcd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f55b0004410 tx=0x7f55b00039f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T07:01:00.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:00.792+0000 7f55b7e00640 1 -- 172.21.15.46:0/1545797099 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f55b8077170 con 0x7f55c00cf870 2024-02-19T07:01:01.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.068+0000 7f55c6000640 1 -- 172.21.15.46:0/1545797099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f55c00ae220 con 0x7f55c00cf870 2024-02-19T07:01:01.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.069+0000 7f55b7e00640 1 -- 172.21.15.46:0/1545797099 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1285 (secure 0 0 0) 0x7f55b807a830 con 0x7f55c00cf870 2024-02-19T07:01:01.071 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:01:01.071 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","modified":"2024-02-19T06:56:43.730990Z","created":"2024-02-19T06:56:43.730990Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3301","nonce":0},{"type":"v1","addr":"172.21.15.142:6790","nonce":0}]},"addr":"172.21.15.142:6790/0","public_addr":"172.21.15.142:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-02-19T07:01:01.072 INFO:teuthology.orchestra.run.smithi046.stderr:dumped monmap epoch 1 2024-02-19T07:01:01.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.071+0000 7f55c6000640 1 -- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f559c06b810 msgr2=0x7f559c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T07:01:01.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.071+0000 7f55c6000640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f559c06b810 0x7f559c06dcd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f55b0004410 tx=0x7f55b00039f0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.071+0000 7f55c6000640 1 -- 172.21.15.46:0/1545797099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55c00cf870 msgr2=0x7f55c014aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T07:01:01.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.071+0000 7f55c6000640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55c00cf870 0x7f55c014aab0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f55b80090b0 tx=0x7f55b80046c0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.071+0000 7f55c6000640 1 -- 172.21.15.46:0/1545797099 shutdown_connections 2024-02-19T07:01:01.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.071+0000 7f55c6000640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f559c06b810 0x7f559c06dcd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.071+0000 7f55c6000640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55c00cf870 0x7f55c014aab0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.071+0000 7f55c6000640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55c00cf3f0 0x7f55c014eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.071+0000 7f55c6000640 1 --2- 172.21.15.46:0/1545797099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c00b3dd0 0x7f55c00cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.071+0000 7f55c6000640 1 -- 172.21.15.46:0/1545797099 >> 172.21.15.46:0/1545797099 conn(0x7f55c0066f70 msgr2=0x7f55c006e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T07:01:01.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.072+0000 7f55c6000640 1 -- 172.21.15.46:0/1545797099 shutdown_connections 2024-02-19T07:01:01.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.072+0000 7f55c6000640 1 -- 172.21.15.46:0/1545797099 wait complete. 2024-02-19T07:01:01.096 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2024-02-19T07:01:01.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.285+0000 7f6ea8200640 1 Processor -- start 2024-02-19T07:01:01.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.285+0000 7f6ea8200640 1 -- start start 2024-02-19T07:01:01.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.286+0000 7f6ea8200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6ea0154b60 0x7f6ea00acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T07:01:01.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.286+0000 7f6ea8200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ea00b3390 0x7f6ea00ae360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T07:01:01.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.287+0000 7f6ea8200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea00aecf0 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.287+0000 7f6ea8200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea00ae010 con 0x7f6ea0154b60 2024-02-19T07:01:01.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.287+0000 7f6ea8200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea015eed0 con 0x7f6ea00b3390 2024-02-19T07:01:01.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.287+0000 7f6ea5800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6ea0154b60 0x7f6ea00acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T07:01:01.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.287+0000 7f6ea5800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6ea0154b60 0x7f6ea00acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45632/0 (socket says 172.21.15.46:45632) 2024-02-19T07:01:01.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.287+0000 7f6ea5800640 1 -- 172.21.15.46:0/265489698 learned_addr learned my addr 172.21.15.46:0/265489698 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T07:01:01.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.287+0000 7f6ea4e00640 1 --2- 172.21.15.46:0/265489698 >> v2:172.21.15.142:3300/0 conn(0x7f6ea00b3390 0x7f6ea00ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T07:01:01.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.287+0000 7f6ea5800640 1 -- 172.21.15.46:0/265489698 >> v2:172.21.15.142:3300/0 conn(0x7f6ea00b3390 msgr2=0x7f6ea00ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T07:01:01.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.288+0000 7f6ea5800640 1 --2- 172.21.15.46:0/265489698 >> v2:172.21.15.142:3300/0 conn(0x7f6ea00b3390 0x7f6ea00ae360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.288+0000 7f6ea5800640 1 -- 172.21.15.46:0/265489698 >> v1:172.21.15.142:6789/0 conn(0x7f6ea00ae8a0 legacy=0x7f6ea01618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T07:01:01.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.288+0000 7f6ea5800640 1 -- 172.21.15.46:0/265489698 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea015e350 con 0x7f6ea0154b60 2024-02-19T07:01:01.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.289+0000 7f6ea5800640 1 --2- 172.21.15.46:0/265489698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea0154b60 0x7f6ea00acb80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6ea006f330 tx=0x7f6e9402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d9e170f75a6705 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T07:01:01.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.289+0000 7f6e9fe00640 1 -- 172.21.15.46:0/265489698 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94031870 con 0x7f6ea0154b60 2024-02-19T07:01:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.289+0000 7f6e9fe00640 1 -- 172.21.15.46:0/265489698 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e940319d0 con 0x7f6ea0154b60 2024-02-19T07:01:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.289+0000 7f6e9fe00640 1 -- 172.21.15.46:0/265489698 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94031d60 con 0x7f6ea0154b60 2024-02-19T07:01:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.290+0000 7f6ea8200640 1 -- 172.21.15.46:0/265489698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea0154b60 msgr2=0x7f6ea00acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T07:01:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.290+0000 7f6ea8200640 1 --2- 172.21.15.46:0/265489698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea0154b60 0x7f6ea00acb80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6ea006f330 tx=0x7f6e9402b910 comp rx=0 tx=0).stop 2024-02-19T07:01:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.290+0000 7f6ea8200640 1 -- 172.21.15.46:0/265489698 shutdown_connections 2024-02-19T07:01:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.290+0000 7f6ea8200640 1 --2- 172.21.15.46:0/265489698 >> v2:172.21.15.142:3300/0 conn(0x7f6ea00b3390 0x7f6ea00ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.290+0000 7f6ea8200640 1 --2- 172.21.15.46:0/265489698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea0154b60 0x7f6ea00acb80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.290+0000 7f6ea8200640 1 -- 172.21.15.46:0/265489698 >> 172.21.15.46:0/265489698 conn(0x7f6ea0066f70 msgr2=0x7f6ea006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T07:01:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.290+0000 7f6ea8200640 1 -- 172.21.15.46:0/265489698 shutdown_connections 2024-02-19T07:01:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.290+0000 7f6ea8200640 1 -- 172.21.15.46:0/265489698 wait complete. 2024-02-19T07:01:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.292+0000 7f6ea8200640 1 Processor -- start 2024-02-19T07:01:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.292+0000 7f6ea8200640 1 -- start start 2024-02-19T07:01:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.293+0000 7f6ea8200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea00ae8a0 0x7f6ea0153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T07:01:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.293+0000 7f6ea8200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ea00b3390 0x7f6ea01599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T07:01:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.293+0000 7f6ea8200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ea0154b60 0x7f6ea01f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T07:01:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.293+0000 7f6ea8200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea0156440 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.293+0000 7f6ea8200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea0153640 con 0x7f6ea0154b60 2024-02-19T07:01:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.293+0000 7f6ea8200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea015a1d0 con 0x7f6ea00b3390 2024-02-19T07:01:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.293+0000 7f6ea5800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea00ae8a0 0x7f6ea0153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T07:01:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.293+0000 7f6ea5800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea00ae8a0 0x7f6ea0153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45644/0 (socket says 172.21.15.46:45644) 2024-02-19T07:01:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.293+0000 7f6ea5800640 1 -- 172.21.15.46:0/2616231135 learned_addr learned my addr 172.21.15.46:0/2616231135 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T07:01:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.294+0000 7f6ea4e00640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ea00b3390 0x7f6ea01599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T07:01:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.294+0000 7f6ea6200640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ea0154b60 0x7f6ea01f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T07:01:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.294+0000 7f6ea5800640 1 -- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ea00b3390 msgr2=0x7f6ea01599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T07:01:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.294+0000 7f6ea5800640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ea00b3390 0x7f6ea01599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.294+0000 7f6ea5800640 1 -- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ea0154b60 msgr2=0x7f6ea01f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T07:01:01.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.294+0000 7f6ea5800640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ea0154b60 0x7f6ea01f6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.294+0000 7f6ea5800640 1 -- 172.21.15.46:0/2616231135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e940094d0 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.294+0000 7f6ea6200640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ea0154b60 0x7f6ea01f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T07:01:01.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.294+0000 7f6ea5800640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea00ae8a0 0x7f6ea0153100 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6e94000c00 tx=0x7f6e940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T07:01:01.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.295+0000 7f6e9d600640 1 -- 172.21.15.46:0/2616231135 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94031840 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.295+0000 7f6e9d600640 1 -- 172.21.15.46:0/2616231135 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e940443f0 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.295+0000 7f6e9d600640 1 -- 172.21.15.46:0/2616231135 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e940447a0 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.295+0000 7f6ea8200640 1 -- 172.21.15.46:0/2616231135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea015a4b0 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.295+0000 7f6ea8200640 1 -- 172.21.15.46:0/2616231135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea0159ee0 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.296+0000 7f6ea8200640 1 -- 172.21.15.46:0/2616231135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea015a9d0 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.297+0000 7f6e9d600640 1 -- 172.21.15.46:0/2616231135 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6e9404d450 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.298+0000 7f6e9d600640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f6e8006b840 0x7f6e8006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T07:01:01.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.298+0000 7f6e9d600640 1 -- 172.21.15.46:0/2616231135 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e9402d040 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.299+0000 7f6ea4e00640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f6e8006b840 0x7f6e8006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T07:01:01.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.300+0000 7f6ea4e00640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f6e8006b840 0x7f6e8006dd00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6ea01546d0 tx=0x7f6e8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T07:01:01.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.303+0000 7f6e9d600640 1 -- 172.21.15.46:0/2616231135 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6ea015a9d0 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.576+0000 7f6ea8200640 1 -- 172.21.15.46:0/2616231135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f6ea00aecf0 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.577+0000 7f6e9d600640 1 -- 172.21.15.46:0/2616231135 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) v1 ==== 82+0+151 (secure 0 0 0) 0x7f6ea00aecf0 con 0x7f6ea00ae8a0 2024-02-19T07:01:01.580 INFO:teuthology.orchestra.run.smithi046.stdout:[client.admin] 2024-02-19T07:01:01.580 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCs+9Jl4qPICRAAplZvaPVZaIfjsMshl8skYA== 2024-02-19T07:01:01.580 INFO:teuthology.orchestra.run.smithi046.stdout: caps mds = "allow *" 2024-02-19T07:01:01.580 INFO:teuthology.orchestra.run.smithi046.stdout: caps mgr = "allow *" 2024-02-19T07:01:01.580 INFO:teuthology.orchestra.run.smithi046.stdout: caps mon = "allow *" 2024-02-19T07:01:01.580 INFO:teuthology.orchestra.run.smithi046.stdout: caps osd = "allow *" 2024-02-19T07:01:01.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.580+0000 7f6ea8200640 1 -- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f6e8006b840 msgr2=0x7f6e8006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T07:01:01.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.580+0000 7f6ea8200640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f6e8006b840 0x7f6e8006dd00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6ea01546d0 tx=0x7f6e8c008040 comp rx=0 tx=0).stop 2024-02-19T07:01:01.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.580+0000 7f6ea8200640 1 -- 172.21.15.46:0/2616231135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea00ae8a0 msgr2=0x7f6ea0153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T07:01:01.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.580+0000 7f6ea8200640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea00ae8a0 0x7f6ea0153100 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6e94000c00 tx=0x7f6e940046c0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.580+0000 7f6ea8200640 1 -- 172.21.15.46:0/2616231135 shutdown_connections 2024-02-19T07:01:01.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.580+0000 7f6ea8200640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f6e8006b840 0x7f6e8006dd00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.580+0000 7f6ea8200640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ea0154b60 0x7f6ea01f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.580+0000 7f6ea8200640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ea00b3390 0x7f6ea01599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.580+0000 7f6ea8200640 1 --2- 172.21.15.46:0/2616231135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea00ae8a0 0x7f6ea0153100 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T07:01:01.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.580+0000 7f6ea8200640 1 -- 172.21.15.46:0/2616231135 >> 172.21.15.46:0/2616231135 conn(0x7f6ea0066f70 msgr2=0x7f6ea00acb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T07:01:01.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.580+0000 7f6ea8200640 1 -- 172.21.15.46:0/2616231135 shutdown_connections 2024-02-19T07:01:01.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T07:01:01.580+0000 7f6ea8200640 1 -- 172.21.15.46:0/2616231135 wait complete. 2024-02-19T07:01:01.604 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-02-19T07:01:01.645 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.SP0ro6ozcj 2024-02-19T07:01:01.645 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T07:01:01.645 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/tmp/tmp.SP0ro6ozcj 2024-02-19T07:01:01.729 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T07:01:01.729 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/tmp/tmp.ca873QOZoIxfstests-dev/local.config 2024-02-19T07:01:01.849 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.03skzeLSgitest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.rEx5Zf47dKscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.46:6789 -k /tmp/tmp.SP0ro6ozcj --client_mountpoint /test" 2024-02-19T07:01:01.849 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T07:01:01.849 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/tmp/tmp.ca873QOZoIxfstests-dev/ceph.exclude 2024-02-19T07:01:01.968 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo make) 2024-02-19T07:01:02.096 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize -cfi 2024-02-19T07:01:02.865 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: putting auxiliary files in '.'. 2024-02-19T07:01:02.865 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file './config.guess' 2024-02-19T07:01:02.874 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file './config.sub' 2024-02-19T07:01:02.886 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file './install-sh' 2024-02-19T07:01:02.898 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file './ltmain.sh' 2024-02-19T07:01:02.967 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-02-19T07:01:02.967 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-02-19T07:01:02.980 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-02-19T07:01:02.993 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-02-19T07:01:03.008 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-02-19T07:01:03.021 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-02-19T07:01:03.041 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-02-19T07:01:03.045 INFO:teuthology.orchestra.run.smithi046.stdout:cp include/install-sh . 2024-02-19T07:01:03.048 INFO:teuthology.orchestra.run.smithi046.stdout:aclocal -I m4 2024-02-19T07:01:04.758 INFO:teuthology.orchestra.run.smithi046.stdout:autoheader 2024-02-19T07:01:05.196 INFO:teuthology.orchestra.run.smithi046.stdout:autoconf 2024-02-19T07:01:05.465 INFO:teuthology.orchestra.run.smithi046.stdout:./configure \ 2024-02-19T07:01:05.465 INFO:teuthology.orchestra.run.smithi046.stdout: --libexecdir=/usr/lib \ 2024-02-19T07:01:05.466 INFO:teuthology.orchestra.run.smithi046.stdout: --exec_prefix=/var/lib 2024-02-19T07:01:05.962 INFO:teuthology.orchestra.run.smithi046.stdout:checking build system type... x86_64-pc-linux-gnu 2024-02-19T07:01:05.962 INFO:teuthology.orchestra.run.smithi046.stdout:checking host system type... x86_64-pc-linux-gnu 2024-02-19T07:01:05.969 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to print strings... printf 2024-02-19T07:01:05.969 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc... gcc 2024-02-19T07:01:06.130 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether the C compiler works... yes 2024-02-19T07:01:06.130 INFO:teuthology.orchestra.run.smithi046.stdout:checking for C compiler default output file name... a.out 2024-02-19T07:01:06.205 INFO:teuthology.orchestra.run.smithi046.stdout:checking for suffix of executables... 2024-02-19T07:01:06.316 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether we are cross compiling... no 2024-02-19T07:01:06.371 INFO:teuthology.orchestra.run.smithi046.stdout:checking for suffix of object files... o 2024-02-19T07:01:06.421 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether we are using the GNU C compiler... yes 2024-02-19T07:01:06.472 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether gcc accepts -g... yes 2024-02-19T07:01:06.543 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc option to accept ISO C89... none needed 2024-02-19T07:01:06.554 INFO:teuthology.orchestra.run.smithi046.stdout:checking for a sed that does not truncate output... /bin/sed 2024-02-19T07:01:06.563 INFO:teuthology.orchestra.run.smithi046.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-02-19T07:01:06.569 INFO:teuthology.orchestra.run.smithi046.stdout:checking for egrep... /bin/grep -E 2024-02-19T07:01:06.576 INFO:teuthology.orchestra.run.smithi046.stdout:checking for fgrep... /bin/grep -F 2024-02-19T07:01:06.590 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ld used by gcc... /bin/ld 2024-02-19T07:01:06.597 INFO:teuthology.orchestra.run.smithi046.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-02-19T07:01:06.614 INFO:teuthology.orchestra.run.smithi046.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-02-19T07:01:07.544 INFO:teuthology.orchestra.run.smithi046.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-02-19T07:01:07.544 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether ln -s works... yes 2024-02-19T07:01:07.579 INFO:teuthology.orchestra.run.smithi046.stdout:checking the maximum length of command line arguments... 1572864 2024-02-19T07:01:07.589 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-02-19T07:01:07.589 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-02-19T07:01:07.590 INFO:teuthology.orchestra.run.smithi046.stdout:checking for /bin/ld option to reload object files... -r 2024-02-19T07:01:07.591 INFO:teuthology.orchestra.run.smithi046.stdout:checking for objdump... objdump 2024-02-19T07:01:07.591 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to recognize dependent libraries... pass_all 2024-02-19T07:01:07.593 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dlltool... no 2024-02-19T07:01:07.593 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-02-19T07:01:07.594 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ar... ar 2024-02-19T07:01:07.708 INFO:teuthology.orchestra.run.smithi046.stdout:checking for archiver @FILE support... @ 2024-02-19T07:01:07.709 INFO:teuthology.orchestra.run.smithi046.stdout:checking for strip... strip 2024-02-19T07:01:07.710 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ranlib... ranlib 2024-02-19T07:01:07.711 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gawk... gawk 2024-02-19T07:01:07.902 INFO:teuthology.orchestra.run.smithi046.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-02-19T07:01:07.907 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sysroot... no 2024-02-19T07:01:07.918 INFO:teuthology.orchestra.run.smithi046.stdout:checking for a working dd... /bin/dd 2024-02-19T07:01:07.928 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-02-19T07:01:07.972 INFO:teuthology.orchestra.run.smithi046.stdout:checking for mt... no 2024-02-19T07:01:07.982 INFO:teuthology.orchestra.run.smithi046.stdout:checking if : is a manifest tool... no 2024-02-19T07:01:08.087 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to run the C preprocessor... gcc -E 2024-02-19T07:01:08.511 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ANSI C header files... yes 2024-02-19T07:01:08.576 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/types.h... yes 2024-02-19T07:01:08.666 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/stat.h... yes 2024-02-19T07:01:08.743 INFO:teuthology.orchestra.run.smithi046.stdout:checking for stdlib.h... yes 2024-02-19T07:01:08.813 INFO:teuthology.orchestra.run.smithi046.stdout:checking for string.h... yes 2024-02-19T07:01:08.901 INFO:teuthology.orchestra.run.smithi046.stdout:checking for memory.h... yes 2024-02-19T07:01:08.978 INFO:teuthology.orchestra.run.smithi046.stdout:checking for strings.h... yes 2024-02-19T07:01:09.079 INFO:teuthology.orchestra.run.smithi046.stdout:checking for inttypes.h... yes 2024-02-19T07:01:09.154 INFO:teuthology.orchestra.run.smithi046.stdout:checking for stdint.h... yes 2024-02-19T07:01:09.267 INFO:teuthology.orchestra.run.smithi046.stdout:checking for unistd.h... yes 2024-02-19T07:01:09.345 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dlfcn.h... yes 2024-02-19T07:01:09.357 INFO:teuthology.orchestra.run.smithi046.stdout:checking for objdir... .libs 2024-02-19T07:01:09.554 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-02-19T07:01:09.554 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-02-19T07:01:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-02-19T07:01:09.663 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc static flag -static works... no 2024-02-19T07:01:09.742 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc supports -c -o file.o... yes 2024-02-19T07:01:09.743 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-02-19T07:01:09.770 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-02-19T07:01:09.841 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether -lc should be explicitly linked in... no 2024-02-19T07:01:09.987 INFO:teuthology.orchestra.run.smithi046.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-02-19T07:01:09.987 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to hardcode library paths into programs... immediate 2024-02-19T07:01:09.992 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether stripping libraries is possible... yes 2024-02-19T07:01:09.992 INFO:teuthology.orchestra.run.smithi046.stdout:checking if libtool supports shared libraries... yes 2024-02-19T07:01:09.993 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether to build shared libraries... yes 2024-02-19T07:01:09.993 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether to build static libraries... yes 2024-02-19T07:01:10.014 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc... (cached) gcc 2024-02-19T07:01:10.075 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-02-19T07:01:10.075 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether gcc accepts -g... (cached) yes 2024-02-19T07:01:10.076 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-02-19T07:01:10.076 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gmake... /usr/bin/gmake 2024-02-19T07:01:10.076 INFO:teuthology.orchestra.run.smithi046.stderr:./configure: line 12083: test: $(SHELL): binary operator expected 2024-02-19T07:01:10.077 INFO:teuthology.orchestra.run.smithi046.stdout:checking for tar... /bin/tar 2024-02-19T07:01:10.077 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gzip... /bin/gzip 2024-02-19T07:01:10.108 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether gcc -MM is supported... yes 2024-02-19T07:01:10.108 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sort... /bin/sort 2024-02-19T07:01:10.108 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether ln -s works... yes 2024-02-19T07:01:10.108 INFO:teuthology.orchestra.run.smithi046.stdout:checking for rpm... /bin/rpm 2024-02-19T07:01:10.117 INFO:teuthology.orchestra.run.smithi046.stdout:checking for rpmbuild... no 2024-02-19T07:01:10.187 INFO:teuthology.orchestra.run.smithi046.stdout:checking assert.h usability... yes 2024-02-19T07:01:10.215 INFO:teuthology.orchestra.run.smithi046.stdout:checking assert.h presence... yes 2024-02-19T07:01:10.216 INFO:teuthology.orchestra.run.smithi046.stdout:checking for assert.h... yes 2024-02-19T07:01:10.297 INFO:teuthology.orchestra.run.smithi046.stdout:checking bstring.h usability... no 2024-02-19T07:01:10.335 INFO:teuthology.orchestra.run.smithi046.stdout:checking bstring.h presence... no 2024-02-19T07:01:10.335 INFO:teuthology.orchestra.run.smithi046.stdout:checking for bstring.h... no 2024-02-19T07:01:10.405 INFO:teuthology.orchestra.run.smithi046.stdout:checking libgen.h usability... yes 2024-02-19T07:01:10.435 INFO:teuthology.orchestra.run.smithi046.stdout:checking libgen.h presence... yes 2024-02-19T07:01:10.435 INFO:teuthology.orchestra.run.smithi046.stdout:checking for libgen.h... yes 2024-02-19T07:01:10.538 INFO:teuthology.orchestra.run.smithi046.stdout:checking dirent.h usability... yes 2024-02-19T07:01:10.568 INFO:teuthology.orchestra.run.smithi046.stdout:checking dirent.h presence... yes 2024-02-19T07:01:10.569 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dirent.h... yes 2024-02-19T07:01:10.677 INFO:teuthology.orchestra.run.smithi046.stdout:checking errno.h usability... yes 2024-02-19T07:01:10.706 INFO:teuthology.orchestra.run.smithi046.stdout:checking errno.h presence... yes 2024-02-19T07:01:10.706 INFO:teuthology.orchestra.run.smithi046.stdout:checking for errno.h... yes 2024-02-19T07:01:10.798 INFO:teuthology.orchestra.run.smithi046.stdout:checking malloc.h usability... yes 2024-02-19T07:01:10.830 INFO:teuthology.orchestra.run.smithi046.stdout:checking malloc.h presence... yes 2024-02-19T07:01:10.830 INFO:teuthology.orchestra.run.smithi046.stdout:checking for malloc.h... yes 2024-02-19T07:01:10.916 INFO:teuthology.orchestra.run.smithi046.stdout:checking uuid.h usability... no 2024-02-19T07:01:10.959 INFO:teuthology.orchestra.run.smithi046.stdout:checking uuid.h presence... no 2024-02-19T07:01:10.959 INFO:teuthology.orchestra.run.smithi046.stdout:checking for uuid.h... no 2024-02-19T07:01:11.056 INFO:teuthology.orchestra.run.smithi046.stdout:checking uuid/uuid.h usability... yes 2024-02-19T07:01:11.089 INFO:teuthology.orchestra.run.smithi046.stdout:checking uuid/uuid.h presence... yes 2024-02-19T07:01:11.090 INFO:teuthology.orchestra.run.smithi046.stdout:checking for uuid/uuid.h... yes 2024-02-19T07:01:11.172 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/uuid.h usability... no 2024-02-19T07:01:11.216 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/uuid.h presence... no 2024-02-19T07:01:11.217 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/uuid.h... no 2024-02-19T07:01:11.298 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/file.h usability... yes 2024-02-19T07:01:11.330 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/file.h presence... yes 2024-02-19T07:01:11.331 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/file.h... yes 2024-02-19T07:01:11.425 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fcntl.h usability... yes 2024-02-19T07:01:11.457 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fcntl.h presence... yes 2024-02-19T07:01:11.457 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/fcntl.h... yes 2024-02-19T07:01:11.543 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/syssgi.h usability... no 2024-02-19T07:01:11.588 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/syssgi.h presence... no 2024-02-19T07:01:11.588 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/syssgi.h... no 2024-02-19T07:01:11.691 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/param.h usability... yes 2024-02-19T07:01:11.728 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/param.h presence... yes 2024-02-19T07:01:11.728 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/param.h... yes 2024-02-19T07:01:11.748 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/stat.h... (cached) yes 2024-02-19T07:01:11.844 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/statvfs.h usability... yes 2024-02-19T07:01:11.874 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/statvfs.h presence... yes 2024-02-19T07:01:11.874 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/statvfs.h... yes 2024-02-19T07:01:11.955 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/time.h usability... yes 2024-02-19T07:01:11.985 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/time.h presence... yes 2024-02-19T07:01:11.985 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/time.h... yes 2024-02-19T07:01:12.075 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/ioctl.h usability... yes 2024-02-19T07:01:12.105 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/ioctl.h presence... yes 2024-02-19T07:01:12.105 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/ioctl.h... yes 2024-02-19T07:01:12.210 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/wait.h usability... yes 2024-02-19T07:01:12.244 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/wait.h presence... yes 2024-02-19T07:01:12.244 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/wait.h... yes 2024-02-19T07:01:12.261 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/types.h... (cached) yes 2024-02-19T07:01:12.279 INFO:teuthology.orchestra.run.smithi046.stdout:checking for strings.h... (cached) yes 2024-02-19T07:01:12.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:01:12.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:01:12.349 INFO:teuthology.orchestra.run.smithi046.stdout:checking err.h usability... yes 2024-02-19T07:01:12.372 INFO:teuthology.orchestra.run.smithi046.stdout:checking err.h presence... yes 2024-02-19T07:01:12.373 INFO:teuthology.orchestra.run.smithi046.stdout:checking for err.h... yes 2024-02-19T07:01:12.449 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/falloc.h usability... yes 2024-02-19T07:01:12.475 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/falloc.h presence... yes 2024-02-19T07:01:12.476 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/falloc.h... yes 2024-02-19T07:01:12.560 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-02-19T07:01:12.605 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-02-19T07:01:12.605 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/fs/xfs_fsops.h... no 2024-02-19T07:01:12.679 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fs/xfs_itable.h usability... no 2024-02-19T07:01:12.717 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fs/xfs_itable.h presence... no 2024-02-19T07:01:12.717 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/fs/xfs_itable.h... no 2024-02-19T07:01:12.790 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfs/platform_defs.h usability... no 2024-02-19T07:01:12.831 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfs/platform_defs.h presence... no 2024-02-19T07:01:12.831 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/platform_defs.h... no 2024-02-19T07:01:12.901 INFO:teuthology.orchestra.run.smithi046.stdout:checking btrfs/ioctl.h usability... no 2024-02-19T07:01:12.937 INFO:teuthology.orchestra.run.smithi046.stdout:checking btrfs/ioctl.h presence... no 2024-02-19T07:01:12.937 INFO:teuthology.orchestra.run.smithi046.stdout:checking for btrfs/ioctl.h... no 2024-02-19T07:01:13.004 INFO:teuthology.orchestra.run.smithi046.stdout:checking cifs/ioctl.h usability... no 2024-02-19T07:01:13.044 INFO:teuthology.orchestra.run.smithi046.stdout:checking cifs/ioctl.h presence... no 2024-02-19T07:01:13.044 INFO:teuthology.orchestra.run.smithi046.stdout:checking for cifs/ioctl.h... no 2024-02-19T07:01:13.125 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/mman.h usability... yes 2024-02-19T07:01:13.154 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/mman.h presence... yes 2024-02-19T07:01:13.154 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/mman.h... yes 2024-02-19T07:01:13.195 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/xfs_log_format.h... no 2024-02-19T07:01:13.279 INFO:teuthology.orchestra.run.smithi046.stdout:checking for uuid_compare... no 2024-02-19T07:01:13.356 INFO:teuthology.orchestra.run.smithi046.stdout:checking for uuid_compare in -luuid... yes 2024-02-19T07:01:13.494 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/xfs.h... yes 2024-02-19T07:01:13.538 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/libxfs.h... no 2024-02-19T07:01:13.590 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether xlog_assign_lsn is declared... no 2024-02-19T07:01:13.658 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/xqm.h... yes 2024-02-19T07:01:13.764 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfsctl from xfs/xfs.h... ok 2024-02-19T07:01:13.820 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfs/handle.h usability... yes 2024-02-19T07:01:13.843 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfs/handle.h presence... yes 2024-02-19T07:01:13.843 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/handle.h... yes 2024-02-19T07:01:13.923 INFO:teuthology.orchestra.run.smithi046.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-02-19T07:01:13.985 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/acl.h usability... yes 2024-02-19T07:01:14.017 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/acl.h presence... yes 2024-02-19T07:01:14.017 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/acl.h... yes 2024-02-19T07:01:14.079 INFO:teuthology.orchestra.run.smithi046.stdout:checking acl/libacl.h usability... yes 2024-02-19T07:01:14.109 INFO:teuthology.orchestra.run.smithi046.stdout:checking acl/libacl.h presence... yes 2024-02-19T07:01:14.109 INFO:teuthology.orchestra.run.smithi046.stdout:checking for acl/libacl.h... yes 2024-02-19T07:01:14.192 INFO:teuthology.orchestra.run.smithi046.stdout:checking for acl_init in -lacl... yes 2024-02-19T07:01:14.257 INFO:teuthology.orchestra.run.smithi046.stdout:checking gdbm-ndbm.h usability... no 2024-02-19T07:01:14.296 INFO:teuthology.orchestra.run.smithi046.stdout:checking gdbm-ndbm.h presence... no 2024-02-19T07:01:14.296 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gdbm-ndbm.h... no 2024-02-19T07:01:14.359 INFO:teuthology.orchestra.run.smithi046.stdout:checking gdbm/ndbm.h usability... yes 2024-02-19T07:01:14.391 INFO:teuthology.orchestra.run.smithi046.stdout:checking gdbm/ndbm.h presence... yes 2024-02-19T07:01:14.391 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gdbm/ndbm.h... yes 2024-02-19T07:01:14.490 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dbm_open in -lgdbm... no 2024-02-19T07:01:14.591 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dbm_fetch in -lgdbm... no 2024-02-19T07:01:14.689 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dbm_store in -lgdbm... no 2024-02-19T07:01:14.793 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dbm_close in -lgdbm... no 2024-02-19T07:01:14.898 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-02-19T07:01:14.983 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-02-19T07:01:15.073 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-02-19T07:01:15.160 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-02-19T07:01:15.228 INFO:teuthology.orchestra.run.smithi046.stdout:checking libaio.h usability... yes 2024-02-19T07:01:15.261 INFO:teuthology.orchestra.run.smithi046.stdout:checking libaio.h presence... yes 2024-02-19T07:01:15.262 INFO:teuthology.orchestra.run.smithi046.stdout:checking for libaio.h... yes 2024-02-19T07:01:15.334 INFO:teuthology.orchestra.run.smithi046.stdout:checking liburing.h usability... no 2024-02-19T07:01:15.379 INFO:teuthology.orchestra.run.smithi046.stdout:checking liburing.h presence... no 2024-02-19T07:01:15.379 INFO:teuthology.orchestra.run.smithi046.stdout:checking for liburing.h... no 2024-02-19T07:01:15.456 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/capability.h usability... yes 2024-02-19T07:01:15.489 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/capability.h presence... yes 2024-02-19T07:01:15.489 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/capability.h... yes 2024-02-19T07:01:15.556 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/fiemap.h usability... yes 2024-02-19T07:01:15.583 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/fiemap.h presence... yes 2024-02-19T07:01:15.584 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/fiemap.h... yes 2024-02-19T07:01:15.677 INFO:teuthology.orchestra.run.smithi046.stdout:checking for fallocate... yes 2024-02-19T07:01:15.765 INFO:teuthology.orchestra.run.smithi046.stdout:checking for open_by_handle_at... yes 2024-02-19T07:01:15.832 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/prctl.h usability... yes 2024-02-19T07:01:15.862 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/prctl.h presence... yes 2024-02-19T07:01:15.862 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/prctl.h... yes 2024-02-19T07:01:15.930 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/fs.h usability... yes 2024-02-19T07:01:15.961 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/fs.h presence... yes 2024-02-19T07:01:15.961 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/fs.h... yes 2024-02-19T07:01:16.027 INFO:teuthology.orchestra.run.smithi046.stdout:checking btrfsutil.h usability... no 2024-02-19T07:01:16.071 INFO:teuthology.orchestra.run.smithi046.stdout:checking btrfsutil.h presence... no 2024-02-19T07:01:16.071 INFO:teuthology.orchestra.run.smithi046.stdout:checking for btrfsutil.h... no 2024-02-19T07:01:16.169 INFO:teuthology.orchestra.run.smithi046.stdout:checking for copy_file_range... yes 2024-02-19T07:01:16.255 INFO:teuthology.orchestra.run.smithi046.stdout:checking for SEEK_DATA... yes 2024-02-19T07:01:16.368 INFO:teuthology.orchestra.run.smithi046.stdout:checking for BMV_OF_SHARED... yes 2024-02-19T07:01:16.463 INFO:teuthology.orchestra.run.smithi046.stdout:checking for nftw... yes 2024-02-19T07:01:16.559 INFO:teuthology.orchestra.run.smithi046.stdout:checking for RLIMIT_NOFILE... yes 2024-02-19T07:01:16.649 INFO:teuthology.orchestra.run.smithi046.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-02-19T07:01:16.742 INFO:teuthology.orchestra.run.smithi046.stdout:checking for FICLONE... yes 2024-02-19T07:01:16.835 INFO:teuthology.orchestra.run.smithi046.stdout:checking for renameat2... yes 2024-02-19T07:01:16.926 INFO:teuthology.orchestra.run.smithi046.stdout:checking for reallocarray... yes 2024-02-19T07:01:17.026 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct mount_attr... yes 2024-02-19T07:01:17.138 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_qgroup_limit... yes 2024-02-19T07:01:17.249 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-02-19T07:01:17.360 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-02-19T07:01:17.472 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-02-19T07:01:17.585 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-02-19T07:01:17.692 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-02-19T07:01:17.794 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-02-19T07:01:17.871 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/btrfs.h usability... yes 2024-02-19T07:01:17.898 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/btrfs.h presence... yes 2024-02-19T07:01:17.898 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/btrfs.h... yes 2024-02-19T07:01:17.983 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/btrfs_tree.h usability... yes 2024-02-19T07:01:18.012 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/btrfs_tree.h presence... yes 2024-02-19T07:01:18.012 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/btrfs_tree.h... yes 2024-02-19T07:01:18.083 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-02-19T07:01:18.120 INFO:teuthology.orchestra.run.smithi046.stdout:configure: creating ./config.status 2024-02-19T07:01:19.409 INFO:teuthology.orchestra.run.smithi046.stdout:config.status: creating include/builddefs 2024-02-19T07:01:19.454 INFO:teuthology.orchestra.run.smithi046.stdout:config.status: creating include/config.h 2024-02-19T07:01:19.487 INFO:teuthology.orchestra.run.smithi046.stdout:config.status: executing libtool commands 2024-02-19T07:01:19.603 INFO:teuthology.orchestra.run.smithi046.stdout:Building include 2024-02-19T07:01:19.614 INFO:teuthology.orchestra.run.smithi046.stdout:Building lib 2024-02-19T07:01:19.625 INFO:teuthology.orchestra.run.smithi046.stdout: [LTDEP] 2024-02-19T07:01:19.968 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dataascii.lo 2024-02-19T07:01:20.248 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] databin.lo 2024-02-19T07:01:20.543 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] datapid.lo 2024-02-19T07:01:20.798 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] file_lock.lo 2024-02-19T07:01:21.134 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] forker.lo 2024-02-19T07:01:21.416 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] pattern.lo 2024-02-19T07:01:21.698 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] open_flags.lo 2024-02-19T07:01:22.000 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] random_range.lo 2024-02-19T07:01:22.395 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] string_to_tokens.lo 2024-02-19T07:01:22.659 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] str_to_bytes.lo 2024-02-19T07:01:22.970 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] tlibio.lo 2024-02-19T07:01:23.399 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] write_log.lo 2024-02-19T07:01:23.804 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] random.lo 2024-02-19T07:01:24.002 INFO:teuthology.orchestra.run.smithi046.stdout: [LD] 2024-02-19T07:01:24.184 INFO:teuthology.orchestra.run.smithi046.stdout:Building ltp 2024-02-19T07:01:24.206 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2024-02-19T07:01:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] doio 2024-02-19T07:01:25.619 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fsstress 2024-02-19T07:01:27.314 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fsx 2024-02-19T07:01:28.293 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] growfiles 2024-02-19T07:01:28.997 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] iogen 2024-02-19T07:01:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-stress 2024-02-19T07:01:30.299 INFO:teuthology.orchestra.run.smithi046.stdout:Building src 2024-02-19T07:01:30.314 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2024-02-19T07:01:34.455 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2024-02-19T07:01:34.535 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2024-02-19T07:01:34.560 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2024-02-19T07:01:35.073 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2024-02-19T07:01:35.131 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dirstress 2024-02-19T07:01:35.571 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fill 2024-02-19T07:01:35.893 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fill2 2024-02-19T07:01:36.335 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] getpagesize 2024-02-19T07:01:36.650 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] holes 2024-02-19T07:01:37.046 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] lstat64 2024-02-19T07:01:37.410 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] nametest 2024-02-19T07:01:37.879 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] permname 2024-02-19T07:01:38.282 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] randholes 2024-02-19T07:01:38.742 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] runas 2024-02-19T07:01:39.127 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] truncfile 2024-02-19T07:01:39.516 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] usemem 2024-02-19T07:01:39.866 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mmapcat 2024-02-19T07:01:40.234 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] append_reader 2024-02-19T07:01:40.581 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] append_writer 2024-02-19T07:01:40.905 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dirperf 2024-02-19T07:01:41.349 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] metaperf 2024-02-19T07:01:41.848 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] devzero 2024-02-19T07:01:42.232 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] feature 2024-02-19T07:01:42.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:01:42.434 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:01:42.659 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] alloc 2024-02-19T07:01:43.026 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fault 2024-02-19T07:01:43.314 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fstest 2024-02-19T07:01:43.701 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_access_root 2024-02-19T07:01:44.020 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] godown 2024-02-19T07:01:44.365 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] resvtest 2024-02-19T07:01:44.746 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] writemod 2024-02-19T07:01:45.099 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] writev_on_pagefault 2024-02-19T07:01:45.470 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] makeextents 2024-02-19T07:01:45.858 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] itrash 2024-02-19T07:01:46.196 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] rename 2024-02-19T07:01:46.544 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] multi_open_unlink 2024-02-19T07:01:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] unwritten_sync 2024-02-19T07:01:47.302 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] genhashnames 2024-02-19T07:01:47.700 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_holes 2024-02-19T07:01:48.048 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_writev 2024-02-19T07:01:48.418 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_truncate_cmtime 2024-02-19T07:01:48.784 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dirhash_collide 2024-02-19T07:01:49.178 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_rename_overwrite 2024-02-19T07:01:49.496 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] holetest 2024-02-19T07:01:49.945 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_truncate_self 2024-02-19T07:01:50.290 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] af_unix 2024-02-19T07:01:50.624 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_stale_pmd 2024-02-19T07:01:51.008 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_cow_race 2024-02-19T07:01:51.378 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_fallocate 2024-02-19T07:01:51.712 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fsync-err 2024-02-19T07:01:52.099 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_write_ro 2024-02-19T07:01:52.448 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_ext4_dax_journal_corruption 2024-02-19T07:01:52.820 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_ext4_dax_inline_corruption 2024-02-19T07:01:53.185 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_ofd_locks 2024-02-19T07:01:53.597 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_collision 2024-02-19T07:01:53.981 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mmap-write-concurrent 2024-02-19T07:01:54.343 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_get_file_time 2024-02-19T07:01:54.679 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_create_short_dirs 2024-02-19T07:01:55.050 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_create_long_dirs 2024-02-19T07:01:55.418 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_enospc 2024-02-19T07:01:55.818 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_writev_overlap 2024-02-19T07:01:56.183 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] checkpoint_journal 2024-02-19T07:01:56.542 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mmap-rw-fault 2024-02-19T07:01:56.916 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] allocstale 2024-02-19T07:01:57.294 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_cow_memory_failure 2024-02-19T07:01:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fake-dump-rootino 2024-02-19T07:01:58.023 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dio-buf-fault 2024-02-19T07:01:58.370 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] rewinddir-test 2024-02-19T07:01:58.765 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] readdir-while-renames 2024-02-19T07:01:59.141 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] xfsctl 2024-02-19T07:01:59.494 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] bstat 2024-02-19T07:01:59.903 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mtab 2024-02-19T07:02:00.270 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] getdevicesize 2024-02-19T07:02:00.616 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] preallo_rw_pattern_reader 2024-02-19T07:02:00.981 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] preallo_rw_pattern_writer 2024-02-19T07:02:01.332 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] ftrunc 2024-02-19T07:02:01.691 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] trunc 2024-02-19T07:02:02.058 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fs_perms 2024-02-19T07:02:02.405 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] testx 2024-02-19T07:02:02.734 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] looptest 2024-02-19T07:02:03.132 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] locktest 2024-02-19T07:02:03.672 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] unwritten_mmap 2024-02-19T07:02:04.012 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] bulkstat_unlink_test 2024-02-19T07:02:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] deduperace 2024-02-19T07:02:04.808 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] bulkstat_unlink_test_modified 2024-02-19T07:02:05.228 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_dir_offset 2024-02-19T07:02:05.586 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_futimens 2024-02-19T07:02:05.935 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_immutable 2024-02-19T07:02:06.816 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] stale_handle 2024-02-19T07:02:07.183 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] pwrite_mmap_blocked 2024-02-19T07:02:07.540 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_dir_offset2 2024-02-19T07:02:07.940 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] seek_sanity_test 2024-02-19T07:02:08.661 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] seek_copy_test 2024-02-19T07:02:09.055 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_readdir_1 2024-02-19T07:02:09.400 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_readdir_2 2024-02-19T07:02:09.756 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fsync-tester 2024-02-19T07:02:10.212 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] nsexec 2024-02-19T07:02:10.580 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] cloner 2024-02-19T07:02:10.934 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] renameat2 2024-02-19T07:02:11.298 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_getcwd 2024-02-19T07:02:11.665 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] e4compact 2024-02-19T07:02:12.078 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] test-nextquota 2024-02-19T07:02:12.435 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] punch-alternating 2024-02-19T07:02:12.564 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:02:12.570 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:02:12.754 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] attr-list-by-handle-cursor-test 2024-02-19T07:02:13.145 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] listxattr 2024-02-19T07:02:13.523 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dio-interleaved 2024-02-19T07:02:13.886 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_dir_type 2024-02-19T07:02:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dio-invalidate-cache 2024-02-19T07:02:14.664 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] stat_test 2024-02-19T07:02:15.179 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_encrypted_d_revalidate 2024-02-19T07:02:15.576 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] attr_replace_test 2024-02-19T07:02:15.944 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] swapon 2024-02-19T07:02:16.289 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mkswap 2024-02-19T07:02:16.651 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_attr_corruption 2024-02-19T07:02:17.016 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_open_tmpfiles 2024-02-19T07:02:17.385 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fscrypt-crypt-util 2024-02-19T07:02:18.315 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] bulkstat_null_ocount 2024-02-19T07:02:18.652 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] splice-test 2024-02-19T07:02:19.028 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] chprojid_fail 2024-02-19T07:02:19.374 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] detached_mounts_propagation 2024-02-19T07:02:19.780 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] ext4_resize 2024-02-19T07:02:20.110 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_readdir_3 2024-02-19T07:02:20.516 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] splice2pipe 2024-02-19T07:02:20.899 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] uuid_ioctl 2024-02-19T07:02:21.273 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_snapshot_deleted_subvolume 2024-02-19T07:02:21.630 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fiemap-tester 2024-02-19T07:02:22.070 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_stripealign 2024-02-19T07:02:22.432 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] open_by_handle 2024-02-19T07:02:22.880 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dbtest 2024-02-19T07:02:23.357 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_dio 2024-02-19T07:02:23.676 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] xfsfind 2024-02-19T07:02:24.085 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_reflink_read_race 2024-02-19T07:02:24.473 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fssum 2024-02-19T07:02:25.178 INFO:teuthology.orchestra.run.smithi046.stdout:Building log-writes 2024-02-19T07:02:25.191 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] replay-log 2024-02-19T07:02:25.735 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2024-02-19T07:02:25.746 INFO:teuthology.orchestra.run.smithi046.stdout:Building aio-dio-regress 2024-02-19T07:02:25.763 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aiocp 2024-02-19T07:02:26.202 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-append-write-fallocate-race 2024-02-19T07:02:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-append-write-read-race 2024-02-19T07:02:26.958 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-cow-race 2024-02-19T07:02:27.290 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-cycle-write 2024-02-19T07:02:27.682 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-eof-race 2024-02-19T07:02:28.062 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-extend-stat 2024-02-19T07:02:28.420 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-fcntl-race 2024-02-19T07:02:28.782 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-hole-filling-race 2024-02-19T07:02:29.125 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-invalidate-failure 2024-02-19T07:02:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-invalidate-readahead 2024-02-19T07:02:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aiodio_sparse2 2024-02-19T07:02:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-subblock-eof-read 2024-02-19T07:02:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-write-verify 2024-02-19T07:02:30.974 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-02-19T07:02:31.271 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-02-19T07:02:31.609 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-last-ref-held-by-io 2024-02-19T07:02:32.017 INFO:teuthology.orchestra.run.smithi046.stdout:Building vfs 2024-02-19T07:02:32.033 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] vfstest 2024-02-19T07:02:36.204 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mount-idmapped 2024-02-19T07:02:36.810 INFO:teuthology.orchestra.run.smithi046.stdout:Building m4 2024-02-19T07:02:36.821 INFO:teuthology.orchestra.run.smithi046.stdout:Building common 2024-02-19T07:02:36.834 INFO:teuthology.orchestra.run.smithi046.stdout:Building tests 2024-02-19T07:02:36.850 INFO:teuthology.orchestra.run.smithi046.stdout:Building btrfs 2024-02-19T07:02:36.867 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/btrfs/group.list 2024-02-19T07:02:37.107 INFO:teuthology.orchestra.run.smithi046.stdout:Building ceph 2024-02-19T07:02:37.122 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/ceph/group.list 2024-02-19T07:02:37.180 INFO:teuthology.orchestra.run.smithi046.stdout:Building cifs 2024-02-19T07:02:37.195 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/cifs/group.list 2024-02-19T07:02:37.243 INFO:teuthology.orchestra.run.smithi046.stdout:Building ext4 2024-02-19T07:02:37.259 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/ext4/group.list 2024-02-19T07:02:37.413 INFO:teuthology.orchestra.run.smithi046.stdout:Building f2fs 2024-02-19T07:02:37.428 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/f2fs/group.list 2024-02-19T07:02:37.495 INFO:teuthology.orchestra.run.smithi046.stdout:Building generic 2024-02-19T07:02:37.514 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/generic/group.list 2024-02-19T07:02:37.886 INFO:teuthology.orchestra.run.smithi046.stdout:Building nfs 2024-02-19T07:02:37.899 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/nfs/group.list 2024-02-19T07:02:37.955 INFO:teuthology.orchestra.run.smithi046.stdout:Building ocfs2 2024-02-19T07:02:37.970 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/ocfs2/group.list 2024-02-19T07:02:38.021 INFO:teuthology.orchestra.run.smithi046.stdout:Building overlay 2024-02-19T07:02:38.037 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/overlay/group.list 2024-02-19T07:02:38.199 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2024-02-19T07:02:38.216 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/perf/group.list 2024-02-19T07:02:38.258 INFO:teuthology.orchestra.run.smithi046.stdout:Building selftest 2024-02-19T07:02:38.273 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/selftest/group.list 2024-02-19T07:02:38.321 INFO:teuthology.orchestra.run.smithi046.stdout:Building shared 2024-02-19T07:02:38.336 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/shared/group.list 2024-02-19T07:02:38.403 INFO:teuthology.orchestra.run.smithi046.stdout:Building tmpfs 2024-02-19T07:02:38.418 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/tmpfs/group.list 2024-02-19T07:02:38.472 INFO:teuthology.orchestra.run.smithi046.stdout:Building udf 2024-02-19T07:02:38.487 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/udf/group.list 2024-02-19T07:02:38.532 INFO:teuthology.orchestra.run.smithi046.stdout:Building xfs 2024-02-19T07:02:38.550 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/xfs/group.list 2024-02-19T07:02:38.934 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo make install) 2024-02-19T07:02:39.067 INFO:teuthology.orchestra.run.smithi046.stdout:Building include 2024-02-19T07:02:39.077 INFO:teuthology.orchestra.run.smithi046.stdout:Building lib 2024-02-19T07:02:39.088 INFO:teuthology.orchestra.run.smithi046.stdout:Building ltp 2024-02-19T07:02:39.098 INFO:teuthology.orchestra.run.smithi046.stdout:Building src 2024-02-19T07:02:39.185 INFO:teuthology.orchestra.run.smithi046.stdout:Building log-writes 2024-02-19T07:02:39.194 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2024-02-19T07:02:39.204 INFO:teuthology.orchestra.run.smithi046.stdout:Building aio-dio-regress 2024-02-19T07:02:39.216 INFO:teuthology.orchestra.run.smithi046.stdout:Building vfs 2024-02-19T07:02:39.226 INFO:teuthology.orchestra.run.smithi046.stdout:Building m4 2024-02-19T07:02:39.236 INFO:teuthology.orchestra.run.smithi046.stdout:Building common 2024-02-19T07:02:39.245 INFO:teuthology.orchestra.run.smithi046.stdout:Building tests 2024-02-19T07:02:39.259 INFO:teuthology.orchestra.run.smithi046.stdout:Building btrfs 2024-02-19T07:02:39.276 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/btrfs/group.list 2024-02-19T07:02:39.505 INFO:teuthology.orchestra.run.smithi046.stdout:Building ceph 2024-02-19T07:02:39.520 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/ceph/group.list 2024-02-19T07:02:39.576 INFO:teuthology.orchestra.run.smithi046.stdout:Building cifs 2024-02-19T07:02:39.590 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/cifs/group.list 2024-02-19T07:02:39.639 INFO:teuthology.orchestra.run.smithi046.stdout:Building ext4 2024-02-19T07:02:39.655 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/ext4/group.list 2024-02-19T07:02:39.808 INFO:teuthology.orchestra.run.smithi046.stdout:Building f2fs 2024-02-19T07:02:39.823 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/f2fs/group.list 2024-02-19T07:02:39.893 INFO:teuthology.orchestra.run.smithi046.stdout:Building generic 2024-02-19T07:02:39.912 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/generic/group.list 2024-02-19T07:02:40.286 INFO:teuthology.orchestra.run.smithi046.stdout:Building nfs 2024-02-19T07:02:40.301 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/nfs/group.list 2024-02-19T07:02:40.357 INFO:teuthology.orchestra.run.smithi046.stdout:Building ocfs2 2024-02-19T07:02:40.373 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/ocfs2/group.list 2024-02-19T07:02:40.425 INFO:teuthology.orchestra.run.smithi046.stdout:Building overlay 2024-02-19T07:02:40.439 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/overlay/group.list 2024-02-19T07:02:40.601 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2024-02-19T07:02:40.616 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/perf/group.list 2024-02-19T07:02:40.660 INFO:teuthology.orchestra.run.smithi046.stdout:Building selftest 2024-02-19T07:02:40.675 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/selftest/group.list 2024-02-19T07:02:40.724 INFO:teuthology.orchestra.run.smithi046.stdout:Building shared 2024-02-19T07:02:40.739 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/shared/group.list 2024-02-19T07:02:40.808 INFO:teuthology.orchestra.run.smithi046.stdout:Building tmpfs 2024-02-19T07:02:40.823 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/tmpfs/group.list 2024-02-19T07:02:40.876 INFO:teuthology.orchestra.run.smithi046.stdout:Building udf 2024-02-19T07:02:40.891 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/udf/group.list 2024-02-19T07:02:40.935 INFO:teuthology.orchestra.run.smithi046.stdout:Building xfs 2024-02-19T07:02:40.952 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.ca873QOZoIxfstests-dev/tests/xfs/group.list 2024-02-19T07:02:41.340 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-02-19T07:02:41.345 INFO:teuthology.orchestra.run.smithi046.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-19T07:02:41.345 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-02-19T07:02:41.350 INFO:teuthology.orchestra.run.smithi046.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-19T07:02:41.351 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-02-19T07:02:41.356 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-02-19T07:02:41.391 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-02-19T07:02:41.635 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-02-19T07:02:41.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-02-19T07:02:41.714 INFO:teuthology.orchestra.run.smithi046.stdout:Building log-writes 2024-02-19T07:02:41.725 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2024-02-19T07:02:41.737 INFO:teuthology.orchestra.run.smithi046.stdout:Building aio-dio-regress 2024-02-19T07:02:41.750 INFO:teuthology.orchestra.run.smithi046.stdout:Building vfs 2024-02-19T07:02:41.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake -C log-writes install 2024-02-19T07:02:41.763 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-02-19T07:02:41.797 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-02-19T07:02:41.833 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake -C perf install 2024-02-19T07:02:41.837 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-02-19T07:02:41.872 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-02-19T07:02:41.960 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-02-19T07:02:41.965 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-02-19T07:02:42.000 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-02-19T07:02:42.188 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake -C vfs install 2024-02-19T07:02:42.191 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-02-19T07:02:42.223 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-02-19T07:02:42.267 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-02-19T07:02:42.300 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-02-19T07:02:42.703 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:02:42.709 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:02:46.981 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-02-19T07:02:47.347 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-02-19T07:02:47.422 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-02-19T07:02:47.426 INFO:teuthology.orchestra.run.smithi046.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-19T07:02:47.427 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-02-19T07:02:47.430 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-02-19T07:02:47.466 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-02-19T07:02:48.047 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-02-19T07:02:48.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/btrfs/ install 2024-02-19T07:02:48.059 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-02-19T07:02:48.095 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 /var/lib/xfstests/tests/btrfs 2024-02-19T07:02:51.732 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-02-19T07:02:51.768 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out /var/lib/xfstests/tests/btrfs 2024-02-19T07:02:55.550 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/ceph/ install 2024-02-19T07:02:55.555 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-02-19T07:02:55.591 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-02-19T07:02:55.672 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-02-19T07:02:55.707 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-02-19T07:02:55.786 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/cifs/ install 2024-02-19T07:02:55.791 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-02-19T07:02:55.820 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-02-19T07:02:55.853 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-02-19T07:02:55.884 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-02-19T07:02:55.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/ext4/ install 2024-02-19T07:02:55.925 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-02-19T07:02:55.960 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-02-19T07:02:56.800 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-02-19T07:02:56.836 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-02-19T07:02:57.633 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/f2fs/ install 2024-02-19T07:02:57.637 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-02-19T07:02:57.673 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-02-19T07:02:57.718 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-02-19T07:02:57.752 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-02-19T07:02:57.799 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/generic/ install 2024-02-19T07:02:57.810 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-02-19T07:02:57.844 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 /var/lib/xfstests/tests/generic 2024-02-19T07:03:06.750 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-02-19T07:03:06.786 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out /var/lib/xfstests/tests/generic 2024-02-19T07:03:12.833 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:03:12.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:03:15.397 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/nfs/ install 2024-02-19T07:03:15.401 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-02-19T07:03:15.437 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-02-19T07:03:15.472 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-02-19T07:03:15.507 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-02-19T07:03:15.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/ocfs2/ install 2024-02-19T07:03:15.548 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-02-19T07:03:15.580 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-02-19T07:03:15.618 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-02-19T07:03:15.650 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-02-19T07:03:15.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/overlay/ install 2024-02-19T07:03:15.688 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-02-19T07:03:15.722 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-02-19T07:03:16.869 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-02-19T07:03:16.903 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-02-19T07:03:18.121 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/perf/ install 2024-02-19T07:03:18.125 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-02-19T07:03:18.161 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-02-19T07:03:18.195 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-02-19T07:03:18.230 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-02-19T07:03:18.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/selftest/ install 2024-02-19T07:03:18.272 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-02-19T07:03:18.304 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-02-19T07:03:18.389 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-02-19T07:03:18.424 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-02-19T07:03:18.515 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/shared/ install 2024-02-19T07:03:18.519 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-02-19T07:03:18.554 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-02-19T07:03:18.610 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-02-19T07:03:18.644 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-02-19T07:03:18.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/tmpfs/ install 2024-02-19T07:03:18.705 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-02-19T07:03:18.740 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-02-19T07:03:18.772 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-02-19T07:03:18.805 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-02-19T07:03:18.839 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/udf/ install 2024-02-19T07:03:18.843 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-02-19T07:03:18.877 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-02-19T07:03:18.911 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-02-19T07:03:18.946 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-02-19T07:03:18.981 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ca873QOZoIxfstests-dev/tests/xfs/ install 2024-02-19T07:03:18.991 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-02-19T07:03:19.029 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 602 603 604 605 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-02-19T07:03:27.322 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-02-19T07:03:27.358 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 602.out 603.out 604.out 605.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-02-19T07:03:35.463 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-02-19T07:03:35.499 INFO:teuthology.orchestra.run.smithi046.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-02-19T07:03:35.533 INFO:teuthology.orchestra.run.smithi046.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-02-19T07:03:35.569 INFO:teuthology.orchestra.run.smithi046.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-02-19T07:03:35.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T07:03:35.610 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec ls tests/generic) 2024-02-19T07:03:35.668 INFO:teuthology.orchestra.run.smithi046.stdout:001 2024-02-19T07:03:35.668 INFO:teuthology.orchestra.run.smithi046.stdout:001.out 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:002 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:002.out 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:003 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:003.out 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:004 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:004.out 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:005 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:005.out 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:006 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:006.out 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:007 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:007.out 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:008 2024-02-19T07:03:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:008.out 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:009 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:009.out 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:010 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:010.out 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:011 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:011.out 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:012 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:012.out 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:013 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:013.out 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:014 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:014.out 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:015 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:015.out 2024-02-19T07:03:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:016 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:016.out 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:017 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:017.out 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:018 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:018.out 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:019 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:019.out 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:020 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:020.out 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:021 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:021.out 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:022 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:022.out 2024-02-19T07:03:35.671 INFO:teuthology.orchestra.run.smithi046.stdout:023 2024-02-19T07:03:35.672 INFO:teuthology.orchestra.run.smithi046.stdout:023.out 2024-02-19T07:03:35.672 INFO:teuthology.orchestra.run.smithi046.stdout:024 2024-02-19T07:03:35.672 INFO:teuthology.orchestra.run.smithi046.stdout:024.out 2024-02-19T07:03:35.672 INFO:teuthology.orchestra.run.smithi046.stdout:025 2024-02-19T07:03:35.672 INFO:teuthology.orchestra.run.smithi046.stdout:025.out 2024-02-19T07:03:35.672 INFO:teuthology.orchestra.run.smithi046.stdout:026 2024-02-19T07:03:35.672 INFO:teuthology.orchestra.run.smithi046.stdout:026.out 2024-02-19T07:03:35.672 INFO:teuthology.orchestra.run.smithi046.stdout:027 2024-02-19T07:03:35.672 INFO:teuthology.orchestra.run.smithi046.stdout:027.out 2024-02-19T07:03:35.672 INFO:teuthology.orchestra.run.smithi046.stdout:028 2024-02-19T07:03:35.672 INFO:teuthology.orchestra.run.smithi046.stdout:028.out 2024-02-19T07:03:35.672 INFO:teuthology.orchestra.run.smithi046.stdout:029 2024-02-19T07:03:35.672 INFO:teuthology.orchestra.run.smithi046.stdout:029.out 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:030 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:030.out 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:031 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:031.out 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:032 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:032.out 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:033 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:033.out 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:034 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:034.out 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:035 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:035.cfg 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:035.out.default 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:035.out.nfs 2024-02-19T07:03:35.673 INFO:teuthology.orchestra.run.smithi046.stdout:036 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:036.out 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:037 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:037.out 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:038 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:038.out 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:039 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:039.out 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:040 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:040.out 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:041 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:041.out 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:042 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:042.out 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:043 2024-02-19T07:03:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:043.out 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:044 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:044.out 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:045 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:045.out 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:046 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:046.out 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:047 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:047.out 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:048 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:048.out 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:049 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:049.out 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:050 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:050.cfg 2024-02-19T07:03:35.675 INFO:teuthology.orchestra.run.smithi046.stdout:050.out.default 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:050.out.nojournal 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:050.out.xfsquota 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:051 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:051.out 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:052 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:052.out 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:053 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:053.out 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:054 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:054.out 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:055 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:055.out 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:056 2024-02-19T07:03:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:056.out 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:057 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:057.out 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:058 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:058.out 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:059 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:059.out 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:060 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:060.out 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:061 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:061.out 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:062 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:062.out 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:063 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:063.out 2024-02-19T07:03:35.677 INFO:teuthology.orchestra.run.smithi046.stdout:064 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:064.out 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:065 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:065.out 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:066 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:066.out 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:067 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:067.out 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:068 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:068.out 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:069 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:069.out 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:070 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:070.out 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:071 2024-02-19T07:03:35.678 INFO:teuthology.orchestra.run.smithi046.stdout:071.out 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:072 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:072.out 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:073 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:073.out 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:074 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:074.out 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:075 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:075.out 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:076 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:076.out 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:077 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:077.out 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:078 2024-02-19T07:03:35.679 INFO:teuthology.orchestra.run.smithi046.stdout:078.out 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:079 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:079.out 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:080 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:080.out 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:081 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:081.out 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:082 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:082.out 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:083 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:083.out 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:084 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:084.out 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:085 2024-02-19T07:03:35.680 INFO:teuthology.orchestra.run.smithi046.stdout:085.out 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:086 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:086.out 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:087 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:087.out 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:088 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:088.out 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:089 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:089.out 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:090 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:090.out 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:091 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:091.out 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:092 2024-02-19T07:03:35.681 INFO:teuthology.orchestra.run.smithi046.stdout:092.out 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:093 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:093.out 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:094 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:094.out 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:095 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:095.out 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:096 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:096.out 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:097 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:097.out 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:098 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:098.out 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:099 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:099.out 2024-02-19T07:03:35.682 INFO:teuthology.orchestra.run.smithi046.stdout:100 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:100.out 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:101 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:101.out 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:102 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:102.out 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:103 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:103.out 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:104 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:104.out 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:105 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:105.out 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:106 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:106.out 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:107 2024-02-19T07:03:35.683 INFO:teuthology.orchestra.run.smithi046.stdout:107.out 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:108 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:108.out 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:109 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:109.out 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:110 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:110.out 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:111 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:111.out 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:112 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:112.out 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:113 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:113.out 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:114 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:114.out 2024-02-19T07:03:35.684 INFO:teuthology.orchestra.run.smithi046.stdout:115 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:115.out 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:116 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:116.out 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:117 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:117.out 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:118 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:118.out 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:119 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:119.out 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:120 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:120.out 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:121 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:121.out 2024-02-19T07:03:35.685 INFO:teuthology.orchestra.run.smithi046.stdout:122 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:122.out 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:123 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:123.out 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:124 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:124.out 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:125 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:125.out 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:126 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:126.out 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:127 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:127.out 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:128 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:128.out 2024-02-19T07:03:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:129 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:129.out 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:130 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:130.out 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:131 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:131.out 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:132 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:132.out 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:133 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:133.out 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:134 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:134.out 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:135 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:135.out 2024-02-19T07:03:35.687 INFO:teuthology.orchestra.run.smithi046.stdout:136 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:136.out 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:137 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:137.out 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:138 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:138.out 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:139 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:139.out 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:140 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:140.out 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:141 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:141.out 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:142 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:142.out 2024-02-19T07:03:35.688 INFO:teuthology.orchestra.run.smithi046.stdout:143 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:143.out 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:144 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:144.out 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:145 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:145.out 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:146 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:146.out 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:147 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:147.out 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:148 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:148.out 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:149 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:149.out 2024-02-19T07:03:35.689 INFO:teuthology.orchestra.run.smithi046.stdout:150 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:150.out 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:151 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:151.out 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:152 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:152.out 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:153 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:153.out 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:154 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:154.out 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:155 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:155.out 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:156 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:156.out 2024-02-19T07:03:35.690 INFO:teuthology.orchestra.run.smithi046.stdout:157 2024-02-19T07:03:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:157.out 2024-02-19T07:03:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:158 2024-02-19T07:03:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:158.out 2024-02-19T07:03:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:159 2024-02-19T07:03:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:159.out 2024-02-19T07:03:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:160 2024-02-19T07:03:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:160.out 2024-02-19T07:03:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:161 2024-02-19T07:03:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:161.out 2024-02-19T07:03:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:162 2024-02-19T07:03:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:162.out 2024-02-19T07:03:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:163 2024-02-19T07:03:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:163.out 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:164 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:164.out 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:165 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:165.out 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:166 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:166.out 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:167 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:167.out 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:168 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:168.out 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:169 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:169.out 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:170 2024-02-19T07:03:35.692 INFO:teuthology.orchestra.run.smithi046.stdout:170.out 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:171 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:171.out 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:172 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:172.out 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:173 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:173.out 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:174 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:174.out 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:175 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:175.out 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:176 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:176.out 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:177 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:177.out 2024-02-19T07:03:35.693 INFO:teuthology.orchestra.run.smithi046.stdout:178 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:178.out 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:179 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:179.out 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:180 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:180.out 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:181 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:181.out 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:182 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:182.out 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:183 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:183.out 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:184 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:184.out 2024-02-19T07:03:35.694 INFO:teuthology.orchestra.run.smithi046.stdout:185 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:185.out 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:186 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:186.out 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:187 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:187.out 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:188 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:188.out 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:189 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:189.out 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:190 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:190.out 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:191 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:191.out 2024-02-19T07:03:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:192 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:192.out 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:193 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:193.out 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:194 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:194.out 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:195 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:195.out 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:196 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:196.out 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:197 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:197.out 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:198 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:198.out 2024-02-19T07:03:35.696 INFO:teuthology.orchestra.run.smithi046.stdout:199 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:199.out 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:200 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:200.out 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:201 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:201.out 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:202 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:202.out 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:203 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:203.out 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:204 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:204.out 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:205 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:205.out 2024-02-19T07:03:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:206 2024-02-19T07:03:35.698 INFO:teuthology.orchestra.run.smithi046.stdout:206.out 2024-02-19T07:03:35.698 INFO:teuthology.orchestra.run.smithi046.stdout:207 2024-02-19T07:03:35.698 INFO:teuthology.orchestra.run.smithi046.stdout:207.out 2024-02-19T07:03:35.698 INFO:teuthology.orchestra.run.smithi046.stdout:208 2024-02-19T07:03:35.698 INFO:teuthology.orchestra.run.smithi046.stdout:208.out 2024-02-19T07:03:35.698 INFO:teuthology.orchestra.run.smithi046.stdout:209 2024-02-19T07:03:35.698 INFO:teuthology.orchestra.run.smithi046.stdout:209.out 2024-02-19T07:03:35.698 INFO:teuthology.orchestra.run.smithi046.stdout:210 2024-02-19T07:03:35.698 INFO:teuthology.orchestra.run.smithi046.stdout:210.out 2024-02-19T07:03:35.698 INFO:teuthology.orchestra.run.smithi046.stdout:211 2024-02-19T07:03:35.698 INFO:teuthology.orchestra.run.smithi046.stdout:211.out 2024-02-19T07:03:35.698 INFO:teuthology.orchestra.run.smithi046.stdout:212 2024-02-19T07:03:35.698 INFO:teuthology.orchestra.run.smithi046.stdout:212.out 2024-02-19T07:03:35.699 INFO:teuthology.orchestra.run.smithi046.stdout:213 2024-02-19T07:03:35.699 INFO:teuthology.orchestra.run.smithi046.stdout:213.out 2024-02-19T07:03:35.699 INFO:teuthology.orchestra.run.smithi046.stdout:214 2024-02-19T07:03:35.699 INFO:teuthology.orchestra.run.smithi046.stdout:214.out 2024-02-19T07:03:35.699 INFO:teuthology.orchestra.run.smithi046.stdout:215 2024-02-19T07:03:35.699 INFO:teuthology.orchestra.run.smithi046.stdout:215.out 2024-02-19T07:03:35.699 INFO:teuthology.orchestra.run.smithi046.stdout:216 2024-02-19T07:03:35.699 INFO:teuthology.orchestra.run.smithi046.stdout:216.out 2024-02-19T07:03:35.699 INFO:teuthology.orchestra.run.smithi046.stdout:217 2024-02-19T07:03:35.699 INFO:teuthology.orchestra.run.smithi046.stdout:217.out 2024-02-19T07:03:35.699 INFO:teuthology.orchestra.run.smithi046.stdout:218 2024-02-19T07:03:35.699 INFO:teuthology.orchestra.run.smithi046.stdout:218.out 2024-02-19T07:03:35.699 INFO:teuthology.orchestra.run.smithi046.stdout:219 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:219.out 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:220 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:220.out 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:221 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:221.out 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:222 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:222.out 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:223 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:223.out 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:224 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:224.out 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:225 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:225.out 2024-02-19T07:03:35.700 INFO:teuthology.orchestra.run.smithi046.stdout:226 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:226.out 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:227 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:227.out 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:228 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:228.out 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:229 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:229.out 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:230 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:230.out 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:231 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:231.out 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:232 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:232.out 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:233 2024-02-19T07:03:35.701 INFO:teuthology.orchestra.run.smithi046.stdout:233.out 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:234 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:234.out 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:235 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:235.out 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:236 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:236.out 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:237 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:237.out 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:238 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:238.out 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:239 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:239.out 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:240 2024-02-19T07:03:35.702 INFO:teuthology.orchestra.run.smithi046.stdout:240.out 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:241 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:241.out 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:242 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:242.out 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:243 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:243.out 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:244 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:244.out 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:245 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:245.out 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:246 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:246.out 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:247 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:247.out 2024-02-19T07:03:35.703 INFO:teuthology.orchestra.run.smithi046.stdout:248 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:248.out 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:249 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:249.out 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:250 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:250.out 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:251 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:251.out 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:252 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:252.out 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:253 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:253.out 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:254 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:254.out 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:255 2024-02-19T07:03:35.704 INFO:teuthology.orchestra.run.smithi046.stdout:255.out 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:256 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:256.out 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:257 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:257.out 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:258 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:258.out 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:259 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:259.out 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:260 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:260.out 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:261 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:261.out 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:262 2024-02-19T07:03:35.705 INFO:teuthology.orchestra.run.smithi046.stdout:262.out 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:263 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:263.out 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:264 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:264.out 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:265 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:265.out 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:266 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:266.out 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:267 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:267.out 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:268 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:268.out 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:269 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:269.out 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:270 2024-02-19T07:03:35.706 INFO:teuthology.orchestra.run.smithi046.stdout:270.out 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:271 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:271.out 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:272 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:272.out 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:273 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:273.out 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:274 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:274.out 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:275 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:275.out 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:276 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:276.out 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:277 2024-02-19T07:03:35.707 INFO:teuthology.orchestra.run.smithi046.stdout:277.out 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:278 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:278.out 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:279 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:279.out 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:280 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:280.out 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:281 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:281.out 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:282 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:282.out 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:283 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:283.out 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:284 2024-02-19T07:03:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:284.out 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:285 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:285.out 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:286 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:286.out 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:287 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:287.out 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:288 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:288.out 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:289 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:289.out 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:290 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:290.out 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:291 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:291.out 2024-02-19T07:03:35.709 INFO:teuthology.orchestra.run.smithi046.stdout:292 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:292.out 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:293 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:293.out 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:294 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:294.out 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:295 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:295.out 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:296 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:296.out 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:297 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:297.out 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:298 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:298.out 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:299 2024-02-19T07:03:35.710 INFO:teuthology.orchestra.run.smithi046.stdout:299.out 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:300 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:300.out 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:301 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:301.out 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:302 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:302.out 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:303 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:303.out 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:304 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:304.out 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:305 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:305.out 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:306 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:306.out 2024-02-19T07:03:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:307 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:307.out 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:308 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:308.out 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:309 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:309.out 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:310 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:310.out 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:311 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:311.out 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:312 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:312.out 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:313 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:313.out 2024-02-19T07:03:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:314 2024-02-19T07:03:35.713 INFO:teuthology.orchestra.run.smithi046.stdout:314.out 2024-02-19T07:03:35.713 INFO:teuthology.orchestra.run.smithi046.stdout:315 2024-02-19T07:03:35.713 INFO:teuthology.orchestra.run.smithi046.stdout:315.out 2024-02-19T07:03:35.713 INFO:teuthology.orchestra.run.smithi046.stdout:316 2024-02-19T07:03:35.713 INFO:teuthology.orchestra.run.smithi046.stdout:316.out 2024-02-19T07:03:35.713 INFO:teuthology.orchestra.run.smithi046.stdout:317 2024-02-19T07:03:35.713 INFO:teuthology.orchestra.run.smithi046.stdout:317.out 2024-02-19T07:03:35.713 INFO:teuthology.orchestra.run.smithi046.stdout:318 2024-02-19T07:03:35.713 INFO:teuthology.orchestra.run.smithi046.stdout:318.out 2024-02-19T07:03:35.713 INFO:teuthology.orchestra.run.smithi046.stdout:319 2024-02-19T07:03:35.713 INFO:teuthology.orchestra.run.smithi046.stdout:319.out 2024-02-19T07:03:35.713 INFO:teuthology.orchestra.run.smithi046.stdout:320 2024-02-19T07:03:35.713 INFO:teuthology.orchestra.run.smithi046.stdout:320.out 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:321 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:321.out 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:322 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:322.out 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:323 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:323.out 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:324 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:324.out 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:325 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:325.out 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:326 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:326.out 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:327 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:327.out 2024-02-19T07:03:35.714 INFO:teuthology.orchestra.run.smithi046.stdout:328 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:328.out 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:329 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:329.out 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:330 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:330.out 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:331 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:331.out 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:332 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:332.out 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:333 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:333.out 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:334 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:334.out 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:335 2024-02-19T07:03:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:335.out 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:336 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:336.out 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:337 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:337.out 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:338 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:338.out 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:339 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:339.out 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:340 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:340.out 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:341 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:341.out 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:342 2024-02-19T07:03:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:342.out 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:343 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:343.out 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:344 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:344.out 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:345 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:345.out 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:346 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:346.out 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:347 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:347.out 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:348 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:348.out 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:349 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:349.out 2024-02-19T07:03:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:350 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:350.out 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:351 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:351.out 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:352 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:352.out 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:353 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:353.out 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:354 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:354.out 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:355 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:355.out 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:356 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:356.out 2024-02-19T07:03:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:357 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:357.out 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:358 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:358.out 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:359 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:359.out 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:360 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:360.out 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:361 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:361.out 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:362 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:362.out 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:363 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:363.out 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:364 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:364.out 2024-02-19T07:03:35.719 INFO:teuthology.orchestra.run.smithi046.stdout:365 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:365.out 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:366 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:366.out 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:367 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:367.out 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:368 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:368.out 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:369 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:369.out 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:370 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:370.out 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:371 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:371.out 2024-02-19T07:03:35.720 INFO:teuthology.orchestra.run.smithi046.stdout:372 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:372.out 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:373 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:373.out 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:374 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:374.out 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:375 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:375.out 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:376 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:376.out 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:377 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:377.out 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:378 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:378.out 2024-02-19T07:03:35.721 INFO:teuthology.orchestra.run.smithi046.stdout:379 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:379.out 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:380 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:380.out 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:381 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:381.out 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:382 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:382.out 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:383 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:383.out 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:384 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:384.out 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:385 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:385.out 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:386 2024-02-19T07:03:35.722 INFO:teuthology.orchestra.run.smithi046.stdout:386.out 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:387 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:387.out 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:388 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:388.out 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:389 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:389.out 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:390 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:390.out 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:391 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:391.out 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:392 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:392.out 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:393 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:393.out 2024-02-19T07:03:35.723 INFO:teuthology.orchestra.run.smithi046.stdout:394 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:394.out 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:395 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:395.out 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:396 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:396.out 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:397 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:397.out 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:398 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:398.out 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:399 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:399.out 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:400 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:400.out 2024-02-19T07:03:35.724 INFO:teuthology.orchestra.run.smithi046.stdout:401 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:401.out 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:402 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:402.out 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:403 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:403.out 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:404 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:404.out 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:405 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:405.out 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:406 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:406.out 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:407 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:407.out 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:408 2024-02-19T07:03:35.725 INFO:teuthology.orchestra.run.smithi046.stdout:408.out 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:409 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:409.out 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:410 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:410.out 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:411 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:411.out 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:412 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:412.out 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:413 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:413.out 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:414 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:414.out 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:415 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:415.out 2024-02-19T07:03:35.726 INFO:teuthology.orchestra.run.smithi046.stdout:416 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:416.out 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:417 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:417.out 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:418 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:418.out 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:419 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:419.out 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:420 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:420.out 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:421 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:421.out 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:422 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:422.out 2024-02-19T07:03:35.727 INFO:teuthology.orchestra.run.smithi046.stdout:423 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:423.out 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:424 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:424.out 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:425 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:425.out 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:426 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:426.out 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:427 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:427.out 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:428 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:428.out 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:429 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:429.out 2024-02-19T07:03:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:430 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:430.out 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:431 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:431.out 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:432 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:432.out 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:433 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:433.out 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:434 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:434.out 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:435 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:435.out 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:436 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:436.out 2024-02-19T07:03:35.729 INFO:teuthology.orchestra.run.smithi046.stdout:437 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:437.out 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:438 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:438.out 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:439 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:439.out 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:440 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:440.out 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:441 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:441.out 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:442 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:442.out 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:443 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:443.out 2024-02-19T07:03:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:444 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:444.out 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:445 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:445.out 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:446 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:446.out 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:447 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:447.out 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:448 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:448.out 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:449 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:449.out 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:450 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:450.out 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:451 2024-02-19T07:03:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:451.out 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:452 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:452.out 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:453 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:453.out 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:454 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:454.out 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:455 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:455.out 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:456 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:456.out 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:457 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:457.out 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:458 2024-02-19T07:03:35.732 INFO:teuthology.orchestra.run.smithi046.stdout:458.out 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:459 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:459.out 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:460 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:460.out 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:461 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:461.out 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:462 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:462.out 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:463 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:463.out 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:464 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:464.out 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:465 2024-02-19T07:03:35.733 INFO:teuthology.orchestra.run.smithi046.stdout:465.out 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:466 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:466.out 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:467 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:467.out 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:468 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:468.out 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:469 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:469.out 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:470 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:470.out 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:471 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:471.out 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:472 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:472.out 2024-02-19T07:03:35.734 INFO:teuthology.orchestra.run.smithi046.stdout:473 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:473.out 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:474 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:474.out 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:475 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:475.out 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:476 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:476.out 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:477 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:477.out 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:478 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:478.out 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:479 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:479.out 2024-02-19T07:03:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:480 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:480.out 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:481 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:481.out 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:482 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:482.out 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:483 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:483.out 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:484 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:484.out 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:485 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:485.out 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:486 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:486.out 2024-02-19T07:03:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:487 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:487.out 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:488 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:488.out 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:489 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:489.out 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:490 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:490.out 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:491 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:491.out 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:492 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:492.out 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:493 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:493.out 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:494 2024-02-19T07:03:35.737 INFO:teuthology.orchestra.run.smithi046.stdout:494.out 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:495 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:495.out 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:496 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:496.out 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:497 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:497.out 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:498 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:498.out 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:499 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:499.out 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:500 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:500.out 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:501 2024-02-19T07:03:35.738 INFO:teuthology.orchestra.run.smithi046.stdout:501.out 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:502 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:502.out 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:503 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:503.out 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:504 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:504.out 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:505 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:505.out 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:506 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:506.out 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:507 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:507.out 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:508 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:508.out 2024-02-19T07:03:35.739 INFO:teuthology.orchestra.run.smithi046.stdout:509 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:509.out 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:510 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:510.out 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:511 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:511.out 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:512 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:512.out 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:513 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:513.out 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:514 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:514.out 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:515 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:515.out 2024-02-19T07:03:35.740 INFO:teuthology.orchestra.run.smithi046.stdout:516 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:516.out 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:517 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:517.out 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:518 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:518.out 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:519 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:519.out 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:520 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:520.out 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:521 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:521.out 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:522 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:522.out 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:523 2024-02-19T07:03:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:523.out 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:524 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:524.out 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:525 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:525.out 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:526 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:526.out 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:527 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:527.out 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:528 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:528.out 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:529 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:529.out 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:530 2024-02-19T07:03:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:530.out 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:531 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:531.out 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:532 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:532.out 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:533 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:533.out 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:534 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:534.out 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:535 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:535.out 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:536 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:536.out 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:537 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:537.out 2024-02-19T07:03:35.743 INFO:teuthology.orchestra.run.smithi046.stdout:538 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:538.out 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:539 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:539.out 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:540 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:540.out 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:541 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:541.out 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:542 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:542.out 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:543 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:543.out 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:544 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:544.out 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:545 2024-02-19T07:03:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:545.out 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:546 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:546.out 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:547 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:547.out 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:548 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:548.out 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:549 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:549.out 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:550 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:550.out 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:551 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:551.out 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:552 2024-02-19T07:03:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:552.out 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:553 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:553.out 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:554 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:554.out 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:555 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:555.out 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:556 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:556.out 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:557 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:557.out 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:558 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:558.out 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:559 2024-02-19T07:03:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:559.out 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:560 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:560.out 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:561 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:561.out 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:562 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:562.out 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:563 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:563.out 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:564 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:564.out 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:565 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:565.out 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:566 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:566.out 2024-02-19T07:03:35.747 INFO:teuthology.orchestra.run.smithi046.stdout:567 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:567.out 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:568 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:568.out 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:569 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:569.out 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:570 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:570.out 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:571 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:571.out 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:572 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:572.out 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:573 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:573.out 2024-02-19T07:03:35.748 INFO:teuthology.orchestra.run.smithi046.stdout:574 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:574.out 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:575 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:575.out 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:576 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:576.out 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:577 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:577.out 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:578 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:578.out 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:579 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:579.out 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:580 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:580.out 2024-02-19T07:03:35.749 INFO:teuthology.orchestra.run.smithi046.stdout:581 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:581.out 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:582 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:582.out 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:583 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:583.out 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:584 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:584.out 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:585 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:585.out 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:586 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:586.out 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:587 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:587.out 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:588 2024-02-19T07:03:35.750 INFO:teuthology.orchestra.run.smithi046.stdout:588.out 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:589 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:589.out 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:590 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:590.out 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:591 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:591.out 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:592 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:592.out 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:593 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:593.out 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:594 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:594.out 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:595 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:595.out 2024-02-19T07:03:35.751 INFO:teuthology.orchestra.run.smithi046.stdout:596 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:596.out 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:597 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:597.out 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:598 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:598.out 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:599 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:599.out 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:600 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:600.out 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:601 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:601.out 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:602 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:602.out 2024-02-19T07:03:35.752 INFO:teuthology.orchestra.run.smithi046.stdout:603 2024-02-19T07:03:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:603.out 2024-02-19T07:03:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:604 2024-02-19T07:03:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:604.out 2024-02-19T07:03:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:605 2024-02-19T07:03:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:605.out 2024-02-19T07:03:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:606 2024-02-19T07:03:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:606.out 2024-02-19T07:03:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:607 2024-02-19T07:03:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:607.out 2024-02-19T07:03:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:608 2024-02-19T07:03:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:608.out 2024-02-19T07:03:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:609 2024-02-19T07:03:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:609.out 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:610 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:610.out 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:611 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:611.out 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:612 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:612.out 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:613 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:613.out 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:614 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:614.out 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:615 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:615.out 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:616 2024-02-19T07:03:35.754 INFO:teuthology.orchestra.run.smithi046.stdout:616.out 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:617 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:617.out 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:618 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:618.out 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:619 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:619.out 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:620 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:620.out 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:621 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:621.out 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:622 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:622.out 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:623 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:623.out 2024-02-19T07:03:35.755 INFO:teuthology.orchestra.run.smithi046.stdout:624 2024-02-19T07:03:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:624.out 2024-02-19T07:03:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:625 2024-02-19T07:03:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:625.out 2024-02-19T07:03:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:626 2024-02-19T07:03:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:626.out 2024-02-19T07:03:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:627 2024-02-19T07:03:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:627.out 2024-02-19T07:03:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:628 2024-02-19T07:03:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:628.out 2024-02-19T07:03:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:629 2024-02-19T07:03:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:629.out 2024-02-19T07:03:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:630 2024-02-19T07:03:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:630.out 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:631 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:631.out 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:632 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:632.out 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:633 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:633.out 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:634 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:634.out 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:635 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:635.out 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:636 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:636.out 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:637 2024-02-19T07:03:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:637.out 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:638 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:638.out 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:639 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:639.out 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:640 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:640.out 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:641 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:641.out 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:642 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:642.out 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:643 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:643.out 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:644 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:644.out 2024-02-19T07:03:35.758 INFO:teuthology.orchestra.run.smithi046.stdout:645 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:645.out 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:646 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:646.out 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:647 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:647.out 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:648 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:648.out 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:649 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:649.out 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:650 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:650.out 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:651 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:651.out 2024-02-19T07:03:35.759 INFO:teuthology.orchestra.run.smithi046.stdout:652 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:652.out 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:653 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:653.out 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:654 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:654.out 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:655 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:655.out 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:656 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:656.out 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:657 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:657.out 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:658 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:658.out 2024-02-19T07:03:35.760 INFO:teuthology.orchestra.run.smithi046.stdout:659 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:659.out 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:660 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:660.out 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:661 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:661.out 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:662 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:662.out 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:663 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:663.out 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:664 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:664.out 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:665 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:665.out 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:666 2024-02-19T07:03:35.761 INFO:teuthology.orchestra.run.smithi046.stdout:666.out 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:667 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:667.out 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:668 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:668.out 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:669 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:669.out 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:670 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:670.out 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:671 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:671.out 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:672 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:672.out 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:673 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:673.out 2024-02-19T07:03:35.762 INFO:teuthology.orchestra.run.smithi046.stdout:674 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:674.out 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:675 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:675.out 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:676 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:676.out 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:677 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:677.out 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:678 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:678.out 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:679 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:679.out 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:680 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:680.out 2024-02-19T07:03:35.763 INFO:teuthology.orchestra.run.smithi046.stdout:681 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:681.out 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:682 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:682.out 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:683 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:683.out 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:684 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:684.out 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:685 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:685.out 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:686 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:686.out 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:687 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:687.out 2024-02-19T07:03:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:688 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:688.out 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:689 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:689.out 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:690 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:690.out 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:691 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:691.out 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:692 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:692.out 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:693 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:693.out 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:694 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:694.out 2024-02-19T07:03:35.765 INFO:teuthology.orchestra.run.smithi046.stdout:695 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:695.out 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:696 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:696.out 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:697 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:697.out 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:698 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:698.out 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:699 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:699.out 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:700 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:700.out 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:701 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:701.out 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:702 2024-02-19T07:03:35.766 INFO:teuthology.orchestra.run.smithi046.stdout:702.out 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:703 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:703.out 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:704 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:704.out 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:705 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:705.out 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:706 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:706.out 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:707 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:707.out 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:708 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:708.out 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:709 2024-02-19T07:03:35.767 INFO:teuthology.orchestra.run.smithi046.stdout:709.out 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:710 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:710.out 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:711 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:711.out 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:712 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:712.out 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:713 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:713.out 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:714 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:714.out 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:715 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:715.out 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:716 2024-02-19T07:03:35.768 INFO:teuthology.orchestra.run.smithi046.stdout:716.out 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:717 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:717.out 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:718 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:718.out 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:719 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:719.out 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:720 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:720.out 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:721 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:721.out 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:722 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:722.out 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:723 2024-02-19T07:03:35.769 INFO:teuthology.orchestra.run.smithi046.stdout:723.out 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:724 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:724.out 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:725 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:725.out 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:726 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:726.out 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:727 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:727.out 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:728 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:728.out 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:729 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:729.out 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:730 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:730.out 2024-02-19T07:03:35.770 INFO:teuthology.orchestra.run.smithi046.stdout:731 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:731.out 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:732 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:732.out 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:733 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:733.out 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:734 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:734.out 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:735 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:735.out 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:736 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:736.out 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:737 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:737.out 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:738 2024-02-19T07:03:35.771 INFO:teuthology.orchestra.run.smithi046.stdout:738.out 2024-02-19T07:03:35.772 INFO:teuthology.orchestra.run.smithi046.stdout:739 2024-02-19T07:03:35.772 INFO:teuthology.orchestra.run.smithi046.stdout:739.out 2024-02-19T07:03:35.772 INFO:teuthology.orchestra.run.smithi046.stdout:group.list 2024-02-19T07:03:35.772 INFO:teuthology.orchestra.run.smithi046.stdout:Makefile 2024-02-19T07:03:35.773 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-02-19T07:03:36.352 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:03:36.368 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:03:36.368 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:03:42.962 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:03:42.969 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:03:44.936 INFO:teuthology.orchestra.run.smithi046.stdout:generic/001 8s 2024-02-19T07:03:44.959 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/001 2024-02-19T07:03:44.959 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:03:44.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:03:44.976 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[50267]: fuse finished with error 0 and tester_r 0 2024-02-19T07:03:45.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:03:45.004 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-02-19T07:03:45.549 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:03:45.563 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:03:45.563 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:03:46.810 INFO:teuthology.orchestra.run.smithi046.stdout:generic/002 1s 2024-02-19T07:03:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/002 2024-02-19T07:03:46.826 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:03:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:03:46.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:03:46.867 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-02-19T07:03:47.367 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:03:47.379 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:03:47.379 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:03:47.827 INFO:teuthology.orchestra.run.smithi046.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:03:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/003 2024-02-19T07:03:47.841 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/003 2024-02-19T07:03:47.841 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:03:47.850 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:03:47.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:03:47.883 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-02-19T07:03:48.428 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:03:48.440 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:03:48.441 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:03:48.876 INFO:teuthology.orchestra.run.smithi046.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-02-19T07:03:48.888 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/004 2024-02-19T07:03:48.889 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/004 2024-02-19T07:03:48.889 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:03:48.901 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:03:48.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:03:48.936 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-02-19T07:03:49.504 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:03:49.516 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:03:49.516 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:03:51.846 INFO:teuthology.orchestra.run.smithi046.stdout:generic/005 2s 2024-02-19T07:03:51.864 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/005 2024-02-19T07:03:51.864 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:03:51.874 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:03:51.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:03:51.911 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-02-19T07:03:52.409 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:03:52.422 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:03:52.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:04:13.160 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:04:13.168 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:04:43.306 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:04:43.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:05:13.442 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:05:13.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:05:17.825 INFO:teuthology.orchestra.run.smithi046.stdout:generic/006 85s 2024-02-19T07:05:17.842 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/006 2024-02-19T07:05:17.842 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:05:17.851 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:05:17.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:05:17.878 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-02-19T07:05:18.501 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:05:18.513 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:05:18.513 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:05:43.589 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:05:43.597 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:06:13.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:06:13.762 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:06:44.720 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:06:44.998 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:07:15.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:07:15.141 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:07:45.275 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:07:45.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:08:15.422 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:08:15.428 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:08:41.792 INFO:teuthology.orchestra.run.smithi046.stdout:generic/007 203s 2024-02-19T07:08:41.809 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/007 2024-02-19T07:08:41.809 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:08:41.812 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:08:41.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:08:41.839 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-02-19T07:08:42.341 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:08:42.355 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:08:42.355 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:08:44.944 INFO:teuthology.orchestra.run.smithi046.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-19T07:08:44.957 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/008 2024-02-19T07:08:44.957 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/008 2024-02-19T07:08:44.958 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:08:44.969 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:08:45.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:08:45.004 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-02-19T07:08:45.551 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:08:45.557 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:08:45.578 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:08:45.591 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:08:45.591 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:08:49.166 INFO:teuthology.orchestra.run.smithi046.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-19T07:08:49.180 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/009 2024-02-19T07:08:49.181 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/009 2024-02-19T07:08:49.181 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:08:49.192 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:08:49.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:08:49.228 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-02-19T07:08:49.782 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:08:49.793 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:08:49.794 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:08:51.833 INFO:teuthology.orchestra.run.smithi046.stdout:generic/010 2s 2024-02-19T07:08:51.926 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/010 2024-02-19T07:08:51.927 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:08:51.938 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:08:51.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:08:51.987 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-02-19T07:08:52.468 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:08:52.481 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:08:52.481 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:09:15.676 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:09:15.683 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:09:45.812 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:09:45.823 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:10:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:generic/011 75s 2024-02-19T07:10:07.664 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/011 2024-02-19T07:10:07.664 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:10:07.673 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:10:07.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:10:07.705 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-02-19T07:10:08.218 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:10:08.229 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:10:08.229 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:10:12.782 INFO:teuthology.orchestra.run.smithi046.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-19T07:10:12.795 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/012 2024-02-19T07:10:12.795 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/012 2024-02-19T07:10:12.795 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:10:12.805 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:10:12.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:10:12.854 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-02-19T07:10:13.342 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:10:13.355 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:10:13.356 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:10:15.961 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:10:15.971 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:10:46.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:10:46.118 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:11:16.309 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:11:16.325 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:11:46.866 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:11:46.875 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:12:17.355 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:12:17.361 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:12:17.812 INFO:teuthology.orchestra.run.smithi046.stdout:generic/013 124s 2024-02-19T07:12:17.834 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/013 2024-02-19T07:12:17.834 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:12:17.844 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:17.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:12:17.876 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-02-19T07:12:18.506 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:12:18.528 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:12:18.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:19.051 INFO:teuthology.orchestra.run.smithi046.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-02-19T07:12:19.063 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/014 2024-02-19T07:12:19.063 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/014 2024-02-19T07:12:19.063 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:12:19.075 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:19.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:12:19.113 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-02-19T07:12:19.731 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:12:19.744 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:12:19.745 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:20.156 INFO:teuthology.orchestra.run.smithi046.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:12:20.170 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/015 2024-02-19T07:12:20.170 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/015 2024-02-19T07:12:20.170 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:12:20.179 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:20.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:12:20.213 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-02-19T07:12:20.843 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:12:20.858 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:12:20.858 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:24.062 INFO:teuthology.orchestra.run.smithi046.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-19T07:12:24.075 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/016 2024-02-19T07:12:24.075 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/016 2024-02-19T07:12:24.075 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:12:24.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:24.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:12:24.135 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-02-19T07:12:24.808 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:12:24.826 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:12:24.827 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:25.240 INFO:teuthology.orchestra.run.smithi046.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:12:25.252 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/017 2024-02-19T07:12:25.252 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/017 2024-02-19T07:12:25.252 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:12:25.264 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:25.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:12:25.295 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-02-19T07:12:25.939 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:12:25.953 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:12:25.953 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:26.378 INFO:teuthology.orchestra.run.smithi046.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:12:26.390 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/018 2024-02-19T07:12:26.391 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/018 2024-02-19T07:12:26.391 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:12:26.400 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:26.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:12:26.433 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-02-19T07:12:27.064 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:12:27.082 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:12:27.082 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:27.498 INFO:teuthology.orchestra.run.smithi046.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:12:27.512 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/019 2024-02-19T07:12:27.512 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/019 2024-02-19T07:12:27.512 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:12:27.522 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:27.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:12:27.558 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-02-19T07:12:28.164 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:12:28.179 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:12:28.179 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:47.948 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:12:47.956 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:12:48.528 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-02-19T07:12:48.525+0000 7fb706c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 123722) UID: 0 2024-02-19T07:12:48.532 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-02-19T07:12:48.528+0000 7f51d5600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 123722) UID: 0 2024-02-19T07:12:49.283 INFO:teuthology.orchestra.run.smithi046.stdout:generic/020 - output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/020.out.bad) 2024-02-19T07:12:49.294 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/020.out 2024-02-19 06:59:27.954911034 +0000 2024-02-19T07:12:49.294 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/020.out.bad 2024-02-19 07:12:49.276673268 +0000 2024-02-19T07:12:49.295 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -47,9 +47,13 @@ 2024-02-19T07:12:49.295 INFO:teuthology.orchestra.run.smithi046.stdout: user.snrub="fish2\012" 2024-02-19T07:12:49.295 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:49.295 INFO:teuthology.orchestra.run.smithi046.stdout: *** really long value 2024-02-19T07:12:49.295 INFO:teuthology.orchestra.run.smithi046.stdout: -0000000 00 2024-02-19T07:12:49.295 INFO:teuthology.orchestra.run.smithi046.stdout: -* 2024-02-19T07:12:49.295 INFO:teuthology.orchestra.run.smithi046.stdout: -ATTRSIZE 2024-02-19T07:12:49.295 INFO:teuthology.orchestra.run.smithi046.stdout: +attr_set: No space left on device 2024-02-19T07:12:49.295 INFO:teuthology.orchestra.run.smithi046.stdout: +Could not set "long_attr" for 2024-02-19T07:12:49.295 INFO:teuthology.orchestra.run.smithi046.stdout: +attr_get: No data available 2024-02-19T07:12:49.295 INFO:teuthology.orchestra.run.smithi046.stdout: +Could not get "long_attr" for 2024-02-19T07:12:49.295 INFO:teuthology.orchestra.run.smithi046.stdout: +0000000 2024-02-19T07:12:49.295 INFO:teuthology.orchestra.run.smithi046.stdout: +attr_remove: No data available 2024-02-19T07:12:49.296 INFO:teuthology.orchestra.run.smithi046.stdout: +Could not remove "long_attr" for 2024-02-19T07:12:49.296 INFO:teuthology.orchestra.run.smithi046.stdout: *** set/get/remove really long names (expect failure) 2024-02-19T07:12:49.296 INFO:teuthology.orchestra.run.smithi046.stdout: attr_set: Invalid argument 2024-02-19T07:12:49.296 INFO:teuthology.orchestra.run.smithi046.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2024-02-19T07:12:49.304 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/020 2024-02-19T07:12:49.304 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/020 2024-02-19T07:12:49.304 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T07:12:49.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:49.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T07:12:49.366 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T07:12:49.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T07:12:49.366 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-02-19T07:12:50.136 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:12:50.155 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:12:50.155 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:53.388 INFO:teuthology.orchestra.run.smithi046.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-19T07:12:53.404 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/021 2024-02-19T07:12:53.405 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/021 2024-02-19T07:12:53.405 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:12:53.412 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:53.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:12:53.456 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-02-19T07:12:54.176 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:12:54.192 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:12:54.192 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:57.327 INFO:teuthology.orchestra.run.smithi046.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-19T07:12:57.339 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/022 2024-02-19T07:12:57.339 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/022 2024-02-19T07:12:57.339 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:12:57.351 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:12:57.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:12:57.392 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-02-19T07:12:58.171 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:12:58.189 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:12:58.189 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:01.918 INFO:teuthology.orchestra.run.smithi046.stdout:generic/023 3s 2024-02-19T07:13:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/023 2024-02-19T07:13:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:01.952 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:02.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:02.005 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-02-19T07:13:02.782 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:02.801 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:02.802 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:03.338 INFO:teuthology.orchestra.run.smithi046.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-02-19T07:13:03.350 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/024 2024-02-19T07:13:03.350 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/024 2024-02-19T07:13:03.351 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:03.359 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:03.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:03.422 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-02-19T07:13:04.188 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:04.208 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:04.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:04.762 INFO:teuthology.orchestra.run.smithi046.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-02-19T07:13:04.775 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/025 2024-02-19T07:13:04.775 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/025 2024-02-19T07:13:04.775 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:04.786 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:04.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:04.855 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-02-19T07:13:05.608 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:05.626 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:05.626 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:06.197 INFO:teuthology.orchestra.run.smithi046.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-02-19T07:13:06.211 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/026 2024-02-19T07:13:06.212 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/026 2024-02-19T07:13:06.212 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:06.221 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:06.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:06.256 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-02-19T07:13:06.967 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:06.986 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:06.986 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:07.434 INFO:teuthology.orchestra.run.smithi046.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:07.447 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/027 2024-02-19T07:13:07.447 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/027 2024-02-19T07:13:07.448 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:07.460 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:07.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:07.493 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-02-19T07:13:08.203 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:08.222 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:08.222 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:13.759 INFO:teuthology.orchestra.run.smithi046.stdout:generic/028 5s 2024-02-19T07:13:13.777 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/028 2024-02-19T07:13:13.777 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:13.786 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:13.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:13.822 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-02-19T07:13:14.489 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:14.508 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:14.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:14.949 INFO:teuthology.orchestra.run.smithi046.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:14.963 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/029 2024-02-19T07:13:14.963 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/029 2024-02-19T07:13:14.963 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:14.972 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:15.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:15.014 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-02-19T07:13:15.746 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:15.764 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:15.764 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:16.235 INFO:teuthology.orchestra.run.smithi046.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:16.247 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/030 2024-02-19T07:13:16.247 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/030 2024-02-19T07:13:16.247 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:16.259 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:16.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:16.294 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-02-19T07:13:16.992 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:17.008 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:17.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:17.485 INFO:teuthology.orchestra.run.smithi046.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:17.498 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/031 2024-02-19T07:13:17.499 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/031 2024-02-19T07:13:17.499 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:17.510 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:17.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:17.548 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-02-19T07:13:18.247 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:18.269 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:18.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:18.743 INFO:teuthology.orchestra.run.smithi046.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:18.760 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/032 2024-02-19T07:13:18.761 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/032 2024-02-19T07:13:18.761 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:18.771 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:18.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:18.814 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-02-19T07:13:19.623 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:19.642 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:19.643 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:20.134 INFO:teuthology.orchestra.run.smithi046.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:20.148 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/033 2024-02-19T07:13:20.149 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/033 2024-02-19T07:13:20.149 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:20.160 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:20.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:20.208 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-02-19T07:13:20.951 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:20.969 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:20.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:21.504 INFO:teuthology.orchestra.run.smithi046.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:21.516 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/034 2024-02-19T07:13:21.517 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/034 2024-02-19T07:13:21.517 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:21.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:21.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:21.563 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-02-19T07:13:22.240 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:22.257 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:22.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:22.919 INFO:teuthology.orchestra.run.smithi046.stdout:generic/035 0s 2024-02-19T07:13:22.941 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/035 2024-02-19T07:13:22.942 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:22.953 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:22.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:22.990 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-02-19T07:13:23.766 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:23.783 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:23.783 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:34.478 INFO:teuthology.orchestra.run.smithi046.stdout:generic/036 11s 2024-02-19T07:13:34.506 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/036 2024-02-19T07:13:34.506 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:34.516 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:34.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:34.562 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-02-19T07:13:35.331 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:35.351 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:35.351 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:35.827 INFO:teuthology.orchestra.run.smithi046.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:35.841 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/037 2024-02-19T07:13:35.841 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/037 2024-02-19T07:13:35.841 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:35.851 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:35.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:35.890 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-02-19T07:13:36.568 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:36.583 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:36.583 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:37.057 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/038 2024-02-19T07:13:37.057 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/038 2024-02-19T07:13:37.057 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:37.069 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:37.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:37.103 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-02-19T07:13:37.813 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:37.831 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:37.831 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:38.302 INFO:teuthology.orchestra.run.smithi046.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:38.316 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/039 2024-02-19T07:13:38.316 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/039 2024-02-19T07:13:38.316 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:38.327 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:38.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:38.370 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-02-19T07:13:39.025 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:39.042 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:39.042 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:39.538 INFO:teuthology.orchestra.run.smithi046.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:39.551 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/040 2024-02-19T07:13:39.551 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/040 2024-02-19T07:13:39.551 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:39.561 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:39.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:39.595 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-02-19T07:13:40.289 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:40.307 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:40.307 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:40.815 INFO:teuthology.orchestra.run.smithi046.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:40.828 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/041 2024-02-19T07:13:40.829 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/041 2024-02-19T07:13:40.829 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:40.838 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:40.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:40.881 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-02-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:41.570 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:41.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:42.051 INFO:teuthology.orchestra.run.smithi046.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:42.069 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/042 2024-02-19T07:13:42.069 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/042 2024-02-19T07:13:42.069 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:42.086 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:42.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:42.125 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-02-19T07:13:42.800 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:42.822 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:42.822 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:43.292 INFO:teuthology.orchestra.run.smithi046.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:43.304 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/043 2024-02-19T07:13:43.304 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/043 2024-02-19T07:13:43.305 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:43.315 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:43.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:43.347 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-02-19T07:13:44.048 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:44.073 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:44.539 INFO:teuthology.orchestra.run.smithi046.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:44.554 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/044 2024-02-19T07:13:44.554 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/044 2024-02-19T07:13:44.554 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:44.563 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:44.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:44.601 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-02-19T07:13:45.284 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:45.299 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:45.299 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:45.760 INFO:teuthology.orchestra.run.smithi046.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:45.778 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/045 2024-02-19T07:13:45.778 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/045 2024-02-19T07:13:45.778 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:45.786 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:45.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:45.825 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-02-19T07:13:46.517 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:46.533 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:46.533 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:46.994 INFO:teuthology.orchestra.run.smithi046.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:47.007 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/046 2024-02-19T07:13:47.008 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/046 2024-02-19T07:13:47.008 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:47.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:47.048 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-02-19T07:13:47.724 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:47.742 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:48.162 INFO:teuthology.orchestra.run.smithi046.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:48.171 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/047 2024-02-19T07:13:48.171 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/047 2024-02-19T07:13:48.171 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:48.178 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:48.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:48.203 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-02-19T07:13:48.886 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:48.901 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:48.901 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:49.362 INFO:teuthology.orchestra.run.smithi046.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:49.379 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/048 2024-02-19T07:13:49.379 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/048 2024-02-19T07:13:49.379 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:49.394 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:49.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:49.434 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-02-19T07:13:50.119 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:50.138 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:50.138 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:50.609 INFO:teuthology.orchestra.run.smithi046.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:50.623 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/049 2024-02-19T07:13:50.623 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/049 2024-02-19T07:13:50.624 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:50.635 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:50.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:50.670 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-02-19T07:13:51.407 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:51.422 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:51.422 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:51.905 INFO:teuthology.orchestra.run.smithi046.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:51.917 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/050 2024-02-19T07:13:51.917 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/050 2024-02-19T07:13:51.918 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:51.933 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:51.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:51.971 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-02-19T07:13:52.850 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:52.867 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:52.867 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:53.350 INFO:teuthology.orchestra.run.smithi046.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:53.365 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/051 2024-02-19T07:13:53.366 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/051 2024-02-19T07:13:53.366 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:53.376 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:53.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:53.416 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-02-19T07:13:54.129 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:54.144 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:54.144 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:54.599 INFO:teuthology.orchestra.run.smithi046.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:54.612 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/052 2024-02-19T07:13:54.613 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/052 2024-02-19T07:13:54.613 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:54.621 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:54.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:54.661 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-02-19T07:13:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:55.400 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:55.400 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:55.832 INFO:teuthology.orchestra.run.smithi046.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:55.845 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/053 2024-02-19T07:13:55.845 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/053 2024-02-19T07:13:55.846 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:55.856 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:55.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:55.890 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-02-19T07:13:56.566 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:56.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:57.047 INFO:teuthology.orchestra.run.smithi046.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:57.059 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/054 2024-02-19T07:13:57.059 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/054 2024-02-19T07:13:57.060 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:57.070 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:57.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:57.105 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-02-19T07:13:57.826 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:57.848 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:57.848 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:58.308 INFO:teuthology.orchestra.run.smithi046.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:58.319 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/055 2024-02-19T07:13:58.319 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/055 2024-02-19T07:13:58.320 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:58.337 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:58.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:58.378 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-02-19T07:13:59.045 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:13:59.065 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:13:59.065 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:59.545 INFO:teuthology.orchestra.run.smithi046.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:13:59.556 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/056 2024-02-19T07:13:59.556 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/056 2024-02-19T07:13:59.556 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:13:59.568 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:13:59.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:13:59.598 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-02-19T07:14:00.303 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:00.319 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:00.320 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:00.782 INFO:teuthology.orchestra.run.smithi046.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:14:00.796 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/057 2024-02-19T07:14:00.796 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/057 2024-02-19T07:14:00.796 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:14:00.806 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:00.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:14:00.838 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-02-19T07:14:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:01.533 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:01.533 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:04.673 INFO:teuthology.orchestra.run.smithi046.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-19T07:14:04.687 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/058 2024-02-19T07:14:04.687 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/058 2024-02-19T07:14:04.688 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:14:04.701 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:04.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:14:04.739 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-02-19T07:14:05.517 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:05.535 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:05.535 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:06.018 INFO:teuthology.orchestra.run.smithi046.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:14:06.030 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/059 2024-02-19T07:14:06.031 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/059 2024-02-19T07:14:06.031 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:14:06.042 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:06.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:14:06.079 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-02-19T07:14:06.768 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:06.784 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:06.784 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:09.976 INFO:teuthology.orchestra.run.smithi046.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-19T07:14:09.989 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/060 2024-02-19T07:14:09.992 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/060 2024-02-19T07:14:09.992 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:14:10.002 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:10.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:14:10.060 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-02-19T07:14:10.825 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:10.847 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:10.848 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:13.983 INFO:teuthology.orchestra.run.smithi046.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-19T07:14:13.995 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/061 2024-02-19T07:14:13.995 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/061 2024-02-19T07:14:13.996 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:14:14.005 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:14.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:14:14.069 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-02-19T07:14:14.828 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:14.846 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:14.846 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:15.301 INFO:teuthology.orchestra.run.smithi046.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:14:15.315 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/062 2024-02-19T07:14:15.315 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/062 2024-02-19T07:14:15.315 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:14:15.326 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:15.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:14:15.364 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-02-19T07:14:16.067 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:16.083 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:16.083 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:19.328 INFO:teuthology.orchestra.run.smithi046.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-19T07:14:19.343 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/063 2024-02-19T07:14:19.343 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/063 2024-02-19T07:14:19.343 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:14:19.354 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:19.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:14:19.392 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-02-19T07:14:20.159 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:20.175 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:20.176 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:20.618 INFO:teuthology.orchestra.run.smithi046.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:14:20.633 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/064 2024-02-19T07:14:20.633 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/064 2024-02-19T07:14:20.633 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:14:20.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:20.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:14:20.683 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-02-19T07:14:21.361 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:21.378 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:21.378 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:14:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/065 2024-02-19T07:14:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/065 2024-02-19T07:14:21.887 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:14:21.897 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:21.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:14:21.933 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-02-19T07:14:22.593 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:22.614 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:22.614 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:23.089 INFO:teuthology.orchestra.run.smithi046.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:14:23.102 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/066 2024-02-19T07:14:23.102 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/066 2024-02-19T07:14:23.102 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:14:23.113 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:23.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:14:23.141 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-02-19T07:14:23.758 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:23.774 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:23.775 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:24.299 INFO:teuthology.orchestra.run.smithi046.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:14:24.311 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/067 2024-02-19T07:14:24.311 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/067 2024-02-19T07:14:24.311 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:14:24.322 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:24.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:14:24.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-02-19T07:14:25.025 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:25.046 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:25.046 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:25.506 INFO:teuthology.orchestra.run.smithi046.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:14:25.518 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/068 2024-02-19T07:14:25.518 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/068 2024-02-19T07:14:25.518 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:14:25.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:25.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:14:25.557 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-02-19T07:14:26.233 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:26.250 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:26.250 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:26.713 INFO:teuthology.orchestra.run.smithi046.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:14:26.727 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/069 2024-02-19T07:14:26.727 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/069 2024-02-19T07:14:26.727 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:14:26.740 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:14:26.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:14:26.780 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-02-19T07:14:27.464 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:14:27.481 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:14:27.482 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:16:05.090 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:16:05.097 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:16:28.542 INFO:teuthology.orchestra.run.smithi046.stdout:generic/070 121s 2024-02-19T07:16:28.560 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/070 2024-02-19T07:16:28.560 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:16:28.569 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:16:28.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:16:28.623 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-02-19T07:16:29.356 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:16:29.370 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:16:29.371 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:16:29.760 INFO:teuthology.orchestra.run.smithi046.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:16:29.772 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/071 2024-02-19T07:16:29.773 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/071 2024-02-19T07:16:29.773 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:16:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:16:29.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:16:29.817 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-02-19T07:16:30.422 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:16:30.439 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:16:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:16:33.131 INFO:teuthology.orchestra.run.smithi046.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-02-19T07:16:33.141 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/072 2024-02-19T07:16:33.141 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/072 2024-02-19T07:16:33.141 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:16:33.149 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:16:33.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:16:33.184 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-02-19T07:16:33.842 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:16:33.855 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:16:33.855 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:16:34.301 INFO:teuthology.orchestra.run.smithi046.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:16:34.315 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/073 2024-02-19T07:16:34.315 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/073 2024-02-19T07:16:34.315 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:16:34.323 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:16:34.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:16:34.351 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-02-19T07:16:34.928 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:16:34.943 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:16:34.943 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:16:35.229 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:16:35.235 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:17:05.378 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:17:05.386 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:17:35.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:17:35.568 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:18:05.734 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:18:05.742 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:18:35.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:18:35.900 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:19:06.063 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:19:06.070 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:19:36.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:19:36.215 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:20:06.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:20:06.387 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:20:36.514 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:20:36.526 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:21:06.731 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:21:06.742 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:21:38.824 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:21:38.831 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:22:09.000 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:22:09.006 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:22:39.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:22:39.164 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:23:10.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:23:10.282 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:23:42.097 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:23:42.106 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:24:12.269 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:24:12.280 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:24:42.456 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:24:42.469 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:25:12.748 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:25:12.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:25:42.895 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:25:42.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:26:13.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:26:13.074 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:26:43.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:26:43.964 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:27:14.102 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:27:14.109 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:27:44.251 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:27:44.257 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:28:14.500 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:28:14.507 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:28:44.660 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:28:44.670 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:29:14.938 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:29:14.945 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:29:45.302 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:29:45.308 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:30:16.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:30:16.155 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:30:46.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:30:46.327 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:31:16.489 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:31:16.495 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:31:46.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:31:46.624 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:32:16.771 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:32:16.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:32:46.935 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:32:46.941 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:33:17.090 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:33:17.096 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:33:47.551 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:33:47.558 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:34:17.699 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:34:17.710 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:34:47.866 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:34:47.876 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:35:17.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:35:18.003 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:35:48.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:35:48.152 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:36:18.301 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:36:18.309 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:36:48.476 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:36:48.484 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:37:18.650 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:37:18.656 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:37:48.787 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:37:48.796 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:38:18.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:38:18.935 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:38:49.072 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:38:49.082 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:39:19.218 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:39:19.230 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:39:49.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:39:49.365 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:40:19.590 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:40:19.597 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:40:49.846 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:40:49.857 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:41:20.399 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:41:20.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:41:50.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:41:50.568 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:42:20.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:42:20.697 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:42:51.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:42:51.639 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:43:21.791 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:43:21.797 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:43:51.920 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:43:51.930 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:44:22.489 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:44:22.498 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:44:52.626 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:44:52.637 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:44:52.742 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T07:44:52.740+0000 7f99f5600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 76276) UID: 0 2024-02-19T07:44:52.743 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T07:44:52.740+0000 7f3c04600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 76276) UID: 0 2024-02-19T07:44:52.743 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T07:44:52.740+0000 7f7183000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 76276) UID: 0 2024-02-19T07:44:52.743 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T07:44:52.740+0000 7f35abe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 76276) UID: 0 2024-02-19T07:47:55.971 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:47:55.980 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:48:26.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:48:26.141 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:48:49.020 INFO:teuthology.orchestra.run.smithi046.stdout:generic/074 1934s 2024-02-19T07:48:49.054 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/074 2024-02-19T07:48:49.054 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:48:49.073 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:48:49.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:48:49.133 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-02-19T07:48:50.084 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:48:50.097 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:48:50.097 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:48:56.277 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:48:56.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:49:26.434 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:49:26.443 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:49:56.589 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:49:56.598 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:50:26.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:50:26.752 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:50:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:generic/075 116s 2024-02-19T07:50:46.942 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/075 2024-02-19T07:50:46.942 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:50:46.952 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:47.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:50:47.003 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-02-19T07:50:47.671 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:50:47.682 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:50:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:48.126 INFO:teuthology.orchestra.run.smithi046.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:50:48.137 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/076 2024-02-19T07:50:48.138 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/076 2024-02-19T07:50:48.138 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:50:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:48.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:50:48.183 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-02-19T07:50:48.758 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:50:48.773 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:50:48.773 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:50.065 INFO:teuthology.orchestra.run.smithi046.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:50:50.080 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/077 2024-02-19T07:50:50.080 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/077 2024-02-19T07:50:50.080 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:50:50.091 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:50.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:50:50.123 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-02-19T07:50:50.698 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:50:50.713 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:50:50.713 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:51.219 INFO:teuthology.orchestra.run.smithi046.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-02-19T07:50:51.232 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/078 2024-02-19T07:50:51.232 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/078 2024-02-19T07:50:51.232 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:50:51.243 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:51.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:50:51.285 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-02-19T07:50:52.243 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:50:52.258 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:50:52.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:52.749 INFO:teuthology.orchestra.run.smithi046.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-02-19T07:50:52.763 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/079 2024-02-19T07:50:52.763 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/079 2024-02-19T07:50:52.764 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:50:52.774 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:52.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:50:52.806 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-02-19T07:50:53.387 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:50:53.402 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:50:53.403 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:56.009 INFO:teuthology.orchestra.run.smithi046.stdout:generic/080 2s 2024-02-19T07:50:56.027 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/080 2024-02-19T07:50:56.027 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:50:56.036 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:56.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:50:56.071 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-02-19T07:50:56.637 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:50:56.649 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:50:56.650 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:56.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:50:56.915 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:50:57.056 INFO:teuthology.orchestra.run.smithi046.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:50:57.066 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/081 2024-02-19T07:50:57.066 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/081 2024-02-19T07:50:57.066 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:50:57.074 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:57.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:50:57.102 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-02-19T07:50:57.695 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:50:57.709 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:50:57.710 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:58.154 INFO:teuthology.orchestra.run.smithi046.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:50:58.166 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/082 2024-02-19T07:50:58.166 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/082 2024-02-19T07:50:58.166 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:50:58.177 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:58.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:50:58.208 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-02-19T07:50:58.780 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:50:58.796 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:50:58.796 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:59.218 INFO:teuthology.orchestra.run.smithi046.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:50:59.228 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/083 2024-02-19T07:50:59.228 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/083 2024-02-19T07:50:59.228 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:50:59.238 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:50:59.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:50:59.266 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-02-19T07:50:59.810 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:50:59.824 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:50:59.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:51:00.257 INFO:teuthology.orchestra.run.smithi046.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:51:00.270 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/084 2024-02-19T07:51:00.271 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/084 2024-02-19T07:51:00.271 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:51:00.283 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:51:00.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:51:00.318 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-02-19T07:51:00.871 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:51:00.886 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:51:00.886 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:51:01.402 INFO:teuthology.orchestra.run.smithi046.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T07:51:01.415 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/085 2024-02-19T07:51:01.416 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/085 2024-02-19T07:51:01.416 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:51:01.426 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:51:01.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:51:01.457 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-02-19T07:51:02.028 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:51:02.044 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:51:02.045 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:51:21.897 INFO:teuthology.orchestra.run.smithi046.stdout:generic/086 19s 2024-02-19T07:51:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/086 2024-02-19T07:51:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:51:21.974 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:51:22.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:51:22.132 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-02-19T07:51:23.615 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:51:23.628 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:51:23.628 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:51:24.566 INFO:teuthology.orchestra.run.smithi046.stdout:generic/087 1s 2024-02-19T07:51:24.583 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/087 2024-02-19T07:51:24.583 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:51:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:51:24.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:51:24.636 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-02-19T07:51:25.321 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:51:25.334 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:51:25.334 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:51:25.863 INFO:teuthology.orchestra.run.smithi046.stdout:generic/088 0s 2024-02-19T07:51:25.879 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/088 2024-02-19T07:51:25.879 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T07:51:25.888 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:51:25.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T07:51:25.927 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-02-19T07:51:26.595 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T07:51:26.607 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T07:51:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T07:51:27.045 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:51:27.050 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:51:57.250 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:51:57.259 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:52:27.439 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:52:27.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:52:58.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:52:58.864 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:53:29.090 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:53:29.097 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:53:59.220 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:53:59.230 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:54:29.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:54:29.361 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:54:59.484 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:54:59.495 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:55:29.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:55:29.706 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:55:59.849 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:55:59.861 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:56:30.036 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:56:30.047 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:57:00.217 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:57:00.233 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:57:30.349 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:57:30.364 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T07:57:30.489 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-02-19T07:57:30.486+0000 7f5e66400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 156925) UID: 0 2024-02-19T07:57:30.489 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T07:57:30.486+0000 7fc963e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 156925) UID: 0 2024-02-19T07:57:30.489 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T07:57:30.486+0000 7f8a09200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 156925) UID: 0 2024-02-19T07:57:30.489 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-02-19T07:57:30.486+0000 7f3514600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 156925) UID: 0 2024-02-19T08:00:58.739 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:00:58.746 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:00:58.851 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-02-19T08:00:58.850+0000 7fb706c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 156962) UID: 0 2024-02-19T08:00:58.852 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-02-19T08:00:58.850+0000 7f51d5600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 156962) UID: 0 2024-02-19T08:04:27.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:04:27.993 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:04:58.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:04:58.210 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:05:28.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:05:28.362 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:05:58.566 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:05:58.580 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:05:58.697 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T08:05:58.695+0000 7f35abe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 76762) UID: 0 2024-02-19T08:05:58.697 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T08:05:58.695+0000 7f7183000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 76762) UID: 0 2024-02-19T08:05:58.698 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T08:05:58.696+0000 7f3c04600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 76762) UID: 0 2024-02-19T08:05:58.698 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T08:05:58.696+0000 7f99f5600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 76762) UID: 0 2024-02-19T08:08:23.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:08:23.362 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:08:53.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:08:53.499 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:09:23.647 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:09:23.654 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:09:23.751 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-02-19T08:09:23.750+0000 7fb706c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 157316) UID: 0 2024-02-19T08:09:23.751 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-02-19T08:09:23.750+0000 7f51d5600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 157316) UID: 0 2024-02-19T08:12:16.963 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:12:16.975 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:12:47.162 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:12:47.174 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:13:17.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:13:17.368 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:13:47.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:13:47.577 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:14:21.158 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:14:21.167 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:14:51.349 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:14:51.360 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:15:21.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:15:21.533 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:15:51.746 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:15:51.755 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:16:21.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:16:21.880 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:16:52.037 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:16:52.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:17:22.233 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:17:22.241 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:17:52.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:17:52.911 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:18:23.043 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:18:23.049 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:18:54.184 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:18:54.193 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:19:24.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:19:24.344 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:19:24.462 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-02-19T08:19:24.462+0000 7fb706c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 159607) UID: 0 2024-02-19T08:19:24.463 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-02-19T08:19:24.462+0000 7f51d5600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 159607) UID: 0 2024-02-19T08:22:19.692 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:22:19.700 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:22:50.168 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:22:50.180 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:23:20.299 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:23:20.309 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:23:50.524 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:23:50.533 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:24:20.727 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:24:20.737 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:24:50.914 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:24:50.925 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:25:21.051 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:25:21.061 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:25:51.474 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:25:51.484 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:26:21.665 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:26:21.675 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:26:21.790 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T08:26:21.790+0000 7f3c04600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 77266) UID: 0 2024-02-19T08:26:21.790 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T08:26:21.790+0000 7f35abe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 77266) UID: 0 2024-02-19T08:26:21.791 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T08:26:21.790+0000 7f7183000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 77266) UID: 0 2024-02-19T08:26:21.791 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T08:26:21.790+0000 7f99f5600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 77266) UID: 0 2024-02-19T08:27:21.607 INFO:teuthology.orchestra.run.smithi046.stdout:generic/089 2155s 2024-02-19T08:27:21.654 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/089 2024-02-19T08:27:21.655 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:27:21.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:27:21.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:27:21.704 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-02-19T08:27:22.651 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:27:22.665 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:27:22.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:27:23.353 INFO:teuthology.orchestra.run.smithi046.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:27:23.368 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/090 2024-02-19T08:27:23.369 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/090 2024-02-19T08:27:23.369 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:27:23.382 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:27:23.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:27:23.418 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-02-19T08:27:24.003 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:27:24.020 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:27:24.020 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:28:46.353 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:28:46.365 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:29:16.502 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:29:16.513 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:29:46.642 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:29:46.650 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:30:16.809 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:30:16.817 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:30:46.951 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:30:46.959 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:31:17.094 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:31:17.106 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:31:47.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:31:47.369 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:31:47.484 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-02-19T08:31:47.484+0000 7f5e66400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 160829) UID: 0 2024-02-19T08:31:47.485 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T08:31:47.484+0000 7f8a09200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 160829) UID: 0 2024-02-19T08:31:47.485 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T08:31:47.484+0000 7fc963e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 160829) UID: 0 2024-02-19T08:31:47.485 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-02-19T08:31:47.484+0000 7f3514600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 160829) UID: 0 2024-02-19T08:33:09.617 INFO:teuthology.orchestra.run.smithi046.stdout:generic/091 345s 2024-02-19T08:33:09.631 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/091 2024-02-19T08:33:09.631 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:33:09.638 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:09.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:33:09.673 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-02-19T08:33:10.395 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:33:10.406 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:33:10.406 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:11.345 INFO:teuthology.orchestra.run.smithi046.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-19T08:33:11.356 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/092 2024-02-19T08:33:11.356 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/092 2024-02-19T08:33:11.356 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:33:11.365 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:11.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:33:11.392 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-02-19T08:33:12.208 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:33:12.219 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:33:12.220 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:14.899 INFO:teuthology.orchestra.run.smithi046.stdout:generic/093 2s 2024-02-19T08:33:14.918 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/093 2024-02-19T08:33:14.918 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:33:14.927 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:14.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:33:14.971 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-02-19T08:33:15.822 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:33:15.833 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:33:15.833 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:16.991 INFO:teuthology.orchestra.run.smithi046.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:33:17.006 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/094 2024-02-19T08:33:17.006 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/094 2024-02-19T08:33:17.006 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:33:17.018 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:17.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:33:17.062 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-02-19T08:33:17.595 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:33:17.607 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:33:17.607 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:18.046 INFO:teuthology.orchestra.run.smithi046.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:33:18.057 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/095 2024-02-19T08:33:18.057 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/095 2024-02-19T08:33:18.057 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:33:18.066 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:18.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:33:18.094 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-02-19T08:33:18.620 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:33:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:33:18.635 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:19.037 INFO:teuthology.orchestra.run.smithi046.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:33:19.047 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/096 2024-02-19T08:33:19.048 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/096 2024-02-19T08:33:19.048 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:33:19.056 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:19.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:33:19.085 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-02-19T08:33:19.688 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:33:19.702 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:33:19.702 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:20.939 INFO:teuthology.orchestra.run.smithi046.stdout:generic/097 1s 2024-02-19T08:33:20.955 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/097 2024-02-19T08:33:20.956 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:33:20.963 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:20.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:33:20.991 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-02-19T08:33:21.480 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:33:21.492 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:33:21.492 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:21.907 INFO:teuthology.orchestra.run.smithi046.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:33:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/098 2024-02-19T08:33:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/098 2024-02-19T08:33:21.919 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:33:21.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:21.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:33:21.960 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-02-19T08:33:22.450 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:33:22.463 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:33:22.463 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:22.998 INFO:teuthology.orchestra.run.smithi046.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-02-19T08:33:23.008 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/099 2024-02-19T08:33:23.008 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/099 2024-02-19T08:33:23.009 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:33:23.017 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:33:23.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:33:23.043 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-02-19T08:33:23.543 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:33:23.554 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:33:23.555 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:34:39.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:34:39.115 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:35:09.436 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:35:09.445 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:35:20.095 INFO:teuthology.orchestra.run.smithi046.stdout:generic/100 117s 2024-02-19T08:35:20.116 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/100 2024-02-19T08:35:20.116 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:35:20.128 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:20.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:35:20.190 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-02-19T08:35:20.922 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:35:20.932 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:35:20.932 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:21.374 INFO:teuthology.orchestra.run.smithi046.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:35:21.388 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/101 2024-02-19T08:35:21.389 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/101 2024-02-19T08:35:21.389 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:35:21.401 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:21.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:35:21.434 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-02-19T08:35:22.015 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:35:22.030 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:35:22.030 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:22.474 INFO:teuthology.orchestra.run.smithi046.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:35:22.488 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/102 2024-02-19T08:35:22.488 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/102 2024-02-19T08:35:22.489 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:35:22.502 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:22.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:35:22.538 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-02-19T08:35:23.133 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:35:23.146 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:35:23.147 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:23.624 INFO:teuthology.orchestra.run.smithi046.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:35:23.639 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/103 2024-02-19T08:35:23.639 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/103 2024-02-19T08:35:23.639 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:35:23.653 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:23.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:35:23.687 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-02-19T08:35:24.272 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:35:24.287 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:35:24.287 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:24.771 INFO:teuthology.orchestra.run.smithi046.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:35:24.785 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/104 2024-02-19T08:35:24.786 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/104 2024-02-19T08:35:24.786 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:35:24.798 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:24.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:35:24.832 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-02-19T08:35:25.405 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:35:25.419 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:35:25.419 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:25.869 INFO:teuthology.orchestra.run.smithi046.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:35:25.881 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/105 2024-02-19T08:35:25.881 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/105 2024-02-19T08:35:25.881 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:35:25.891 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:25.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:35:25.921 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-02-19T08:35:26.495 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:35:26.509 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:35:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:26.967 INFO:teuthology.orchestra.run.smithi046.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:35:26.979 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/106 2024-02-19T08:35:26.980 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/106 2024-02-19T08:35:26.980 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:35:26.992 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:27.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:35:27.024 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-02-19T08:35:27.587 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:35:27.601 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:35:27.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:28.073 INFO:teuthology.orchestra.run.smithi046.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:35:28.089 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/107 2024-02-19T08:35:28.089 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/107 2024-02-19T08:35:28.090 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:35:28.101 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:28.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:35:28.136 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-02-19T08:35:28.717 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:35:28.730 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:35:28.730 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:29.516 INFO:teuthology.orchestra.run.smithi046.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:35:29.529 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/108 2024-02-19T08:35:29.529 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/108 2024-02-19T08:35:29.529 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:35:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:29.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:35:29.571 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-02-19T08:35:30.149 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:35:30.163 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:35:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:30.615 INFO:teuthology.orchestra.run.smithi046.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:35:30.630 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/109 2024-02-19T08:35:30.630 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/109 2024-02-19T08:35:30.631 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:35:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:30.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:35:30.680 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-02-19T08:35:31.261 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:35:31.275 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:35:31.275 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:31.846 INFO:teuthology.orchestra.run.smithi046.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T08:35:31.861 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/110 2024-02-19T08:35:31.861 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/110 2024-02-19T08:35:31.862 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:35:31.874 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:31.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:35:31.911 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-02-19T08:35:32.628 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:35:32.639 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:35:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:33.232 INFO:teuthology.orchestra.run.smithi046.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T08:35:33.246 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/111 2024-02-19T08:35:33.246 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/111 2024-02-19T08:35:33.247 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:35:33.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:33.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:35:33.300 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-02-19T08:35:33.983 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:35:33.995 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:35:33.995 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:35:39.583 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:35:39.593 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:36:09.797 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:36:09.806 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:36:39.945 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:36:39.955 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:37:10.109 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:37:10.118 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:37:36.856 INFO:teuthology.orchestra.run.smithi046.stdout:generic/112 122s 2024-02-19T08:37:36.879 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/112 2024-02-19T08:37:36.880 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:37:36.892 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:37:36.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:37:36.943 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-02-19T08:37:37.680 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:37:37.693 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:37:37.693 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:37:40.253 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:37:40.263 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:38:10.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:38:10.399 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:38:30.631 INFO:teuthology.orchestra.run.smithi046.stdout:generic/113 53s 2024-02-19T08:38:30.653 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/113 2024-02-19T08:38:30.653 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:38:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:30.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:38:30.714 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-02-19T08:38:31.448 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:38:31.459 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:38:31.459 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:31.942 INFO:teuthology.orchestra.run.smithi046.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-02-19T08:38:31.954 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/114 2024-02-19T08:38:31.954 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/114 2024-02-19T08:38:31.955 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:38:31.965 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:31.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:38:31.996 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-02-19T08:38:32.555 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:38:32.567 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:38:32.567 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:33.171 INFO:teuthology.orchestra.run.smithi046.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T08:38:33.182 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/115 2024-02-19T08:38:33.183 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/115 2024-02-19T08:38:33.183 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:38:33.193 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:33.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:38:33.239 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-02-19T08:38:33.918 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:38:33.928 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:38:33.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:34.488 INFO:teuthology.orchestra.run.smithi046.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T08:38:34.503 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/116 2024-02-19T08:38:34.503 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/116 2024-02-19T08:38:34.504 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:38:34.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:34.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:38:34.561 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-02-19T08:38:35.259 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:38:35.273 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:38:35.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:35.718 INFO:teuthology.orchestra.run.smithi046.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:38:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/117 2024-02-19T08:38:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/117 2024-02-19T08:38:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:38:35.741 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:35.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:38:35.771 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-02-19T08:38:36.388 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:38:36.401 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:38:36.401 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:36.979 INFO:teuthology.orchestra.run.smithi046.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T08:38:36.992 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/118 2024-02-19T08:38:36.992 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/118 2024-02-19T08:38:36.993 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:38:37.004 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:37.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:38:37.044 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-02-19T08:38:37.739 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:38:37.751 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:38:37.751 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:38.334 INFO:teuthology.orchestra.run.smithi046.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T08:38:38.347 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/119 2024-02-19T08:38:38.347 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/119 2024-02-19T08:38:38.347 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:38:38.359 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:38.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:38:38.407 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-02-19T08:38:39.084 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:38:39.095 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:38:39.095 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:39.516 INFO:teuthology.orchestra.run.smithi046.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:38:39.528 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/120 2024-02-19T08:38:39.528 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/120 2024-02-19T08:38:39.528 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:38:39.538 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:39.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:38:39.569 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-02-19T08:38:40.141 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:38:40.154 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:38:40.154 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:40.798 INFO:teuthology.orchestra.run.smithi046.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-02-19T08:38:40.811 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/121 2024-02-19T08:38:40.811 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/121 2024-02-19T08:38:40.811 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:38:40.823 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:40.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:38:40.873 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-02-19T08:38:41.298 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:38:41.303 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:38:41.556 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:38:41.568 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:38:41.568 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:42.102 INFO:teuthology.orchestra.run.smithi046.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-02-19T08:38:42.114 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/122 2024-02-19T08:38:42.114 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/122 2024-02-19T08:38:42.114 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:38:42.125 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:42.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:38:42.165 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-02-19T08:38:42.861 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:38:42.874 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:38:42.875 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:44.382 INFO:teuthology.orchestra.run.smithi046.stdout:generic/123 2s 2024-02-19T08:38:44.401 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/123 2024-02-19T08:38:44.401 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:38:44.410 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:44.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:38:44.459 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-02-19T08:38:45.150 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:38:45.161 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:38:45.161 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:45.569 INFO:teuthology.orchestra.run.smithi046.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T08:38:45.581 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/124 2024-02-19T08:38:45.582 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/124 2024-02-19T08:38:45.582 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:38:45.593 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:38:45.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:38:45.626 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-02-19T08:38:46.182 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:38:46.195 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:38:46.195 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:39:11.413 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:39:11.422 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:39:41.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:39:41.635 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:39:49.431 INFO:teuthology.orchestra.run.smithi046.stdout:generic/125 63s 2024-02-19T08:39:49.454 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/125 2024-02-19T08:39:49.454 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T08:39:49.464 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:39:49.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T08:39:49.505 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-02-19T08:39:50.176 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:39:50.188 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:39:50.188 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:39:51.919 INFO:teuthology.orchestra.run.smithi046.stdout:generic/126 - output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/126.out.bad) 2024-02-19T08:39:51.926 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/126.out 2024-02-19 06:59:27.971910841 +0000 2024-02-19T08:39:51.926 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/126.out.bad 2024-02-19 08:39:51.915490464 +0000 2024-02-19T08:39:51.926 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,7 +1,7 @@ 2024-02-19T08:39:51.927 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 126 2024-02-19T08:39:51.927 INFO:teuthology.orchestra.run.smithi046.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2024-02-19T08:39:51.927 INFO:teuthology.orchestra.run.smithi046.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2024-02-19T08:39:51.927 INFO:teuthology.orchestra.run.smithi046.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2024-02-19T08:39:51.927 INFO:teuthology.orchestra.run.smithi046.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2024-02-19T08:39:51.927 INFO:teuthology.orchestra.run.smithi046.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2024-02-19T08:39:51.927 INFO:teuthology.orchestra.run.smithi046.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2024-02-19T08:39:51.927 INFO:teuthology.orchestra.run.smithi046.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2024-02-19T08:39:51.927 INFO:teuthology.orchestra.run.smithi046.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2024-02-19T08:39:51.927 INFO:teuthology.orchestra.run.smithi046.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2024-02-19T08:39:51.934 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/126 2024-02-19T08:39:51.934 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/126 2024-02-19T08:39:51.934 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T08:39:51.942 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:39:51.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T08:39:51.970 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T08:39:51.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T08:39:51.970 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-02-19T08:39:52.703 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T08:39:52.714 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T08:39:52.714 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T08:40:11.837 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:40:11.846 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:40:42.042 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:40:42.053 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:41:12.171 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:41:12.182 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:41:42.402 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:41:42.412 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:42:12.607 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:42:12.617 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:42:42.837 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:42:42.848 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:43:12.974 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:43:12.984 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:43:43.137 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:43:43.146 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:44:13.277 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:44:13.286 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:44:43.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:44:43.437 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:45:13.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:45:13.572 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:45:43.802 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:45:43.812 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:46:13.946 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:46:13.954 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:46:44.109 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:46:44.118 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:47:14.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:47:14.256 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:47:44.387 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:47:44.396 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:48:14.590 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:48:14.599 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:48:44.729 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:48:44.739 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:49:14.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:49:14.876 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:49:45.031 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:49:45.042 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:50:15.181 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:50:15.191 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:50:45.322 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:50:45.334 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:51:15.490 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:51:15.502 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:51:45.633 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:51:45.643 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:52:15.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:52:15.785 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:52:46.012 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:52:46.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:53:16.224 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:53:16.234 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:53:46.390 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:53:46.400 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:54:16.526 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:54:16.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:54:46.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:54:46.715 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:55:16.871 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:55:16.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:55:47.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:55:47.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:56:17.222 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:56:17.232 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:56:17.347 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-02-19T08:56:17.345+0000 7f5e66400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 191948) UID: 0 2024-02-19T08:56:17.347 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T08:56:17.345+0000 7f8a09200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 191948) UID: 0 2024-02-19T08:56:17.348 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T08:56:17.345+0000 7fc963e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 191948) UID: 0 2024-02-19T08:56:17.348 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-02-19T08:56:17.345+0000 7f3514600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 191948) UID: 0 2024-02-19T08:59:07.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:59:07.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:59:38.440 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T08:59:38.449 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:00:08.586 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:00:08.597 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:00:38.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:00:38.734 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:01:08.867 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:01:08.876 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:01:39.015 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:01:39.025 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:02:09.153 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:02:09.164 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:02:39.295 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:02:39.303 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:03:09.436 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:03:09.445 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:03:39.600 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:03:39.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:04:09.738 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:04:09.748 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:04:09.863 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-02-19T09:04:09.862+0000 7fb706c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 192186) UID: 0 2024-02-19T09:04:09.863 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-02-19T09:04:09.862+0000 7f51d5600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 192186) UID: 0 2024-02-19T09:06:59.429 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:06:59.438 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:07:29.640 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:07:29.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:07:59.788 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:07:59.799 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:08:30.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:08:30.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:09:00.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:09:00.163 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:09:30.294 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:09:30.302 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:10:00.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:10:00.451 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:10:30.615 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:10:30.624 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:11:01.241 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:11:01.250 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:11:31.408 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:11:31.417 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:12:01.543 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:12:01.551 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:12:31.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:12:31.698 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:13:01.896 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:13:01.905 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:13:32.075 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:13:32.083 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:14:02.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:14:02.230 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:14:32.435 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:14:32.444 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:15:02.605 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:15:02.615 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:15:32.752 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:15:32.764 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:16:02.902 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:16:02.913 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:16:33.041 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:16:33.050 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:17:03.184 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:17:03.193 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:17:33.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:17:33.331 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:18:03.511 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:18:03.523 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:18:33.648 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:18:33.658 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:19:02.153 INFO:teuthology.orchestra.run.smithi046.stdout:generic/127 2350s 2024-02-19T09:19:02.172 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/127 2024-02-19T09:19:02.172 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:19:02.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:19:02.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:19:02.244 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-02-19T09:19:02.950 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:19:02.962 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:19:02.962 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:19:03.410 INFO:teuthology.orchestra.run.smithi046.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:19:03.422 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/128 2024-02-19T09:19:03.423 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/128 2024-02-19T09:19:03.423 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:19:03.432 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:19:03.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:19:03.464 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-02-19T09:19:03.795 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:19:03.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:19:04.047 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:19:04.061 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:19:04.061 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:19:04.484 INFO:teuthology.orchestra.run.smithi046.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:19:04.497 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/129 2024-02-19T09:19:04.497 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/129 2024-02-19T09:19:04.497 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:19:04.506 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:19:04.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:19:04.538 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-02-19T09:19:05.099 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:19:05.113 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:19:05.114 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:19:05.606 INFO:teuthology.orchestra.run.smithi046.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:19:05.622 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/130 2024-02-19T09:19:05.622 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/130 2024-02-19T09:19:05.622 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:19:05.634 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:19:05.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:19:05.669 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-02-19T09:19:06.247 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:19:06.261 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:19:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:19:08.311 INFO:teuthology.orchestra.run.smithi046.stdout:generic/131 2s 2024-02-19T09:19:08.329 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/131 2024-02-19T09:19:08.329 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:19:08.339 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:19:08.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:19:08.383 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-02-19T09:19:09.083 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:19:09.095 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:19:09.095 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:19:09.534 INFO:teuthology.orchestra.run.smithi046.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:19:09.545 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/132 2024-02-19T09:19:09.545 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/132 2024-02-19T09:19:09.545 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:19:09.555 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:19:09.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:19:09.585 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-02-19T09:19:10.169 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:19:10.181 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:19:10.181 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:19:33.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:19:33.951 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:20:04.083 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:20:04.092 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:20:34.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:20:34.289 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:21:04.467 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:21:04.476 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:21:34.681 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:21:34.691 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:22:04.843 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:22:04.854 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:22:34.998 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:22:35.009 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:23:05.137 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:23:05.147 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:23:35.568 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:23:35.578 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:24:05.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:24:05.712 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:24:35.846 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:24:35.855 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:25:06.012 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:25:06.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:25:36.210 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:25:36.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:26:06.342 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:26:06.352 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:26:36.478 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:26:36.487 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:27:06.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:27:06.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:27:36.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:27:36.884 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:28:07.009 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:28:07.020 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:28:37.162 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:28:37.171 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:29:07.353 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:29:07.365 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:29:28.385 INFO:teuthology.orchestra.run.smithi046.stdout:generic/133 618s 2024-02-19T09:29:28.410 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/133 2024-02-19T09:29:28.410 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:28.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:28.460 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-02-19T09:29:29.248 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:29.259 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:29.259 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:29.841 INFO:teuthology.orchestra.run.smithi046.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:29.855 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/134 2024-02-19T09:29:29.855 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/134 2024-02-19T09:29:29.855 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:29.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:29.910 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-02-19T09:29:30.600 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:30.612 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:31.160 INFO:teuthology.orchestra.run.smithi046.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:29:31.174 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/135 2024-02-19T09:29:31.174 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/135 2024-02-19T09:29:31.174 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:31.185 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:31.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:31.219 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-02-19T09:29:31.816 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:31.832 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:31.832 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:32.395 INFO:teuthology.orchestra.run.smithi046.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:32.407 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/136 2024-02-19T09:29:32.407 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/136 2024-02-19T09:29:32.407 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:32.417 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:32.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:32.473 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-02-19T09:29:33.150 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:33.163 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:33.163 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:33.761 INFO:teuthology.orchestra.run.smithi046.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:33.776 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/137 2024-02-19T09:29:33.776 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/137 2024-02-19T09:29:33.776 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:33.788 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:33.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:33.831 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-02-19T09:29:34.511 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:34.523 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:34.523 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:35.066 INFO:teuthology.orchestra.run.smithi046.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:35.081 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/138 2024-02-19T09:29:35.081 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/138 2024-02-19T09:29:35.081 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:35.093 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:35.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:35.132 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-02-19T09:29:35.856 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:35.869 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:35.869 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:36.428 INFO:teuthology.orchestra.run.smithi046.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:36.440 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/139 2024-02-19T09:29:36.440 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/139 2024-02-19T09:29:36.440 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:36.450 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:36.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:36.481 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-02-19T09:29:37.187 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:37.199 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:37.199 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:37.541 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:29:37.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:29:37.728 INFO:teuthology.orchestra.run.smithi046.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:37.739 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/140 2024-02-19T09:29:37.739 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/140 2024-02-19T09:29:37.739 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:37.748 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:37.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:37.792 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-02-19T09:29:38.509 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:38.521 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:38.521 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:38.878 INFO:teuthology.orchestra.run.smithi046.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:29:38.887 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/141 2024-02-19T09:29:38.887 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/141 2024-02-19T09:29:38.887 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:38.894 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:38.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:38.919 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-02-19T09:29:39.385 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:39.397 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:39.397 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:39.941 INFO:teuthology.orchestra.run.smithi046.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:39.957 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/142 2024-02-19T09:29:39.957 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/142 2024-02-19T09:29:39.957 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:39.969 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:40.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:40.017 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-02-19T09:29:40.685 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:40.700 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:40.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:41.227 INFO:teuthology.orchestra.run.smithi046.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:41.238 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/143 2024-02-19T09:29:41.238 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/143 2024-02-19T09:29:41.238 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:41.246 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:41.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:41.291 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-02-19T09:29:41.970 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:41.982 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:41.982 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:42.521 INFO:teuthology.orchestra.run.smithi046.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:42.535 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/144 2024-02-19T09:29:42.535 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/144 2024-02-19T09:29:42.536 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:42.550 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:42.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:42.600 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-02-19T09:29:43.282 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:43.295 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:43.295 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:43.879 INFO:teuthology.orchestra.run.smithi046.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:43.893 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/145 2024-02-19T09:29:43.893 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/145 2024-02-19T09:29:43.894 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:43.906 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:43.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:43.968 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-02-19T09:29:44.620 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:44.632 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:44.632 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:45.185 INFO:teuthology.orchestra.run.smithi046.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:45.195 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/146 2024-02-19T09:29:45.195 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/146 2024-02-19T09:29:45.195 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:45.205 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:45.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:45.240 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-02-19T09:29:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:45.930 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:45.930 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:46.489 INFO:teuthology.orchestra.run.smithi046.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:46.502 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/147 2024-02-19T09:29:46.502 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/147 2024-02-19T09:29:46.502 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:46.514 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:46.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:46.569 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-02-19T09:29:47.233 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:47.245 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:47.779 INFO:teuthology.orchestra.run.smithi046.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:47.794 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/148 2024-02-19T09:29:47.794 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/148 2024-02-19T09:29:47.794 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:47.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:47.847 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-02-19T09:29:48.521 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:48.532 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:48.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:49.024 INFO:teuthology.orchestra.run.smithi046.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:49.035 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/149 2024-02-19T09:29:49.035 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/149 2024-02-19T09:29:49.035 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:49.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:49.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:49.080 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-02-19T09:29:49.746 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:49.759 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:49.759 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:50.344 INFO:teuthology.orchestra.run.smithi046.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:50.358 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/150 2024-02-19T09:29:50.359 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/150 2024-02-19T09:29:50.359 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:50.370 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:50.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:50.424 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-02-19T09:29:51.098 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:51.112 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:51.112 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:51.697 INFO:teuthology.orchestra.run.smithi046.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:51.712 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/151 2024-02-19T09:29:51.712 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/151 2024-02-19T09:29:51.712 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:51.723 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:51.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:51.764 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-02-19T09:29:52.449 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:52.461 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:52.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:53.004 INFO:teuthology.orchestra.run.smithi046.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:53.019 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/152 2024-02-19T09:29:53.019 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/152 2024-02-19T09:29:53.019 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:53.029 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:53.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:53.061 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-02-19T09:29:53.752 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:53.764 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:53.764 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:54.340 INFO:teuthology.orchestra.run.smithi046.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:54.352 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/153 2024-02-19T09:29:54.352 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/153 2024-02-19T09:29:54.352 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:54.362 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:54.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:54.394 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-02-19T09:29:55.080 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:55.092 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:55.092 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:55.682 INFO:teuthology.orchestra.run.smithi046.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:55.696 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/154 2024-02-19T09:29:55.697 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/154 2024-02-19T09:29:55.697 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:55.710 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:55.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:55.753 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-02-19T09:29:56.435 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:56.446 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:56.446 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:57.020 INFO:teuthology.orchestra.run.smithi046.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:57.034 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/155 2024-02-19T09:29:57.034 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/155 2024-02-19T09:29:57.034 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:57.046 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:57.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:57.091 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-02-19T09:29:57.773 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:57.784 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:57.784 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:58.298 INFO:teuthology.orchestra.run.smithi046.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:58.311 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/156 2024-02-19T09:29:58.312 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/156 2024-02-19T09:29:58.312 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:58.323 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:58.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:58.379 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-02-19T09:29:59.062 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:29:59.073 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:29:59.074 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:59.616 INFO:teuthology.orchestra.run.smithi046.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:29:59.632 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/157 2024-02-19T09:29:59.632 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/157 2024-02-19T09:29:59.632 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:29:59.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:29:59.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:29:59.696 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-02-19T09:30:00.357 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:00.367 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:00.367 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:00.917 INFO:teuthology.orchestra.run.smithi046.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-02-19T09:30:00.929 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/158 2024-02-19T09:30:00.929 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/158 2024-02-19T09:30:00.929 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:00.939 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:00.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:00.986 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-02-19T09:30:01.645 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:01.656 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:01.656 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:02.194 INFO:teuthology.orchestra.run.smithi046.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-02-19T09:30:02.206 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/159 2024-02-19T09:30:02.206 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/159 2024-02-19T09:30:02.206 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:02.216 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:02.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:02.256 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-02-19T09:30:02.805 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:02.818 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:02.819 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:03.348 INFO:teuthology.orchestra.run.smithi046.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-02-19T09:30:03.362 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/160 2024-02-19T09:30:03.362 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/160 2024-02-19T09:30:03.363 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:03.374 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:03.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:03.414 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-02-19T09:30:03.997 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:04.014 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:04.014 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:04.454 INFO:teuthology.orchestra.run.smithi046.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:04.467 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/161 2024-02-19T09:30:04.468 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/161 2024-02-19T09:30:04.468 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:04.477 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:04.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:04.508 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-02-19T09:30:05.089 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:05.103 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:05.103 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:05.567 INFO:teuthology.orchestra.run.smithi046.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:05.580 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/162 2024-02-19T09:30:05.580 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/162 2024-02-19T09:30:05.580 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:05.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:05.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:05.619 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-02-19T09:30:06.164 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:06.177 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:06.177 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:06.610 INFO:teuthology.orchestra.run.smithi046.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:06.623 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/163 2024-02-19T09:30:06.623 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/163 2024-02-19T09:30:06.623 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:06.633 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:06.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:06.665 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-02-19T09:30:07.238 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:07.254 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:07.254 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:07.704 INFO:teuthology.orchestra.run.smithi046.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:07.715 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/164 2024-02-19T09:30:07.715 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/164 2024-02-19T09:30:07.715 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:07.724 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:07.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:30:07.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:30:07.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:07.754 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-02-19T09:30:08.350 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:08.363 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:08.363 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:08.883 INFO:teuthology.orchestra.run.smithi046.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:08.896 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/165 2024-02-19T09:30:08.896 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/165 2024-02-19T09:30:08.896 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:08.906 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:08.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:08.940 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-02-19T09:30:09.533 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:09.549 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:09.549 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:09.984 INFO:teuthology.orchestra.run.smithi046.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:09.997 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/166 2024-02-19T09:30:09.997 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/166 2024-02-19T09:30:09.997 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:10.007 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:10.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:10.036 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-02-19T09:30:10.595 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:10.607 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:10.607 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:11.037 INFO:teuthology.orchestra.run.smithi046.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:11.052 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/167 2024-02-19T09:30:11.052 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/167 2024-02-19T09:30:11.052 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:11.065 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:11.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:11.097 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-02-19T09:30:11.688 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:11.703 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:11.703 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:12.150 INFO:teuthology.orchestra.run.smithi046.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:12.163 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/168 2024-02-19T09:30:12.163 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/168 2024-02-19T09:30:12.163 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:12.171 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:12.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:12.201 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-02-19T09:30:12.784 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:12.797 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:12.797 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:13.211 INFO:teuthology.orchestra.run.smithi046.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:13.226 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/169 2024-02-19T09:30:13.226 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/169 2024-02-19T09:30:13.227 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:13.239 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:13.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:13.269 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-02-19T09:30:13.844 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:13.858 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:13.858 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:14.319 INFO:teuthology.orchestra.run.smithi046.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:14.331 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/170 2024-02-19T09:30:14.331 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/170 2024-02-19T09:30:14.331 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:14.339 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:14.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:14.373 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-02-19T09:30:14.938 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:14.950 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:14.950 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:15.397 INFO:teuthology.orchestra.run.smithi046.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:15.409 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/171 2024-02-19T09:30:15.410 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/171 2024-02-19T09:30:15.410 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:15.422 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:15.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:15.453 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-02-19T09:30:16.017 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:16.032 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:16.032 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:16.518 INFO:teuthology.orchestra.run.smithi046.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:16.532 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/172 2024-02-19T09:30:16.532 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/172 2024-02-19T09:30:16.532 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:16.543 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:16.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:16.576 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-02-19T09:30:17.152 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:17.167 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:17.167 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:17.650 INFO:teuthology.orchestra.run.smithi046.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:17.662 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/173 2024-02-19T09:30:17.663 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/173 2024-02-19T09:30:17.663 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:17.673 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:17.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:17.709 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-02-19T09:30:18.269 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:18.283 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:18.283 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:18.729 INFO:teuthology.orchestra.run.smithi046.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:18.745 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/174 2024-02-19T09:30:18.745 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/174 2024-02-19T09:30:18.745 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:18.756 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:18.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:18.792 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-02-19T09:30:19.359 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:19.371 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:19.371 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:19.753 INFO:teuthology.orchestra.run.smithi046.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:19.766 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/175 2024-02-19T09:30:19.766 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/175 2024-02-19T09:30:19.766 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:19.776 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:19.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:19.808 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-02-19T09:30:20.372 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:20.388 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:20.388 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:20.854 INFO:teuthology.orchestra.run.smithi046.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:20.870 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/176 2024-02-19T09:30:20.870 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/176 2024-02-19T09:30:20.870 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:20.883 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:20.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:20.915 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-02-19T09:30:21.486 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:21.501 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:21.502 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:22.009 INFO:teuthology.orchestra.run.smithi046.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:22.024 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/177 2024-02-19T09:30:22.025 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/177 2024-02-19T09:30:22.025 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:22.038 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:22.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:22.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-02-19T09:30:22.654 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:22.669 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:22.670 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:23.244 INFO:teuthology.orchestra.run.smithi046.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:30:23.257 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/178 2024-02-19T09:30:23.257 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/178 2024-02-19T09:30:23.258 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:23.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:23.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:23.309 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-02-19T09:30:24.014 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:24.027 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:24.598 INFO:teuthology.orchestra.run.smithi046.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:30:24.610 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/179 2024-02-19T09:30:24.610 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/179 2024-02-19T09:30:24.610 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:24.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:24.659 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-02-19T09:30:25.341 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:25.354 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:25.354 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:25.916 INFO:teuthology.orchestra.run.smithi046.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:30:25.928 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/180 2024-02-19T09:30:25.928 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/180 2024-02-19T09:30:25.928 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:25.938 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:25.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:25.970 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-02-19T09:30:26.672 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:26.682 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:26.682 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:27.247 INFO:teuthology.orchestra.run.smithi046.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:30:27.264 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/181 2024-02-19T09:30:27.264 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/181 2024-02-19T09:30:27.264 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:27.279 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:27.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:27.325 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-02-19T09:30:27.999 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:28.011 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:28.011 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:28.580 INFO:teuthology.orchestra.run.smithi046.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-02-19T09:30:28.592 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/182 2024-02-19T09:30:28.592 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/182 2024-02-19T09:30:28.593 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:28.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:28.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:28.639 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-02-19T09:30:29.323 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:29.336 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:29.336 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:29.807 INFO:teuthology.orchestra.run.smithi046.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:29.820 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/183 2024-02-19T09:30:29.820 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/183 2024-02-19T09:30:29.820 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:29.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:29.867 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-02-19T09:30:30.423 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:30.437 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:30.962 INFO:teuthology.orchestra.run.smithi046.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/184.out.bad) 2024-02-19T09:30:30.971 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/184.out 2024-02-19 06:59:27.981910728 +0000 2024-02-19T09:30:30.971 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/184.out.bad 2024-02-19 09:30:30.957195270 +0000 2024-02-19T09:30:30.971 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1 +1,2 @@ 2024-02-19T09:30:30.971 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 184 2024-02-19T09:30:30.971 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.ca873QOZoIxfstests-dev/tests/generic/184: line 23: /tmp/tmp.03skzeLSgitest/null: Permission denied 2024-02-19T09:30:30.979 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/184 2024-02-19T09:30:30.979 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/184 2024-02-19T09:30:30.979 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T09:30:30.989 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:31.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T09:30:31.019 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T09:30:31.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T09:30:31.020 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-02-19T09:30:31.591 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:31.605 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:31.605 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:32.034 INFO:teuthology.orchestra.run.smithi046.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:32.045 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/185 2024-02-19T09:30:32.046 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/185 2024-02-19T09:30:32.046 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:32.054 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:32.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:32.084 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-02-19T09:30:32.635 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:33.061 INFO:teuthology.orchestra.run.smithi046.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:33.076 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/186 2024-02-19T09:30:33.076 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/186 2024-02-19T09:30:33.076 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:33.088 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:33.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:33.125 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-02-19T09:30:33.685 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:33.699 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:33.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:34.127 INFO:teuthology.orchestra.run.smithi046.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:34.141 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/187 2024-02-19T09:30:34.142 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/187 2024-02-19T09:30:34.142 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:34.154 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:34.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:34.186 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-02-19T09:30:34.755 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:34.767 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:34.768 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:35.202 INFO:teuthology.orchestra.run.smithi046.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:35.214 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/188 2024-02-19T09:30:35.214 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/188 2024-02-19T09:30:35.214 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:35.223 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:35.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:35.254 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-02-19T09:30:35.828 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:35.843 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:36.305 INFO:teuthology.orchestra.run.smithi046.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:36.317 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/189 2024-02-19T09:30:36.317 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/189 2024-02-19T09:30:36.317 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:36.326 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:36.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:36.361 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-02-19T09:30:36.937 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:36.950 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:36.950 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:37.401 INFO:teuthology.orchestra.run.smithi046.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:37.414 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/190 2024-02-19T09:30:37.414 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/190 2024-02-19T09:30:37.414 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:37.425 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:37.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:37.456 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-02-19T09:30:37.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:30:37.898 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:30:38.009 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:38.021 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:38.021 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:38.448 INFO:teuthology.orchestra.run.smithi046.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:38.460 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/191 2024-02-19T09:30:38.460 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/191 2024-02-19T09:30:38.460 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:38.469 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:38.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:38.503 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-02-19T09:30:39.131 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:39.144 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:39.144 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:39.575 INFO:teuthology.orchestra.run.smithi046.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2024-02-19T09:30:39.585 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/192 2024-02-19T09:30:39.586 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/192 2024-02-19T09:30:39.586 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:39.595 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:39.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:39.631 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-02-19T09:30:40.238 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:40.253 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:40.253 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:43.043 INFO:teuthology.orchestra.run.smithi046.stdout:generic/193 - output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/193.out.bad) 2024-02-19T09:30:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/193.out 2024-02-19 06:59:27.983910705 +0000 2024-02-19T09:30:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/193.out.bad 2024-02-19 09:30:43.037055516 +0000 2024-02-19T09:30:43.050 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -24,7 +24,6 @@ 2024-02-19T09:30:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: user: chmod a+r on qa_user owned file (should succeed) 2024-02-19T09:30:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: user: chmod a+r on root owned file (should fail) 2024-02-19T09:30:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2024-02-19T09:30:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: check that the sgid bit is cleared 2024-02-19T09:30:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: -rw-rw-rw- 2024-02-19T09:30:43.051 INFO:teuthology.orchestra.run.smithi046.stdout: check that suid bit is not cleared 2024-02-19T09:30:43.058 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/193 2024-02-19T09:30:43.059 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/193 2024-02-19T09:30:43.059 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T09:30:43.068 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:43.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T09:30:43.112 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T09:30:43.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T09:30:43.112 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-02-19T09:30:43.811 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:43.822 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:43.823 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:44.296 INFO:teuthology.orchestra.run.smithi046.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:44.308 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/194 2024-02-19T09:30:44.308 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/194 2024-02-19T09:30:44.308 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:44.318 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:44.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:44.350 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-02-19T09:30:44.920 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:44.933 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:44.933 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:45.375 INFO:teuthology.orchestra.run.smithi046.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:45.386 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/195 2024-02-19T09:30:45.386 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/195 2024-02-19T09:30:45.386 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:45.397 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:45.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:45.431 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-02-19T09:30:46.007 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:46.020 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:46.020 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:46.467 INFO:teuthology.orchestra.run.smithi046.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:46.482 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/196 2024-02-19T09:30:46.482 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/196 2024-02-19T09:30:46.482 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:46.494 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:46.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:46.536 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-02-19T09:30:47.129 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:47.144 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:47.144 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:47.596 INFO:teuthology.orchestra.run.smithi046.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:47.607 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/197 2024-02-19T09:30:47.607 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/197 2024-02-19T09:30:47.608 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:47.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:47.647 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-02-19T09:30:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:48.256 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:48.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:50.442 INFO:teuthology.orchestra.run.smithi046.stdout:generic/198 2s 2024-02-19T09:30:50.460 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/198 2024-02-19T09:30:50.461 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:50.469 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:50.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:50.499 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-02-19T09:30:51.241 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:51.252 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:51.252 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:51.663 INFO:teuthology.orchestra.run.smithi046.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:51.678 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/199 2024-02-19T09:30:51.678 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/199 2024-02-19T09:30:51.679 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:51.691 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:51.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:51.724 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-02-19T09:30:52.307 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:52.322 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:52.322 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:52.784 INFO:teuthology.orchestra.run.smithi046.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:52.798 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/200 2024-02-19T09:30:52.799 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/200 2024-02-19T09:30:52.799 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:52.812 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:52.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:52.848 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-02-19T09:30:53.428 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:53.442 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:53.880 INFO:teuthology.orchestra.run.smithi046.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:53.892 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/201 2024-02-19T09:30:53.892 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/201 2024-02-19T09:30:53.892 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:53.900 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:53.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:53.927 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-02-19T09:30:54.538 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:54.552 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:54.552 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:54.991 INFO:teuthology.orchestra.run.smithi046.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:55.003 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/202 2024-02-19T09:30:55.004 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/202 2024-02-19T09:30:55.004 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:55.014 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:55.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:55.046 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-02-19T09:30:55.622 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:55.636 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:55.636 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:56.070 INFO:teuthology.orchestra.run.smithi046.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:56.082 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/203 2024-02-19T09:30:56.082 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/203 2024-02-19T09:30:56.082 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:56.091 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:56.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:56.121 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-02-19T09:30:56.693 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:56.706 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:56.707 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:57.604 INFO:teuthology.orchestra.run.smithi046.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:57.619 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/204 2024-02-19T09:30:57.619 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/204 2024-02-19T09:30:57.619 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:57.631 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:57.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:57.671 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-02-19T09:30:58.267 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:58.281 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:58.281 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:58.716 INFO:teuthology.orchestra.run.smithi046.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:58.731 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/205 2024-02-19T09:30:58.731 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/205 2024-02-19T09:30:58.731 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:58.743 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:58.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:58.780 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-02-19T09:30:59.369 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:30:59.384 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:30:59.384 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:59.826 INFO:teuthology.orchestra.run.smithi046.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:30:59.840 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/206 2024-02-19T09:30:59.840 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/206 2024-02-19T09:30:59.840 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:30:59.847 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:30:59.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:30:59.879 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-02-19T09:31:00.438 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:31:00.453 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:31:00.454 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:31:08.048 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:31:08.060 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:31:38.286 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:31:38.295 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:31:44.028 INFO:teuthology.orchestra.run.smithi046.stdout:generic/207 43s 2024-02-19T09:31:44.048 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/207 2024-02-19T09:31:44.048 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:31:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:31:44.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:31:44.121 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-02-19T09:31:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:31:44.810 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:31:44.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:32:08.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:32:08.437 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:32:38.578 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:32:38.588 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:33:08.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:33:08.792 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:33:38.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:33:38.941 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:34:09.092 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:34:09.102 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:34:39.306 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:34:39.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:35:05.571 INFO:teuthology.orchestra.run.smithi046.stdout:generic/208 201s 2024-02-19T09:35:05.593 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/208 2024-02-19T09:35:05.593 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:05.604 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:05.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:05.647 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-02-19T09:35:06.338 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:06.348 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:06.349 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:09.446 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:35:09.457 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:35:29.428 INFO:teuthology.orchestra.run.smithi046.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/209.out.bad) 2024-02-19T09:35:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/209.out 2024-02-19 06:59:27.986910671 +0000 2024-02-19T09:35:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/209.out.bad 2024-02-19 09:35:29.418725500 +0000 2024-02-19T09:35:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,2 +1,2 @@ 2024-02-19T09:35:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 209 2024-02-19T09:35:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: -test ran for 30 seconds without error 2024-02-19T09:35:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: +reader found old byte at pos 4096 2024-02-19T09:35:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: \ No newline at end of file 2024-02-19T09:35:29.457 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/209 2024-02-19T09:35:29.457 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/209 2024-02-19T09:35:29.457 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T09:35:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:29.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T09:35:29.525 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T09:35:29.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T09:35:29.525 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-02-19T09:35:30.125 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:30.137 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:30.774 INFO:teuthology.orchestra.run.smithi046.stdout:generic/210 0s 2024-02-19T09:35:30.792 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/210 2024-02-19T09:35:30.792 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:30.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:30.863 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-02-19T09:35:31.530 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:31.543 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:31.543 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:32.579 INFO:teuthology.orchestra.run.smithi046.stdout:generic/211 1s 2024-02-19T09:35:32.596 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/211 2024-02-19T09:35:32.596 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:32.606 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:32.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:32.639 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-02-19T09:35:33.234 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:33.250 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:33.250 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:33.931 INFO:teuthology.orchestra.run.smithi046.stdout:generic/212 0s 2024-02-19T09:35:33.949 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/212 2024-02-19T09:35:33.949 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:33.956 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:33.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:33.986 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-02-19T09:35:34.567 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:34.583 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:34.584 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:35.433 INFO:teuthology.orchestra.run.smithi046.stdout:generic/213 - output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/213.out.bad) 2024-02-19T09:35:35.439 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/213.out 2024-02-19 06:59:27.986910671 +0000 2024-02-19T09:35:35.439 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/213.out.bad 2024-02-19 09:35:35.429655580 +0000 2024-02-19T09:35:35.439 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,4 +1,3 @@ 2024-02-19T09:35:35.439 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 213 2024-02-19T09:35:35.439 INFO:teuthology.orchestra.run.smithi046.stdout: We should get: fallocate: No space left on device 2024-02-19T09:35:35.439 INFO:teuthology.orchestra.run.smithi046.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2024-02-19T09:35:35.440 INFO:teuthology.orchestra.run.smithi046.stdout: -fallocate: No space left on device 2024-02-19T09:35:35.445 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/213 2024-02-19T09:35:35.445 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/213 2024-02-19T09:35:35.445 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T09:35:35.452 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:35.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T09:35:35.502 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T09:35:35.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T09:35:35.502 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-02-19T09:35:36.139 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:36.151 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:36.151 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:37.104 INFO:teuthology.orchestra.run.smithi046.stdout:generic/214 1s 2024-02-19T09:35:37.123 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/214 2024-02-19T09:35:37.123 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:37.134 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:37.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:37.162 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-02-19T09:35:37.950 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:37.967 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:37.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:39.604 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:35:39.610 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:35:42.026 INFO:teuthology.orchestra.run.smithi046.stdout:generic/215 5s 2024-02-19T09:35:42.046 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/215 2024-02-19T09:35:42.046 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:42.056 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:42.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:42.091 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-02-19T09:35:42.666 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:42.682 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:42.682 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:43.066 INFO:teuthology.orchestra.run.smithi046.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:35:43.077 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/216 2024-02-19T09:35:43.078 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/216 2024-02-19T09:35:43.078 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:43.085 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:43.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:43.117 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-02-19T09:35:43.699 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:43.715 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:43.715 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:44.111 INFO:teuthology.orchestra.run.smithi046.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:35:44.121 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/217 2024-02-19T09:35:44.121 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/217 2024-02-19T09:35:44.121 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:44.132 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:44.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:44.162 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-02-19T09:35:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:44.749 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:44.749 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:45.151 INFO:teuthology.orchestra.run.smithi046.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:35:45.161 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/218 2024-02-19T09:35:45.162 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/218 2024-02-19T09:35:45.162 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:45.169 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:45.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:45.202 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-02-19T09:35:45.798 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:45.810 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:46.203 INFO:teuthology.orchestra.run.smithi046.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:35:46.215 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/219 2024-02-19T09:35:46.215 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/219 2024-02-19T09:35:46.215 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:46.227 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:46.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:46.256 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-02-19T09:35:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:46.855 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:47.255 INFO:teuthology.orchestra.run.smithi046.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:35:47.266 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/220 2024-02-19T09:35:47.266 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/220 2024-02-19T09:35:47.266 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:47.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:47.304 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-02-19T09:35:47.899 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:47.912 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:49.403 INFO:teuthology.orchestra.run.smithi046.stdout:generic/221 2s 2024-02-19T09:35:49.422 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/221 2024-02-19T09:35:49.422 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:49.432 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:49.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:49.466 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-02-19T09:35:50.074 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:50.090 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:50.090 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:50.471 INFO:teuthology.orchestra.run.smithi046.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:35:50.484 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/222 2024-02-19T09:35:50.484 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/222 2024-02-19T09:35:50.484 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:50.495 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:50.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:50.532 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-02-19T09:35:51.110 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:51.124 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:51.124 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:51.496 INFO:teuthology.orchestra.run.smithi046.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:35:51.508 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/223 2024-02-19T09:35:51.508 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/223 2024-02-19T09:35:51.508 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:51.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:51.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:51.546 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-02-19T09:35:52.116 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:52.132 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:52.132 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:52.551 INFO:teuthology.orchestra.run.smithi046.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:35:52.562 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/224 2024-02-19T09:35:52.563 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/224 2024-02-19T09:35:52.563 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:52.572 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:52.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:52.602 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-02-19T09:35:53.187 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:53.201 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:53.201 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:53.592 INFO:teuthology.orchestra.run.smithi046.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:35:53.606 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/225 2024-02-19T09:35:53.606 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/225 2024-02-19T09:35:53.607 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:53.615 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:53.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:53.643 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-02-19T09:35:54.217 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:54.234 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:54.234 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:54.608 INFO:teuthology.orchestra.run.smithi046.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:35:54.621 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/226 2024-02-19T09:35:54.621 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/226 2024-02-19T09:35:54.621 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:54.630 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:54.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:54.659 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-02-19T09:35:55.249 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:55.266 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:55.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:55.661 INFO:teuthology.orchestra.run.smithi046.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:35:55.673 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/227 2024-02-19T09:35:55.673 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/227 2024-02-19T09:35:55.673 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:55.683 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:55.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:55.721 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-02-19T09:35:56.289 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:56.306 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:56.306 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:56.939 INFO:teuthology.orchestra.run.smithi046.stdout:generic/228 0s 2024-02-19T09:35:56.955 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/228 2024-02-19T09:35:56.956 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:56.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:57.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:57.009 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-02-19T09:35:57.789 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:57.804 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:58.205 INFO:teuthology.orchestra.run.smithi046.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:35:58.220 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/229 2024-02-19T09:35:58.220 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/229 2024-02-19T09:35:58.220 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:58.229 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:58.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:58.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-02-19T09:35:58.847 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:58.862 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:58.862 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:59.236 INFO:teuthology.orchestra.run.smithi046.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:35:59.246 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/230 2024-02-19T09:35:59.246 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/230 2024-02-19T09:35:59.246 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:35:59.254 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:35:59.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:35:59.291 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-02-19T09:35:59.875 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:35:59.893 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:35:59.893 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:00.271 INFO:teuthology.orchestra.run.smithi046.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:36:00.281 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/231 2024-02-19T09:36:00.281 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/231 2024-02-19T09:36:00.281 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:36:00.291 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:00.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:36:00.325 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-02-19T09:36:00.979 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:36:00.993 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:36:00.993 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:01.492 INFO:teuthology.orchestra.run.smithi046.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:36:01.504 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/232 2024-02-19T09:36:01.504 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/232 2024-02-19T09:36:01.504 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:36:01.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:01.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:36:01.541 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-02-19T09:36:02.124 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:36:02.143 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:36:02.143 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:02.614 INFO:teuthology.orchestra.run.smithi046.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:36:02.626 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/233 2024-02-19T09:36:02.626 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/233 2024-02-19T09:36:02.627 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:36:02.636 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:02.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:36:02.667 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-02-19T09:36:03.235 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:36:03.249 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:36:03.249 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:03.645 INFO:teuthology.orchestra.run.smithi046.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:36:03.656 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/234 2024-02-19T09:36:03.656 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/234 2024-02-19T09:36:03.656 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:36:03.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:03.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:36:03.694 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-02-19T09:36:04.273 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:36:04.288 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:36:04.288 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:04.694 INFO:teuthology.orchestra.run.smithi046.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:36:04.705 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/235 2024-02-19T09:36:04.706 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/235 2024-02-19T09:36:04.706 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:36:04.715 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:04.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:36:04.750 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-02-19T09:36:05.339 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:36:05.356 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:36:05.356 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:generic/236 1s 2024-02-19T09:36:06.943 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/236 2024-02-19T09:36:06.943 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:36:06.952 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:06.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:36:06.990 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-02-19T09:36:07.776 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:36:07.791 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:36:07.791 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:08.301 INFO:teuthology.orchestra.run.smithi046.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-02-19T09:36:08.315 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/237 2024-02-19T09:36:08.315 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/237 2024-02-19T09:36:08.315 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:36:08.324 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:08.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:36:08.355 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-02-19T09:36:08.939 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:36:08.953 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:36:08.954 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:09.340 INFO:teuthology.orchestra.run.smithi046.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:36:09.351 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/238 2024-02-19T09:36:09.351 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/238 2024-02-19T09:36:09.351 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:36:09.361 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:09.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:36:09.392 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-02-19T09:36:09.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:36:09.895 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:36:09.972 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:36:09.989 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:36:09.989 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:10.440 INFO:teuthology.orchestra.run.smithi046.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-02-19T09:36:10.451 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/239 2024-02-19T09:36:10.451 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/239 2024-02-19T09:36:10.452 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:36:10.462 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:10.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:36:10.490 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-02-19T09:36:11.072 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:36:11.086 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:36:11.086 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:11.533 INFO:teuthology.orchestra.run.smithi046.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-02-19T09:36:11.544 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/240 2024-02-19T09:36:11.544 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/240 2024-02-19T09:36:11.544 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:36:11.551 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:11.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:36:11.586 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-02-19T09:36:12.202 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:36:12.221 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:36:12.221 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:36:40.024 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:36:40.031 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:37:11.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:37:11.131 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:37:26.236 INFO:teuthology.orchestra.run.smithi046.stdout:generic/241 74s 2024-02-19T09:37:26.253 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/241 2024-02-19T09:37:26.253 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:37:26.262 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:37:26.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:37:26.304 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-02-19T09:37:27.091 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:37:27.105 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:37:27.105 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:37:27.492 INFO:teuthology.orchestra.run.smithi046.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:37:27.505 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/242 2024-02-19T09:37:27.505 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/242 2024-02-19T09:37:27.505 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:37:27.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:37:27.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:37:27.548 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-02-19T09:37:28.150 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:37:28.165 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:37:28.165 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:37:28.770 INFO:teuthology.orchestra.run.smithi046.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:37:28.780 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/243 2024-02-19T09:37:28.780 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/243 2024-02-19T09:37:28.780 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:37:28.788 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:37:28.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:37:28.822 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-02-19T09:37:29.402 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:37:29.417 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:37:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:37:29.790 INFO:teuthology.orchestra.run.smithi046.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-02-19T09:37:29.802 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/244 2024-02-19T09:37:29.803 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/244 2024-02-19T09:37:29.803 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:37:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:37:29.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:37:29.852 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-02-19T09:37:30.439 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:37:30.455 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:37:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:37:31.033 INFO:teuthology.orchestra.run.smithi046.stdout:generic/245 1s 2024-02-19T09:37:31.050 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/245 2024-02-19T09:37:31.051 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:37:31.060 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:37:31.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:37:31.089 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-02-19T09:37:32.029 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:37:32.047 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:37:32.047 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:37:32.590 INFO:teuthology.orchestra.run.smithi046.stdout:generic/246 0s 2024-02-19T09:37:32.608 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/246 2024-02-19T09:37:32.609 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:37:32.619 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:37:32.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:37:32.653 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-02-19T09:37:33.448 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:37:33.463 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:37:33.463 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:37:41.286 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:37:41.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:38:11.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:38:11.434 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:38:20.255 INFO:teuthology.orchestra.run.smithi046.stdout:generic/247 47s 2024-02-19T09:38:20.275 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/247 2024-02-19T09:38:20.275 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:20.284 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:20.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:20.310 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-02-19T09:38:20.880 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:20.896 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:20.896 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:21.385 INFO:teuthology.orchestra.run.smithi046.stdout:generic/248 1s 2024-02-19T09:38:21.406 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/248 2024-02-19T09:38:21.407 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:21.416 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:21.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:21.443 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-02-19T09:38:22.037 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:22.048 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:26.309 INFO:teuthology.orchestra.run.smithi046.stdout:generic/249 4s 2024-02-19T09:38:26.329 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/249 2024-02-19T09:38:26.329 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:26.340 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:26.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:26.369 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-02-19T09:38:27.150 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:27.166 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:27.166 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:27.592 INFO:teuthology.orchestra.run.smithi046.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:38:27.602 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/250 2024-02-19T09:38:27.602 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/250 2024-02-19T09:38:27.602 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:27.613 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:27.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:27.651 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-02-19T09:38:28.248 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:28.263 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:28.263 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:28.672 INFO:teuthology.orchestra.run.smithi046.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:38:28.683 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/251 2024-02-19T09:38:28.683 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/251 2024-02-19T09:38:28.683 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:28.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:28.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:28.725 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-02-19T09:38:29.309 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:29.325 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:29.325 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:29.770 INFO:teuthology.orchestra.run.smithi046.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:38:29.780 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/252 2024-02-19T09:38:29.780 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/252 2024-02-19T09:38:29.780 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:29.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:29.828 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-02-19T09:38:30.387 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:30.402 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:30.779 INFO:teuthology.orchestra.run.smithi046.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:38:30.790 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/253 2024-02-19T09:38:30.790 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/253 2024-02-19T09:38:30.790 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:30.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:30.826 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-02-19T09:38:31.405 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:31.418 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:31.418 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:31.778 INFO:teuthology.orchestra.run.smithi046.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:38:31.789 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/254 2024-02-19T09:38:31.789 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/254 2024-02-19T09:38:31.789 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:31.796 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:31.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:31.827 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-02-19T09:38:32.437 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:32.454 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:32.454 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:35.101 INFO:teuthology.orchestra.run.smithi046.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-19T09:38:35.115 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/255 2024-02-19T09:38:35.115 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/255 2024-02-19T09:38:35.115 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:35.124 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:35.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:35.168 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-02-19T09:38:35.963 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:35.977 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:35.977 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:38.613 INFO:teuthology.orchestra.run.smithi046.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:38:38.627 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/256 2024-02-19T09:38:38.627 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/256 2024-02-19T09:38:38.627 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:38.639 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:38.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:38.672 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-02-19T09:38:39.250 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:39.265 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:39.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:41.563 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:38:41.579 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:38:42.464 INFO:teuthology.orchestra.run.smithi046.stdout:generic/257 3s 2024-02-19T09:38:42.690 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/257 2024-02-19T09:38:42.690 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:42.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:42.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:42.740 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-02-19T09:38:43.540 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:43.557 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:43.557 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:44.605 INFO:teuthology.orchestra.run.smithi046.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/258.out.bad) 2024-02-19T09:38:44.616 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/258.out 2024-02-19 06:59:27.994910581 +0000 2024-02-19T09:38:44.616 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/258.out.bad 2024-02-19 09:38:44.517460469 +0000 2024-02-19T09:38:44.616 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,5 +1,6 @@ 2024-02-19T09:38:44.616 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 258 2024-02-19T09:38:44.616 INFO:teuthology.orchestra.run.smithi046.stdout: Creating file with timestamp of Jan 1, 1960 2024-02-19T09:38:44.616 INFO:teuthology.orchestra.run.smithi046.stdout: Testing for negative seconds since epoch 2024-02-19T09:38:44.616 INFO:teuthology.orchestra.run.smithi046.stdout: -Remounting to flush cache 2024-02-19T09:38:44.616 INFO:teuthology.orchestra.run.smithi046.stdout: -Testing for negative seconds since epoch 2024-02-19T09:38:44.616 INFO:teuthology.orchestra.run.smithi046.stdout: +Timestamp wrapped: 3979351756 2024-02-19T09:38:44.616 INFO:teuthology.orchestra.run.smithi046.stdout: +Timestamp wrapped 2024-02-19T09:38:44.616 INFO:teuthology.orchestra.run.smithi046.stdout: +(see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/258.full for details) 2024-02-19T09:38:44.624 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/258 2024-02-19T09:38:44.624 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/258 2024-02-19T09:38:44.624 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T09:38:44.632 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:44.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T09:38:44.657 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T09:38:44.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T09:38:44.657 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-02-19T09:38:45.266 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:45.280 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:45.280 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:45.693 INFO:teuthology.orchestra.run.smithi046.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:38:45.705 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/259 2024-02-19T09:38:45.706 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/259 2024-02-19T09:38:45.706 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:45.716 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:45.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:45.746 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-02-19T09:38:46.331 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:46.347 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:46.347 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:46.723 INFO:teuthology.orchestra.run.smithi046.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:38:46.734 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/260 2024-02-19T09:38:46.734 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/260 2024-02-19T09:38:46.734 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:46.746 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:46.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:46.779 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-02-19T09:38:47.358 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:47.374 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:47.775 INFO:teuthology.orchestra.run.smithi046.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:38:47.787 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/261 2024-02-19T09:38:47.787 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/261 2024-02-19T09:38:47.787 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:47.796 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:47.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:47.824 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-02-19T09:38:48.390 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:48.409 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:48.409 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:48.809 INFO:teuthology.orchestra.run.smithi046.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:38:48.821 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/262 2024-02-19T09:38:48.821 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/262 2024-02-19T09:38:48.821 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:38:48.828 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:38:48.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:38:48.861 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-02-19T09:38:49.448 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:38:49.464 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:38:49.464 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:39:13.146 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:39:13.151 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:39:43.366 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:39:43.371 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:40:13.496 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:40:13.504 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:40:42.764 INFO:teuthology.orchestra.run.smithi046.stdout:generic/263 113s 2024-02-19T09:40:42.788 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/263 2024-02-19T09:40:42.788 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:42.800 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:42.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:42.855 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-02-19T09:40:43.569 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:43.582 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:43.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:43.629 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:40:43.634 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:40:43.917 INFO:teuthology.orchestra.run.smithi046.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:43.932 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/264 2024-02-19T09:40:43.932 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/264 2024-02-19T09:40:43.932 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:43.944 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:43.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:43.978 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-02-19T09:40:44.537 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:44.550 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:44.551 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:45.026 INFO:teuthology.orchestra.run.smithi046.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:45.040 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/265 2024-02-19T09:40:45.040 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/265 2024-02-19T09:40:45.040 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:45.052 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:45.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:45.092 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-02-19T09:40:45.677 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:45.691 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:45.691 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:46.203 INFO:teuthology.orchestra.run.smithi046.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:46.218 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/266 2024-02-19T09:40:46.219 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/266 2024-02-19T09:40:46.219 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:46.232 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:46.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:46.266 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-02-19T09:40:46.838 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:46.854 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:46.854 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:47.283 INFO:teuthology.orchestra.run.smithi046.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:47.295 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/267 2024-02-19T09:40:47.295 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/267 2024-02-19T09:40:47.295 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:47.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:47.338 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-02-19T09:40:47.893 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:47.904 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:48.406 INFO:teuthology.orchestra.run.smithi046.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:48.418 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/268 2024-02-19T09:40:48.418 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/268 2024-02-19T09:40:48.418 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:48.428 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:48.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:48.456 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-02-19T09:40:49.025 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:49.039 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:49.039 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:49.486 INFO:teuthology.orchestra.run.smithi046.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:49.501 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/269 2024-02-19T09:40:49.501 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/269 2024-02-19T09:40:49.502 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:49.514 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:49.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:49.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-02-19T09:40:50.146 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:50.162 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:50.163 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:50.626 INFO:teuthology.orchestra.run.smithi046.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-02-19T09:40:50.639 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/270 2024-02-19T09:40:50.640 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/270 2024-02-19T09:40:50.640 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:50.652 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:50.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:50.686 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-02-19T09:40:51.296 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:51.310 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:51.310 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:51.752 INFO:teuthology.orchestra.run.smithi046.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:51.767 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/271 2024-02-19T09:40:51.767 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/271 2024-02-19T09:40:51.767 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:51.779 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:51.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:51.812 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-02-19T09:40:52.366 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:52.379 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:52.379 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:52.870 INFO:teuthology.orchestra.run.smithi046.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:52.883 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/272 2024-02-19T09:40:52.883 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/272 2024-02-19T09:40:52.884 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:52.894 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:52.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:52.931 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-02-19T09:40:53.527 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:53.542 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:53.542 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:54.004 INFO:teuthology.orchestra.run.smithi046.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:54.019 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/273 2024-02-19T09:40:54.019 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/273 2024-02-19T09:40:54.019 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:54.034 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:54.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:54.067 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-02-19T09:40:54.635 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:54.651 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:54.651 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:55.117 INFO:teuthology.orchestra.run.smithi046.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:55.131 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/274 2024-02-19T09:40:55.131 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/274 2024-02-19T09:40:55.131 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:55.144 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:55.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:55.177 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-02-19T09:40:55.771 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:55.784 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:55.784 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:56.204 INFO:teuthology.orchestra.run.smithi046.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:56.216 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/275 2024-02-19T09:40:56.216 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/275 2024-02-19T09:40:56.216 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:56.225 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:56.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:56.256 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-02-19T09:40:56.836 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:56.851 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:56.851 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:57.362 INFO:teuthology.orchestra.run.smithi046.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:57.376 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/276 2024-02-19T09:40:57.376 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/276 2024-02-19T09:40:57.376 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:57.386 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:57.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:57.419 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-02-19T09:40:58.004 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:58.017 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:58.017 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:58.465 INFO:teuthology.orchestra.run.smithi046.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:58.477 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/277 2024-02-19T09:40:58.477 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/277 2024-02-19T09:40:58.477 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:58.486 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:58.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:58.518 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-02-19T09:40:59.086 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:40:59.101 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:40:59.101 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:59.570 INFO:teuthology.orchestra.run.smithi046.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:40:59.584 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/278 2024-02-19T09:40:59.584 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/278 2024-02-19T09:40:59.584 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:40:59.597 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:40:59.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:40:59.630 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-02-19T09:41:00.217 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:41:00.232 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:41:00.232 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:41:00.848 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/279 2024-02-19T09:41:00.848 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/279 2024-02-19T09:41:00.848 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:41:00.860 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:00.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:41:00.893 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-02-19T09:41:01.472 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:41:01.488 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:41:01.488 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:01.996 INFO:teuthology.orchestra.run.smithi046.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:41:02.010 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/280 2024-02-19T09:41:02.011 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/280 2024-02-19T09:41:02.011 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:41:02.023 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:02.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:41:02.057 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-02-19T09:41:02.680 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:41:02.694 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:41:02.694 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:03.223 INFO:teuthology.orchestra.run.smithi046.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:41:03.238 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/281 2024-02-19T09:41:03.238 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/281 2024-02-19T09:41:03.238 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:41:03.250 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:03.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:41:03.285 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-02-19T09:41:03.861 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:41:03.876 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:41:03.876 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:04.403 INFO:teuthology.orchestra.run.smithi046.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:41:04.417 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/282 2024-02-19T09:41:04.417 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/282 2024-02-19T09:41:04.417 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:41:04.430 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:04.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:41:04.466 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-02-19T09:41:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:41:05.093 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:41:05.093 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:05.585 INFO:teuthology.orchestra.run.smithi046.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:41:05.596 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/283 2024-02-19T09:41:05.596 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/283 2024-02-19T09:41:05.596 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:41:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:05.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:41:05.637 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-02-19T09:41:06.192 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:41:06.206 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:41:06.206 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:06.649 INFO:teuthology.orchestra.run.smithi046.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:41:06.663 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/284 2024-02-19T09:41:06.663 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/284 2024-02-19T09:41:06.663 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:41:06.674 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:06.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:41:06.705 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-02-19T09:41:07.286 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:41:07.334 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:41:07.334 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:13.336 INFO:teuthology.orchestra.run.smithi046.stdout:generic/285 6s 2024-02-19T09:41:13.354 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/285 2024-02-19T09:41:13.354 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:41:13.364 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:13.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:41:13.395 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-02-19T09:41:13.830 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:41:13.845 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:41:14.248 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:41:14.267 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:41:14.267 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:41:44.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:41:44.024 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:42:14.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:42:14.212 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:42:44.385 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:42:44.394 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:43:14.540 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:43:14.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:43:44.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:43:44.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:44:13.531 INFO:teuthology.orchestra.run.smithi046.stdout:generic/286 179s 2024-02-19T09:44:13.571 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/286 2024-02-19T09:44:13.572 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:13.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:13.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:13.615 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-02-19T09:44:14.553 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:14.565 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:14.565 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:14.974 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:44:14.980 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:44:15.031 INFO:teuthology.orchestra.run.smithi046.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:15.043 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/287 2024-02-19T09:44:15.043 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/287 2024-02-19T09:44:15.043 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:15.052 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:15.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:15.079 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-02-19T09:44:15.642 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:15.657 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:15.658 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:16.151 INFO:teuthology.orchestra.run.smithi046.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:16.163 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/288 2024-02-19T09:44:16.163 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/288 2024-02-19T09:44:16.163 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:16.173 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:16.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:16.204 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-02-19T09:44:16.758 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:16.771 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:16.771 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:17.185 INFO:teuthology.orchestra.run.smithi046.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/289 2024-02-19T09:44:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/289 2024-02-19T09:44:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:17.203 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:17.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:17.230 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-02-19T09:44:17.812 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:17.826 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:17.826 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:18.265 INFO:teuthology.orchestra.run.smithi046.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:18.280 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/290 2024-02-19T09:44:18.280 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/290 2024-02-19T09:44:18.280 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:18.292 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:18.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:18.327 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-02-19T09:44:18.894 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:18.906 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:18.906 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:19.335 INFO:teuthology.orchestra.run.smithi046.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:19.345 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/291 2024-02-19T09:44:19.346 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/291 2024-02-19T09:44:19.346 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:19.356 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:19.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:19.388 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-02-19T09:44:19.952 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:19.966 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:19.966 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:20.396 INFO:teuthology.orchestra.run.smithi046.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:20.407 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/292 2024-02-19T09:44:20.407 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/292 2024-02-19T09:44:20.407 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:20.419 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:20.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:20.449 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-02-19T09:44:21.036 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:21.048 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:21.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:21.492 INFO:teuthology.orchestra.run.smithi046.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:21.503 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/293 2024-02-19T09:44:21.504 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/293 2024-02-19T09:44:21.504 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:21.514 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:21.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:21.546 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-02-19T09:44:22.118 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:22.133 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:22.133 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:22.601 INFO:teuthology.orchestra.run.smithi046.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:22.614 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/294 2024-02-19T09:44:22.614 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/294 2024-02-19T09:44:22.614 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:22.624 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:22.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:22.654 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-02-19T09:44:23.286 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:23.299 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:23.299 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:23.721 INFO:teuthology.orchestra.run.smithi046.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:23.735 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/295 2024-02-19T09:44:23.735 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/295 2024-02-19T09:44:23.735 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:23.746 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:23.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:23.777 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-02-19T09:44:24.348 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:24.363 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:24.363 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:24.823 INFO:teuthology.orchestra.run.smithi046.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:24.834 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/296 2024-02-19T09:44:24.834 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/296 2024-02-19T09:44:24.834 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:24.842 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:24.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:24.872 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-02-19T09:44:25.435 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:25.448 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:25.448 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:25.931 INFO:teuthology.orchestra.run.smithi046.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:25.945 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/297 2024-02-19T09:44:25.946 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/297 2024-02-19T09:44:25.946 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:25.956 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:25.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:25.988 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-02-19T09:44:26.618 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:26.633 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:26.633 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:27.106 INFO:teuthology.orchestra.run.smithi046.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:27.118 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/298 2024-02-19T09:44:27.119 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/298 2024-02-19T09:44:27.119 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:27.131 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:27.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:27.166 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-02-19T09:44:27.735 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:27.750 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:28.185 INFO:teuthology.orchestra.run.smithi046.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:28.199 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/299 2024-02-19T09:44:28.199 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/299 2024-02-19T09:44:28.199 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:28.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:28.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:28.242 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-02-19T09:44:28.792 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:28.807 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:28.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:29.243 INFO:teuthology.orchestra.run.smithi046.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:29.257 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/300 2024-02-19T09:44:29.257 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/300 2024-02-19T09:44:29.258 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:29.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:29.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:29.302 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-02-19T09:44:29.877 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:29.891 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:30.347 INFO:teuthology.orchestra.run.smithi046.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:30.362 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/301 2024-02-19T09:44:30.362 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/301 2024-02-19T09:44:30.363 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:30.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:30.411 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-02-19T09:44:30.992 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:31.006 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:31.006 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:31.475 INFO:teuthology.orchestra.run.smithi046.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:31.489 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/302 2024-02-19T09:44:31.489 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/302 2024-02-19T09:44:31.489 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:31.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:31.534 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-02-19T09:44:32.099 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:32.114 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:32.114 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:32.710 INFO:teuthology.orchestra.run.smithi046.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:44:32.723 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/303 2024-02-19T09:44:32.723 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/303 2024-02-19T09:44:32.724 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:32.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:32.773 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-02-19T09:44:33.482 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:33.495 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:33.495 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:34.077 INFO:teuthology.orchestra.run.smithi046.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-02-19T09:44:34.091 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/304 2024-02-19T09:44:34.091 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/304 2024-02-19T09:44:34.091 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:34.103 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:34.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:34.150 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-02-19T09:44:34.844 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:34.856 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:34.856 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:35.320 INFO:teuthology.orchestra.run.smithi046.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:35.334 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/305 2024-02-19T09:44:35.334 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/305 2024-02-19T09:44:35.334 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:35.345 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:35.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:35.378 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-02-19T09:44:35.969 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:35.981 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:35.982 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:36.437 INFO:teuthology.orchestra.run.smithi046.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:36.449 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/306 2024-02-19T09:44:36.450 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/306 2024-02-19T09:44:36.450 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:36.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:36.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:36.494 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-02-19T09:44:37.072 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:37.084 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:37.084 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:44:37.582 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/307 2024-02-19T09:44:37.582 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/307 2024-02-19T09:44:37.582 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:37.593 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:37.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:37.624 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-02-19T09:44:38.230 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:38.244 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:38.244 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:38.784 INFO:teuthology.orchestra.run.smithi046.stdout:generic/308 0s 2024-02-19T09:44:38.799 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/308 2024-02-19T09:44:38.799 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:38.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:38.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:38.835 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-02-19T09:44:39.401 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:39.414 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:39.414 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:41.063 INFO:teuthology.orchestra.run.smithi046.stdout:generic/309 2s 2024-02-19T09:44:41.080 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/309 2024-02-19T09:44:41.080 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:44:41.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:41.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:44:41.125 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-02-19T09:44:41.845 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:44:41.857 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:44:41.857 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:44:45.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:44:45.109 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:45:15.568 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:45:15.578 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:45:45.781 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:45:45.791 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:46:16.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:46:16.012 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:46:37.976 INFO:teuthology.orchestra.run.smithi046.stdout:generic/310 116s 2024-02-19T09:46:37.994 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/310 2024-02-19T09:46:37.994 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:46:38.001 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:38.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:46:38.045 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-02-19T09:46:38.796 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:46:38.807 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:46:38.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:39.283 INFO:teuthology.orchestra.run.smithi046.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:46:39.295 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/311 2024-02-19T09:46:39.295 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/311 2024-02-19T09:46:39.296 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:46:39.305 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:39.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:46:39.336 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-02-19T09:46:39.897 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:46:39.912 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:46:39.912 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:40.425 INFO:teuthology.orchestra.run.smithi046.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:46:40.437 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/312 2024-02-19T09:46:40.437 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/312 2024-02-19T09:46:40.437 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:46:40.447 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:40.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:46:40.481 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-02-19T09:46:41.063 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:46:41.078 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:46:41.078 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:45.745 INFO:teuthology.orchestra.run.smithi046.stdout:generic/313 4s 2024-02-19T09:46:45.764 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/313 2024-02-19T09:46:45.765 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:46:45.775 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:45.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:46:45.807 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-02-19T09:46:46.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:46:46.220 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:46:46.355 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:46:46.370 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:46:46.370 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:48.304 INFO:teuthology.orchestra.run.smithi046.stdout:generic/314 2s 2024-02-19T09:46:48.323 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/314 2024-02-19T09:46:48.323 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:46:48.333 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:48.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:46:48.363 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-02-19T09:46:48.995 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:46:49.008 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:46:49.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:50.715 INFO:teuthology.orchestra.run.smithi046.stdout:generic/315 1s 2024-02-19T09:46:50.735 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/315 2024-02-19T09:46:50.735 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:46:50.746 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:50.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:46:50.786 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-02-19T09:46:51.493 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:46:51.506 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:46:51.506 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:55.838 INFO:teuthology.orchestra.run.smithi046.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-19T09:46:55.851 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/316 2024-02-19T09:46:55.851 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/316 2024-02-19T09:46:55.851 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:46:55.861 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:55.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:46:55.891 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-02-19T09:46:56.594 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:46:56.605 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:46:56.605 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:57.020 INFO:teuthology.orchestra.run.smithi046.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:46:57.032 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/317 2024-02-19T09:46:57.032 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/317 2024-02-19T09:46:57.032 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:46:57.041 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:57.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:46:57.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-02-19T09:46:57.655 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:46:57.668 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:46:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:58.150 INFO:teuthology.orchestra.run.smithi046.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:46:58.162 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/318 2024-02-19T09:46:58.162 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/318 2024-02-19T09:46:58.163 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:46:58.171 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:58.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:46:58.197 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-02-19T09:46:58.759 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:46:58.774 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:46:58.774 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:59.290 INFO:teuthology.orchestra.run.smithi046.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-02-19T09:46:59.301 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/319 2024-02-19T09:46:59.301 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/319 2024-02-19T09:46:59.301 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:46:59.311 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:46:59.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:46:59.341 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-02-19T09:46:59.943 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:46:59.957 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:46:59.957 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:47:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:47:00.409 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/320 2024-02-19T09:47:00.410 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/320 2024-02-19T09:47:00.410 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:47:00.421 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:47:00.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:47:00.454 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-02-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:47:01.094 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:47:01.095 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:47:01.622 INFO:teuthology.orchestra.run.smithi046.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:47:01.637 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/321 2024-02-19T09:47:01.637 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/321 2024-02-19T09:47:01.637 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:47:01.650 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:47:01.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:47:01.685 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-02-19T09:47:02.256 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:47:02.271 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:47:02.271 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:47:02.766 INFO:teuthology.orchestra.run.smithi046.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:47:02.778 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/322 2024-02-19T09:47:02.778 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/322 2024-02-19T09:47:02.778 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:47:02.787 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:47:02.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:47:02.816 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-02-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:47:03.411 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:47:03.411 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:47:16.438 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:47:16.443 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:47:46.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:47:46.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:48:16.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:48:16.862 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:48:47.767 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:48:47.773 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:49:06.376 INFO:teuthology.orchestra.run.smithi046.stdout:generic/323 123s 2024-02-19T09:49:06.393 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/323 2024-02-19T09:49:06.393 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:06.402 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:06.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:06.461 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-02-19T09:49:07.099 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:07.111 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:07.111 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:07.621 INFO:teuthology.orchestra.run.smithi046.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:07.634 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/324 2024-02-19T09:49:07.634 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/324 2024-02-19T09:49:07.634 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:07.646 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:07.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:07.678 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-02-19T09:49:08.231 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:08.244 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:08.244 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:08.763 INFO:teuthology.orchestra.run.smithi046.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:08.779 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/325 2024-02-19T09:49:08.779 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/325 2024-02-19T09:49:08.779 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:08.793 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:08.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:08.827 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-02-19T09:49:09.415 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:09.427 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:09.427 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:09.912 INFO:teuthology.orchestra.run.smithi046.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:09.926 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/326 2024-02-19T09:49:09.926 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/326 2024-02-19T09:49:09.926 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:09.938 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:09.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:09.970 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-02-19T09:49:10.539 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:10.551 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:10.552 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:10.981 INFO:teuthology.orchestra.run.smithi046.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:10.993 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/327 2024-02-19T09:49:10.993 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/327 2024-02-19T09:49:10.993 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:11.004 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:11.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:11.035 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-02-19T09:49:11.607 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:11.620 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:11.620 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:12.067 INFO:teuthology.orchestra.run.smithi046.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:12.081 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/328 2024-02-19T09:49:12.081 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/328 2024-02-19T09:49:12.082 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:12.094 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:12.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:12.131 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-02-19T09:49:12.739 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:12.752 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:12.752 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:13.236 INFO:teuthology.orchestra.run.smithi046.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:13.249 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/329 2024-02-19T09:49:13.249 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/329 2024-02-19T09:49:13.249 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:13.259 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:13.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:13.290 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-02-19T09:49:13.874 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:13.888 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:13.888 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:14.328 INFO:teuthology.orchestra.run.smithi046.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:14.342 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/330 2024-02-19T09:49:14.342 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/330 2024-02-19T09:49:14.342 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:14.353 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:14.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:14.386 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-02-19T09:49:14.982 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:14.996 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:14.996 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:15.444 INFO:teuthology.orchestra.run.smithi046.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:15.457 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/331 2024-02-19T09:49:15.457 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/331 2024-02-19T09:49:15.457 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:15.467 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:15.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:15.502 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-02-19T09:49:16.083 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:16.099 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:16.521 INFO:teuthology.orchestra.run.smithi046.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:16.532 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/332 2024-02-19T09:49:16.532 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/332 2024-02-19T09:49:16.532 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:16.542 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:16.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:16.575 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-02-19T09:49:17.173 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:17.190 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:17.190 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:17.631 INFO:teuthology.orchestra.run.smithi046.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:17.643 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/333 2024-02-19T09:49:17.643 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/333 2024-02-19T09:49:17.643 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:17.653 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:17.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:17.685 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-02-19T09:49:17.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:49:17.904 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:49:18.229 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:18.243 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:18.243 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:18.681 INFO:teuthology.orchestra.run.smithi046.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:18.695 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/334 2024-02-19T09:49:18.695 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/334 2024-02-19T09:49:18.695 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:18.706 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:18.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:18.742 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-02-19T09:49:19.294 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:19.308 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:19.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:19.775 INFO:teuthology.orchestra.run.smithi046.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:19.787 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/335 2024-02-19T09:49:19.787 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/335 2024-02-19T09:49:19.787 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:19.797 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:19.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:19.829 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-02-19T09:49:20.367 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:20.380 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:20.380 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:20.869 INFO:teuthology.orchestra.run.smithi046.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:20.880 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/336 2024-02-19T09:49:20.880 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/336 2024-02-19T09:49:20.880 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:20.888 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:20.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:20.916 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-02-19T09:49:21.476 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:21.490 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:21.490 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:21.947 INFO:teuthology.orchestra.run.smithi046.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/337 2024-02-19T09:49:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/337 2024-02-19T09:49:21.962 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:21.974 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:22.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:22.007 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-02-19T09:49:22.606 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:22.621 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:22.621 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:23.093 INFO:teuthology.orchestra.run.smithi046.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:23.107 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/338 2024-02-19T09:49:23.107 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/338 2024-02-19T09:49:23.108 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:23.119 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:23.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:23.149 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-02-19T09:49:23.727 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:23.741 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:23.741 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:24.262 INFO:teuthology.orchestra.run.smithi046.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:24.274 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/339 2024-02-19T09:49:24.274 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/339 2024-02-19T09:49:24.274 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:24.283 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:24.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:24.314 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-02-19T09:49:24.891 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:24.905 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:24.905 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:25.331 INFO:teuthology.orchestra.run.smithi046.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:25.345 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/340 2024-02-19T09:49:25.345 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/340 2024-02-19T09:49:25.345 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:25.358 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:25.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:25.393 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-02-19T09:49:25.975 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:25.989 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:25.989 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:26.474 INFO:teuthology.orchestra.run.smithi046.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:26.488 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/341 2024-02-19T09:49:26.488 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/341 2024-02-19T09:49:26.488 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:26.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:26.530 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-02-19T09:49:27.120 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:27.135 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:27.135 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:27.591 INFO:teuthology.orchestra.run.smithi046.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:27.605 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/342 2024-02-19T09:49:27.606 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/342 2024-02-19T09:49:27.606 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:27.617 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:27.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:27.654 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-02-19T09:49:28.236 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:28.249 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:28.249 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:28.706 INFO:teuthology.orchestra.run.smithi046.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:28.721 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/343 2024-02-19T09:49:28.721 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/343 2024-02-19T09:49:28.721 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:28.733 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:28.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:28.768 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-02-19T09:49:29.365 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:29.382 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:29.382 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:29.826 INFO:teuthology.orchestra.run.smithi046.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:29.838 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/344 2024-02-19T09:49:29.838 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/344 2024-02-19T09:49:29.838 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:29.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:29.878 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-02-19T09:49:30.442 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:30.457 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:30.917 INFO:teuthology.orchestra.run.smithi046.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:30.926 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/345 2024-02-19T09:49:30.927 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/345 2024-02-19T09:49:30.927 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:30.935 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:30.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:30.964 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-02-19T09:49:31.510 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:31.524 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:31.524 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:31.971 INFO:teuthology.orchestra.run.smithi046.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:31.983 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/346 2024-02-19T09:49:31.983 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/346 2024-02-19T09:49:31.983 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:31.993 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:32.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:32.025 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-02-19T09:49:32.606 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:32.618 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:32.618 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:33.161 INFO:teuthology.orchestra.run.smithi046.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:33.175 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/347 2024-02-19T09:49:33.175 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/347 2024-02-19T09:49:33.176 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:33.188 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:33.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:33.219 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-02-19T09:49:33.824 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:33.840 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:33.840 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:34.359 INFO:teuthology.orchestra.run.smithi046.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:34.374 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/348 2024-02-19T09:49:34.374 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/348 2024-02-19T09:49:34.374 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:34.385 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:34.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:34.419 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-02-19T09:49:35.024 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:35.038 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:38.900 INFO:teuthology.orchestra.run.smithi046.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-19T09:49:38.916 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/349 2024-02-19T09:49:38.916 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/349 2024-02-19T09:49:38.916 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:38.929 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:38.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:38.963 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-02-19T09:49:39.540 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:39.553 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:39.553 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:44.927 INFO:teuthology.orchestra.run.smithi046.stdout:generic/350 5s 2024-02-19T09:49:44.945 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/350 2024-02-19T09:49:44.945 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:44.955 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:44.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:44.984 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-02-19T09:49:45.545 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:45.558 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:45.558 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:48.088 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:49:48.101 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:49:49.264 INFO:teuthology.orchestra.run.smithi046.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-02-19T09:49:49.279 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/351 2024-02-19T09:49:49.280 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/351 2024-02-19T09:49:49.280 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:49.292 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:49.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:49.328 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-02-19T09:49:50.023 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:50.034 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:50.034 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:50.522 INFO:teuthology.orchestra.run.smithi046.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:50.536 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/352 2024-02-19T09:49:50.536 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/352 2024-02-19T09:49:50.537 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:50.549 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:50.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:50.581 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-02-19T09:49:51.218 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:51.232 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:51.232 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:51.690 INFO:teuthology.orchestra.run.smithi046.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:51.706 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/353 2024-02-19T09:49:51.706 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/353 2024-02-19T09:49:51.706 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:51.719 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:51.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:51.754 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-02-19T09:49:52.336 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:52.351 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:52.785 INFO:teuthology.orchestra.run.smithi046.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:52.797 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/354 2024-02-19T09:49:52.797 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/354 2024-02-19T09:49:52.797 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:52.807 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:52.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:52.839 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-02-19T09:49:53.418 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:53.432 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:53.432 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:55.163 INFO:teuthology.orchestra.run.smithi046.stdout:generic/355 2s 2024-02-19T09:49:55.180 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/355 2024-02-19T09:49:55.180 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:55.189 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:55.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:55.216 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-02-19T09:49:55.921 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:55.934 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:55.934 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:56.344 INFO:teuthology.orchestra.run.smithi046.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:56.356 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/356 2024-02-19T09:49:56.356 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/356 2024-02-19T09:49:56.356 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:56.365 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:56.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:56.394 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-02-19T09:49:56.983 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:56.995 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:57.456 INFO:teuthology.orchestra.run.smithi046.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:57.471 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/357 2024-02-19T09:49:57.471 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/357 2024-02-19T09:49:57.472 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:57.484 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:57.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:57.518 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-02-19T09:49:58.107 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:58.122 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:58.122 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:58.585 INFO:teuthology.orchestra.run.smithi046.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:58.597 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/358 2024-02-19T09:49:58.598 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/358 2024-02-19T09:49:58.598 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:58.608 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:58.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:58.637 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-02-19T09:49:59.197 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:49:59.211 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:49:59.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:59.651 INFO:teuthology.orchestra.run.smithi046.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:49:59.666 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/359 2024-02-19T09:49:59.666 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/359 2024-02-19T09:49:59.666 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:49:59.678 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:49:59.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:49:59.712 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-02-19T09:50:00.332 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:00.345 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:00.345 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:01.073 INFO:teuthology.orchestra.run.smithi046.stdout:generic/360 1s 2024-02-19T09:50:01.094 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/360 2024-02-19T09:50:01.094 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:01.104 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:01.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:01.138 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-02-19T09:50:01.720 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:01.733 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:01.733 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:02.209 INFO:teuthology.orchestra.run.smithi046.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:02.225 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/361 2024-02-19T09:50:02.225 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/361 2024-02-19T09:50:02.225 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:02.237 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:02.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:02.273 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-02-19T09:50:02.873 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:02.886 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:02.887 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:03.293 INFO:teuthology.orchestra.run.smithi046.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:03.305 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/362 2024-02-19T09:50:03.305 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/362 2024-02-19T09:50:03.305 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:03.315 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:03.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:03.345 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-02-19T09:50:03.925 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:03.938 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:03.938 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:04.323 INFO:teuthology.orchestra.run.smithi046.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:04.334 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/363 2024-02-19T09:50:04.334 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/363 2024-02-19T09:50:04.334 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:04.344 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:04.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:04.376 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-02-19T09:50:04.940 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:04.953 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:04.953 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:05.401 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/364 2024-02-19T09:50:05.401 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/364 2024-02-19T09:50:05.401 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:05.410 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:05.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:05.440 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-02-19T09:50:06.033 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:06.045 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:06.046 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:06.485 INFO:teuthology.orchestra.run.smithi046.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:06.500 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/365 2024-02-19T09:50:06.500 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/365 2024-02-19T09:50:06.500 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:06.512 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:06.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:06.544 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-02-19T09:50:07.117 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:07.131 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:07.131 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:07.539 INFO:teuthology.orchestra.run.smithi046.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:07.550 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/366 2024-02-19T09:50:07.550 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/366 2024-02-19T09:50:07.550 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:07.561 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:07.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:07.593 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-02-19T09:50:08.159 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:08.173 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:08.173 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:08.606 INFO:teuthology.orchestra.run.smithi046.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:08.617 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/367 2024-02-19T09:50:08.617 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/367 2024-02-19T09:50:08.617 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:08.625 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:08.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:08.653 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-02-19T09:50:09.221 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:09.234 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:09.234 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:09.647 INFO:teuthology.orchestra.run.smithi046.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:09.663 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/368 2024-02-19T09:50:09.663 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/368 2024-02-19T09:50:09.663 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:09.675 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:09.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:09.712 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-02-19T09:50:10.278 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:10.291 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:10.291 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:10.719 INFO:teuthology.orchestra.run.smithi046.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:10.731 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/369 2024-02-19T09:50:10.731 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/369 2024-02-19T09:50:10.731 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:10.740 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:10.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:10.769 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-02-19T09:50:11.352 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:11.366 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:11.367 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:11.807 INFO:teuthology.orchestra.run.smithi046.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:11.821 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/370 2024-02-19T09:50:11.821 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/370 2024-02-19T09:50:11.821 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:11.834 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:11.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:11.871 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-02-19T09:50:12.471 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:12.486 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:12.486 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:12.929 INFO:teuthology.orchestra.run.smithi046.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:12.941 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/371 2024-02-19T09:50:12.941 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/371 2024-02-19T09:50:12.941 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:12.950 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:12.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:12.985 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-02-19T09:50:13.566 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:13.580 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:13.580 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:14.030 INFO:teuthology.orchestra.run.smithi046.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:14.044 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/372 2024-02-19T09:50:14.044 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/372 2024-02-19T09:50:14.044 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:14.054 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:14.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:14.088 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-02-19T09:50:14.719 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:14.735 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:14.735 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:15.152 INFO:teuthology.orchestra.run.smithi046.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:15.166 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/373 2024-02-19T09:50:15.166 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/373 2024-02-19T09:50:15.166 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:15.175 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:15.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:15.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-02-19T09:50:15.794 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:15.810 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:15.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:16.288 INFO:teuthology.orchestra.run.smithi046.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:16.300 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/374 2024-02-19T09:50:16.300 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/374 2024-02-19T09:50:16.300 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:16.309 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:16.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:16.337 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-02-19T09:50:16.949 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:16.967 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:16.968 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:17.514 INFO:teuthology.orchestra.run.smithi046.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-02-19T09:50:17.529 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/375 2024-02-19T09:50:17.529 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/375 2024-02-19T09:50:17.529 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:17.541 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:17.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:17.580 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-02-19T09:50:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:18.177 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:18.177 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:18.491 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:50:18.497 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:50:18.700 INFO:teuthology.orchestra.run.smithi046.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:18.714 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/376 2024-02-19T09:50:18.714 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/376 2024-02-19T09:50:18.714 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:18.726 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:18.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:18.759 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-02-19T09:50:19.307 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:19.319 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:19.319 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:19.765 INFO:teuthology.orchestra.run.smithi046.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:19.777 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/377 2024-02-19T09:50:19.777 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/377 2024-02-19T09:50:19.777 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:19.788 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:19.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:19.819 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-02-19T09:50:20.325 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:20.336 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:20.336 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:21.600 INFO:teuthology.orchestra.run.smithi046.stdout:generic/378 1s 2024-02-19T09:50:21.619 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/378 2024-02-19T09:50:21.619 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:21.629 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:21.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:21.675 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-02-19T09:50:22.374 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:22.386 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:22.386 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:22.810 INFO:teuthology.orchestra.run.smithi046.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:22.825 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/379 2024-02-19T09:50:22.826 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/379 2024-02-19T09:50:22.826 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:22.840 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:22.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:22.877 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-02-19T09:50:23.466 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:23.481 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:23.481 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:23.922 INFO:teuthology.orchestra.run.smithi046.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:23.934 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/380 2024-02-19T09:50:23.934 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/380 2024-02-19T09:50:23.934 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:23.945 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:23.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:23.974 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-02-19T09:50:24.567 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:24.582 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:25.059 INFO:teuthology.orchestra.run.smithi046.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:25.073 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/381 2024-02-19T09:50:25.073 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/381 2024-02-19T09:50:25.073 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:25.085 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:25.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:25.118 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-02-19T09:50:25.715 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:25.729 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:25.729 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:26.164 INFO:teuthology.orchestra.run.smithi046.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:26.174 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/382 2024-02-19T09:50:26.174 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/382 2024-02-19T09:50:26.175 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:26.184 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:26.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:26.212 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-02-19T09:50:26.795 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:26.807 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:26.807 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:27.283 INFO:teuthology.orchestra.run.smithi046.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:27.295 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/383 2024-02-19T09:50:27.296 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/383 2024-02-19T09:50:27.296 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:27.305 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:27.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:27.336 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-02-19T09:50:27.929 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:27.945 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:27.945 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:28.440 INFO:teuthology.orchestra.run.smithi046.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-02-19T09:50:28.451 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/384 2024-02-19T09:50:28.451 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/384 2024-02-19T09:50:28.451 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:28.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:28.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:28.496 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-02-19T09:50:29.053 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:29.066 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:29.066 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:29.502 INFO:teuthology.orchestra.run.smithi046.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:29.519 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/385 2024-02-19T09:50:29.519 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/385 2024-02-19T09:50:29.519 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:29.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:29.564 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-02-19T09:50:30.146 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:30.160 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:30.605 INFO:teuthology.orchestra.run.smithi046.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-02-19T09:50:30.616 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/386 2024-02-19T09:50:30.617 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/386 2024-02-19T09:50:30.617 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:30.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:30.653 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-02-19T09:50:31.229 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:31.244 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:31.244 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:31.691 INFO:teuthology.orchestra.run.smithi046.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:31.705 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/387 2024-02-19T09:50:31.705 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/387 2024-02-19T09:50:31.705 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:31.718 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:31.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:31.749 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-02-19T09:50:32.307 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:32.320 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:32.320 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:32.764 INFO:teuthology.orchestra.run.smithi046.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:32.777 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/388 2024-02-19T09:50:32.778 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/388 2024-02-19T09:50:32.778 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:32.790 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:32.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:32.823 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-02-19T09:50:33.434 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:33.447 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:33.447 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:33.944 INFO:teuthology.orchestra.run.smithi046.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-02-19T09:50:33.956 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/389 2024-02-19T09:50:33.956 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/389 2024-02-19T09:50:33.956 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:33.965 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:33.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:33.998 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-02-19T09:50:34.566 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:34.580 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:34.580 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:35.063 INFO:teuthology.orchestra.run.smithi046.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:50:35.076 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/390 2024-02-19T09:50:35.076 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/390 2024-02-19T09:50:35.076 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:50:35.086 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:35.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:50:35.118 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-02-19T09:50:35.697 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:50:35.712 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:50:35.712 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:50:48.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:50:48.723 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:51:19.042 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:51:19.053 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:51:49.665 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:51:49.675 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:51:52.516 INFO:teuthology.orchestra.run.smithi046.stdout:generic/391 77s 2024-02-19T09:51:52.609 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/391 2024-02-19T09:51:52.609 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:51:52.621 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:51:52.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:51:52.664 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-02-19T09:51:53.762 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:51:53.776 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:51:53.776 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:51:54.210 INFO:teuthology.orchestra.run.smithi046.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:51:54.221 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/392 2024-02-19T09:51:54.221 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/392 2024-02-19T09:51:54.222 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:51:54.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:51:54.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:51:54.259 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-02-19T09:51:54.822 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:51:54.839 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:51:54.839 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:51:55.239 INFO:teuthology.orchestra.run.smithi046.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:51:55.250 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/393 2024-02-19T09:51:55.250 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/393 2024-02-19T09:51:55.250 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:51:55.260 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:51:55.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:51:55.286 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-02-19T09:51:55.859 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:51:55.870 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:51:55.870 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:51:56.422 INFO:teuthology.orchestra.run.smithi046.stdout:generic/394 1s 2024-02-19T09:51:56.440 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/394 2024-02-19T09:51:56.440 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:51:56.449 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:51:56.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:51:56.478 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-02-19T09:51:57.134 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:51:57.144 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:51:57.145 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:51:57.618 INFO:teuthology.orchestra.run.smithi046.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:51:57.629 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/395 2024-02-19T09:51:57.629 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/395 2024-02-19T09:51:57.629 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:51:57.638 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:51:57.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:51:57.671 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-02-19T09:51:58.143 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:51:58.155 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:51:58.155 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:51:58.751 INFO:teuthology.orchestra.run.smithi046.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:51:58.764 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/396 2024-02-19T09:51:58.764 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/396 2024-02-19T09:51:58.764 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:51:58.774 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:51:58.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:51:58.808 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-02-19T09:51:59.395 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:51:59.408 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:51:59.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:51:59.996 INFO:teuthology.orchestra.run.smithi046.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:00.011 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/397 2024-02-19T09:52:00.012 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/397 2024-02-19T09:52:00.012 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:00.024 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:00.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:00.060 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-02-19T09:52:00.645 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:00.658 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:00.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:01.245 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/398 2024-02-19T09:52:01.245 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/398 2024-02-19T09:52:01.245 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:01.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:01.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:01.294 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-02-19T09:52:01.873 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:01.888 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:01.888 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:02.435 INFO:teuthology.orchestra.run.smithi046.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:02.449 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/399 2024-02-19T09:52:02.449 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/399 2024-02-19T09:52:02.449 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:02.462 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:02.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:02.494 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-02-19T09:52:03.076 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:03.092 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:03.092 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:03.551 INFO:teuthology.orchestra.run.smithi046.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-02-19T09:52:03.566 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/400 2024-02-19T09:52:03.566 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/400 2024-02-19T09:52:03.567 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:03.579 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:03.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:03.618 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-02-19T09:52:04.208 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:04.222 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:04.222 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:04.681 INFO:teuthology.orchestra.run.smithi046.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:04.696 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/401 2024-02-19T09:52:04.696 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/401 2024-02-19T09:52:04.697 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:04.710 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:04.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:04.749 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-02-19T09:52:05.345 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:05.807 INFO:teuthology.orchestra.run.smithi046.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:05.821 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/402 2024-02-19T09:52:05.821 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/402 2024-02-19T09:52:05.821 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:05.833 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:05.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:05.868 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-02-19T09:52:06.453 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:06.467 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:06.467 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:06.913 INFO:teuthology.orchestra.run.smithi046.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:06.926 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/403 2024-02-19T09:52:06.926 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/403 2024-02-19T09:52:06.926 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:06.936 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:06.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:06.968 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-02-19T09:52:07.567 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:07.582 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:07.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:11.398 INFO:teuthology.orchestra.run.smithi046.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-02-19T09:52:11.413 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/404 2024-02-19T09:52:11.413 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/404 2024-02-19T09:52:11.413 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:11.426 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:11.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:11.457 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-02-19T09:52:12.159 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:12.171 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:12.172 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:12.740 INFO:teuthology.orchestra.run.smithi046.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:12.754 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/405 2024-02-19T09:52:12.755 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/405 2024-02-19T09:52:12.755 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:12.767 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:12.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:12.803 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-02-19T09:52:13.395 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:13.409 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:13.409 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:13.862 INFO:teuthology.orchestra.run.smithi046.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:13.875 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/406 2024-02-19T09:52:13.875 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/406 2024-02-19T09:52:13.875 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:13.885 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:13.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:13.916 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-02-19T09:52:14.474 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:14.489 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:14.489 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:15.144 INFO:teuthology.orchestra.run.smithi046.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:52:15.157 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/407 2024-02-19T09:52:15.157 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/407 2024-02-19T09:52:15.157 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:15.167 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:15.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:15.201 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-02-19T09:52:15.908 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:15.922 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:15.922 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:16.539 INFO:teuthology.orchestra.run.smithi046.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-02-19T09:52:16.551 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/408 2024-02-19T09:52:16.551 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/408 2024-02-19T09:52:16.551 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:16.560 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:16.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:16.618 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-02-19T09:52:17.301 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:17.316 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:17.317 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:17.750 INFO:teuthology.orchestra.run.smithi046.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:17.763 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/409 2024-02-19T09:52:17.763 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/409 2024-02-19T09:52:17.763 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:17.774 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:17.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:17.806 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-02-19T09:52:18.373 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:18.386 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:18.817 INFO:teuthology.orchestra.run.smithi046.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:18.829 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/410 2024-02-19T09:52:18.829 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/410 2024-02-19T09:52:18.829 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:18.838 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:18.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:18.869 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-02-19T09:52:19.443 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:19.456 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:19.456 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:19.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:52:19.823 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:52:19.898 INFO:teuthology.orchestra.run.smithi046.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:19.908 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/411 2024-02-19T09:52:19.908 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/411 2024-02-19T09:52:19.908 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:19.918 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:19.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:19.948 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-02-19T09:52:20.561 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:20.577 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:20.577 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:20.986 INFO:teuthology.orchestra.run.smithi046.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:20.998 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/412 2024-02-19T09:52:20.998 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/412 2024-02-19T09:52:20.998 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:21.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:21.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:21.039 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-02-19T09:52:21.624 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:21.638 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:21.639 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:22.144 INFO:teuthology.orchestra.run.smithi046.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:22.156 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/413 2024-02-19T09:52:22.156 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/413 2024-02-19T09:52:22.156 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:22.166 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:22.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:22.198 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-02-19T09:52:22.787 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:22.802 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:22.802 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:23.270 INFO:teuthology.orchestra.run.smithi046.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:23.281 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/414 2024-02-19T09:52:23.281 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/414 2024-02-19T09:52:23.281 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:23.290 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:23.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:23.319 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-02-19T09:52:23.934 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:23.950 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:23.950 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:24.415 INFO:teuthology.orchestra.run.smithi046.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:24.427 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/415 2024-02-19T09:52:24.428 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/415 2024-02-19T09:52:24.428 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:24.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:24.469 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-02-19T09:52:25.052 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:25.068 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:25.068 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:25.537 INFO:teuthology.orchestra.run.smithi046.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:25.551 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/416 2024-02-19T09:52:25.551 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/416 2024-02-19T09:52:25.551 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:25.563 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:25.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:25.595 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-02-19T09:52:26.180 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:26.194 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:26.194 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:26.644 INFO:teuthology.orchestra.run.smithi046.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:26.655 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/417 2024-02-19T09:52:26.655 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/417 2024-02-19T09:52:26.655 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:26.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:26.693 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-02-19T09:52:27.259 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:27.274 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:27.274 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:27.842 INFO:teuthology.orchestra.run.smithi046.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2024-02-19T09:52:27.858 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/418 2024-02-19T09:52:27.858 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/418 2024-02-19T09:52:27.858 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:27.870 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:27.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:27.910 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-02-19T09:52:28.495 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:28.507 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:28.507 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:29.042 INFO:teuthology.orchestra.run.smithi046.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:29.054 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/419 2024-02-19T09:52:29.054 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/419 2024-02-19T09:52:29.054 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:29.064 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:29.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:29.096 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-02-19T09:52:29.707 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:29.721 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:33.039 INFO:teuthology.orchestra.run.smithi046.stdout:generic/420 4s 2024-02-19T09:52:33.058 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/420 2024-02-19T09:52:33.058 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:33.067 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:33.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:33.095 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-02-19T09:52:33.811 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:33.823 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:33.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:34.344 INFO:teuthology.orchestra.run.smithi046.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:34.357 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/421 2024-02-19T09:52:34.357 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/421 2024-02-19T09:52:34.357 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:34.368 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:34.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:34.400 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-02-19T09:52:34.983 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:34.996 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:34.996 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:35.465 INFO:teuthology.orchestra.run.smithi046.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:35.477 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/422 2024-02-19T09:52:35.477 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/422 2024-02-19T09:52:35.477 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:35.489 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:35.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:35.519 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-02-19T09:52:36.124 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:36.140 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:36.140 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:36.952 INFO:teuthology.orchestra.run.smithi046.stdout:generic/423 0s 2024-02-19T09:52:36.968 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/423 2024-02-19T09:52:36.969 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:36.978 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:37.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:37.026 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-02-19T09:52:37.714 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:37.725 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:37.725 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:38.214 INFO:teuthology.orchestra.run.smithi046.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-02-19T09:52:38.226 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/424 2024-02-19T09:52:38.226 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/424 2024-02-19T09:52:38.226 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:38.236 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:38.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:38.274 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-02-19T09:52:38.854 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:38.867 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:38.867 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:39.295 INFO:teuthology.orchestra.run.smithi046.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:52:39.308 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/425 2024-02-19T09:52:39.308 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/425 2024-02-19T09:52:39.308 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:52:39.317 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:39.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:52:39.351 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-02-19T09:52:39.911 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:52:39.922 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:52:39.922 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:52:49.976 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:52:49.984 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:53:20.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:53:20.205 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:53:51.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:53:51.043 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:54:05.811 INFO:teuthology.orchestra.run.smithi046.stdout:generic/426 - output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/426.out.bad) 2024-02-19T09:54:05.836 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/426.out 2024-02-19 06:59:28.023910252 +0000 2024-02-19T09:54:05.836 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/426.out.bad 2024-02-19 09:54:05.770821457 +0000 2024-02-19T09:54:05.836 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,5 +1,119 @@ 2024-02-19T09:54:05.836 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 426 2024-02-19T09:54:05.836 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/426-dir -d 2024-02-19T09:54:05.836 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000910) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000911) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000912) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000913) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000914) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000915) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000916) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000917) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000918) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000919) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000920) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000921) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000922) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000923) opened an unlinked file! 2024-02-19T09:54:05.837 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000924) opened an unlinked file! 2024-02-19T09:54:05.838 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000925) opened an unlinked file! 2024-02-19T09:54:05.838 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000926) opened an unlinked file! 2024-02-19T09:54:05.838 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000927) opened an unlinked file! 2024-02-19T09:54:05.838 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000928) opened an unlinked file! 2024-02-19T09:54:05.838 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000929) opened an unlinked file! 2024-02-19T09:54:05.838 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000930) opened an unlinked file! 2024-02-19T09:54:05.838 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000931) opened an unlinked file! 2024-02-19T09:54:05.838 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000932) opened an unlinked file! 2024-02-19T09:54:05.838 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000933) opened an unlinked file! 2024-02-19T09:54:05.838 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000934) opened an unlinked file! 2024-02-19T09:54:05.838 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000935) opened an unlinked file! 2024-02-19T09:54:05.838 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000936) opened an unlinked file! 2024-02-19T09:54:05.838 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000937) opened an unlinked file! 2024-02-19T09:54:05.839 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000938) opened an unlinked file! 2024-02-19T09:54:05.839 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000939) opened an unlinked file! 2024-02-19T09:54:05.839 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000940) opened an unlinked file! 2024-02-19T09:54:05.839 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000941) opened an unlinked file! 2024-02-19T09:54:05.839 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000942) opened an unlinked file! 2024-02-19T09:54:05.839 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000943) opened an unlinked file! 2024-02-19T09:54:05.839 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000944) opened an unlinked file! 2024-02-19T09:54:05.839 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000945) opened an unlinked file! 2024-02-19T09:54:05.839 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000946) opened an unlinked file! 2024-02-19T09:54:05.839 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000947) opened an unlinked file! 2024-02-19T09:54:05.839 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000948) opened an unlinked file! 2024-02-19T09:54:05.839 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000949) opened an unlinked file! 2024-02-19T09:54:05.839 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000950) opened an unlinked file! 2024-02-19T09:54:05.840 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000951) opened an unlinked file! 2024-02-19T09:54:05.840 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000952) opened an unlinked file! 2024-02-19T09:54:05.840 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000953) opened an unlinked file! 2024-02-19T09:54:05.840 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000954) opened an unlinked file! 2024-02-19T09:54:05.840 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000955) opened an unlinked file! 2024-02-19T09:54:05.840 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000956) opened an unlinked file! 2024-02-19T09:54:05.840 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000957) opened an unlinked file! 2024-02-19T09:54:05.840 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000958) opened an unlinked file! 2024-02-19T09:54:05.840 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000959) opened an unlinked file! 2024-02-19T09:54:05.840 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000960) opened an unlinked file! 2024-02-19T09:54:05.840 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000961) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000962) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000963) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000964) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000965) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000966) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000967) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000968) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000969) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000970) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000971) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000972) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000973) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000974) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000975) opened an unlinked file! 2024-02-19T09:54:05.841 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000976) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000977) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000978) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000979) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000980) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000981) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000982) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000983) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000984) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000985) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000986) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000987) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000988) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000989) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000990) opened an unlinked file! 2024-02-19T09:54:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000991) opened an unlinked file! 2024-02-19T09:54:05.843 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000992) opened an unlinked file! 2024-02-19T09:54:05.843 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000993) opened an unlinked file! 2024-02-19T09:54:05.843 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000994) opened an unlinked file! 2024-02-19T09:54:05.843 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000995) opened an unlinked file! 2024-02-19T09:54:05.843 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000996) opened an unlinked file! 2024-02-19T09:54:05.843 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000997) opened an unlinked file! 2024-02-19T09:54:05.843 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000998) opened an unlinked file! 2024-02-19T09:54:05.843 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file000999) opened an unlinked file! 2024-02-19T09:54:05.843 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001000) opened an unlinked file! 2024-02-19T09:54:05.843 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001001) opened an unlinked file! 2024-02-19T09:54:05.844 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001002) opened an unlinked file! 2024-02-19T09:54:05.844 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001003) opened an unlinked file! 2024-02-19T09:54:05.844 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001004) opened an unlinked file! 2024-02-19T09:54:05.844 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001005) opened an unlinked file! 2024-02-19T09:54:05.844 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001006) opened an unlinked file! 2024-02-19T09:54:05.844 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001007) opened an unlinked file! 2024-02-19T09:54:05.844 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001008) opened an unlinked file! 2024-02-19T09:54:05.844 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001009) opened an unlinked file! 2024-02-19T09:54:05.844 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001010) opened an unlinked file! 2024-02-19T09:54:05.844 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001011) opened an unlinked file! 2024-02-19T09:54:05.844 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001012) opened an unlinked file! 2024-02-19T09:54:05.844 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001013) opened an unlinked file! 2024-02-19T09:54:05.844 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001014) opened an unlinked file! 2024-02-19T09:54:05.845 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001015) opened an unlinked file! 2024-02-19T09:54:05.845 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001016) opened an unlinked file! 2024-02-19T09:54:05.845 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001017) opened an unlinked file! 2024-02-19T09:54:05.845 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001018) opened an unlinked file! 2024-02-19T09:54:05.845 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001019) opened an unlinked file! 2024-02-19T09:54:05.845 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001020) opened an unlinked file! 2024-02-19T09:54:05.845 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001021) opened an unlinked file! 2024-02-19T09:54:05.845 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001022) opened an unlinked file! 2024-02-19T09:54:05.845 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/426-dir/file001023) opened an unlinked file! 2024-02-19T09:54:05.845 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/426-dir 2024-02-19T09:54:05.845 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/426-dir -l 2024-02-19T09:54:05.845 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/426-dir -u 2024-02-19T09:54:05.857 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/426 2024-02-19T09:54:05.857 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/426 2024-02-19T09:54:05.857 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T09:54:05.887 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:06.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T09:54:06.069 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T09:54:06.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T09:54:06.069 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-02-19T09:54:07.763 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:54:07.777 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:54:07.778 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:08.340 INFO:teuthology.orchestra.run.smithi046.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:54:08.353 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/427 2024-02-19T09:54:08.353 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/427 2024-02-19T09:54:08.353 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:54:08.365 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:08.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:54:08.398 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-02-19T09:54:08.977 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:54:08.993 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:54:08.993 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:09.539 INFO:teuthology.orchestra.run.smithi046.stdout:generic/428 0s 2024-02-19T09:54:09.562 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/428 2024-02-19T09:54:09.562 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:54:09.574 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:09.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:54:09.609 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-02-19T09:54:10.148 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:54:10.160 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:54:10.160 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:10.796 INFO:teuthology.orchestra.run.smithi046.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:54:10.811 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/429 2024-02-19T09:54:10.811 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/429 2024-02-19T09:54:10.811 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:54:10.825 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:10.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:54:10.859 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-02-19T09:54:11.420 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:54:11.432 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:54:11.432 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:12.257 INFO:teuthology.orchestra.run.smithi046.stdout:generic/430 1s 2024-02-19T09:54:12.278 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/430 2024-02-19T09:54:12.278 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:54:12.288 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:12.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:54:12.323 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-02-19T09:54:13.026 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:54:13.037 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:54:13.037 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:13.829 INFO:teuthology.orchestra.run.smithi046.stdout:generic/431 0s 2024-02-19T09:54:13.846 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/431 2024-02-19T09:54:13.846 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:54:13.855 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:13.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:54:13.886 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-02-19T09:54:14.570 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:54:14.581 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:54:14.581 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:15.473 INFO:teuthology.orchestra.run.smithi046.stdout:generic/432 1s 2024-02-19T09:54:15.491 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/432 2024-02-19T09:54:15.491 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:54:15.499 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:15.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:54:15.532 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-02-19T09:54:16.220 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:54:16.231 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:54:16.231 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:16.949 INFO:teuthology.orchestra.run.smithi046.stdout:generic/433 0s 2024-02-19T09:54:16.965 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/433 2024-02-19T09:54:16.965 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:54:16.974 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:17.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:54:17.008 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-02-19T09:54:17.701 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:54:17.713 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:54:17.713 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:18.451 INFO:teuthology.orchestra.run.smithi046.stdout:generic/434 - output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/434.out.bad) 2024-02-19T09:54:18.459 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/434.out 2024-02-19 06:59:28.024910241 +0000 2024-02-19T09:54:18.459 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/434.out.bad 2024-02-19 09:54:18.445675047 +0000 2024-02-19T09:54:18.459 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -9,6 +9,6 @@ 2024-02-19T09:54:18.459 INFO:teuthology.orchestra.run.smithi046.stdout: copy_range: Bad file descriptor 2024-02-19T09:54:18.459 INFO:teuthology.orchestra.run.smithi046.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2024-02-19T09:54:18.459 INFO:teuthology.orchestra.run.smithi046.stdout: Try to copy to a device 2024-02-19T09:54:18.459 INFO:teuthology.orchestra.run.smithi046.stdout: -copy_range: Invalid argument 2024-02-19T09:54:18.459 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.03skzeLSgitest/test-434/dev1: Permission denied 2024-02-19T09:54:18.459 INFO:teuthology.orchestra.run.smithi046.stdout: Try to copy to a fifo 2024-02-19T09:54:18.459 INFO:teuthology.orchestra.run.smithi046.stdout: copy_range: Invalid argument 2024-02-19T09:54:18.467 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/434 2024-02-19T09:54:18.467 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/434 2024-02-19T09:54:18.467 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T09:54:18.477 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:18.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T09:54:18.519 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T09:54:18.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T09:54:18.519 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-02-19T09:54:19.200 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:54:19.211 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:54:19.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:19.744 INFO:teuthology.orchestra.run.smithi046.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:54:19.757 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/435 2024-02-19T09:54:19.757 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/435 2024-02-19T09:54:19.757 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:54:19.767 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:19.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:54:19.800 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-02-19T09:54:20.393 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:54:20.405 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:54:20.405 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:21.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:54:21.832 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:54:23.248 INFO:teuthology.orchestra.run.smithi046.stdout:generic/436 3s 2024-02-19T09:54:23.267 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/436 2024-02-19T09:54:23.267 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:54:23.278 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:23.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:54:23.309 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-02-19T09:54:24.034 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:54:24.048 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:54:24.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:25.466 INFO:teuthology.orchestra.run.smithi046.stdout:generic/437 1s 2024-02-19T09:54:25.485 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/437 2024-02-19T09:54:25.485 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:54:25.496 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:25.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:54:25.530 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-02-19T09:54:26.102 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:54:26.116 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:54:26.116 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:54:52.011 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:54:52.019 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:55:22.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:55:22.183 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:55:52.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:55:52.324 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:56:22.460 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:56:22.466 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:56:52.606 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:56:52.613 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:57:22.762 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:57:22.769 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:57:42.451 INFO:teuthology.orchestra.run.smithi046.stdout:generic/438 196s 2024-02-19T09:57:42.470 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/438 2024-02-19T09:57:42.470 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:57:42.479 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:42.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:57:42.508 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-02-19T09:57:43.076 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:57:43.091 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:57:43.091 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:43.539 INFO:teuthology.orchestra.run.smithi046.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:57:43.550 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/439 2024-02-19T09:57:43.550 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/439 2024-02-19T09:57:43.550 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:57:43.558 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:43.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:57:43.585 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-02-19T09:57:44.172 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:57:44.186 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:57:44.186 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:45.879 INFO:teuthology.orchestra.run.smithi046.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:57:45.892 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/440 2024-02-19T09:57:45.892 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/440 2024-02-19T09:57:45.892 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:57:45.902 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:45.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:57:45.936 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-02-19T09:57:46.460 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:57:46.472 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:57:46.472 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:46.979 INFO:teuthology.orchestra.run.smithi046.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:57:46.992 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/441 2024-02-19T09:57:46.992 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/441 2024-02-19T09:57:46.992 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:57:47.003 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:47.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:57:47.035 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-02-19T09:57:47.603 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:57:47.617 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:57:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:48.120 INFO:teuthology.orchestra.run.smithi046.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:57:48.132 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/442 2024-02-19T09:57:48.132 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/442 2024-02-19T09:57:48.132 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:57:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:48.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:57:48.171 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-02-19T09:57:48.753 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:57:48.766 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:57:48.766 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:49.317 INFO:teuthology.orchestra.run.smithi046.stdout:generic/443 1s 2024-02-19T09:57:49.336 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/443 2024-02-19T09:57:49.336 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:57:49.346 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:49.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:57:49.380 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-02-19T09:57:49.950 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:57:49.965 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:57:49.965 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:50.734 INFO:teuthology.orchestra.run.smithi046.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-02-19T09:57:50.750 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/444 2024-02-19T09:57:50.750 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/444 2024-02-19T09:57:50.750 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:57:50.765 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:50.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:57:50.835 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-02-19T09:57:51.412 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:57:51.425 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:57:51.425 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:52.910 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:57:52.919 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:57:53.996 INFO:teuthology.orchestra.run.smithi046.stdout:generic/445 2s 2024-02-19T09:57:54.015 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/445 2024-02-19T09:57:54.015 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:57:54.022 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:54.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:57:54.048 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-02-19T09:57:54.751 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:57:54.764 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:57:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:55.164 INFO:teuthology.orchestra.run.smithi046.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:57:55.175 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/446 2024-02-19T09:57:55.175 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/446 2024-02-19T09:57:55.175 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:57:55.184 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:55.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:57:55.217 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-02-19T09:57:55.761 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:57:55.775 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:57:55.775 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:56.231 INFO:teuthology.orchestra.run.smithi046.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:57:56.245 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/447 2024-02-19T09:57:56.245 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/447 2024-02-19T09:57:56.245 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:57:56.256 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:56.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:57:56.292 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-02-19T09:57:56.872 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:57:56.888 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:57:56.888 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:59.579 INFO:teuthology.orchestra.run.smithi046.stdout:generic/448 3s 2024-02-19T09:57:59.602 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/448 2024-02-19T09:57:59.602 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:57:59.615 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:57:59.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:57:59.684 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-02-19T09:58:00.371 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:00.384 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:00.384 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:00.765 INFO:teuthology.orchestra.run.smithi046.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:00.776 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/449 2024-02-19T09:58:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/449 2024-02-19T09:58:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:00.786 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:00.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:00.820 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-02-19T09:58:01.397 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:01.413 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:01.414 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:05.265 INFO:teuthology.orchestra.run.smithi046.stdout:generic/450 4s 2024-02-19T09:58:05.284 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/450 2024-02-19T09:58:05.284 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:05.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:05.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:05.327 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-02-19T09:58:06.053 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:06.066 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:06.066 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:06.842 INFO:teuthology.orchestra.run.smithi046.stdout:generic/451 - output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/451.out.bad) 2024-02-19T09:58:06.850 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/451.out 2024-02-19 06:59:28.027910207 +0000 2024-02-19T09:58:06.850 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/451.out.bad 2024-02-19 09:58:06.837060160 +0000 2024-02-19T09:58:06.850 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,2 +1,5 @@ 2024-02-19T09:58:06.850 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 451 2024-02-19T09:58:06.850 INFO:teuthology.orchestra.run.smithi046.stdout: +get stale data from buffer read 2024-02-19T09:58:06.850 INFO:teuthology.orchestra.run.smithi046.stdout: +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2024-02-19T09:58:06.850 INFO:teuthology.orchestra.run.smithi046.stdout: +000a0000 2024-02-19T09:58:06.850 INFO:teuthology.orchestra.run.smithi046.stdout: Silence is golden 2024-02-19T09:58:06.857 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/451 2024-02-19T09:58:06.857 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/451 2024-02-19T09:58:06.857 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T09:58:06.866 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:06.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T09:58:06.895 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T09:58:06.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T09:58:06.895 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-02-19T09:58:07.685 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:07.711 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:07.711 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:08.023 INFO:teuthology.orchestra.run.smithi046.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:08.034 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/452 2024-02-19T09:58:08.034 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/452 2024-02-19T09:58:08.034 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:08.043 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:08.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:08.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-02-19T09:58:08.662 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:08.674 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:08.674 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:09.078 INFO:teuthology.orchestra.run.smithi046.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:09.092 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/453 2024-02-19T09:58:09.092 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/453 2024-02-19T09:58:09.093 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:09.105 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:09.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:09.136 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-02-19T09:58:09.714 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:09.728 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:09.728 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:10.154 INFO:teuthology.orchestra.run.smithi046.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:10.166 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/454 2024-02-19T09:58:10.166 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/454 2024-02-19T09:58:10.166 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:10.175 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:10.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:10.205 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-02-19T09:58:10.785 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:10.800 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:10.800 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:11.422 INFO:teuthology.orchestra.run.smithi046.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:11.437 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/455 2024-02-19T09:58:11.437 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/455 2024-02-19T09:58:11.437 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:11.450 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:11.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:11.483 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-02-19T09:58:12.058 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:12.074 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:12.074 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:12.579 INFO:teuthology.orchestra.run.smithi046.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:12.592 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/456 2024-02-19T09:58:12.592 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/456 2024-02-19T09:58:12.593 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:12.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:12.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:12.636 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-02-19T09:58:13.212 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:13.228 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:13.228 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:13.829 INFO:teuthology.orchestra.run.smithi046.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:13.841 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/457 2024-02-19T09:58:13.841 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/457 2024-02-19T09:58:13.842 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:13.851 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:13.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:13.883 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-02-19T09:58:14.466 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:14.481 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:14.481 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:14.924 INFO:teuthology.orchestra.run.smithi046.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:14.936 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/458 2024-02-19T09:58:14.936 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/458 2024-02-19T09:58:14.936 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:14.946 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:14.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:14.981 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-02-19T09:58:15.577 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:15.592 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:15.592 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:16.246 INFO:teuthology.orchestra.run.smithi046.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:16.260 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/459 2024-02-19T09:58:16.261 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/459 2024-02-19T09:58:16.261 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:16.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:16.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:16.307 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-02-19T09:58:16.923 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:16.937 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:16.937 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:17.370 INFO:teuthology.orchestra.run.smithi046.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:17.383 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/460 2024-02-19T09:58:17.383 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/460 2024-02-19T09:58:17.383 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:17.393 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:17.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:17.426 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-02-19T09:58:18.001 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:18.014 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:18.015 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:18.491 INFO:teuthology.orchestra.run.smithi046.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:18.506 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/461 2024-02-19T09:58:18.506 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/461 2024-02-19T09:58:18.506 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:18.518 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:18.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:18.558 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-02-19T09:58:19.171 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:19.184 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:19.184 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:19.665 INFO:teuthology.orchestra.run.smithi046.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:19.680 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/462 2024-02-19T09:58:19.680 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/462 2024-02-19T09:58:19.680 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:19.694 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:19.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:19.729 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-02-19T09:58:20.286 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:20.299 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:20.299 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:20.928 INFO:teuthology.orchestra.run.smithi046.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T09:58:20.944 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/463 2024-02-19T09:58:20.944 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/463 2024-02-19T09:58:20.944 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:20.956 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:20.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:20.998 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-02-19T09:58:21.700 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:21.711 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:21.711 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:22.191 INFO:teuthology.orchestra.run.smithi046.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:22.203 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/464 2024-02-19T09:58:22.203 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/464 2024-02-19T09:58:22.203 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:22.212 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:22.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:22.243 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-02-19T09:58:22.799 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:22.813 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:22.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:23.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:58:23.136 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:58:51.335 INFO:teuthology.orchestra.run.smithi046.stdout:generic/465 29s 2024-02-19T09:58:51.379 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/465 2024-02-19T09:58:51.379 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:51.393 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:51.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:51.442 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-02-19T09:58:52.077 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:52.090 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:52.090 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:52.535 INFO:teuthology.orchestra.run.smithi046.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:58:52.551 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/466 2024-02-19T09:58:52.551 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/466 2024-02-19T09:58:52.551 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:58:52.563 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:52.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:58:52.602 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-02-19T09:58:53.240 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:58:53.253 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:58:53.253 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:58:53.342 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:58:53.348 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:59:02.226 INFO:teuthology.orchestra.run.smithi046.stdout:generic/467 - output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/467.out.bad) 2024-02-19T09:59:02.247 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/467.out 2024-02-19 06:59:28.030910173 +0000 2024-02-19T09:59:02.247 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/467.out.bad 2024-02-19 09:59:02.192437350 +0000 2024-02-19T09:59:02.247 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,5 +1,15 @@ 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 467 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/467-dir -dp 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/467-dir/file000000) opened an unlinked file! 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/467-dir/file000001) opened an unlinked file! 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/467-dir/file000002) opened an unlinked file! 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/467-dir/file000003) opened an unlinked file! 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/467-dir/file000004) opened an unlinked file! 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/467-dir/file000005) opened an unlinked file! 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/467-dir/file000006) opened an unlinked file! 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/467-dir/file000007) opened an unlinked file! 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/467-dir/file000008) opened an unlinked file! 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.03skzeLSgitest/467-dir/file000009) opened an unlinked file! 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/467-dir -rp 2024-02-19T09:59:02.248 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/467-dir -dkr 2024-02-19T09:59:02.249 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/467-dir -lr 2024-02-19T09:59:02.276 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/467 2024-02-19T09:59:02.276 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/467 2024-02-19T09:59:02.276 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T09:59:02.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:59:02.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T09:59:02.471 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T09:59:02.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T09:59:02.471 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-02-19T09:59:04.156 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:59:04.173 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:59:04.173 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:59:04.738 INFO:teuthology.orchestra.run.smithi046.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:59:04.751 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/468 2024-02-19T09:59:04.752 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/468 2024-02-19T09:59:04.752 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:59:04.764 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:59:04.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:59:04.793 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-02-19T09:59:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:59:05.402 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:59:05.402 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:59:12.711 INFO:teuthology.orchestra.run.smithi046.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-19T09:59:12.724 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/469 2024-02-19T09:59:12.724 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/469 2024-02-19T09:59:12.724 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:59:12.737 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:59:12.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:59:12.771 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-02-19T09:59:13.514 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:59:13.528 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:59:13.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:59:14.006 INFO:teuthology.orchestra.run.smithi046.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T09:59:14.021 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/470 2024-02-19T09:59:14.021 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/470 2024-02-19T09:59:14.022 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T09:59:14.034 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:59:14.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T09:59:14.069 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-02-19T09:59:14.660 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T09:59:14.675 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T09:59:14.675 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T09:59:24.375 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:59:24.386 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:59:54.572 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T09:59:54.582 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:00:24.723 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:00:24.734 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:00:54.938 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:00:54.947 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:01:25.158 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:01:25.174 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:01:31.790 INFO:teuthology.orchestra.run.smithi046.stdout:generic/471 137s 2024-02-19T10:01:31.826 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/471 2024-02-19T10:01:31.826 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:01:31.844 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:31.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:01:31.887 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-02-19T10:01:32.933 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:01:32.960 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:01:32.960 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:33.292 INFO:teuthology.orchestra.run.smithi046.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:01:33.305 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/472 2024-02-19T10:01:33.305 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/472 2024-02-19T10:01:33.305 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:01:33.316 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:33.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:01:33.346 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-02-19T10:01:33.913 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:01:33.928 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:01:33.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:34.654 INFO:teuthology.orchestra.run.smithi046.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-19T10:01:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/473 2024-02-19T10:01:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/473 2024-02-19T10:01:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:01:34.679 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:34.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:01:34.715 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-02-19T10:01:35.290 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:01:35.303 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:01:35.303 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:35.742 INFO:teuthology.orchestra.run.smithi046.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:01:35.756 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/474 2024-02-19T10:01:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/474 2024-02-19T10:01:35.757 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:01:35.771 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:35.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:01:35.807 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-02-19T10:01:36.403 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:01:36.416 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:01:36.416 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:36.966 INFO:teuthology.orchestra.run.smithi046.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:01:36.979 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/475 2024-02-19T10:01:36.979 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/475 2024-02-19T10:01:36.979 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:01:36.989 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:37.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:01:37.020 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-02-19T10:01:37.588 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:01:37.604 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:01:37.604 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:38.090 INFO:teuthology.orchestra.run.smithi046.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:01:38.101 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/476 2024-02-19T10:01:38.101 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/476 2024-02-19T10:01:38.101 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:01:38.110 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:38.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:01:38.140 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-02-19T10:01:38.738 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:01:38.753 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:01:38.753 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:52.826 INFO:teuthology.orchestra.run.smithi046.stdout:generic/477 14s 2024-02-19T10:01:52.981 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/477 2024-02-19T10:01:52.981 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:01:52.994 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:53.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:01:53.110 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-02-19T10:01:55.280 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:01:55.294 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:01:55.295 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:01:55.371 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:01:55.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:02:07.537 INFO:teuthology.orchestra.run.smithi046.stdout:generic/478 - output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/478.out.bad) 2024-02-19T10:02:07.548 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/478.out 2024-02-19 06:59:28.032910150 +0000 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/478.out.bad 2024-02-19 10:02:07.527359340 +0000 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -10,7 +10,7 @@ 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: get wrlck 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: -lock could be placed 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: +get wrlck 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -25,7 +25,7 @@ 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: get wrlck 2024-02-19T10:02:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: -lock could be placed 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: +get wrlck 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -37,7 +37,7 @@ 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: get rdlck 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: get rdlck 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: -lock could be placed 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: +get rdlck 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: get rdlck 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: get rdlck 2024-02-19T10:02:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -46,7 +46,7 @@ 2024-02-19T10:02:07.551 INFO:teuthology.orchestra.run.smithi046.stdout: get rdlck 2024-02-19T10:02:07.551 INFO:teuthology.orchestra.run.smithi046.stdout: get rdlck 2024-02-19T10:02:07.551 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.551 INFO:teuthology.orchestra.run.smithi046.stdout: -lock could be placed 2024-02-19T10:02:07.551 INFO:teuthology.orchestra.run.smithi046.stdout: +get rdlck 2024-02-19T10:02:07.551 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.551 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.551 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2024-02-19T10:02:07.558 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/478 2024-02-19T10:02:07.558 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/478 2024-02-19T10:02:07.558 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T10:02:07.568 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:07.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T10:02:07.601 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T10:02:07.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T10:02:07.601 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-02-19T10:02:08.177 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:08.190 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:08.190 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:08.774 INFO:teuthology.orchestra.run.smithi046.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:08.790 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/479 2024-02-19T10:02:08.790 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/479 2024-02-19T10:02:08.790 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:08.802 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:08.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:08.841 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-02-19T10:02:09.432 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:09.447 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:09.447 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:09.983 INFO:teuthology.orchestra.run.smithi046.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:09.998 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/480 2024-02-19T10:02:09.998 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/480 2024-02-19T10:02:09.998 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:10.011 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:10.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:10.043 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-02-19T10:02:10.581 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:10.594 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:10.594 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:11.104 INFO:teuthology.orchestra.run.smithi046.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:11.117 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/481 2024-02-19T10:02:11.118 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/481 2024-02-19T10:02:11.118 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:11.129 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:11.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:11.166 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-02-19T10:02:11.738 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:11.751 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:11.751 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:12.377 INFO:teuthology.orchestra.run.smithi046.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:12.392 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/482 2024-02-19T10:02:12.392 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/482 2024-02-19T10:02:12.393 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:12.403 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:12.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:12.435 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-02-19T10:02:13.000 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:13.012 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:13.013 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:13.481 INFO:teuthology.orchestra.run.smithi046.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:13.494 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/483 2024-02-19T10:02:13.494 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/483 2024-02-19T10:02:13.495 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:13.504 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:13.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:13.536 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-02-19T10:02:14.096 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:14.107 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:14.107 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:14.560 INFO:teuthology.orchestra.run.smithi046.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:14.575 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/484 2024-02-19T10:02:14.575 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/484 2024-02-19T10:02:14.575 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:14.587 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:14.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:14.620 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-02-19T10:02:15.202 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:15.214 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:15.215 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:19.539 INFO:teuthology.orchestra.run.smithi046.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-02-19T10:02:19.553 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/485 2024-02-19T10:02:19.554 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/485 2024-02-19T10:02:19.554 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:19.565 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:19.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:19.600 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-02-19T10:02:20.291 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:20.302 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:20.302 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:20.805 INFO:teuthology.orchestra.run.smithi046.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:20.820 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/486 2024-02-19T10:02:20.820 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/486 2024-02-19T10:02:20.821 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:20.832 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:20.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:20.870 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-02-19T10:02:21.447 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:21.461 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:21.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:21.966 INFO:teuthology.orchestra.run.smithi046.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/487 2024-02-19T10:02:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/487 2024-02-19T10:02:21.978 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:21.988 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:22.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:22.020 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-02-19T10:02:22.569 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:22.585 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:22.585 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:23.080 INFO:teuthology.orchestra.run.smithi046.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:23.096 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/488 2024-02-19T10:02:23.096 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/488 2024-02-19T10:02:23.096 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:23.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:23.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:23.145 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-02-19T10:02:23.710 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:23.725 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:23.725 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:24.195 INFO:teuthology.orchestra.run.smithi046.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:24.208 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/489 2024-02-19T10:02:24.208 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/489 2024-02-19T10:02:24.208 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:24.218 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:24.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:24.251 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-02-19T10:02:24.819 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:24.831 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:24.831 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:25.696 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:02:25.706 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:02:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:generic/490 3s 2024-02-19T10:02:27.506 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/490 2024-02-19T10:02:27.506 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:27.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:27.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:27.548 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-02-19T10:02:28.270 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:28.282 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:28.282 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:28.710 INFO:teuthology.orchestra.run.smithi046.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:28.723 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/491 2024-02-19T10:02:28.723 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/491 2024-02-19T10:02:28.723 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:28.732 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:28.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:28.765 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-02-19T10:02:29.343 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:29.357 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:29.357 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:29.800 INFO:teuthology.orchestra.run.smithi046.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:29.811 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/492 2024-02-19T10:02:29.811 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/492 2024-02-19T10:02:29.811 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:29.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:29.851 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-02-19T10:02:30.421 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:30.436 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:30.870 INFO:teuthology.orchestra.run.smithi046.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:30.883 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/493 2024-02-19T10:02:30.883 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/493 2024-02-19T10:02:30.884 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:30.894 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:30.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:30.926 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-02-19T10:02:31.525 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:31.542 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:31.542 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:31.986 INFO:teuthology.orchestra.run.smithi046.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:31.998 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/494 2024-02-19T10:02:31.998 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/494 2024-02-19T10:02:31.998 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:32.007 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:32.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:32.041 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-02-19T10:02:32.623 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:32.635 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:32.635 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:33.065 INFO:teuthology.orchestra.run.smithi046.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:33.078 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/495 2024-02-19T10:02:33.078 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/495 2024-02-19T10:02:33.078 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:33.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:33.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:33.124 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-02-19T10:02:33.709 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:33.722 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:33.722 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:34.185 INFO:teuthology.orchestra.run.smithi046.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:34.199 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/496 2024-02-19T10:02:34.199 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/496 2024-02-19T10:02:34.200 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:34.212 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:34.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:34.250 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-02-19T10:02:34.841 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:34.854 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:34.854 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:35.317 INFO:teuthology.orchestra.run.smithi046.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:35.331 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/497 2024-02-19T10:02:35.331 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/497 2024-02-19T10:02:35.332 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:35.344 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:35.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:35.379 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-02-19T10:02:35.970 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:35.986 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:35.986 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:36.471 INFO:teuthology.orchestra.run.smithi046.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:36.483 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/498 2024-02-19T10:02:36.483 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/498 2024-02-19T10:02:36.484 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:36.493 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:36.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:36.524 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-02-19T10:02:37.083 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:37.098 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:37.098 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:37.519 INFO:teuthology.orchestra.run.smithi046.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:37.533 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/499 2024-02-19T10:02:37.533 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/499 2024-02-19T10:02:37.534 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:37.545 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:37.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:37.582 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-02-19T10:02:38.162 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:38.174 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:38.174 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:38.702 INFO:teuthology.orchestra.run.smithi046.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:38.717 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/500 2024-02-19T10:02:38.717 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/500 2024-02-19T10:02:38.717 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:38.729 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:38.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:38.761 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-02-19T10:02:39.341 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:39.354 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:39.354 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:39.835 INFO:teuthology.orchestra.run.smithi046.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:39.849 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/501 2024-02-19T10:02:39.849 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/501 2024-02-19T10:02:39.849 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:39.861 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:39.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:39.899 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-02-19T10:02:40.469 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:40.482 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:40.482 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:40.973 INFO:teuthology.orchestra.run.smithi046.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:40.987 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/502 2024-02-19T10:02:40.987 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/502 2024-02-19T10:02:40.987 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:40.997 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:41.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:41.028 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-02-19T10:02:41.615 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:41.630 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:41.630 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:42.049 INFO:teuthology.orchestra.run.smithi046.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:42.059 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/503 2024-02-19T10:02:42.059 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/503 2024-02-19T10:02:42.060 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:42.068 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:42.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:42.095 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-02-19T10:02:42.665 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:42.679 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:42.679 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:43.233 INFO:teuthology.orchestra.run.smithi046.stdout:generic/504 - output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/504.out.bad) 2024-02-19T10:02:43.241 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/504.out 2024-02-19 06:59:28.036910105 +0000 2024-02-19T10:02:43.242 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/504.out.bad 2024-02-19 10:02:43.227962559 +0000 2024-02-19T10:02:43.242 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,2 +1,3 @@ 2024-02-19T10:02:43.242 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 504 2024-02-19T10:02:43.242 INFO:teuthology.orchestra.run.smithi046.stdout: +lock info not found 2024-02-19T10:02:43.242 INFO:teuthology.orchestra.run.smithi046.stdout: Silence is golden 2024-02-19T10:02:43.250 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/504 2024-02-19T10:02:43.250 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/504 2024-02-19T10:02:43.250 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T10:02:43.259 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:43.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T10:02:43.294 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T10:02:43.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T10:02:43.294 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-02-19T10:02:43.905 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:43.918 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:44.382 INFO:teuthology.orchestra.run.smithi046.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:44.397 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/505 2024-02-19T10:02:44.397 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/505 2024-02-19T10:02:44.397 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:44.410 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:44.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:44.442 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-02-19T10:02:45.000 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:45.013 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:45.013 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:45.489 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/506 2024-02-19T10:02:45.490 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/506 2024-02-19T10:02:45.490 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:45.503 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:45.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:45.540 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-02-19T10:02:46.094 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:46.109 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:46.109 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:46.697 INFO:teuthology.orchestra.run.smithi046.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-02-19T10:02:46.711 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/507 2024-02-19T10:02:46.711 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/507 2024-02-19T10:02:46.712 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:46.724 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:46.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:46.762 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-02-19T10:02:47.344 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:47.360 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:47.842 INFO:teuthology.orchestra.run.smithi046.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2024-02-19T10:02:47.855 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/508 2024-02-19T10:02:47.855 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/508 2024-02-19T10:02:47.855 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:47.864 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:47.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:47.894 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-02-19T10:02:48.460 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:48.475 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:48.475 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:48.938 INFO:teuthology.orchestra.run.smithi046.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:48.952 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/509 2024-02-19T10:02:48.952 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/509 2024-02-19T10:02:48.952 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:48.964 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:49.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:49.005 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-02-19T10:02:49.588 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:49.603 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:49.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:50.081 INFO:teuthology.orchestra.run.smithi046.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:50.095 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/510 2024-02-19T10:02:50.095 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/510 2024-02-19T10:02:50.095 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:50.105 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:50.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:50.137 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-02-19T10:02:50.706 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:50.722 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:50.722 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:51.160 INFO:teuthology.orchestra.run.smithi046.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:51.172 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/511 2024-02-19T10:02:51.172 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/511 2024-02-19T10:02:51.173 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:51.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:51.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:51.214 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-02-19T10:02:51.798 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:51.811 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:51.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:52.270 INFO:teuthology.orchestra.run.smithi046.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:52.283 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/512 2024-02-19T10:02:52.283 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/512 2024-02-19T10:02:52.283 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:52.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:52.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:52.327 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-02-19T10:02:52.896 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:52.910 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:52.910 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:53.409 INFO:teuthology.orchestra.run.smithi046.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:53.423 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/513 2024-02-19T10:02:53.423 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/513 2024-02-19T10:02:53.424 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:53.436 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:53.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:53.469 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-02-19T10:02:54.068 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:54.083 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:54.083 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:54.538 INFO:teuthology.orchestra.run.smithi046.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:54.552 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/514 2024-02-19T10:02:54.552 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/514 2024-02-19T10:02:54.553 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:54.566 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:54.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:54.602 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-02-19T10:02:55.177 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:55.189 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:55.190 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:55.619 INFO:teuthology.orchestra.run.smithi046.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:55.631 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/515 2024-02-19T10:02:55.631 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/515 2024-02-19T10:02:55.631 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:55.642 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:55.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:55.676 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-02-19T10:02:55.838 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:02:55.844 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:02:56.213 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:56.229 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:56.229 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:56.861 INFO:teuthology.orchestra.run.smithi046.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-02-19T10:02:56.877 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/516 2024-02-19T10:02:56.877 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/516 2024-02-19T10:02:56.877 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:56.890 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:56.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:56.940 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-02-19T10:02:57.637 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:57.649 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:58.110 INFO:teuthology.orchestra.run.smithi046.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:58.123 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/517 2024-02-19T10:02:58.123 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/517 2024-02-19T10:02:58.123 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:58.135 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:58.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:58.168 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-02-19T10:02:58.726 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:58.744 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:58.744 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:59.238 INFO:teuthology.orchestra.run.smithi046.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:02:59.251 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/518 2024-02-19T10:02:59.251 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/518 2024-02-19T10:02:59.251 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:02:59.261 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:02:59.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:02:59.300 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-02-19T10:02:59.892 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:02:59.908 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:02:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:03:00.341 INFO:teuthology.orchestra.run.smithi046.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:03:00.355 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/519 2024-02-19T10:03:00.355 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/519 2024-02-19T10:03:00.356 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:03:00.369 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:03:00.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:03:00.405 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-02-19T10:03:01.026 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:03:01.040 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:03:01.040 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:03:01.507 INFO:teuthology.orchestra.run.smithi046.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T10:03:01.519 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/520 2024-02-19T10:03:01.519 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/520 2024-02-19T10:03:01.519 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T10:03:01.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:03:01.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T10:03:01.558 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-02-19T10:03:02.145 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T10:03:02.158 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T10:03:02.159 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T10:03:26.046 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:03:26.055 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:03:56.202 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:03:56.214 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:04:26.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:04:26.391 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:04:56.516 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:04:56.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:05:26.673 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:05:26.682 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:05:56.828 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:05:56.838 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:06:27.000 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:06:27.008 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:06:57.128 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:06:57.136 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:07:27.270 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:07:27.280 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:07:57.419 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:07:57.428 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:08:27.570 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:08:27.579 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:08:57.726 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:08:57.734 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:09:27.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:09:27.871 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:09:58.067 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:09:58.075 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:10:28.230 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:10:28.239 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:10:58.446 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:10:58.454 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:11:28.673 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:11:28.682 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:11:58.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:11:58.833 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:12:28.962 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:12:28.972 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:12:59.112 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:12:59.120 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:13:29.477 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:13:29.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:13:59.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:13:59.628 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:14:29.760 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:14:29.769 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:14:59.891 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:14:59.900 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:15:30.050 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:15:30.059 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:16:00.206 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:16:00.216 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:16:30.357 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:16:30.366 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:17:00.506 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:17:00.514 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:17:30.645 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:17:30.657 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:18:00.788 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:18:00.798 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:18:30.969 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:18:30.978 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:19:01.151 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:19:01.159 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:19:31.295 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:19:31.304 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:20:01.438 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:20:01.448 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:20:31.588 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:20:31.597 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:21:01.746 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:21:01.755 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:21:31.889 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:21:31.898 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:22:02.027 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:22:02.036 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:22:32.175 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:22:32.184 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:23:02.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:23:02.327 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:23:32.602 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:23:32.610 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:24:02.740 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:24:02.748 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:24:32.894 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:24:32.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:25:03.031 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:25:03.040 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:25:33.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:25:33.206 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:26:03.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:26:03.348 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:26:33.479 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:26:33.488 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:27:03.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:27:03.636 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:27:33.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:27:33.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:28:03.909 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:28:03.917 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:28:34.067 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:28:34.076 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:29:04.213 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:29:04.222 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:29:34.357 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:29:34.367 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:30:04.497 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:30:04.506 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:30:34.655 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:30:34.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:31:04.793 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:31:04.802 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:31:34.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:31:34.963 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:32:05.092 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:32:05.101 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:32:35.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:32:35.246 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:33:05.504 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:33:05.513 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:33:35.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:33:35.650 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:34:05.789 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:34:05.799 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:34:35.969 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:34:35.980 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:35:06.107 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:35:06.116 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:35:36.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:35:36.263 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:36:06.447 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:36:06.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:36:36.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:36:36.605 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:37:06.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:37:06.748 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:37:36.887 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:37:36.900 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:38:07.027 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:38:07.037 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:38:37.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:38:37.169 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:39:07.295 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:39:07.305 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:39:37.433 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:39:37.443 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:40:07.609 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:40:07.620 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:40:37.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:40:37.895 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:41:08.021 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:41:08.032 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:41:38.164 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:41:38.174 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:42:08.304 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:42:08.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:42:38.447 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:42:38.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:43:08.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:43:08.624 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:43:38.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:43:38.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:44:08.949 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:44:08.958 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:44:39.094 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:44:39.105 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:45:09.257 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:45:09.269 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:45:39.415 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:45:39.424 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:46:09.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:46:09.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:46:10.047 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-02-19T10:46:10.044+0000 7fb706c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 414654) UID: 0 2024-02-19T10:46:10.048 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-02-19T10:46:10.044+0000 7f51d5600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 414654) UID: 0 2024-02-19T10:49:00.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:49:00.908 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:49:31.041 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:49:31.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:50:01.180 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:50:01.189 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:50:31.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:50:31.326 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:51:01.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:51:01.476 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:51:31.609 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:51:31.621 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:52:01.781 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:52:01.791 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:52:31.926 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:52:31.935 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:53:02.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:53:02.079 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:53:32.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:53:32.218 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:54:02.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:54:02.355 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:54:32.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:54:32.497 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:55:02.662 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:55:02.672 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:55:32.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:55:32.825 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:56:03.389 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:56:03.398 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:56:33.539 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:56:33.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:57:03.698 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:57:03.707 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:57:33.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:57:33.857 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:58:03.993 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:58:04.003 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:58:34.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:58:34.147 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:59:04.275 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:59:04.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:59:34.423 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T10:59:34.432 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:00:04.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:00:04.574 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:00:34.706 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:00:34.714 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:01:04.858 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:01:04.868 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:01:35.005 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:01:35.013 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:02:05.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:02:05.156 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:02:05.270 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T11:02:05.269+0000 7f35abe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 82599) UID: 0 2024-02-19T11:02:05.270 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T11:02:05.269+0000 7f3c04600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 82599) UID: 0 2024-02-19T11:02:05.271 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T11:02:05.269+0000 7f7183000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 82599) UID: 0 2024-02-19T11:02:05.271 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T11:02:05.269+0000 7f99f5600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 82599) UID: 0 2024-02-19T11:04:29.820 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:04:29.831 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:04:59.969 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:04:59.978 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:05:30.117 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:05:30.126 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:06:00.265 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:06:00.273 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:06:30.397 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:06:30.406 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:07:00.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:07:00.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:07:30.705 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:07:30.714 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:08:00.825 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:08:00.835 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:08:30.998 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:08:31.008 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:09:01.153 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:09:01.162 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:09:31.296 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:09:31.305 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:10:01.429 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:10:01.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:10:31.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:10:31.587 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:11:01.717 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:11:01.727 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:11:31.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:11:31.917 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:12:02.058 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:12:02.068 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:12:32.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:12:32.206 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:13:02.335 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:13:02.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:13:32.484 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:13:32.494 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:14:02.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:14:02.637 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:14:32.819 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:14:32.829 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:15:02.961 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:15:02.970 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:15:33.113 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:15:33.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:16:03.251 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:16:03.260 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:16:33.396 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:16:33.405 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:17:03.540 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:17:03.548 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:17:33.697 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:17:33.706 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:18:03.837 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:18:03.848 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:18:34.002 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:18:34.011 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:19:04.149 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:19:04.159 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:19:34.308 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:19:34.319 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:20:04.615 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:20:04.627 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:20:34.745 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:20:34.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:21:04.895 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:21:04.905 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:21:35.065 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:21:35.074 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:22:05.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:22:05.258 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:22:35.384 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:22:35.397 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:23:05.524 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:23:05.534 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:23:35.659 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:23:35.668 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:24:05.833 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:24:05.847 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:24:35.986 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:24:35.996 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:25:06.123 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:25:06.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:25:36.262 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:25:36.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:26:06.403 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:26:06.412 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:26:36.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:26:36.545 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:27:06.684 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:27:06.693 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:27:36.849 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:27:36.859 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:28:06.989 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:28:06.998 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:28:37.129 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:28:37.138 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:29:07.279 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:29:07.287 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:29:37.419 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:29:37.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:30:07.555 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:30:07.565 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:30:37.698 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:30:37.706 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:31:07.850 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:31:07.868 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:31:37.996 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:31:38.006 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:32:08.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:32:08.144 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:32:38.275 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:32:38.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:33:08.444 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:33:08.454 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:33:38.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:33:38.591 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:34:08.731 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:34:08.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:34:38.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:34:38.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:35:09.019 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:35:09.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:35:39.151 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:35:39.160 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:36:09.290 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:36:09.299 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:36:39.454 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:36:39.463 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:37:09.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:37:09.621 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:37:39.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:37:39.762 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:38:09.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:38:09.913 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:38:40.058 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:38:40.067 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:39:10.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:39:10.207 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:39:40.340 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:39:40.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:40:10.496 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:40:10.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:40:40.645 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:40:40.656 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:41:10.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:41:10.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:41:40.943 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:41:40.952 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:41:41.054 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T11:41:41.054+0000 7f35abe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 83985) UID: 0 2024-02-19T11:41:41.055 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T11:41:41.054+0000 7f7183000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 83985) UID: 0 2024-02-19T11:41:41.055 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T11:41:41.054+0000 7f3c04600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 83985) UID: 0 2024-02-19T11:41:41.055 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T11:41:41.054+0000 7f99f5600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 83985) UID: 0 2024-02-19T11:44:13.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:44:13.406 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:44:43.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:44:43.562 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:45:13.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:45:13.722 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:45:43.957 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:45:43.968 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:46:14.217 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:46:14.227 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:46:44.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:46:44.375 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:47:14.505 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:47:14.513 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:47:44.645 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:47:44.654 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:48:14.796 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:48:14.806 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:48:44.945 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:48:44.956 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:49:15.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:49:15.131 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:49:45.490 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:49:45.500 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:50:15.636 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:50:15.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:50:45.899 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:50:45.908 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:51:16.041 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:51:16.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:51:46.182 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:51:46.191 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:52:16.349 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:52:16.359 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:52:46.502 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:52:46.514 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:53:16.809 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:53:16.819 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:53:46.992 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:53:47.007 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:54:17.153 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:54:17.161 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:54:47.315 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:54:47.326 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:55:17.460 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:55:17.468 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:55:47.733 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:55:47.741 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:56:17.887 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:56:17.897 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:56:48.031 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:56:48.041 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:57:18.189 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:57:18.200 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:57:48.347 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:57:48.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:58:18.494 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:58:18.503 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:58:48.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:58:48.640 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:59:18.790 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:59:18.801 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:59:49.031 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T11:59:49.041 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:00:19.186 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:00:19.197 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:00:49.342 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:00:49.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:01:19.486 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:01:19.496 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:01:49.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:01:49.640 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:02:19.772 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:02:19.782 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:02:49.906 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:02:49.916 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:03:20.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:03:20.079 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:03:50.229 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:03:50.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:04:20.378 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:04:20.388 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:04:50.514 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:04:50.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:05:20.652 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:05:20.662 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:05:50.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:05:50.914 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:06:21.062 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:06:21.072 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:06:51.226 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:06:51.237 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:07:21.365 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:07:21.374 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:07:51.510 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:07:51.519 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:08:21.654 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:08:21.664 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:08:51.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:08:51.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:09:21.994 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:09:22.002 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:09:52.149 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:09:52.158 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:10:22.305 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:10:22.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:10:52.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:10:52.457 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:11:22.589 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:11:22.597 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:11:52.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:11:52.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:12:23.122 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:12:23.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:12:53.474 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:12:53.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:13:23.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:13:23.631 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:13:53.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:13:53.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:14:23.913 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:14:23.923 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:14:54.050 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:14:54.060 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:15:24.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:15:24.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:15:54.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:15:54.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:16:18.664 INFO:teuthology.orchestra.run.smithi046.stdout:generic/521 7996s 2024-02-19T12:16:18.684 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/521 2024-02-19T12:16:18.684 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T12:16:18.693 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T12:16:18.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T12:16:18.730 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-02-19T12:16:19.421 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T12:16:19.433 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T12:16:19.434 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T12:16:24.487 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:16:24.497 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:16:54.630 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:16:54.640 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:17:24.768 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:17:24.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:17:54.913 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:17:54.924 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:18:25.093 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:18:25.105 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:18:55.231 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:18:55.241 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:19:25.370 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:19:25.379 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:19:55.603 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:19:55.612 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:20:25.754 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:20:25.764 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:20:55.895 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:20:55.904 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:21:26.056 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:21:26.065 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:21:56.188 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:21:56.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:22:26.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:22:26.362 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:22:56.490 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:22:56.499 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:23:26.644 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:23:26.653 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:23:56.774 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:23:56.784 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:24:26.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:24:26.914 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:24:57.069 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:24:57.080 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:25:27.213 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:25:27.222 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:25:57.370 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:25:57.379 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:26:27.516 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:26:27.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:26:57.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:26:57.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:27:27.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:27:27.928 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:27:58.062 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:27:58.070 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:28:28.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:28:28.245 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:28:58.415 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:28:58.424 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:29:28.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:29:28.562 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:29:58.693 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:29:58.706 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:30:28.834 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:30:28.843 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:30:59.128 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:30:59.137 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:31:29.265 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:31:29.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:31:59.402 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:31:59.412 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:32:29.543 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:32:29.552 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:32:59.708 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:32:59.717 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:33:29.850 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:33:29.859 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:34:00.005 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:34:00.014 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:34:30.162 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:34:30.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:35:00.297 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:35:00.306 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:35:30.454 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:35:30.463 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:36:00.610 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:36:00.618 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:36:30.739 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:36:30.748 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:37:00.930 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:37:00.942 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:37:31.080 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:37:31.090 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:38:01.237 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:38:01.247 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:38:31.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:38:31.387 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:39:01.523 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:39:01.534 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:39:31.664 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:39:31.673 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:40:01.811 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:40:01.821 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:40:31.963 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:40:31.973 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:41:02.110 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:41:02.119 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:41:32.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:41:32.246 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:42:02.382 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:42:02.391 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:42:32.522 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:42:32.533 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:43:02.679 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:43:02.692 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:43:32.832 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:43:32.844 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:44:02.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:44:03.004 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:44:33.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:44:33.143 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:45:03.355 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:45:03.364 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:45:33.506 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:45:33.516 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:46:03.646 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:46:03.656 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:46:33.796 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:46:33.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:47:03.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:47:03.942 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:47:34.083 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:47:34.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:48:04.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:48:04.254 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:48:34.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:48:34.415 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:49:04.561 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:49:04.570 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:49:34.768 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:49:34.777 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:50:04.928 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:50:04.937 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:50:35.069 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:50:35.078 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:51:05.210 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:51:05.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:51:35.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:51:35.372 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:52:05.492 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:52:05.502 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:52:35.639 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:52:35.650 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:53:05.789 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:53:05.798 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:53:35.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:53:35.941 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:54:06.078 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:54:06.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:54:36.342 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:54:36.352 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:55:06.785 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:55:06.794 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:55:36.957 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:55:36.968 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:56:07.113 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:56:07.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:56:37.263 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:56:37.272 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:57:07.466 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:57:07.476 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:57:37.617 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:57:37.631 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:58:07.774 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:58:07.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:58:38.033 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:58:38.047 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:59:08.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:59:08.203 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:59:38.335 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T12:59:38.345 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:00:08.478 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:00:08.488 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:00:38.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:00:38.651 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:01:08.780 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:01:08.793 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:01:38.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:01:38.964 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:02:09.141 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:02:09.152 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:02:39.287 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:02:39.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:03:09.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:03:09.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:03:39.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:03:39.584 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:04:09.974 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:04:09.984 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:04:40.108 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:04:40.119 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:05:10.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:05:10.265 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:05:40.420 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:05:40.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:06:10.555 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:06:10.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:06:40.703 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:06:40.714 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:07:10.858 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:07:10.868 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:07:41.013 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:07:41.023 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:08:11.162 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:08:11.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:08:41.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:08:41.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:09:11.460 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:09:11.471 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:09:41.600 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:09:41.611 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:10:11.740 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:10:11.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:10:41.917 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:10:41.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:11:12.061 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:11:12.071 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:11:42.202 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:11:42.211 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:12:12.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:12:12.354 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:12:42.476 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:12:42.488 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:13:12.613 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:13:12.623 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:13:42.766 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:13:42.777 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:14:12.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:14:12.923 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:14:43.059 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:14:43.069 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:15:13.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:15:13.217 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:15:43.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:15:43.369 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:16:13.507 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:16:13.517 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:16:43.657 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:16:43.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:17:13.795 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:17:13.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:17:43.936 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:17:43.947 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:18:14.185 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:18:14.195 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:18:44.333 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:18:44.342 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:19:14.506 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:19:14.516 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:19:44.746 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:19:44.755 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:20:14.937 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:20:14.946 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:20:45.077 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:20:45.087 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:21:15.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:21:15.225 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:21:45.366 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:21:45.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:22:15.498 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:22:15.507 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:22:45.654 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:22:45.663 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:23:15.793 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:23:15.802 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:23:45.932 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:23:45.942 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:24:16.074 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:24:16.083 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:24:46.207 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:24:46.216 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:25:16.363 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:25:16.372 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:25:46.505 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:25:46.515 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:26:16.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:26:16.666 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:26:46.795 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:26:46.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:27:16.942 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:27:16.952 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:27:47.089 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:27:47.097 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:27:47.214 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T13:27:47.213+0000 7f35abe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 87849) UID: 0 2024-02-19T13:27:47.214 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T13:27:47.213+0000 7f7183000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 87849) UID: 0 2024-02-19T13:27:47.214 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T13:27:47.213+0000 7f3c04600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 87849) UID: 0 2024-02-19T13:27:47.215 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T13:27:47.213+0000 7f99f5600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 87849) UID: 0 2024-02-19T13:30:10.255 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:30:10.267 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:30:40.407 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:30:40.417 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:31:10.564 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:31:10.573 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:31:40.711 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:31:40.720 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:32:10.849 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:32:10.859 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:32:40.980 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:32:40.989 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:33:11.127 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:33:11.138 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:33:41.289 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:33:41.298 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:34:11.444 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:34:11.456 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:34:41.591 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:34:41.600 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:35:11.739 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:35:11.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:35:41.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:35:41.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:35:42.019 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-02-19T13:35:42.018+0000 7fb706c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 421106) UID: 0 2024-02-19T13:35:42.019 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-02-19T13:35:42.018+0000 7f51d5600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 421106) UID: 0 2024-02-19T13:38:36.735 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:38:36.745 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:39:06.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:39:07.000 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:39:37.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:39:37.154 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:40:07.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:40:07.303 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:40:37.445 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:40:37.454 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:41:07.587 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:41:07.639 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:41:37.765 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:41:37.774 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:42:07.898 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:42:07.907 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:42:38.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:42:38.056 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:43:08.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:43:08.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:43:38.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:43:38.344 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:44:08.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:44:08.476 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:44:38.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:44:38.624 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:45:08.752 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:45:08.761 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:45:38.902 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:45:38.912 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:46:09.042 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:46:09.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:46:39.182 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:46:39.192 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:47:09.323 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:47:09.332 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:47:39.456 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:47:39.464 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:48:09.605 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:48:09.614 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:48:39.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:48:39.763 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:49:10.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:49:10.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:49:40.160 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:49:40.170 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:50:10.308 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:50:10.317 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:50:40.449 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:50:40.458 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:51:05.218 INFO:teuthology.orchestra.run.smithi046.stdout:generic/522 5686s 2024-02-19T13:51:05.265 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/522 2024-02-19T13:51:05.265 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:05.276 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:05.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:05.307 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-02-19T13:51:06.148 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:06.161 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:06.161 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:06.679 INFO:teuthology.orchestra.run.smithi046.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T13:51:06.693 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/523 2024-02-19T13:51:06.693 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/523 2024-02-19T13:51:06.694 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:06.706 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:06.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:06.743 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-02-19T13:51:07.321 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:07.335 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:07.335 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:07.751 INFO:teuthology.orchestra.run.smithi046.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T13:51:07.765 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/524 2024-02-19T13:51:07.765 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/524 2024-02-19T13:51:07.765 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:07.776 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:07.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:07.805 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-02-19T13:51:08.386 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:08.401 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:08.401 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:08.836 INFO:teuthology.orchestra.run.smithi046.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T13:51:08.850 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/525 2024-02-19T13:51:08.850 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/525 2024-02-19T13:51:08.850 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:08.862 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:08.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:08.896 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-02-19T13:51:09.488 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:09.502 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:09.502 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:09.985 INFO:teuthology.orchestra.run.smithi046.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T13:51:10.000 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/526 2024-02-19T13:51:10.000 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/526 2024-02-19T13:51:10.000 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:10.013 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:10.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:10.049 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-02-19T13:51:10.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:51:10.608 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:51:10.692 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:10.704 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:10.704 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:11.182 INFO:teuthology.orchestra.run.smithi046.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T13:51:11.198 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/527 2024-02-19T13:51:11.198 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/527 2024-02-19T13:51:11.198 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:11.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:11.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:11.248 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-02-19T13:51:11.838 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:11.850 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:11.850 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:12.396 INFO:teuthology.orchestra.run.smithi046.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2024-02-19T13:51:12.411 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/528 2024-02-19T13:51:12.411 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/528 2024-02-19T13:51:12.411 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:12.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:12.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:12.454 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-02-19T13:51:13.052 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:13.068 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:13.068 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:13.553 INFO:teuthology.orchestra.run.smithi046.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-02-19T13:51:13.566 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/529 2024-02-19T13:51:13.566 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/529 2024-02-19T13:51:13.566 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:13.577 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:13.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:13.608 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-02-19T13:51:14.199 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:14.215 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:14.215 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:14.667 INFO:teuthology.orchestra.run.smithi046.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T13:51:14.679 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/530 2024-02-19T13:51:14.679 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/530 2024-02-19T13:51:14.679 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:14.688 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:14.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:14.719 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-02-19T13:51:15.309 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:15.325 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:15.786 INFO:teuthology.orchestra.run.smithi046.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T13:51:15.798 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/531 2024-02-19T13:51:15.798 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/531 2024-02-19T13:51:15.798 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:15.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:15.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:15.837 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-02-19T13:51:16.406 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:16.421 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:16.421 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:16.968 INFO:teuthology.orchestra.run.smithi046.stdout:generic/532 0s 2024-02-19T13:51:16.985 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/532 2024-02-19T13:51:16.985 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:16.993 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:17.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:17.023 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-02-19T13:51:17.584 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:17.596 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:17.596 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:18.600 INFO:teuthology.orchestra.run.smithi046.stdout:generic/533 1s 2024-02-19T13:51:18.615 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/533 2024-02-19T13:51:18.615 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:18.623 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:18.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:18.649 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-02-19T13:51:19.225 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:19.241 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:19.241 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:19.723 INFO:teuthology.orchestra.run.smithi046.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T13:51:19.736 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/534 2024-02-19T13:51:19.736 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/534 2024-02-19T13:51:19.736 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:19.748 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:19.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:19.782 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-02-19T13:51:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:20.375 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:20.375 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:20.837 INFO:teuthology.orchestra.run.smithi046.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T13:51:20.852 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/535 2024-02-19T13:51:20.852 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/535 2024-02-19T13:51:20.853 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:20.864 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:20.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:20.896 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-02-19T13:51:21.513 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:21.530 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:21.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:22.002 INFO:teuthology.orchestra.run.smithi046.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T13:51:22.015 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/536 2024-02-19T13:51:22.015 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/536 2024-02-19T13:51:22.015 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:22.025 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:22.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:22.057 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-02-19T13:51:22.629 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:22.644 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:22.644 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:23.119 INFO:teuthology.orchestra.run.smithi046.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T13:51:23.136 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/537 2024-02-19T13:51:23.136 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/537 2024-02-19T13:51:23.136 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T13:51:23.148 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:23.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T13:51:23.181 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-02-19T13:51:23.735 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T13:51:23.749 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T13:51:23.750 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T13:51:40.735 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:51:40.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:52:10.967 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:52:10.976 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:52:41.153 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:52:41.162 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:53:11.311 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:53:11.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:53:41.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:53:41.463 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:54:11.609 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:54:11.619 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:54:41.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:54:41.822 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:55:11.986 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:55:11.996 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:55:42.125 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:55:42.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:56:12.296 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:56:12.305 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:56:42.495 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:56:42.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:57:12.642 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:57:12.652 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:57:42.855 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:57:42.864 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:58:13.043 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:58:13.053 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:58:43.207 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:58:43.216 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:59:13.369 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:59:13.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:59:43.517 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T13:59:43.530 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:00:13.665 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:00:13.674 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:00:44.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:00:44.207 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:01:14.340 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:01:14.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:01:44.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:01:44.499 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:02:14.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:02:14.636 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:02:44.831 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:02:44.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:03:14.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:03:14.993 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:03:45.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:03:45.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:04:15.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:04:15.345 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:04:45.569 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:04:45.579 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:05:15.774 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:05:15.784 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:05:45.978 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:05:45.987 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:06:16.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:06:16.217 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:06:46.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:06:46.355 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:07:16.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:07:16.531 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:07:46.674 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:07:46.684 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:08:16.944 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:08:16.956 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:08:47.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:08:47.097 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:09:17.243 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:09:17.270 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:09:47.402 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:09:47.412 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:10:17.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:10:17.564 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:10:47.711 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:10:47.720 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:10:47.836 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T14:10:47.834+0000 7f8a09200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 430491) UID: 0 2024-02-19T14:10:47.837 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-02-19T14:10:47.834+0000 7f3514600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 430491) UID: 0 2024-02-19T14:10:47.837 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-02-19T14:10:47.834+0000 7f5e66400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 430491) UID: 0 2024-02-19T14:10:47.837 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T14:10:47.834+0000 7fc963e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 430491) UID: 0 2024-02-19T14:13:25.139 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:13:25.148 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:13:55.324 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:13:55.334 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:14:25.479 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:14:25.488 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:14:55.635 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:14:55.645 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:15:25.780 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:15:25.789 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:15:55.951 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:15:55.961 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:16:26.164 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:16:26.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:16:56.311 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:16:56.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:17:26.449 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:17:26.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:17:56.664 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:17:56.673 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:18:26.901 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:18:26.910 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:18:57.049 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:18:57.058 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:19:27.246 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:19:27.255 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:19:57.395 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:19:57.406 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:20:27.546 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:20:27.555 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:20:57.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:20:57.695 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:21:27.857 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:21:27.866 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:21:57.997 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:21:58.006 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:22:28.251 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:22:28.260 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:22:58.421 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:22:58.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:23:28.569 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:23:28.578 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:23:58.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:23:58.725 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:24:28.937 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:24:28.952 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:24:59.075 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:24:59.084 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:25:29.289 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:25:29.298 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:25:59.443 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:25:59.451 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:26:29.586 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:26:29.595 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:26:59.719 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:26:59.730 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:27:29.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:27:29.873 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:28:00.006 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:28:00.015 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:28:30.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:28:30.252 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:29:00.397 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:29:00.406 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:29:30.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:29:30.546 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:30:00.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:30:00.700 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:30:30.828 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:30:30.838 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:31:00.988 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:31:00.996 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:31:31.141 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:31:31.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:32:01.355 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:32:01.363 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:32:31.525 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:32:31.534 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:33:01.673 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:33:01.682 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:33:31.830 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:33:31.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:34:01.965 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:34:01.975 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:34:32.138 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:34:32.147 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:35:02.342 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:35:02.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:35:32.564 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:35:32.576 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:36:02.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:36:02.724 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:36:32.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:36:32.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:37:02.996 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:37:03.005 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:37:33.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:37:33.171 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:38:03.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:38:03.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:38:33.462 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:38:33.470 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:39:03.606 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:39:03.615 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:39:33.763 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:39:33.772 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:40:03.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:40:03.920 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:40:34.073 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:40:34.082 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:41:04.209 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:41:04.218 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:41:34.348 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:41:34.357 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:42:04.478 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:42:04.498 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:42:34.639 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:42:34.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:43:04.781 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:43:04.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:43:34.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:43:34.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:44:05.067 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:44:05.076 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:44:35.324 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:44:35.334 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:45:05.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:45:05.476 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:45:35.604 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:45:35.616 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:46:05.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:46:05.760 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:46:35.889 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:46:35.899 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:47:06.136 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:47:06.146 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:47:36.290 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:47:36.299 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:48:06.472 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:48:06.482 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:48:06.597 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T14:48:06.594+0000 7f35abe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 90568) UID: 0 2024-02-19T14:48:06.598 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T14:48:06.594+0000 7f7183000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 90568) UID: 0 2024-02-19T14:48:06.598 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T14:48:06.594+0000 7f3c04600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 90568) UID: 0 2024-02-19T14:48:06.599 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T14:48:06.594+0000 7f99f5600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 90568) UID: 0 2024-02-19T14:50:26.699 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:50:26.711 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:50:56.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:50:56.902 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:51:27.033 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:51:27.042 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:51:57.193 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:51:57.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:52:27.358 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:52:27.367 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:52:57.506 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:52:57.517 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:53:27.646 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:53:27.656 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:53:57.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:53:57.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:54:27.934 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:54:27.942 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:54:58.082 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:54:58.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:55:28.256 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:55:28.266 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:55:58.392 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:55:58.401 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:56:28.539 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:56:28.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:56:58.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:56:58.686 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:57:28.826 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:57:28.835 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:57:59.013 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:57:59.022 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:58:29.168 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:58:29.176 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:58:59.331 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:58:59.340 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:59:29.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:59:29.631 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:59:59.766 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T14:59:59.777 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:00:29.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:00:29.912 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:01:00.042 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:01:00.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:01:30.188 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:01:30.197 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:02:00.362 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:02:00.372 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:02:00.478 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T15:02:00.475+0000 7f99f5600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 91027) UID: 0 2024-02-19T15:02:00.479 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T15:02:00.475+0000 7f35abe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 91027) UID: 0 2024-02-19T15:02:00.479 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T15:02:00.475+0000 7f3c04600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 91027) UID: 0 2024-02-19T15:02:00.479 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T15:02:00.475+0000 7f7183000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 91027) UID: 0 2024-02-19T15:04:23.361 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:04:23.371 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:04:53.511 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:04:53.520 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:05:23.650 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:05:23.658 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:05:53.790 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:05:53.802 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:06:23.936 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:06:23.945 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:06:54.084 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:06:54.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:07:24.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:07:24.247 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:07:54.378 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:07:54.387 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:08:24.523 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:08:24.532 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:08:54.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:08:54.679 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:09:24.825 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:09:24.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:09:55.021 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:09:55.030 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:10:25.170 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:10:25.180 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:10:55.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:10:55.325 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:11:25.454 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:11:25.463 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:11:55.602 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:11:55.612 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:12:25.755 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:12:25.765 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:12:55.914 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:12:55.923 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:13:26.078 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:13:26.089 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:13:56.219 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:13:56.228 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:14:26.349 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:14:26.358 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:14:56.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:14:56.560 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:15:26.778 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:15:26.787 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:15:56.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:15:56.940 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:16:27.079 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:16:27.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:16:57.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:16:57.237 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:16:57.349 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-02-19T15:16:57.347+0000 7f5e66400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436574) UID: 0 2024-02-19T15:16:57.350 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T15:16:57.347+0000 7fc963e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436574) UID: 0 2024-02-19T15:16:57.350 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T15:16:57.347+0000 7f8a09200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436574) UID: 0 2024-02-19T15:16:57.350 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-02-19T15:16:57.347+0000 7f3514600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436574) UID: 0 2024-02-19T15:19:37.386 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:19:37.395 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:20:07.535 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:20:07.544 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:20:37.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:20:37.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:21:07.832 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:21:07.842 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:21:37.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:21:37.983 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:22:08.113 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:22:08.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:22:38.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:22:38.336 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:23:08.470 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:23:08.480 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:23:38.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:23:38.629 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:24:08.765 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:24:08.776 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:24:39.215 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:24:39.224 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:25:09.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:25:09.353 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:25:39.487 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:25:39.496 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:26:09.636 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:26:09.644 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:26:39.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:26:39.784 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:27:09.917 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:27:09.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:27:40.137 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:27:40.145 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:28:10.298 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:28:10.307 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:28:40.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:28:40.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:29:10.709 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:29:10.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:29:40.843 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:29:40.852 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:30:11.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:30:11.013 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:30:41.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:30:41.156 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:31:11.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:31:11.298 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:31:41.454 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:31:41.462 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:32:11.599 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:32:11.608 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:32:41.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:32:41.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:33:11.901 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:33:11.911 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:33:42.066 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:33:42.078 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:34:12.210 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:34:12.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:34:42.348 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:34:42.357 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:35:12.545 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:35:12.555 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:35:42.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:35:42.696 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:36:12.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:36:12.856 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:36:43.004 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:36:43.017 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:36:44.982 INFO:teuthology.orchestra.run.smithi046.stdout:generic/538 6321s 2024-02-19T15:36:45.007 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/538 2024-02-19T15:36:45.008 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:36:45.021 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:45.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:36:45.063 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-02-19T15:36:45.752 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:36:45.765 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:36:45.765 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:52.973 INFO:teuthology.orchestra.run.smithi046.stdout:generic/539 7s 2024-02-19T15:36:52.992 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/539 2024-02-19T15:36:52.992 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:36:53.003 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:53.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:36:53.034 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-02-19T15:36:53.759 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:36:53.773 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:36:53.773 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:54.188 INFO:teuthology.orchestra.run.smithi046.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:36:54.199 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/540 2024-02-19T15:36:54.200 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/540 2024-02-19T15:36:54.200 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:36:54.209 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:54.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:36:54.240 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-02-19T15:36:54.812 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:36:54.826 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:36:54.826 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:36:55.247 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/541 2024-02-19T15:36:55.247 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/541 2024-02-19T15:36:55.247 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:36:55.256 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:55.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:36:55.287 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-02-19T15:36:55.890 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:36:55.906 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:36:55.906 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:56.366 INFO:teuthology.orchestra.run.smithi046.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:36:56.380 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/542 2024-02-19T15:36:56.380 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/542 2024-02-19T15:36:56.380 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:36:56.392 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:56.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:36:56.427 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-02-19T15:36:57.002 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:36:57.017 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:36:57.017 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:57.472 INFO:teuthology.orchestra.run.smithi046.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:36:57.484 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/543 2024-02-19T15:36:57.484 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/543 2024-02-19T15:36:57.484 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:36:57.493 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:57.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:36:57.521 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-02-19T15:36:58.070 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:36:58.083 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:36:58.083 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:58.527 INFO:teuthology.orchestra.run.smithi046.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:36:58.539 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/544 2024-02-19T15:36:58.539 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/544 2024-02-19T15:36:58.539 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:36:58.552 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:58.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:36:58.586 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-02-19T15:36:59.141 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:36:59.154 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:36:59.154 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:59.849 INFO:teuthology.orchestra.run.smithi046.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-02-19T15:36:59.862 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/545 2024-02-19T15:36:59.862 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/545 2024-02-19T15:36:59.863 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:36:59.873 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:36:59.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:36:59.910 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-02-19T15:37:00.480 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:00.493 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:00.493 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:01.151 INFO:teuthology.orchestra.run.smithi046.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:01.166 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/546 2024-02-19T15:37:01.166 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/546 2024-02-19T15:37:01.166 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:01.179 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:01.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:01.217 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-02-19T15:37:01.778 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:01.791 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:01.791 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:02.284 INFO:teuthology.orchestra.run.smithi046.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:02.298 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/547 2024-02-19T15:37:02.298 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/547 2024-02-19T15:37:02.298 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:02.311 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:02.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:02.347 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-02-19T15:37:02.958 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:02.973 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:02.973 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:03.518 INFO:teuthology.orchestra.run.smithi046.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:03.532 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/548 2024-02-19T15:37:03.532 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/548 2024-02-19T15:37:03.533 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:03.545 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:03.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:03.581 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-02-19T15:37:04.148 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:04.162 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:04.162 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:04.718 INFO:teuthology.orchestra.run.smithi046.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:04.733 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/549 2024-02-19T15:37:04.733 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/549 2024-02-19T15:37:04.733 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:04.745 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:04.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:04.779 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-02-19T15:37:05.341 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:05.354 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:05.922 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/550 2024-02-19T15:37:05.922 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/550 2024-02-19T15:37:05.922 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:05.934 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:05.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:05.970 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-02-19T15:37:06.564 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:06.578 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:06.578 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:07.035 INFO:teuthology.orchestra.run.smithi046.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:07.047 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/551 2024-02-19T15:37:07.047 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/551 2024-02-19T15:37:07.048 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:07.057 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:07.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:07.091 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-02-19T15:37:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:07.659 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:07.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:08.145 INFO:teuthology.orchestra.run.smithi046.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:08.162 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/552 2024-02-19T15:37:08.162 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/552 2024-02-19T15:37:08.162 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:08.174 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:08.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:08.209 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-02-19T15:37:08.782 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:08.796 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:08.796 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:09.475 INFO:teuthology.orchestra.run.smithi046.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2024-02-19T15:37:09.488 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/553 2024-02-19T15:37:09.488 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/553 2024-02-19T15:37:09.488 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:09.498 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:09.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:09.539 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-02-19T15:37:10.249 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:10.262 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:10.262 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:10.662 INFO:teuthology.orchestra.run.smithi046.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:10.672 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/554 2024-02-19T15:37:10.673 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/554 2024-02-19T15:37:10.673 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:10.684 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:10.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:10.716 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-02-19T15:37:11.289 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:11.301 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:11.301 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:11.861 INFO:teuthology.orchestra.run.smithi046.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2024-02-19T15:37:11.876 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/555 2024-02-19T15:37:11.876 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/555 2024-02-19T15:37:11.876 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:11.888 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:11.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:11.922 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-02-19T15:37:12.626 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:12.637 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:12.637 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:13.050 INFO:teuthology.orchestra.run.smithi046.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:13.062 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/556 2024-02-19T15:37:13.063 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/556 2024-02-19T15:37:13.063 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:13.073 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:13.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:13.105 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-02-19T15:37:13.157 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:37:13.163 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:37:13.629 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:13.641 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:13.641 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:14.052 INFO:teuthology.orchestra.run.smithi046.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:14.065 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/557 2024-02-19T15:37:14.065 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/557 2024-02-19T15:37:14.066 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:14.079 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:14.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:14.116 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-02-19T15:37:14.657 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:14.669 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:14.669 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:15.068 INFO:teuthology.orchestra.run.smithi046.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:15.079 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/558 2024-02-19T15:37:15.079 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/558 2024-02-19T15:37:15.079 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:15.087 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:15.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:15.120 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-02-19T15:37:15.595 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:15.606 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:15.606 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:15.975 INFO:teuthology.orchestra.run.smithi046.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:15.988 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/559 2024-02-19T15:37:15.988 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/559 2024-02-19T15:37:15.989 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:16.000 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:16.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:16.039 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-02-19T15:37:16.624 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:16.638 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:16.638 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:17.024 INFO:teuthology.orchestra.run.smithi046.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:17.036 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/560 2024-02-19T15:37:17.036 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/560 2024-02-19T15:37:17.036 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:17.047 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:17.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:17.081 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-02-19T15:37:17.635 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:17.647 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:17.647 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:18.084 INFO:teuthology.orchestra.run.smithi046.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:18.100 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/561 2024-02-19T15:37:18.100 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/561 2024-02-19T15:37:18.100 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:18.112 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:18.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:18.150 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-02-19T15:37:18.730 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:18.743 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:18.743 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:19.187 INFO:teuthology.orchestra.run.smithi046.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:19.201 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/562 2024-02-19T15:37:19.201 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/562 2024-02-19T15:37:19.201 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:19.213 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:19.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:19.247 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-02-19T15:37:19.809 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:19.823 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:19.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:20.323 INFO:teuthology.orchestra.run.smithi046.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:20.335 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/563 2024-02-19T15:37:20.335 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/563 2024-02-19T15:37:20.335 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:20.346 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:20.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:20.377 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-02-19T15:37:20.917 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:20.933 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:20.933 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:22.199 INFO:teuthology.orchestra.run.smithi046.stdout:generic/564 2s 2024-02-19T15:37:22.219 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/564 2024-02-19T15:37:22.219 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:22.228 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:22.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:22.266 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-02-19T15:37:22.945 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:22.955 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:22.955 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:23.360 INFO:teuthology.orchestra.run.smithi046.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:23.373 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/565 2024-02-19T15:37:23.373 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/565 2024-02-19T15:37:23.373 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:23.382 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:23.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:23.412 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-02-19T15:37:24.011 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:24.026 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:24.523 INFO:teuthology.orchestra.run.smithi046.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:24.538 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/566 2024-02-19T15:37:24.538 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/566 2024-02-19T15:37:24.538 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:24.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:24.591 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-02-19T15:37:25.154 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:25.171 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:25.171 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:25.603 INFO:teuthology.orchestra.run.smithi046.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:25.614 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/567 2024-02-19T15:37:25.614 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/567 2024-02-19T15:37:25.615 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:25.625 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:25.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:25.656 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-02-19T15:37:26.216 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:26.232 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:26.232 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:26.914 INFO:teuthology.orchestra.run.smithi046.stdout:generic/568 0s 2024-02-19T15:37:26.945 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/568 2024-02-19T15:37:26.945 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:26.958 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:27.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:27.004 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-02-19T15:37:27.574 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:27.588 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:27.588 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:28.106 INFO:teuthology.orchestra.run.smithi046.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:28.121 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/569 2024-02-19T15:37:28.121 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/569 2024-02-19T15:37:28.121 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:28.133 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:28.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:28.167 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-02-19T15:37:28.764 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:28.779 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:28.779 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:29.228 INFO:teuthology.orchestra.run.smithi046.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:29.243 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/570 2024-02-19T15:37:29.243 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/570 2024-02-19T15:37:29.243 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:29.254 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:29.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:29.292 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-02-19T15:37:29.886 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:29.900 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:36.580 INFO:teuthology.orchestra.run.smithi046.stdout:generic/571 7s 2024-02-19T15:37:36.597 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/571 2024-02-19T15:37:36.597 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:36.606 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:36.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:36.639 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-02-19T15:37:37.340 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:37.351 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:37.351 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:37.741 INFO:teuthology.orchestra.run.smithi046.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:37.751 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/572 2024-02-19T15:37:37.751 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/572 2024-02-19T15:37:37.751 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:37.758 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:37.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:37.792 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-02-19T15:37:38.363 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:38.377 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:38.377 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:38.788 INFO:teuthology.orchestra.run.smithi046.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:38.800 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/573 2024-02-19T15:37:38.800 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/573 2024-02-19T15:37:38.800 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:38.809 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:38.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:38.838 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-02-19T15:37:39.391 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:39.402 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:39.402 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:39.880 INFO:teuthology.orchestra.run.smithi046.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:39.895 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/574 2024-02-19T15:37:39.895 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/574 2024-02-19T15:37:39.895 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:39.907 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:39.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:39.942 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-02-19T15:37:40.518 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:40.533 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:40.534 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:40.959 INFO:teuthology.orchestra.run.smithi046.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/575 2024-02-19T15:37:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/575 2024-02-19T15:37:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:40.981 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:41.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:41.012 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-02-19T15:37:41.593 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:41.608 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:41.608 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:42.138 INFO:teuthology.orchestra.run.smithi046.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:42.150 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/576 2024-02-19T15:37:42.150 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/576 2024-02-19T15:37:42.151 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:42.161 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:42.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:42.195 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-02-19T15:37:42.777 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:42.792 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:42.792 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:43.216 INFO:teuthology.orchestra.run.smithi046.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:43.229 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/577 2024-02-19T15:37:43.230 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/577 2024-02-19T15:37:43.230 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:43.241 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:43.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:43.274 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-02-19T15:37:43.379 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:37:43.384 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:37:43.800 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:43.813 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:43.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:44.332 INFO:teuthology.orchestra.run.smithi046.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-19T15:37:44.344 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/578 2024-02-19T15:37:44.344 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/578 2024-02-19T15:37:44.344 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:44.353 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:44.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:44.392 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-02-19T15:37:44.951 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:44.965 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:44.965 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:45.467 INFO:teuthology.orchestra.run.smithi046.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:45.480 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/579 2024-02-19T15:37:45.480 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/579 2024-02-19T15:37:45.480 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:45.490 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:45.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:45.523 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-02-19T15:37:46.127 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:46.142 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:46.142 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:46.691 INFO:teuthology.orchestra.run.smithi046.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:46.705 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/580 2024-02-19T15:37:46.706 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/580 2024-02-19T15:37:46.706 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:46.718 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:46.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:46.751 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-02-19T15:37:47.337 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:47.350 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:48.699 INFO:teuthology.orchestra.run.smithi046.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:48.714 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/581 2024-02-19T15:37:48.714 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/581 2024-02-19T15:37:48.714 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:48.727 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:48.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:48.761 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-02-19T15:37:49.358 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:49.372 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:49.372 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:49.973 INFO:teuthology.orchestra.run.smithi046.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:49.986 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/582 2024-02-19T15:37:49.986 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/582 2024-02-19T15:37:49.986 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:49.998 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:50.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:50.034 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-02-19T15:37:50.608 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:50.620 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:50.620 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:51.170 INFO:teuthology.orchestra.run.smithi046.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:51.186 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/583 2024-02-19T15:37:51.187 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/583 2024-02-19T15:37:51.187 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:51.199 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:51.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:51.235 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-02-19T15:37:51.794 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:51.807 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:51.807 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:52.368 INFO:teuthology.orchestra.run.smithi046.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:52.380 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/584 2024-02-19T15:37:52.380 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/584 2024-02-19T15:37:52.381 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:52.391 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:52.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:52.425 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-02-19T15:37:53.009 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:53.022 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:53.022 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:53.460 INFO:teuthology.orchestra.run.smithi046.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:37:53.471 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/585 2024-02-19T15:37:53.471 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/585 2024-02-19T15:37:53.471 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:37:53.482 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:37:53.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:37:53.517 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-02-19T15:37:54.098 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:37:54.113 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:37:54.113 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:13.587 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:38:13.595 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:38:42.755 INFO:teuthology.orchestra.run.smithi046.stdout:generic/586 48s 2024-02-19T15:38:42.778 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/586 2024-02-19T15:38:42.778 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:38:42.791 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:42.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:38:42.833 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-02-19T15:38:43.578 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:38:43.589 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:38:43.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:43.730 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:38:43.734 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:38:44.264 INFO:teuthology.orchestra.run.smithi046.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-02-19T15:38:44.275 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/587 2024-02-19T15:38:44.275 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/587 2024-02-19T15:38:44.275 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:38:44.285 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:44.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:38:44.314 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-02-19T15:38:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:38:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:38:44.800 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:45.220 INFO:teuthology.orchestra.run.smithi046.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:38:45.230 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/588 2024-02-19T15:38:45.230 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/588 2024-02-19T15:38:45.230 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:38:45.240 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:45.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:38:45.269 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-02-19T15:38:45.809 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:38:45.822 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:38:45.823 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:38:46.243 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/589 2024-02-19T15:38:46.243 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/589 2024-02-19T15:38:46.243 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:38:46.253 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:46.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:38:46.285 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-02-19T15:38:46.851 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:38:46.863 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:38:46.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:47.303 INFO:teuthology.orchestra.run.smithi046.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:38:47.315 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/590 2024-02-19T15:38:47.315 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/590 2024-02-19T15:38:47.315 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:38:47.324 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:47.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:38:47.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-02-19T15:38:47.957 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:38:47.970 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:38:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:48.843 INFO:teuthology.orchestra.run.smithi046.stdout:generic/591 1s 2024-02-19T15:38:48.864 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/591 2024-02-19T15:38:48.864 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:38:48.875 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:48.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:38:48.915 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-02-19T15:38:49.631 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:38:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:38:49.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:50.227 INFO:teuthology.orchestra.run.smithi046.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:38:50.241 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/592 2024-02-19T15:38:50.241 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/592 2024-02-19T15:38:50.241 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:38:50.254 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:50.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:38:50.288 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-02-19T15:38:50.864 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:38:50.877 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:38:50.878 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:51.410 INFO:teuthology.orchestra.run.smithi046.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:38:51.422 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/593 2024-02-19T15:38:51.422 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/593 2024-02-19T15:38:51.423 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:38:51.432 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:51.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:38:51.463 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-02-19T15:38:52.066 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:38:52.081 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:38:52.081 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:52.483 INFO:teuthology.orchestra.run.smithi046.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:38:52.495 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/594 2024-02-19T15:38:52.495 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/594 2024-02-19T15:38:52.495 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:38:52.505 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:52.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:38:52.540 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-02-19T15:38:53.126 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:38:53.140 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:38:53.140 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:53.677 INFO:teuthology.orchestra.run.smithi046.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:38:53.692 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/595 2024-02-19T15:38:53.692 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/595 2024-02-19T15:38:53.693 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:38:53.704 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:53.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:38:53.737 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-02-19T15:38:54.312 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:38:54.326 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:38:54.326 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:54.851 INFO:teuthology.orchestra.run.smithi046.stdout:generic/596 [not run] file system doesn't support chattr +S 2024-02-19T15:38:54.862 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/596 2024-02-19T15:38:54.862 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/596 2024-02-19T15:38:54.862 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:38:54.870 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:54.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:38:54.900 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-02-19T15:38:55.427 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:38:55.440 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:38:55.441 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:57.122 INFO:teuthology.orchestra.run.smithi046.stdout:generic/597 - output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/597.out.bad) 2024-02-19T15:38:57.129 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/597.out 2024-02-19 06:59:28.052909924 +0000 2024-02-19T15:38:57.129 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/597.out.bad 2024-02-19 15:38:57.119008603 +0000 2024-02-19T15:38:57.129 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -4,11 +4,11 @@ 2024-02-19T15:38:57.129 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_symlinks = 0 2024-02-19T15:38:57.129 INFO:teuthology.orchestra.run.smithi046.stdout: successfully followed symlink 2024-02-19T15:38:57.129 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_symlinks = 1 2024-02-19T15:38:57.129 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2024-02-19T15:38:57.129 INFO:teuthology.orchestra.run.smithi046.stdout: +successfully followed symlink 2024-02-19T15:38:57.129 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:57.129 INFO:teuthology.orchestra.run.smithi046.stdout: == Test hardlink create protection when 2024-02-19T15:38:57.129 INFO:teuthology.orchestra.run.smithi046.stdout: == process != target owner and process cannot read target 2024-02-19T15:38:57.130 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_hardlinks = 0 2024-02-19T15:38:57.130 INFO:teuthology.orchestra.run.smithi046.stdout: -successfully created hardlink 2024-02-19T15:38:57.130 INFO:teuthology.orchestra.run.smithi046.stdout: +Permission denied 2024-02-19T15:38:57.130 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_hardlinks = 1 2024-02-19T15:38:57.130 INFO:teuthology.orchestra.run.smithi046.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2024-02-19T15:38:57.130 INFO:teuthology.orchestra.run.smithi046.stdout: +Permission denied 2024-02-19T15:38:57.136 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/597 2024-02-19T15:38:57.136 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/597 2024-02-19T15:38:57.136 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T15:38:57.144 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:57.203 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T15:38:57.203 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T15:38:57.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T15:38:57.204 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-02-19T15:38:57.860 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:38:57.871 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:38:57.871 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:59.662 INFO:teuthology.orchestra.run.smithi046.stdout:generic/598 - output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/598.out.bad) 2024-02-19T15:38:59.668 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/598.out 2024-02-19 06:59:28.052909924 +0000 2024-02-19T15:38:59.668 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/598.out.bad 2024-02-19 15:38:59.657979200 +0000 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -5,13 +5,10 @@ 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: = only group writable dir 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_regular = 1 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: = group & world writable dir 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: = only group writable dir 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_regular = 2 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: = group & world writable dir 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: = only group writable dir 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2024-02-19T15:38:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_fifos = 0 2024-02-19T15:38:59.670 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -19,10 +16,7 @@ 2024-02-19T15:38:59.670 INFO:teuthology.orchestra.run.smithi046.stdout: = only group writable dir 2024-02-19T15:38:59.670 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_fifos = 1 2024-02-19T15:38:59.670 INFO:teuthology.orchestra.run.smithi046.stdout: = group & world writable dir 2024-02-19T15:38:59.670 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2024-02-19T15:38:59.670 INFO:teuthology.orchestra.run.smithi046.stdout: = only group writable dir 2024-02-19T15:38:59.670 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_fifos = 2 2024-02-19T15:38:59.670 INFO:teuthology.orchestra.run.smithi046.stdout: = group & world writable dir 2024-02-19T15:38:59.670 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2024-02-19T15:38:59.670 INFO:teuthology.orchestra.run.smithi046.stdout: = only group writable dir 2024-02-19T15:38:59.670 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2024-02-19T15:38:59.676 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/598 2024-02-19T15:38:59.676 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/598 2024-02-19T15:38:59.676 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T15:38:59.686 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:38:59.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T15:38:59.716 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T15:38:59.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T15:38:59.717 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-02-19T15:39:00.430 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:00.443 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:00.443 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:00.858 INFO:teuthology.orchestra.run.smithi046.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:00.871 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/599 2024-02-19T15:39:00.871 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/599 2024-02-19T15:39:00.871 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:00.880 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:00.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:00.910 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-02-19T15:39:01.474 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:01.488 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:01.488 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:01.937 INFO:teuthology.orchestra.run.smithi046.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:01.950 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/600 2024-02-19T15:39:01.950 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/600 2024-02-19T15:39:01.950 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:01.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:01.993 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-02-19T15:39:02.539 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:02.550 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:02.550 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:03.005 INFO:teuthology.orchestra.run.smithi046.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:03.017 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/601 2024-02-19T15:39:03.017 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/601 2024-02-19T15:39:03.017 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:03.027 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:03.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:03.066 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-02-19T15:39:03.640 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:03.655 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:03.655 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:04.216 INFO:teuthology.orchestra.run.smithi046.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:04.230 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/602 2024-02-19T15:39:04.230 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/602 2024-02-19T15:39:04.230 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:04.240 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:04.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:04.273 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-02-19T15:39:04.841 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:04.856 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:04.856 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:05.339 INFO:teuthology.orchestra.run.smithi046.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:05.353 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/603 2024-02-19T15:39:05.353 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/603 2024-02-19T15:39:05.353 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:05.365 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:05.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:05.404 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-02-19T15:39:05.996 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:06.008 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:06.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:06.420 INFO:teuthology.orchestra.run.smithi046.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:06.432 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/604 2024-02-19T15:39:06.432 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/604 2024-02-19T15:39:06.432 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:06.442 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:06.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:06.476 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-02-19T15:39:07.046 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:07.059 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:07.059 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:07.521 INFO:teuthology.orchestra.run.smithi046.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:07.535 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/605 2024-02-19T15:39:07.535 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/605 2024-02-19T15:39:07.536 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:07.548 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:07.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:07.583 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-02-19T15:39:08.149 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:08.162 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:08.162 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:08.611 INFO:teuthology.orchestra.run.smithi046.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:08.624 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/606 2024-02-19T15:39:08.625 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/606 2024-02-19T15:39:08.625 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:08.638 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:08.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:08.673 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-02-19T15:39:09.249 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:09.265 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:09.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:09.712 INFO:teuthology.orchestra.run.smithi046.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:09.724 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/607 2024-02-19T15:39:09.724 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/607 2024-02-19T15:39:09.724 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:09.733 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:09.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:09.758 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-02-19T15:39:10.348 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:10.363 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:10.363 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:10.819 INFO:teuthology.orchestra.run.smithi046.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:10.835 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/608 2024-02-19T15:39:10.835 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/608 2024-02-19T15:39:10.835 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:10.848 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:10.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:10.882 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-02-19T15:39:11.472 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:11.486 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:11.487 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:12.666 INFO:teuthology.orchestra.run.smithi046.stdout:generic/609 1s 2024-02-19T15:39:12.685 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/609 2024-02-19T15:39:12.685 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:12.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:12.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:12.734 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-02-19T15:39:13.451 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:13.464 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:13.464 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:13.838 INFO:teuthology.orchestra.run.smithi046.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:13.848 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/610 2024-02-19T15:39:13.848 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/610 2024-02-19T15:39:13.848 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:13.857 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:13.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:39:13.866 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:39:13.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:13.883 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-02-19T15:39:14.375 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:14.388 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:14.388 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:14.783 INFO:teuthology.orchestra.run.smithi046.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:14.793 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/611 2024-02-19T15:39:14.793 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/611 2024-02-19T15:39:14.793 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:14.801 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:14.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:14.827 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-02-19T15:39:15.371 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:15.385 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:15.385 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:15.968 INFO:teuthology.orchestra.run.smithi046.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T15:39:15.982 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/612 2024-02-19T15:39:15.982 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/612 2024-02-19T15:39:15.982 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:15.995 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:16.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:16.035 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-02-19T15:39:16.721 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:16.734 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:16.734 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:17.280 INFO:teuthology.orchestra.run.smithi046.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:17.295 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/613 2024-02-19T15:39:17.296 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/613 2024-02-19T15:39:17.296 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:17.307 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:17.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:17.343 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-02-19T15:39:17.894 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:17.908 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:17.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:18.344 INFO:teuthology.orchestra.run.smithi046.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/614 2024-02-19T15:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/614 2024-02-19T15:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:18.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:18.408 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-02-19T15:39:18.955 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:18.969 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:18.969 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:19.401 INFO:teuthology.orchestra.run.smithi046.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:19.417 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/615 2024-02-19T15:39:19.417 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/615 2024-02-19T15:39:19.417 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:19.430 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:19.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:19.465 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-02-19T15:39:20.012 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:20.025 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:20.025 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:20.477 INFO:teuthology.orchestra.run.smithi046.stdout:generic/616 [not run] kernel does not support IO_URING 2024-02-19T15:39:20.487 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/616 2024-02-19T15:39:20.487 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/616 2024-02-19T15:39:20.487 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:20.495 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:20.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:20.525 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-02-19T15:39:21.111 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:21.125 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:21.125 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:21.644 INFO:teuthology.orchestra.run.smithi046.stdout:generic/617 [not run] kernel does not support IO_URING 2024-02-19T15:39:21.656 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/617 2024-02-19T15:39:21.657 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/617 2024-02-19T15:39:21.657 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:21.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:21.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:21.701 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-02-19T15:39:22.277 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:22.290 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:22.291 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:22.712 INFO:teuthology.orchestra.run.smithi046.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:22.724 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/618 2024-02-19T15:39:22.724 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/618 2024-02-19T15:39:22.724 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:22.735 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:22.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:22.766 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-02-19T15:39:23.312 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:23.326 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:23.327 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:23.800 INFO:teuthology.orchestra.run.smithi046.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:23.811 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/619 2024-02-19T15:39:23.811 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/619 2024-02-19T15:39:23.812 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:23.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:23.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:23.852 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-02-19T15:39:24.403 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:24.416 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:24.909 INFO:teuthology.orchestra.run.smithi046.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:24.921 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/620 2024-02-19T15:39:24.921 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/620 2024-02-19T15:39:24.921 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:24.931 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:24.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:24.962 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-02-19T15:39:25.508 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:25.521 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:25.521 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:26.044 INFO:teuthology.orchestra.run.smithi046.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:26.057 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/621 2024-02-19T15:39:26.057 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/621 2024-02-19T15:39:26.057 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:26.067 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:26.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:26.099 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-02-19T15:39:26.666 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:26.678 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:26.679 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:27.113 INFO:teuthology.orchestra.run.smithi046.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:27.125 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/622 2024-02-19T15:39:27.125 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/622 2024-02-19T15:39:27.125 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:27.136 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:27.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:27.169 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-02-19T15:39:27.743 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:27.758 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:27.758 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:28.198 INFO:teuthology.orchestra.run.smithi046.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:28.211 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/623 2024-02-19T15:39:28.211 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/623 2024-02-19T15:39:28.211 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:28.221 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:28.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:28.253 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-02-19T15:39:28.858 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:28.872 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:29.306 INFO:teuthology.orchestra.run.smithi046.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:29.318 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/624 2024-02-19T15:39:29.318 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/624 2024-02-19T15:39:29.318 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:29.327 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:29.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:29.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-02-19T15:39:29.906 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:29.919 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:30.339 INFO:teuthology.orchestra.run.smithi046.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:30.352 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/625 2024-02-19T15:39:30.352 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/625 2024-02-19T15:39:30.353 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:30.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:30.402 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-02-19T15:39:30.972 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:30.984 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:30.984 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:31.441 INFO:teuthology.orchestra.run.smithi046.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:31.454 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/626 2024-02-19T15:39:31.455 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/626 2024-02-19T15:39:31.455 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:31.467 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:31.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:31.499 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-02-19T15:39:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:32.072 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:32.072 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:32.509 INFO:teuthology.orchestra.run.smithi046.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:32.522 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/627 2024-02-19T15:39:32.522 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/627 2024-02-19T15:39:32.522 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:32.533 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:32.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:32.569 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-02-19T15:39:33.157 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:33.171 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:33.172 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:33.677 INFO:teuthology.orchestra.run.smithi046.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:33.693 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/628 2024-02-19T15:39:33.693 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/628 2024-02-19T15:39:33.694 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:33.705 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:33.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:33.740 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-02-19T15:39:34.327 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:34.342 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:34.342 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:34.853 INFO:teuthology.orchestra.run.smithi046.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:34.869 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/629 2024-02-19T15:39:34.869 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/629 2024-02-19T15:39:34.870 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:34.883 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:34.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:34.915 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-02-19T15:39:35.485 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:35.499 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:35.499 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:35.937 INFO:teuthology.orchestra.run.smithi046.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:35.952 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/630 2024-02-19T15:39:35.953 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/630 2024-02-19T15:39:35.953 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:35.965 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:36.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:36.004 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-02-19T15:39:36.577 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:36.590 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:37.004 INFO:teuthology.orchestra.run.smithi046.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:39:37.018 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/631 2024-02-19T15:39:37.018 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/631 2024-02-19T15:39:37.018 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:37.030 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:37.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:37.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-02-19T15:39:37.652 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:37.666 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:37.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:44.083 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:39:44.092 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:39:58.879 INFO:teuthology.orchestra.run.smithi046.stdout:generic/632 21s 2024-02-19T15:39:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/632 2024-02-19T15:39:58.898 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:39:58.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:39:58.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:39:58.942 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-02-19T15:39:59.513 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:39:59.527 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:39:59.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:00.564 INFO:teuthology.orchestra.run.smithi046.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/633.out.bad) 2024-02-19T15:40:00.581 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/633.out 2024-02-19 06:59:28.058909856 +0000 2024-02-19T15:40:00.582 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.ca873QOZoIxfstests-dev/results//generic/633.out.bad 2024-02-19 15:40:00.556273945 +0000 2024-02-19T15:40:00.582 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,2 +1,5 @@ 2024-02-19T15:40:00.582 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 633 2024-02-19T15:40:00.582 INFO:teuthology.orchestra.run.smithi046.stdout: Silence is golden 2024-02-19T15:40:00.582 INFO:teuthology.orchestra.run.smithi046.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2024-02-19T15:40:00.582 INFO:teuthology.orchestra.run.smithi046.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2024-02-19T15:40:00.582 INFO:teuthology.orchestra.run.smithi046.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2024-02-19T15:40:00.599 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/633 2024-02-19T15:40:00.599 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/633 2024-02-19T15:40:00.600 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2024-02-19T15:40:00.618 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:00.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T15:40:00.667 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-02-19T15:40:00.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-02-19T15:40:00.668 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-02-19T15:40:01.269 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:01.284 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:01.284 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:01.722 INFO:teuthology.orchestra.run.smithi046.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:40:01.734 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/634 2024-02-19T15:40:01.734 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/634 2024-02-19T15:40:01.734 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:01.744 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:01.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:01.777 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-02-19T15:40:02.361 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:02.373 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:02.374 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:02.818 INFO:teuthology.orchestra.run.smithi046.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:40:02.830 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/635 2024-02-19T15:40:02.830 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/635 2024-02-19T15:40:02.830 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:02.840 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:02.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:02.875 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-02-19T15:40:03.453 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:03.468 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:03.468 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:03.905 INFO:teuthology.orchestra.run.smithi046.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:40:03.920 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/636 2024-02-19T15:40:03.920 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/636 2024-02-19T15:40:03.920 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:03.931 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:03.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:03.966 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-02-19T15:40:04.537 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:04.549 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:04.549 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:07.939 INFO:teuthology.orchestra.run.smithi046.stdout:generic/637 3s 2024-02-19T15:40:07.958 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/637 2024-02-19T15:40:07.958 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:07.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:07.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:07.999 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-02-19T15:40:08.738 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:08.750 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:08.750 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:09.275 INFO:teuthology.orchestra.run.smithi046.stdout:generic/638 1s 2024-02-19T15:40:09.291 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/638 2024-02-19T15:40:09.291 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:09.302 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:09.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:09.332 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-02-19T15:40:09.923 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:09.938 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:09.938 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:14.263 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:40:14.272 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:40:15.510 INFO:teuthology.orchestra.run.smithi046.stdout:generic/639 6s 2024-02-19T15:40:15.528 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/639 2024-02-19T15:40:15.528 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:15.536 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:15.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:15.561 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-02-19T15:40:16.086 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:16.098 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:16.098 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:16.538 INFO:teuthology.orchestra.run.smithi046.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:40:16.549 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/640 2024-02-19T15:40:16.549 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/640 2024-02-19T15:40:16.549 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:16.559 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:16.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:16.592 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-02-19T15:40:17.182 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:17.197 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:17.198 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:17.639 INFO:teuthology.orchestra.run.smithi046.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:40:17.652 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/641 2024-02-19T15:40:17.652 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/641 2024-02-19T15:40:17.652 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:17.662 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:17.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:17.696 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-02-19T15:40:18.268 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:18.282 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:18.282 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:18.728 INFO:teuthology.orchestra.run.smithi046.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:40:18.740 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/642 2024-02-19T15:40:18.741 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/642 2024-02-19T15:40:18.741 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:18.754 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:18.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:18.792 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-02-19T15:40:19.388 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:19.403 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:19.404 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:19.867 INFO:teuthology.orchestra.run.smithi046.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:40:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/643 2024-02-19T15:40:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/643 2024-02-19T15:40:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:19.891 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:19.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:19.926 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-02-19T15:40:20.523 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:20.536 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:20.536 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:21.022 INFO:teuthology.orchestra.run.smithi046.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2024-02-19T15:40:21.035 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/644 2024-02-19T15:40:21.036 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/644 2024-02-19T15:40:21.036 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:21.050 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:21.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:21.084 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-02-19T15:40:21.669 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:21.681 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:21.681 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:22.098 INFO:teuthology.orchestra.run.smithi046.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2024-02-19T15:40:22.110 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/645 2024-02-19T15:40:22.110 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/645 2024-02-19T15:40:22.110 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:22.120 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:22.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:22.154 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-02-19T15:40:22.697 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:22.711 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:22.712 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:23.135 INFO:teuthology.orchestra.run.smithi046.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:40:23.149 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/646 2024-02-19T15:40:23.149 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/646 2024-02-19T15:40:23.149 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:23.159 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:23.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:23.194 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-02-19T15:40:23.780 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:23.794 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:23.794 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:generic/647 1s 2024-02-19T15:40:24.694 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/647 2024-02-19T15:40:24.694 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:24.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:24.757 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-02-19T15:40:25.465 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:25.479 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:25.479 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:25.917 INFO:teuthology.orchestra.run.smithi046.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T15:40:25.930 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/648 2024-02-19T15:40:25.931 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/648 2024-02-19T15:40:25.931 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:25.941 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:25.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:25.978 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-02-19T15:40:26.552 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:26.565 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:26.565 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:27.208 INFO:teuthology.orchestra.run.smithi046.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T15:40:27.221 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/649 2024-02-19T15:40:27.221 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/649 2024-02-19T15:40:27.221 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T15:40:27.232 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:27.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T15:40:27.286 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-02-19T15:40:27.981 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T15:40:27.993 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T15:40:27.994 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T15:40:44.443 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:40:44.452 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:41:14.604 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:41:14.615 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:41:45.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:41:45.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:42:15.404 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:42:15.417 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:42:45.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:42:45.601 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:43:15.741 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:43:15.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:43:45.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:43:45.892 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:44:16.059 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:44:16.070 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:44:46.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:44:46.390 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:45:16.962 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:45:16.967 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:45:17.078 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-02-19T15:45:17.078+0000 7f5e66400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 488985) UID: 0 2024-02-19T15:45:17.080 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T15:45:17.080+0000 7fc963e00640 -1 received signal: Hangup from (PID: 488985) UID: 0 2024-02-19T15:45:17.080 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-02-19T15:45:17.080+0000 7f3514600640 -1 received signal: Hangup from (PID: 488985) UID: 0 2024-02-19T15:45:17.082 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T15:45:17.082+0000 7f8a09200640 -1 Fail to open '/proc/488985/cmdline' error = (2) No such file or directory 2024-02-19T15:45:17.082 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T15:45:17.082+0000 7f8a09200640 -1 received signal: Hangup from (PID: 488985) UID: 0 2024-02-19T15:50:05.785 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:50:05.794 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:50:36.719 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:50:36.728 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:51:07.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:51:07.054 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:51:37.622 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:51:37.633 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:52:07.934 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:52:07.946 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:52:38.119 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:52:38.127 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:53:08.261 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:53:08.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:53:38.820 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:53:38.833 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:54:09.082 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:54:09.090 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:54:39.224 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:54:39.232 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:55:09.640 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:55:09.647 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:55:40.125 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:55:40.141 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:56:10.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:56:10.632 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:56:40.849 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:56:40.861 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:57:11.011 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:57:11.019 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:57:41.168 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:57:41.186 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:58:11.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:58:11.425 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:58:41.846 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:58:41.854 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:59:12.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:59:12.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T15:59:12.305 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-02-19T15:59:12.304+0000 7fb706c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 491969) UID: 0 2024-02-19T15:59:12.307 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-02-19T15:59:12.307+0000 7f51d5600640 -1 Fail to open '/proc/491969/cmdline' error = (2) No such file or directory 2024-02-19T15:59:12.307 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-02-19T15:59:12.307+0000 7f51d5600640 -1 received signal: Hangup from (PID: 491969) UID: 0 2024-02-19T16:03:41.224 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:03:41.232 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:04:11.456 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:04:11.471 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:04:41.701 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:04:41.714 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:05:12.532 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:05:12.538 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:05:42.673 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:05:42.683 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:06:12.848 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:06:12.857 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:06:43.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:06:43.030 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:07:13.206 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:07:13.221 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:07:43.460 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:07:43.468 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:08:13.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:08:13.725 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:08:44.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:08:44.107 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:09:14.230 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:09:14.242 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:09:44.417 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:09:44.446 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:10:14.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:10:14.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:10:44.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:10:44.859 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:11:14.976 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:11:15.117 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:11:45.755 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:11:45.767 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:12:16.525 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:12:16.536 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:12:46.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:12:46.752 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:12:46.850 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T16:12:46.849+0000 7f35abe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93231) UID: 0 2024-02-19T16:12:46.851 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T16:12:46.849+0000 7f7183000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93231) UID: 0 2024-02-19T16:12:46.851 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T16:12:46.849+0000 7f3c04600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93231) UID: 0 2024-02-19T16:12:46.851 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T16:12:46.850+0000 7f99f5600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93231) UID: 0 2024-02-19T16:15:43.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:15:43.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:15:43.520 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-02-19T16:15:43.516+0000 7f5e66400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495470) UID: 0 2024-02-19T16:15:43.521 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-02-19T16:15:43.516+0000 7f3514600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495470) UID: 0 2024-02-19T16:15:43.531 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T16:15:43.520+0000 7fc963e00640 -1 Fail to open '/proc/495470/cmdline' error = (2) No such file or directory 2024-02-19T16:15:43.531 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T16:15:43.527+0000 7fc963e00640 -1 received signal: Hangup from (PID: 495470) UID: 0 2024-02-19T16:15:43.547 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T16:15:43.543+0000 7f8a09200640 -1 Fail to open '/proc/495470/cmdline' error = (2) No such file or directory 2024-02-19T16:15:43.547 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T16:15:43.546+0000 7f8a09200640 -1 received signal: Hangup from (PID: 495470) UID: 0 2024-02-19T16:19:54.979 INFO:teuthology.orchestra.run.smithi046.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.2.log.1: 2024-02-19T16:19:54.980 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: stdin: file size changed while zipping 2024-02-19T16:20:28.084 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:20:28.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:20:58.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:20:58.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:21:29.037 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:21:29.057 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:21:59.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:21:59.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:22:29.648 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:22:29.655 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:22:59.785 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:22:59.794 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:22:59.938 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-02-19T16:22:59.937+0000 7fb706c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 496865) UID: 0 2024-02-19T16:22:59.941 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-02-19T16:22:59.941+0000 7f51d5600640 -1 received signal: Hangup from (PID: 496865) UID: 0 2024-02-19T16:27:57.458 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:27:57.468 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:28:28.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:28:28.301 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:28:58.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:28:58.573 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:29:28.817 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:29:28.847 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:29:58.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:29:58.992 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:30:29.148 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:30:29.165 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:30:59.335 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:30:59.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:31:29.505 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:31:29.511 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:31:59.764 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:31:59.776 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:32:00.033 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-02-19T16:32:00.031+0000 7f5e66400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 498718) UID: 0 2024-02-19T16:32:00.040 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T16:32:00.032+0000 7fc963e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 498718) UID: 0 2024-02-19T16:32:00.041 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-02-19T16:32:00.038+0000 7f3514600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 498718) UID: 0 2024-02-19T16:32:00.046 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T16:32:00.040+0000 7f8a09200640 -1 Fail to open '/proc/498718/cmdline' error = (2) No such file or directory 2024-02-19T16:32:00.047 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T16:32:00.040+0000 7f8a09200640 -1 received signal: Hangup from (PID: 498718) UID: 0 2024-02-19T16:36:39.521 INFO:teuthology.orchestra.run.smithi046.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.1.log.1: 2024-02-19T16:36:39.522 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: stdin: file size changed while zipping 2024-02-19T16:37:13.578 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:37:13.589 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:37:13.689 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T16:37:13.688+0000 7f35abe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93584) UID: 0 2024-02-19T16:37:13.690 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T16:37:13.688+0000 7f7183000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93584) UID: 0 2024-02-19T16:37:13.690 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T16:37:13.688+0000 7f3c04600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93584) UID: 0 2024-02-19T16:37:13.690 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T16:37:13.688+0000 7f99f5600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93584) UID: 0 2024-02-19T16:40:21.752 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:40:21.759 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:40:21.880 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T16:40:21.878+0000 7f7183000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93607) UID: 0 2024-02-19T16:40:21.881 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T16:40:21.878+0000 7f3c04600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93607) UID: 0 2024-02-19T16:40:21.881 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T16:40:21.878+0000 7f99f5600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93607) UID: 0 2024-02-19T16:40:21.881 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T16:40:21.878+0000 7f35abe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93607) UID: 0 2024-02-19T16:40:21.893 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-02-19T16:40:21.890+0000 7fb706c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 499875) UID: 0 2024-02-19T16:40:21.893 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-02-19T16:40:21.891+0000 7f51d5600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 499875) UID: 0 2024-02-19T16:40:51.042 INFO:teuthology.orchestra.run.smithi046.stdout:generic/650 3622s 2024-02-19T16:40:51.130 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/650 2024-02-19T16:40:51.130 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:40:51.140 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:40:51.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:40:51.172 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-02-19T16:40:52.057 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:40:52.081 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:40:52.081 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:40:52.611 INFO:teuthology.orchestra.run.smithi046.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:40:52.624 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/651 2024-02-19T16:40:52.626 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/651 2024-02-19T16:40:52.626 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:40:52.634 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:40:52.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:40:52.673 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-02-19T16:40:53.351 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:40:53.370 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:40:53.370 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:40:53.976 INFO:teuthology.orchestra.run.smithi046.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:40:53.987 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/652 2024-02-19T16:40:53.987 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/652 2024-02-19T16:40:53.987 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:40:53.998 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:40:54.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:40:54.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-02-19T16:40:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:40:55.394 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:40:55.395 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:40:55.823 INFO:teuthology.orchestra.run.smithi046.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:40:55.837 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/653 2024-02-19T16:40:55.837 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/653 2024-02-19T16:40:55.837 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:40:55.848 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:40:55.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:40:55.888 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-02-19T16:40:56.490 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:40:56.507 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:40:56.507 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:40:57.681 INFO:teuthology.orchestra.run.smithi046.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:40:57.693 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/654 2024-02-19T16:40:57.693 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/654 2024-02-19T16:40:57.693 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:40:57.701 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:40:57.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:40:57.729 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-02-19T16:40:58.321 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:40:58.338 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:40:58.338 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:00.375 INFO:teuthology.orchestra.run.smithi046.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:00.389 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/655 2024-02-19T16:41:00.389 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/655 2024-02-19T16:41:00.389 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:00.400 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:00.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:00.428 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-02-19T16:41:01.080 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:01.098 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:01.098 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:01.721 INFO:teuthology.orchestra.run.smithi046.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2024-02-19T16:41:01.733 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/656 2024-02-19T16:41:01.733 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/656 2024-02-19T16:41:01.733 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:01.745 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:01.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:01.778 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-02-19T16:41:02.449 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:02.462 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:02.463 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:02.910 INFO:teuthology.orchestra.run.smithi046.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:02.926 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/657 2024-02-19T16:41:02.926 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/657 2024-02-19T16:41:02.926 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:02.934 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:02.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:02.970 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-02-19T16:41:03.640 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:03.659 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:03.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:04.090 INFO:teuthology.orchestra.run.smithi046.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:04.105 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/658 2024-02-19T16:41:04.105 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/658 2024-02-19T16:41:04.106 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:04.116 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:04.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:04.146 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-02-19T16:41:04.808 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:04.824 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:04.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:05.349 INFO:teuthology.orchestra.run.smithi046.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:05.359 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/659 2024-02-19T16:41:05.359 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/659 2024-02-19T16:41:05.360 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:05.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:05.408 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-02-19T16:41:06.040 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:06.059 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:06.059 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:06.475 INFO:teuthology.orchestra.run.smithi046.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:06.487 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/660 2024-02-19T16:41:06.487 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/660 2024-02-19T16:41:06.487 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:06.498 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:06.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:06.524 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-02-19T16:41:07.164 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:07.176 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:07.177 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:07.601 INFO:teuthology.orchestra.run.smithi046.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/661 2024-02-19T16:41:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/661 2024-02-19T16:41:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:07.626 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:07.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:07.657 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-02-19T16:41:08.312 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:08.328 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:08.328 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:08.778 INFO:teuthology.orchestra.run.smithi046.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:08.792 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/662 2024-02-19T16:41:08.793 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/662 2024-02-19T16:41:08.793 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:08.800 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:08.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:08.834 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-02-19T16:41:09.488 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:09.506 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:09.506 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:09.943 INFO:teuthology.orchestra.run.smithi046.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:09.955 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/663 2024-02-19T16:41:09.957 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/663 2024-02-19T16:41:09.957 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:09.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:10.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:10.001 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-02-19T16:41:10.667 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:10.682 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:10.682 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:11.110 INFO:teuthology.orchestra.run.smithi046.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:11.123 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/664 2024-02-19T16:41:11.123 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/664 2024-02-19T16:41:11.123 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:11.134 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:11.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:11.173 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-02-19T16:41:11.842 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:11.859 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:11.859 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:12.286 INFO:teuthology.orchestra.run.smithi046.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:12.298 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/665 2024-02-19T16:41:12.298 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/665 2024-02-19T16:41:12.298 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:12.309 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:12.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:12.339 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-02-19T16:41:12.999 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:13.015 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:13.015 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:13.423 INFO:teuthology.orchestra.run.smithi046.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:13.436 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/666 2024-02-19T16:41:13.437 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/666 2024-02-19T16:41:13.437 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:13.444 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:13.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:13.473 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-02-19T16:41:14.114 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:14.133 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:14.133 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:14.585 INFO:teuthology.orchestra.run.smithi046.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:14.599 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/667 2024-02-19T16:41:14.599 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/667 2024-02-19T16:41:14.599 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:14.613 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:14.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:14.652 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-02-19T16:41:15.298 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:15.315 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:15.315 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:15.730 INFO:teuthology.orchestra.run.smithi046.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:15.746 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/668 2024-02-19T16:41:15.746 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/668 2024-02-19T16:41:15.747 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:15.761 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:15.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:15.801 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-02-19T16:41:16.441 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:16.463 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:16.463 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:16.903 INFO:teuthology.orchestra.run.smithi046.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:16.916 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/669 2024-02-19T16:41:16.916 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/669 2024-02-19T16:41:16.916 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:16.926 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:16.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:16.957 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-02-19T16:41:17.629 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:17.644 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:17.644 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:18.072 INFO:teuthology.orchestra.run.smithi046.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:18.085 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/670 2024-02-19T16:41:18.086 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/670 2024-02-19T16:41:18.086 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:18.093 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:18.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:18.124 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-02-19T16:41:18.734 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:18.751 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:18.751 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:19.200 INFO:teuthology.orchestra.run.smithi046.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:19.211 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/671 2024-02-19T16:41:19.212 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/671 2024-02-19T16:41:19.212 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:19.225 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:19.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:19.258 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-02-19T16:41:19.932 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:19.950 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:19.950 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:20.434 INFO:teuthology.orchestra.run.smithi046.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:20.442 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/672 2024-02-19T16:41:20.442 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/672 2024-02-19T16:41:20.442 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:20.450 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:20.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:20.478 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-02-19T16:41:21.095 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:21.112 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:21.112 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:22.870 INFO:teuthology.orchestra.run.smithi046.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:22.885 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/673 2024-02-19T16:41:22.885 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/673 2024-02-19T16:41:22.885 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:22.896 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:22.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:22.927 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-02-19T16:41:23.530 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:23.547 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:23.547 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:24.147 INFO:teuthology.orchestra.run.smithi046.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:24.162 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/674 2024-02-19T16:41:24.162 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/674 2024-02-19T16:41:24.162 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:24.170 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:24.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:24.205 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-02-19T16:41:24.818 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:24.830 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:24.830 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:25.961 INFO:teuthology.orchestra.run.smithi046.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T16:41:25.973 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/675 2024-02-19T16:41:25.973 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/675 2024-02-19T16:41:25.974 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T16:41:25.984 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:41:26.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T16:41:26.015 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-02-19T16:41:26.652 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T16:41:26.666 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T16:41:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T16:46:08.565 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-02-19T16:46:08.562+0000 7f5e66400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510844) UID: 0 2024-02-19T16:46:08.566 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-02-19T16:46:08.563+0000 7fc963e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510844) UID: 0 2024-02-19T16:46:08.566 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-02-19T16:46:08.563+0000 7f8a09200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510844) UID: 0 2024-02-19T16:46:08.567 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-02-19T16:46:08.563+0000 7f3514600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510844) UID: 0 2024-02-19T16:52:54.818 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:52:54.827 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T16:52:54.931 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T16:52:54.930+0000 7f35abe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93638) UID: 0 2024-02-19T16:52:54.932 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T16:52:54.930+0000 7f7183000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93638) UID: 0 2024-02-19T16:52:54.932 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T16:52:54.930+0000 7f3c04600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93638) UID: 0 2024-02-19T16:52:54.932 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T16:52:54.930+0000 7f99f5600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93638) UID: 0 2024-02-19T16:52:55.451 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-02-19T16:52:55.448+0000 7fb706c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 510884) UID: 0 2024-02-19T16:52:55.452 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-02-19T16:52:55.448+0000 7f51d5600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 510884) UID: 0 2024-02-19T17:04:20.756 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T17:04:20.763 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T17:04:26.891 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-02-19T17:04:26.898+0000 7fb706c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 510921) UID: 0 2024-02-19T17:04:26.892 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-02-19T17:04:26.898+0000 7f51d5600640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 510921) UID: 0 2024-02-19T17:08:41.405 INFO:teuthology.orchestra.run.smithi046.stdout:generic/676 1635s 2024-02-19T17:08:41.691 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/676 2024-02-19T17:08:41.691 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:08:41.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:08:41.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:08:41.915 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-02-19T17:08:48.220 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:08:48.237 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:08:48.237 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:08:49.115 INFO:teuthology.orchestra.run.smithi046.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:08:49.174 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/677 2024-02-19T17:08:49.175 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/677 2024-02-19T17:08:49.175 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:08:49.227 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:08:49.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:08:49.265 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-02-19T17:08:49.999 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:08:50.015 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:08:50.015 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:08:50.996 INFO:teuthology.orchestra.run.smithi046.stdout:generic/678 [not run] kernel does not support IO_URING 2024-02-19T17:08:51.005 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/678 2024-02-19T17:08:51.005 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/678 2024-02-19T17:08:51.005 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:08:51.014 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:08:51.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:08:51.048 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-02-19T17:08:51.718 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:08:51.736 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:08:51.738 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:08:52.631 INFO:teuthology.orchestra.run.smithi046.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:08:52.644 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/679 2024-02-19T17:08:52.644 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/679 2024-02-19T17:08:52.644 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:08:52.654 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:08:52.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:08:52.688 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-02-19T17:08:53.518 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:08:53.534 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:08:53.534 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:08:56.267 INFO:teuthology.orchestra.run.smithi046.stdout:generic/680 3s 2024-02-19T17:08:56.287 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/680 2024-02-19T17:08:56.287 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:08:56.298 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:08:56.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:08:56.337 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-02-19T17:08:57.290 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:08:57.308 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:08:57.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:08:58.169 INFO:teuthology.orchestra.run.smithi046.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-02-19T17:08:58.181 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/681 2024-02-19T17:08:58.181 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/681 2024-02-19T17:08:58.181 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:08:58.191 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:08:58.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:08:58.221 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-02-19T17:08:58.863 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:08:58.879 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:08:58.880 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:08:59.414 INFO:teuthology.orchestra.run.smithi046.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-02-19T17:08:59.426 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/682 2024-02-19T17:08:59.426 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/682 2024-02-19T17:08:59.426 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:08:59.434 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:08:59.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:08:59.466 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-02-19T17:09:00.125 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:00.143 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:00.143 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:01.180 INFO:teuthology.orchestra.run.smithi046.stdout:generic/683 [not run] /tmp/tmp.03skzeLSgitest: file alloc unit 4194304 larger than op length 65536 2024-02-19T17:09:01.193 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/683 2024-02-19T17:09:01.193 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/683 2024-02-19T17:09:01.193 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:01.203 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:01.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:01.233 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-02-19T17:09:01.888 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:01.906 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:01.906 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:04.963 INFO:teuthology.orchestra.run.smithi046.stdout:generic/684 [not run] /tmp/tmp.03skzeLSgitest: file alloc unit 4194304 larger than op length 65536 2024-02-19T17:09:04.976 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/684 2024-02-19T17:09:04.976 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/684 2024-02-19T17:09:04.976 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:04.988 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:05.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:05.027 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-02-19T17:09:05.576 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:05.593 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:05.593 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:08.551 INFO:teuthology.orchestra.run.smithi046.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-19T17:09:08.563 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/685 2024-02-19T17:09:08.563 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/685 2024-02-19T17:09:08.563 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:08.572 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:08.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:08.604 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-02-19T17:09:09.265 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:09.279 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:09.279 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:12.486 INFO:teuthology.orchestra.run.smithi046.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-02-19T17:09:12.500 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/686 2024-02-19T17:09:12.500 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/686 2024-02-19T17:09:12.500 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:12.513 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:12.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:12.541 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-02-19T17:09:13.175 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:13.191 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:13.191 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:16.338 INFO:teuthology.orchestra.run.smithi046.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-02-19T17:09:16.352 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/687 2024-02-19T17:09:16.352 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/687 2024-02-19T17:09:16.352 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:16.363 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:16.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:16.398 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-02-19T17:09:17.088 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:17.102 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:17.102 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:17.901 INFO:teuthology.orchestra.run.smithi046.stdout:generic/688 [not run] /tmp/tmp.03skzeLSgitest: file alloc unit 4194304 larger than op length 65536 2024-02-19T17:09:17.916 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/688 2024-02-19T17:09:17.916 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/688 2024-02-19T17:09:17.917 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:17.925 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:17.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:17.965 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-02-19T17:09:18.614 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:18.631 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:19.292 INFO:teuthology.orchestra.run.smithi046.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2024-02-19T17:09:19.307 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/689 2024-02-19T17:09:19.307 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/689 2024-02-19T17:09:19.307 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:19.318 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:19.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:19.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-02-19T17:09:20.027 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:20.044 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:20.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:20.624 INFO:teuthology.orchestra.run.smithi046.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:09:20.639 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/690 2024-02-19T17:09:20.639 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/690 2024-02-19T17:09:20.639 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:20.648 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:20.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:20.688 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-02-19T17:09:21.233 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:21.252 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:21.252 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:21.694 INFO:teuthology.orchestra.run.smithi046.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:09:21.711 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/691 2024-02-19T17:09:21.711 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/691 2024-02-19T17:09:21.712 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:21.721 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:21.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:21.750 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-02-19T17:09:22.391 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:22.407 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:22.407 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:22.847 INFO:teuthology.orchestra.run.smithi046.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:09:22.860 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/692 2024-02-19T17:09:22.860 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/692 2024-02-19T17:09:22.861 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:22.873 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:22.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:22.909 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-02-19T17:09:23.607 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:23.621 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:23.621 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:24.187 INFO:teuthology.orchestra.run.smithi046.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:09:24.202 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/693 2024-02-19T17:09:24.202 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/693 2024-02-19T17:09:24.202 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:24.217 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:24.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:24.247 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-02-19T17:09:24.917 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:24.929 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:24.929 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:26.373 INFO:teuthology.orchestra.run.smithi046.stdout:generic/694 2s 2024-02-19T17:09:26.798 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/694 2024-02-19T17:09:26.798 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:26.806 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:26.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:26.839 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-02-19T17:09:27.489 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:27.509 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:27.510 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:28.170 INFO:teuthology.orchestra.run.smithi046.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:09:28.183 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/695 2024-02-19T17:09:28.184 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/695 2024-02-19T17:09:28.184 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:28.200 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:28.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:28.233 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-02-19T17:09:28.886 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:28.905 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:28.905 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:29.346 INFO:teuthology.orchestra.run.smithi046.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:09:29.360 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/696 2024-02-19T17:09:29.360 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/696 2024-02-19T17:09:29.360 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:29.372 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:29.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:29.398 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-02-19T17:09:30.040 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:30.062 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:30.636 INFO:teuthology.orchestra.run.smithi046.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-02-19T17:09:30.647 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/697 2024-02-19T17:09:30.647 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/697 2024-02-19T17:09:30.647 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:30.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:30.698 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-02-19T17:09:31.365 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:31.379 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:31.379 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:31.830 INFO:teuthology.orchestra.run.smithi046.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:09:31.842 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/698 2024-02-19T17:09:31.843 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/698 2024-02-19T17:09:31.843 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:31.854 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:31.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:31.892 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-02-19T17:09:32.524 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:32.541 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:32.541 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:33.542 INFO:teuthology.orchestra.run.smithi046.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:09:33.558 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/699 2024-02-19T17:09:33.559 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/699 2024-02-19T17:09:33.559 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:33.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:33.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:33.607 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-02-19T17:09:34.246 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:34.262 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:34.263 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:34.772 INFO:teuthology.orchestra.run.smithi046.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:09:34.784 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/700 2024-02-19T17:09:34.784 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/700 2024-02-19T17:09:34.784 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:34.792 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:34.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:34.827 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-02-19T17:09:35.503 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:35.523 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:35.523 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:36.431 INFO:teuthology.orchestra.run.smithi046.stdout:generic/701 1s 2024-02-19T17:09:36.462 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/701 2024-02-19T17:09:36.462 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:36.473 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:36.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:36.508 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-02-19T17:09:37.326 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:37.343 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:37.343 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:37.813 INFO:teuthology.orchestra.run.smithi046.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:09:37.827 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/702 2024-02-19T17:09:37.827 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/702 2024-02-19T17:09:37.827 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:37.840 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:37.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:37.879 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-02-19T17:09:38.563 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:38.590 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:38.591 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:39.155 INFO:teuthology.orchestra.run.smithi046.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:09:39.168 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/703 2024-02-19T17:09:39.168 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/703 2024-02-19T17:09:39.168 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:39.176 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:39.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:39.211 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-02-19T17:09:39.843 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:39.862 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:39.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:40.528 INFO:teuthology.orchestra.run.smithi046.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2024-02-19T17:09:40.540 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/704 2024-02-19T17:09:40.541 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/704 2024-02-19T17:09:40.541 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:40.552 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:40.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:40.585 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-02-19T17:09:41.205 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:41.217 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:41.639 INFO:teuthology.orchestra.run.smithi046.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:09:41.655 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/705 2024-02-19T17:09:41.655 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/705 2024-02-19T17:09:41.655 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:41.671 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:41.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:41.711 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-02-19T17:09:42.348 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:42.362 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:42.363 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:generic/706 2s 2024-02-19T17:09:44.851 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/706 2024-02-19T17:09:44.851 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:44.859 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:44.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:44.914 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-02-19T17:09:45.758 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:45.772 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:45.772 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:46.201 INFO:teuthology.orchestra.run.smithi046.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:09:46.215 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/707 2024-02-19T17:09:46.215 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/707 2024-02-19T17:09:46.215 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:46.226 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:46.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:46.264 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-02-19T17:09:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:46.950 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:48.215 INFO:teuthology.orchestra.run.smithi046.stdout:generic/708 2s 2024-02-19T17:09:48.234 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/708 2024-02-19T17:09:48.234 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:48.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:48.275 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-02-19T17:09:49.145 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:49.174 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:49.174 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:49.800 INFO:teuthology.orchestra.run.smithi046.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-02-19T17:09:49.813 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/709 2024-02-19T17:09:49.814 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/709 2024-02-19T17:09:49.814 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:49.822 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:49.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:49.883 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-02-19T17:09:50.844 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:50.890 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:50.891 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:52.249 INFO:teuthology.orchestra.run.smithi046.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-02-19T17:09:52.271 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/710 2024-02-19T17:09:52.271 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/710 2024-02-19T17:09:52.271 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:52.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:52.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:52.325 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-02-19T17:09:53.180 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:53.197 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:53.197 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:53.896 INFO:teuthology.orchestra.run.smithi046.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-02-19T17:09:53.910 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/711 2024-02-19T17:09:53.910 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/711 2024-02-19T17:09:53.910 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:53.922 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:53.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:53.955 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-02-19T17:09:54.846 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:54.862 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:54.862 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:55.435 INFO:teuthology.orchestra.run.smithi046.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-02-19T17:09:55.448 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/712 2024-02-19T17:09:55.448 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/712 2024-02-19T17:09:55.449 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:55.458 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:55.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:55.493 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-02-19T17:09:56.394 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:56.412 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:56.413 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:57.001 INFO:teuthology.orchestra.run.smithi046.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-02-19T17:09:57.012 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/713 2024-02-19T17:09:57.012 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/713 2024-02-19T17:09:57.012 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:57.023 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:57.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:57.053 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-02-19T17:09:57.958 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:57.974 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:57.975 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:58.548 INFO:teuthology.orchestra.run.smithi046.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-02-19T17:09:58.560 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/714 2024-02-19T17:09:58.560 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/714 2024-02-19T17:09:58.560 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:09:58.572 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:09:58.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:09:58.621 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-02-19T17:09:59.488 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:09:59.514 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:09:59.514 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:00.107 INFO:teuthology.orchestra.run.smithi046.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-02-19T17:10:00.120 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/715 2024-02-19T17:10:00.120 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/715 2024-02-19T17:10:00.120 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:00.131 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:00.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:00.169 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-02-19T17:10:01.055 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:01.069 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:01.070 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:01.647 INFO:teuthology.orchestra.run.smithi046.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-02-19T17:10:01.660 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/716 2024-02-19T17:10:01.660 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/716 2024-02-19T17:10:01.660 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:01.668 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:01.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:01.709 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-02-19T17:10:02.568 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:02.589 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:02.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:03.223 INFO:teuthology.orchestra.run.smithi046.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-02-19T17:10:03.236 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/717 2024-02-19T17:10:03.236 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/717 2024-02-19T17:10:03.236 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:03.244 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:03.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:03.288 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-02-19T17:10:04.147 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:04.164 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:04.164 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:04.730 INFO:teuthology.orchestra.run.smithi046.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-02-19T17:10:04.744 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/718 2024-02-19T17:10:04.744 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/718 2024-02-19T17:10:04.744 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:04.755 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:04.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:04.803 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-02-19T17:10:05.686 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:05.706 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:06.253 INFO:teuthology.orchestra.run.smithi046.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-02-19T17:10:06.265 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/719 2024-02-19T17:10:06.266 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/719 2024-02-19T17:10:06.266 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:06.276 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:06.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:06.317 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-02-19T17:10:07.142 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:07.159 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:07.159 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:07.724 INFO:teuthology.orchestra.run.smithi046.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-02-19T17:10:07.739 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/720 2024-02-19T17:10:07.739 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/720 2024-02-19T17:10:07.739 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:07.754 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:07.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:07.790 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-02-19T17:10:08.654 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:08.670 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:08.671 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:09.215 INFO:teuthology.orchestra.run.smithi046.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-02-19T17:10:09.228 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/721 2024-02-19T17:10:09.228 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/721 2024-02-19T17:10:09.228 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:09.238 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:09.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:09.274 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-02-19T17:10:09.939 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:09.959 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:09.959 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:10.502 INFO:teuthology.orchestra.run.smithi046.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-02-19T17:10:10.515 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/722 2024-02-19T17:10:10.516 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/722 2024-02-19T17:10:10.516 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:10.526 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:10.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:10.558 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-02-19T17:10:11.380 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:11.397 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:11.398 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:11.968 INFO:teuthology.orchestra.run.smithi046.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-02-19T17:10:11.983 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/723 2024-02-19T17:10:11.983 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/723 2024-02-19T17:10:11.983 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:11.994 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:12.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:12.043 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-02-19T17:10:12.916 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:12.931 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:12.931 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:13.492 INFO:teuthology.orchestra.run.smithi046.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-02-19T17:10:13.504 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/724 2024-02-19T17:10:13.504 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/724 2024-02-19T17:10:13.504 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:13.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:13.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:13.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-02-19T17:10:14.459 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:14.480 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:14.480 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:15.130 INFO:teuthology.orchestra.run.smithi046.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-02-19T17:10:15.144 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/725 2024-02-19T17:10:15.144 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/725 2024-02-19T17:10:15.145 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:15.155 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:15.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:15.193 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-02-19T17:10:16.038 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:16.056 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:16.056 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:17.864 INFO:teuthology.orchestra.run.smithi046.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-02-19T17:10:17.876 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/726 2024-02-19T17:10:17.876 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/726 2024-02-19T17:10:17.876 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:17.886 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:17.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:17.936 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-02-19T17:10:18.798 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:18.813 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:18.814 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:19.579 INFO:teuthology.orchestra.run.smithi046.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-02-19T17:10:19.592 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/727 2024-02-19T17:10:19.592 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/727 2024-02-19T17:10:19.593 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:19.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:19.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:19.643 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-02-19T17:10:20.549 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:20.567 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:20.567 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:25.484 INFO:teuthology.orchestra.run.smithi046.stdout:generic/728 5s 2024-02-19T17:10:25.506 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/728 2024-02-19T17:10:25.506 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:25.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:25.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:25.553 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-02-19T17:10:26.215 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:26.232 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:26.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:27.314 INFO:teuthology.orchestra.run.smithi046.stdout:generic/729 1s 2024-02-19T17:10:27.334 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/729 2024-02-19T17:10:27.334 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:27.343 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:27.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:27.378 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-02-19T17:10:28.236 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:28.257 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:28.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:28.749 INFO:teuthology.orchestra.run.smithi046.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2024-02-19T17:10:28.762 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/730 2024-02-19T17:10:28.762 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/730 2024-02-19T17:10:28.762 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:28.772 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:28.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:28.808 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-02-19T17:10:29.469 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:29.489 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:29.965 INFO:teuthology.orchestra.run.smithi046.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2024-02-19T17:10:29.984 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/731 2024-02-19T17:10:29.985 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/731 2024-02-19T17:10:29.985 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:30.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:30.029 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-02-19T17:10:30.694 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:30.708 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:31.221 INFO:teuthology.orchestra.run.smithi046.stdout:generic/732 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:10:31.234 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/732 2024-02-19T17:10:31.234 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/732 2024-02-19T17:10:31.234 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:31.243 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:31.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:31.286 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-02-19T17:10:32.003 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:32.019 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:32.020 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:33.054 INFO:teuthology.orchestra.run.smithi046.stdout:generic/733 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:10:33.071 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/733 2024-02-19T17:10:33.072 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/733 2024-02-19T17:10:33.072 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:33.083 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:33.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:33.120 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-02-19T17:10:33.776 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:33.791 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:33.791 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:34.524 INFO:teuthology.orchestra.run.smithi046.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-02-19T17:10:34.537 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/734 2024-02-19T17:10:34.537 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/734 2024-02-19T17:10:34.537 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:34.547 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:34.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:34.584 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-02-19T17:10:35.408 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:35.426 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:35.426 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:38.518 INFO:teuthology.orchestra.run.smithi046.stdout:generic/735 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-02-19T17:10:38.535 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/735 2024-02-19T17:10:38.535 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/735 2024-02-19T17:10:38.536 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:10:38.544 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:10:38.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:10:38.578 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-02-19T17:10:39.447 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:10:39.461 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:10:39.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:13:15.945 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T17:13:15.952 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T17:13:46.114 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T17:13:46.118 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T17:14:04.570 INFO:teuthology.orchestra.run.smithi046.stdout:generic/736 205s 2024-02-19T17:14:04.587 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/736 2024-02-19T17:14:04.587 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:14:04.596 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:04.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:14:04.633 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-02-19T17:14:05.450 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:14:05.464 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:14:05.464 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:05.857 INFO:teuthology.orchestra.run.smithi046.stdout:generic/737 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:14:05.868 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/737 2024-02-19T17:14:05.869 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/737 2024-02-19T17:14:05.869 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:14:05.879 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:05.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:14:05.919 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-02-19T17:14:06.571 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:14:06.586 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:14:06.586 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:07.002 INFO:teuthology.orchestra.run.smithi046.stdout:generic/738 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:14:07.020 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/738 2024-02-19T17:14:07.020 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/738 2024-02-19T17:14:07.020 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:14:07.029 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:07.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:14:07.062 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.ca873QOZoIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/739) 2024-02-19T17:14:07.657 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2024-02-19T17:14:07.675 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-19T17:14:07.675 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:08.187 INFO:teuthology.orchestra.run.smithi046.stdout:generic/739 [not run] this test requires a valid $SCRATCH_DEV 2024-02-19T17:14:08.201 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/739 2024-02-19T17:14:08.201 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/739 2024-02-19T17:14:08.201 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2024-02-19T17:14:08.212 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:08.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-02-19T17:14:08.243 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 16========================================================= 2024-02-19T17:14:08.243 DEBUG:teuthology.orchestra.run.smithi046:> sudo userdel --force --remove fsgqa 2024-02-19T17:14:13.932 DEBUG:teuthology.orchestra.run.smithi046:> sudo userdel --force --remove 123456-fsgqa 2024-02-19T17:14:14.629 DEBUG:teuthology.orchestra.run.smithi046:> sudo groupdel fsgqa 2024-02-19T17:14:14.758 INFO:teuthology.orchestra.run.smithi046.stderr:groupdel: group 'fsgqa' does not exist 2024-02-19T17:14:14.763 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-19T17:14:14.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T17:14:14.764 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.ca873QOZoIxfstests-dev/results) 2024-02-19T17:14:14.835 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T17:14:14.835 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2024-02-19T17:14:14.836 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.ca873QOZoIxfstests-dev 2024-02-19T17:14:14.836 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf /tmp/tmp.ca873QOZoIxfstests-dev 2024-02-19T17:14:15.571 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-19T17:14:15.571 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-19T17:14:15.740 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-19T17:14:16.001 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-19T17:14:16.001 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T17:14:16.001 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T17:14:16.078 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054609,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500052k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250024k,nr_inodes=812506,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500052k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-02-19T17:14:16.078 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T17:14:16.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T17:14:16.078 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-19T17:14:16.192 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T17:14:16.192 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T17:14:16.254 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053823,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-02-19T17:14:16.254 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T17:14:16.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T17:14:16.254 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-19T17:14:16.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T17:14:16.317 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-02-19T17:14:16.317 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T17:14:16.318 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T17:14:16.323 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T17:14:16.364 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-19T17:14:16.365 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054609,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500052k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250024k,nr_inodes=812506,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500052k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-02-19T17:14:16.365 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T17:14:16.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T17:14:16.366 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-02-19T17:14:16.456 INFO:teuthology.orchestra.run.smithi046.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-02-19T17:14:16.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T17:14:16.457 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T17:14:16.457 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T17:14:16.472 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-19T17:14:16.487+0000 7f7183000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93799) UID: 0 2024-02-19T17:14:16.473 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-19T17:14:16.487+0000 7f3c04600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93799) UID: 0 2024-02-19T17:14:16.473 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-19T17:14:16.487+0000 7f99f5600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93799) UID: 0 2024-02-19T17:14:16.473 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-19T17:14:16.488+0000 7f35abe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 93799) UID: 0 2024-02-19T17:14:16.509 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053823,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-02-19T17:14:16.510 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T17:14:16.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T17:14:16.510 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-02-19T17:14:16.610 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-02-19T17:14:16.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T17:14:16.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T17:14:17.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.174+0000 7fb6e6e00640 1 Processor -- start 2024-02-19T17:14:17.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.175+0000 7fb6e6e00640 1 -- start start 2024-02-19T17:14:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.176+0000 7fb6e6e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e0159dd0 0x7fb6e00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.176+0000 7fb6e6e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb6e00cd7f0 0x7fb6e006d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.176+0000 7fb6e6e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e00cfbe0 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.176+0000 7fb6e6e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e006efb0 con 0x7fb6e00cd7f0 2024-02-19T17:14:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.176+0000 7fb6e6e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e015a520 con 0x7fb6e0159dd0 2024-02-19T17:14:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.176+0000 7fb6e5000640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb6e00cf7c0 0x7fb6e00cd0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33090/0 (socket says 172.21.15.46:33090) 2024-02-19T17:14:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.176+0000 7fb6e5000640 1 -- 172.21.15.46:0/1791060617 learned_addr learned my addr 172.21.15.46:0/1791060617 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.176+0000 7fb6e5a00640 1 --2- 172.21.15.46:0/1791060617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e0159dd0 0x7fb6e00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:17.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.177+0000 7fb6e6400640 1 --2- 172.21.15.46:0/1791060617 >> v2:172.21.15.142:3300/0 conn(0x7fb6e00cd7f0 0x7fb6e006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:17.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.177+0000 7fb6e5a00640 1 -- 172.21.15.46:0/1791060617 >> v2:172.21.15.142:3300/0 conn(0x7fb6e00cd7f0 msgr2=0x7fb6e006d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:17.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.177+0000 7fb6e5a00640 1 --2- 172.21.15.46:0/1791060617 >> v2:172.21.15.142:3300/0 conn(0x7fb6e00cd7f0 0x7fb6e006d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.177+0000 7fb6e5a00640 1 -- 172.21.15.46:0/1791060617 >> v1:172.21.15.46:6789/0 conn(0x7fb6e00cf7c0 legacy=0x7fb6e00cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:17.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.177+0000 7fb6e5a00640 1 -- 172.21.15.46:0/1791060617 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e015a800 con 0x7fb6e0159dd0 2024-02-19T17:14:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.179+0000 7fb6e5a00640 1 --2- 172.21.15.46:0/1791060617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e0159dd0 0x7fb6e00cf280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40097a0 tx=0x7fb6d402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb29be7d16c8dfe server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.180+0000 7fb6dfe00640 1 -- 172.21.15.46:0/1791060617 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4031830 con 0x7fb6e0159dd0 2024-02-19T17:14:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.180+0000 7fb6dfe00640 1 -- 172.21.15.46:0/1791060617 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d4031990 con 0x7fb6e0159dd0 2024-02-19T17:14:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.180+0000 7fb6dfe00640 1 -- 172.21.15.46:0/1791060617 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4031d20 con 0x7fb6e0159dd0 2024-02-19T17:14:17.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.181+0000 7fb6e6e00640 1 -- 172.21.15.46:0/1791060617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e0159dd0 msgr2=0x7fb6e00cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:17.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.181+0000 7fb6e6e00640 1 --2- 172.21.15.46:0/1791060617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e0159dd0 0x7fb6e00cf280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40097a0 tx=0x7fb6d402b8d0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.182+0000 7fb6e6e00640 1 -- 172.21.15.46:0/1791060617 shutdown_connections 2024-02-19T17:14:17.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.182+0000 7fb6e6e00640 1 --2- 172.21.15.46:0/1791060617 >> v2:172.21.15.142:3300/0 conn(0x7fb6e00cd7f0 0x7fb6e006d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.182+0000 7fb6e6e00640 1 --2- 172.21.15.46:0/1791060617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e0159dd0 0x7fb6e00cf280 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.182+0000 7fb6e6e00640 1 -- 172.21.15.46:0/1791060617 >> 172.21.15.46:0/1791060617 conn(0x7fb6e00b0ec0 msgr2=0x7fb6e00b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:17.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.183+0000 7fb6e6e00640 1 -- 172.21.15.46:0/1791060617 shutdown_connections 2024-02-19T17:14:17.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.184+0000 7fb6e6e00640 1 -- 172.21.15.46:0/1791060617 wait complete. 2024-02-19T17:14:17.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.187+0000 7fb6e6e00640 1 Processor -- start 2024-02-19T17:14:17.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.191+0000 7fb6e6e00640 1 -- start start 2024-02-19T17:14:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.193+0000 7fb6e6e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6e00cd7f0 0x7fb6e01593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.193+0000 7fb6e6e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e00cf7c0 0x7fb6e015c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.193+0000 7fb6e6e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e0159dd0 0x7fb6e015c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.193+0000 7fb6e6e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e014e970 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.193+0000 7fb6e6e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e0167cc0 con 0x7fb6e00cd7f0 2024-02-19T17:14:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.193+0000 7fb6e6e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e0159910 con 0x7fb6e0159dd0 2024-02-19T17:14:17.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.194+0000 7fb6e5000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e00cf7c0 0x7fb6e015c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:17.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.194+0000 7fb6e5a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6e00cd7f0 0x7fb6e01593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:17.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.194+0000 7fb6e5000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e00cf7c0 0x7fb6e015c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48090/0 (socket says 172.21.15.46:48090) 2024-02-19T17:14:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.194+0000 7fb6e5000640 1 -- 172.21.15.46:0/2197019192 learned_addr learned my addr 172.21.15.46:0/2197019192 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.194+0000 7fb6e6400640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e0159dd0 0x7fb6e015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.194+0000 7fb6e5000640 1 -- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e0159dd0 msgr2=0x7fb6e015c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.194+0000 7fb6e5000640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e0159dd0 0x7fb6e015c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.194+0000 7fb6e5000640 1 -- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6e00cd7f0 msgr2=0x7fb6e01593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.194+0000 7fb6e5000640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6e00cd7f0 0x7fb6e01593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.194+0000 7fb6e5000640 1 -- 172.21.15.46:0/2197019192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d4009400 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.195+0000 7fb6e6400640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e0159dd0 0x7fb6e015c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T17:14:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.195+0000 7fb6e5000640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e00cf7c0 0x7fb6e015c220 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00c430 tx=0x7fb6cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.195+0000 7fb6dd600640 1 -- 172.21.15.46:0/2197019192 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc005ce0 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.195+0000 7fb6dd600640 1 -- 172.21.15.46:0/2197019192 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6cc005e40 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.195+0000 7fb6dd600640 1 -- 172.21.15.46:0/2197019192 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc0072f0 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.195+0000 7fb6e6e00640 1 -- 172.21.15.46:0/2197019192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e014ebc0 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.198+0000 7fb6e6e00640 1 -- 172.21.15.46:0/2197019192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e0167950 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.206+0000 7fb6dd600640 1 -- 172.21.15.46:0/2197019192 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb6cc007450 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.208+0000 7fb6dd600640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb6c006b890 0x7fb6c006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:17.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.208+0000 7fb6e5a00640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb6c006b890 0x7fb6c006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:17.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.209+0000 7fb6dd600640 1 -- 172.21.15.46:0/2197019192 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6cc057c70 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.199+0000 7fb6e6e00640 1 -- 172.21.15.46:0/2197019192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e0167e50 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.216+0000 7fb6e5a00640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb6c006b890 0x7fb6c006dd50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40097a0 tx=0x7fb6d403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:17.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.229+0000 7fb6dd600640 1 -- 172.21.15.46:0/2197019192 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb6cc0546a0 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.632+0000 7fb6e6e00640 1 -- 172.21.15.46:0/2197019192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6e004eee0 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.647+0000 7fb6dd600640 1 -- 172.21.15.46:0/2197019192 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fb6cc017030 con 0x7fb6e00cf7c0 2024-02-19T17:14:17.633 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:17.633 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2121507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2121507890},{"type":"v1","addr":"172.21.15.142:6835","nonce":2121507890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3952092655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3952092655},{"type":"v1","addr":"172.21.15.46:6835","nonce":3952092655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1741774776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1741774776},{"type":"v1","addr":"172.21.15.142:6837","nonce":1741774776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:59:16.065049+0000","modified":"2024-02-19T06:59:19.096312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6834/1322569769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1322569769},{"type":"v1","addr":"172.21.15.46:6834","nonce":1322569769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-19T17:14:17.634 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-02-19T17:14:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.651+0000 7fb6e6e00640 1 -- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb6c006b890 msgr2=0x7fb6c006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.651+0000 7fb6e6e00640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb6c006b890 0x7fb6c006dd50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40097a0 tx=0x7fb6d403c040 comp rx=0 tx=0).stop 2024-02-19T17:14:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.651+0000 7fb6e6e00640 1 -- 172.21.15.46:0/2197019192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e00cf7c0 msgr2=0x7fb6e015c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.651+0000 7fb6e6e00640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e00cf7c0 0x7fb6e015c220 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00c430 tx=0x7fb6cc00c8f0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.651+0000 7fb6e6e00640 1 -- 172.21.15.46:0/2197019192 shutdown_connections 2024-02-19T17:14:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.651+0000 7fb6e6e00640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb6c006b890 0x7fb6c006dd50 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.651+0000 7fb6e6e00640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e0159dd0 0x7fb6e015c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.651+0000 7fb6e6e00640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e00cf7c0 0x7fb6e015c220 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.651+0000 7fb6e6e00640 1 --2- 172.21.15.46:0/2197019192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6e00cd7f0 0x7fb6e01593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.651+0000 7fb6e6e00640 1 -- 172.21.15.46:0/2197019192 >> 172.21.15.46:0/2197019192 conn(0x7fb6e00b0ec0 msgr2=0x7fb6e00ac9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.651+0000 7fb6e6e00640 1 -- 172.21.15.46:0/2197019192 shutdown_connections 2024-02-19T17:14:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.652+0000 7fb6e6e00640 1 -- 172.21.15.46:0/2197019192 wait complete. 2024-02-19T17:14:17.666 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T17:14:17.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.937+0000 7ff241e00640 1 Processor -- start 2024-02-19T17:14:17.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.937+0000 7ff241e00640 1 -- start start 2024-02-19T17:14:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.938+0000 7ff241e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff23c0b2590 0x7ff23c0d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.939+0000 7ff241e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff23c0b2ae0 0x7ff23c0d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.939+0000 7ff241e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23c161ba0 con 0x7ff23c0d0310 2024-02-19T17:14:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.939+0000 7ff241e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c162820 con 0x7ff23c0b2ae0 2024-02-19T17:14:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.939+0000 7ff241e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c161e80 con 0x7ff23c0b2590 2024-02-19T17:14:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.939+0000 7ff23aa00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff23c0d0310 0x7ff23c0d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33106/0 (socket says 172.21.15.46:33106) 2024-02-19T17:14:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.939+0000 7ff23aa00640 1 -- 172.21.15.46:0/4047966568 learned_addr learned my addr 172.21.15.46:0/4047966568 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.939+0000 7ff23b400640 1 --2- 172.21.15.46:0/4047966568 >> v2:172.21.15.142:3300/0 conn(0x7ff23c0b2ae0 0x7ff23c0d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:17.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.940+0000 7ff23a000640 1 --2- 172.21.15.46:0/4047966568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff23c0b2590 0x7ff23c0d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:17.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.940+0000 7ff23b400640 1 -- 172.21.15.46:0/4047966568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff23c0b2590 msgr2=0x7ff23c0d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:17.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.940+0000 7ff23b400640 1 --2- 172.21.15.46:0/4047966568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff23c0b2590 0x7ff23c0d1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.940+0000 7ff23b400640 1 -- 172.21.15.46:0/4047966568 >> v1:172.21.15.46:6789/0 conn(0x7ff23c0d0310 legacy=0x7ff23c0d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:17.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.940+0000 7ff23b400640 1 -- 172.21.15.46:0/4047966568 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c162160 con 0x7ff23c0b2ae0 2024-02-19T17:14:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.942+0000 7ff23b400640 1 --2- 172.21.15.46:0/4047966568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff23c0b2ae0 0x7ff23c0d2420 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff234009d90 tx=0x7ff23402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=658122f7ec3ab40d server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.943+0000 7ff239600640 1 -- 172.21.15.46:0/4047966568 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23402cbc0 con 0x7ff23c0b2ae0 2024-02-19T17:14:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.943+0000 7ff239600640 1 -- 172.21.15.46:0/4047966568 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23402cd20 con 0x7ff23c0b2ae0 2024-02-19T17:14:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.943+0000 7ff239600640 1 -- 172.21.15.46:0/4047966568 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234034660 con 0x7ff23c0b2ae0 2024-02-19T17:14:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.944+0000 7ff241e00640 1 -- 172.21.15.46:0/4047966568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff23c0b2ae0 msgr2=0x7ff23c0d2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.944+0000 7ff241e00640 1 --2- 172.21.15.46:0/4047966568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff23c0b2ae0 0x7ff23c0d2420 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff234009d90 tx=0x7ff23402be10 comp rx=0 tx=0).stop 2024-02-19T17:14:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.944+0000 7ff241e00640 1 -- 172.21.15.46:0/4047966568 shutdown_connections 2024-02-19T17:14:17.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.944+0000 7ff241e00640 1 --2- 172.21.15.46:0/4047966568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff23c0b2ae0 0x7ff23c0d2420 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.944+0000 7ff241e00640 1 --2- 172.21.15.46:0/4047966568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff23c0b2590 0x7ff23c0d1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.944+0000 7ff241e00640 1 -- 172.21.15.46:0/4047966568 >> 172.21.15.46:0/4047966568 conn(0x7ff23c06be20 msgr2=0x7ff23c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:17.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.944+0000 7ff241e00640 1 -- 172.21.15.46:0/4047966568 shutdown_connections 2024-02-19T17:14:17.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.944+0000 7ff241e00640 1 -- 172.21.15.46:0/4047966568 wait complete. 2024-02-19T17:14:17.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.946+0000 7ff241e00640 1 Processor -- start 2024-02-19T17:14:17.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.946+0000 7ff241e00640 1 -- start start 2024-02-19T17:14:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.948+0000 7ff241e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff23c0b2590 0x7ff23c0c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.948+0000 7ff241e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff23c0b2ae0 0x7ff23c070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.948+0000 7ff241e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff23c0d0310 0x7ff23c071410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:17.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.948+0000 7ff23aa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff23c0b2590 0x7ff23c0c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:17.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.948+0000 7ff23aa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff23c0b2590 0x7ff23c0c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:37482/0 (socket says 172.21.15.46:37482) 2024-02-19T17:14:17.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.948+0000 7ff23a000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff23c0b2ae0 0x7ff23c070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:17.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.948+0000 7ff23aa00640 1 -- 172.21.15.46:0/1200713135 learned_addr learned my addr 172.21.15.46:0/1200713135 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:17.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.948+0000 7ff241e00640 1 -- 172.21.15.46:0/1200713135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0b3980 con 0x7ff23c0d0310 2024-02-19T17:14:17.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.948+0000 7ff241e00640 1 -- 172.21.15.46:0/1200713135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0b4500 con 0x7ff23c0b2590 2024-02-19T17:14:17.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.948+0000 7ff241e00640 1 -- 172.21.15.46:0/1200713135 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0b3bd0 con 0x7ff23c0b2ae0 2024-02-19T17:14:17.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.949+0000 7ff23b400640 1 --2- 172.21.15.46:0/1200713135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff23c0d0310 0x7ff23c071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:17.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.949+0000 7ff23b400640 1 -- 172.21.15.46:0/1200713135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff23c0b2ae0 msgr2=0x7ff23c070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:17.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.949+0000 7ff23b400640 1 --2- 172.21.15.46:0/1200713135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff23c0b2ae0 0x7ff23c070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.949+0000 7ff23b400640 1 -- 172.21.15.46:0/1200713135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff23c0b2590 msgr2=0x7ff23c0c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:17.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.949+0000 7ff23b400640 1 --2- 172.21.15.46:0/1200713135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff23c0b2590 0x7ff23c0c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:17.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.949+0000 7ff23b400640 1 -- 172.21.15.46:0/1200713135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff234009a70 con 0x7ff23c0d0310 2024-02-19T17:14:17.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.950+0000 7ff23b400640 1 --2- 172.21.15.46:0/1200713135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff23c0d0310 0x7ff23c071410 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7ff23c06caa0 tx=0x7ff234004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.951+0000 7ff233400640 1 -- 172.21.15.46:0/1200713135 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23403e610 con 0x7ff23c0d0310 2024-02-19T17:14:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.951+0000 7ff233400640 1 -- 172.21.15.46:0/1200713135 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23402ce90 con 0x7ff23c0d0310 2024-02-19T17:14:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.951+0000 7ff233400640 1 -- 172.21.15.46:0/1200713135 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23403e9d0 con 0x7ff23c0d0310 2024-02-19T17:14:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.951+0000 7ff241e00640 1 -- 172.21.15.46:0/1200713135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c0b3eb0 con 0x7ff23c0d0310 2024-02-19T17:14:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.951+0000 7ff241e00640 1 -- 172.21.15.46:0/1200713135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c0c7be0 con 0x7ff23c0d0310 2024-02-19T17:14:17.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.954+0000 7ff241e00640 1 -- 172.21.15.46:0/1200713135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23c0682b0 con 0x7ff23c0d0310 2024-02-19T17:14:17.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.962+0000 7ff233400640 1 -- 172.21.15.46:0/1200713135 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff23403b050 con 0x7ff23c0d0310 2024-02-19T17:14:17.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.963+0000 7ff233400640 1 --2- 172.21.15.46:0/1200713135 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff21806b8e0 0x7ff21806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:17.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.963+0000 7ff233400640 1 -- 172.21.15.46:0/1200713135 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2340aca30 con 0x7ff23c0d0310 2024-02-19T17:14:17.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.964+0000 7ff23aa00640 1 --2- 172.21.15.46:0/1200713135 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff21806b8e0 0x7ff21806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:17.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.966+0000 7ff23aa00640 1 --2- 172.21.15.46:0/1200713135 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff21806b8e0 0x7ff21806dda0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff224009370 tx=0x7ff224009300 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:17.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:17.966+0000 7ff233400640 1 -- 172.21.15.46:0/1200713135 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff234077690 con 0x7ff23c0d0310 2024-02-19T17:14:18.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.264+0000 7ff241e00640 1 -- 172.21.15.46:0/1200713135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff23c0b4640 con 0x7ff23c0d0310 2024-02-19T17:14:18.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.288+0000 7ff233400640 1 -- 172.21.15.46:0/1200713135 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16669 (secure 0 0 0) 0x7ff234039090 con 0x7ff23c0d0310 2024-02-19T17:14:18.275 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:18.275 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":35,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:59:17.589125+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:59:14.017896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-19T06:59:15.078011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T17:14:18.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.292+0000 7ff241e00640 1 -- 172.21.15.46:0/1200713135 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff21806b8e0 msgr2=0x7ff21806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:18.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.292+0000 7ff241e00640 1 --2- 172.21.15.46:0/1200713135 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff21806b8e0 0x7ff21806dda0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff224009370 tx=0x7ff224009300 comp rx=0 tx=0).stop 2024-02-19T17:14:18.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.292+0000 7ff241e00640 1 -- 172.21.15.46:0/1200713135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff23c0d0310 msgr2=0x7ff23c071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:18.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.292+0000 7ff241e00640 1 --2- 172.21.15.46:0/1200713135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff23c0d0310 0x7ff23c071410 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7ff23c06caa0 tx=0x7ff234004a40 comp rx=0 tx=0).stop 2024-02-19T17:14:18.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.292+0000 7ff241e00640 1 -- 172.21.15.46:0/1200713135 shutdown_connections 2024-02-19T17:14:18.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.292+0000 7ff241e00640 1 --2- 172.21.15.46:0/1200713135 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff21806b8e0 0x7ff21806dda0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:18.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.292+0000 7ff241e00640 1 --2- 172.21.15.46:0/1200713135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff23c0d0310 0x7ff23c071410 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:18.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.292+0000 7ff241e00640 1 --2- 172.21.15.46:0/1200713135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff23c0b2ae0 0x7ff23c070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:18.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.292+0000 7ff241e00640 1 --2- 172.21.15.46:0/1200713135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff23c0b2590 0x7ff23c0c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:18.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.292+0000 7ff241e00640 1 -- 172.21.15.46:0/1200713135 >> 172.21.15.46:0/1200713135 conn(0x7ff23c06be20 msgr2=0x7ff23c0cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:18.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.293+0000 7ff241e00640 1 -- 172.21.15.46:0/1200713135 shutdown_connections 2024-02-19T17:14:18.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.293+0000 7ff241e00640 1 -- 172.21.15.46:0/1200713135 wait complete. 2024-02-19T17:14:18.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T06:57:43.741269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-19T06:59:14.017896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-02-19T06:59:15.078011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T17:14:18.302 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T17:14:18.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.560+0000 7fe6aaa00640 1 Processor -- start 2024-02-19T17:14:18.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.561+0000 7fe6aaa00640 1 -- start start 2024-02-19T17:14:18.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.562+0000 7fe6aaa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6a40b3e70 0x7fe6a40b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:18.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.562+0000 7fe6aaa00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe6a40b2a10 0x7fe6a40cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:18.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.562+0000 7fe6aaa00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a40b49f0 con 0x7fe6a415dde0 2024-02-19T17:14:18.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.562+0000 7fe6aaa00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a40cd340 con 0x7fe6a40b2a10 2024-02-19T17:14:18.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.562+0000 7fe6aaa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40b4430 con 0x7fe6a40b3e70 2024-02-19T17:14:18.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.563+0000 7fe6a3e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe6a415dde0 0x7fe6a406dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33122/0 (socket says 172.21.15.46:33122) 2024-02-19T17:14:18.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.563+0000 7fe6a3e00640 1 -- 172.21.15.46:0/1235132071 learned_addr learned my addr 172.21.15.46:0/1235132071 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:18.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.563+0000 7fe6a3400640 1 --2- 172.21.15.46:0/1235132071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6a40b3e70 0x7fe6a40b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:18.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.563+0000 7fe6a8a00640 1 --2- 172.21.15.46:0/1235132071 >> v2:172.21.15.142:3300/0 conn(0x7fe6a40b2a10 0x7fe6a40cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:18.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.563+0000 7fe6a3400640 1 -- 172.21.15.46:0/1235132071 >> v2:172.21.15.142:3300/0 conn(0x7fe6a40b2a10 msgr2=0x7fe6a40cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:18.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.563+0000 7fe6a3400640 1 --2- 172.21.15.46:0/1235132071 >> v2:172.21.15.142:3300/0 conn(0x7fe6a40b2a10 0x7fe6a40cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:18.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.563+0000 7fe6a3400640 1 -- 172.21.15.46:0/1235132071 >> v1:172.21.15.46:6789/0 conn(0x7fe6a415dde0 legacy=0x7fe6a406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:18.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.564+0000 7fe6a3400640 1 -- 172.21.15.46:0/1235132071 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a40b4710 con 0x7fe6a40b3e70 2024-02-19T17:14:18.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.565+0000 7fe6a3400640 1 --2- 172.21.15.46:0/1235132071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6a40b3e70 0x7fe6a40b24d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe69400ba40 tx=0x7fe69402e080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54cb2ab9f998e557 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:18.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.568+0000 7fe6a2a00640 1 -- 172.21.15.46:0/1235132071 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69402ee30 con 0x7fe6a40b3e70 2024-02-19T17:14:18.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.568+0000 7fe6a2a00640 1 -- 172.21.15.46:0/1235132071 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe694036440 con 0x7fe6a40b3e70 2024-02-19T17:14:18.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.568+0000 7fe6a2a00640 1 -- 172.21.15.46:0/1235132071 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6940367d0 con 0x7fe6a40b3e70 2024-02-19T17:14:18.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.569+0000 7fe6aaa00640 1 -- 172.21.15.46:0/1235132071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6a40b3e70 msgr2=0x7fe6a40b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.569+0000 7fe6aaa00640 1 --2- 172.21.15.46:0/1235132071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6a40b3e70 0x7fe6a40b24d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe69400ba40 tx=0x7fe69402e080 comp rx=0 tx=0).stop 2024-02-19T17:14:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.569+0000 7fe6aaa00640 1 -- 172.21.15.46:0/1235132071 shutdown_connections 2024-02-19T17:14:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.569+0000 7fe6aaa00640 1 --2- 172.21.15.46:0/1235132071 >> v2:172.21.15.142:3300/0 conn(0x7fe6a40b2a10 0x7fe6a40cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.569+0000 7fe6aaa00640 1 --2- 172.21.15.46:0/1235132071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6a40b3e70 0x7fe6a40b24d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.569+0000 7fe6aaa00640 1 -- 172.21.15.46:0/1235132071 >> 172.21.15.46:0/1235132071 conn(0x7fe6a4066fc0 msgr2=0x7fe6a406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.569+0000 7fe6aaa00640 1 -- 172.21.15.46:0/1235132071 shutdown_connections 2024-02-19T17:14:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.569+0000 7fe6aaa00640 1 -- 172.21.15.46:0/1235132071 wait complete. 2024-02-19T17:14:18.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.571+0000 7fe6aaa00640 1 Processor -- start 2024-02-19T17:14:18.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.571+0000 7fe6aaa00640 1 -- start start 2024-02-19T17:14:18.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.573+0000 7fe6aaa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6a40b2a10 0x7fe6a4156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:18.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.573+0000 7fe6aaa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a40b3e70 0x7fe6a40714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:18.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.573+0000 7fe6aaa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6a415dde0 0x7fe6a4071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:18.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.573+0000 7fe6aaa00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a4147de0 con 0x7fe6a40b3e70 2024-02-19T17:14:18.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.573+0000 7fe6aaa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a41552e0 con 0x7fe6a415dde0 2024-02-19T17:14:18.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.573+0000 7fe6aaa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a4153db0 con 0x7fe6a40b2a10 2024-02-19T17:14:18.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.573+0000 7fe6a3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a40b3e70 0x7fe6a40714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:18.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.573+0000 7fe6a3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a40b3e70 0x7fe6a40714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48114/0 (socket says 172.21.15.46:48114) 2024-02-19T17:14:18.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.573+0000 7fe6a3400640 1 -- 172.21.15.46:0/4187943192 learned_addr learned my addr 172.21.15.46:0/4187943192 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:18.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.573+0000 7fe6a3e00640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6a40b2a10 0x7fe6a4156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:18.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.574+0000 7fe6a8a00640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6a415dde0 0x7fe6a4071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:18.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.574+0000 7fe6a3e00640 1 -- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6a415dde0 msgr2=0x7fe6a4071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:18.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.574+0000 7fe6a3e00640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6a415dde0 0x7fe6a4071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:18.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.574+0000 7fe6a3e00640 1 -- 172.21.15.46:0/4187943192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a40b3e70 msgr2=0x7fe6a40714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:18.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.574+0000 7fe6a3e00640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a40b3e70 0x7fe6a40714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:18.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.575+0000 7fe6a3e00640 1 -- 172.21.15.46:0/4187943192 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69400b6a0 con 0x7fe6a40b2a10 2024-02-19T17:14:18.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.575+0000 7fe6a8a00640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6a415dde0 0x7fe6a4071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T17:14:18.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.575+0000 7fe6a3e00640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6a40b2a10 0x7fe6a4156080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00c390 tx=0x7fe68c00c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:18.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.576+0000 7fe69be00640 1 -- 172.21.15.46:0/4187943192 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c005ce0 con 0x7fe6a40b2a10 2024-02-19T17:14:18.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.576+0000 7fe69be00640 1 -- 172.21.15.46:0/4187943192 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c005e40 con 0x7fe6a40b2a10 2024-02-19T17:14:18.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.576+0000 7fe69be00640 1 -- 172.21.15.46:0/4187943192 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c007310 con 0x7fe6a40b2a10 2024-02-19T17:14:18.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.576+0000 7fe6aaa00640 1 -- 172.21.15.46:0/4187943192 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a41555a0 con 0x7fe6a40b2a10 2024-02-19T17:14:18.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.576+0000 7fe6aaa00640 1 -- 172.21.15.46:0/4187943192 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a4155b60 con 0x7fe6a40b2a10 2024-02-19T17:14:18.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.580+0000 7fe6aaa00640 1 -- 172.21.15.46:0/4187943192 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a4067ba0 con 0x7fe6a40b2a10 2024-02-19T17:14:18.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.581+0000 7fe69be00640 1 -- 172.21.15.46:0/4187943192 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe68c007470 con 0x7fe6a40b2a10 2024-02-19T17:14:18.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.582+0000 7fe69be00640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe68006b860 0x7fe68006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:18.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.583+0000 7fe69be00640 1 -- 172.21.15.46:0/4187943192 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe68c001000 con 0x7fe6a40b2a10 2024-02-19T17:14:18.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.586+0000 7fe6a3400640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe68006b860 0x7fe68006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:18.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.591+0000 7fe69be00640 1 -- 172.21.15.46:0/4187943192 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe68c054ae0 con 0x7fe6a40b2a10 2024-02-19T17:14:18.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.594+0000 7fe6a3400640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe68006b860 0x7fe68006dd20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe69402e0c0 tx=0x7fe694008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:18.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.903+0000 7fe6aaa00640 1 -- 172.21.15.46:0/4187943192 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6a4152ec0 con 0x7fe6a40b2a10 2024-02-19T17:14:18.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.913+0000 7fe69be00640 1 -- 172.21.15.46:0/4187943192 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe68c017030 con 0x7fe6a40b2a10 2024-02-19T17:14:18.900 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T17:14:18.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.916+0000 7fe6aaa00640 1 -- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe68006b860 msgr2=0x7fe68006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:18.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.916+0000 7fe6aaa00640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe68006b860 0x7fe68006dd20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe69402e0c0 tx=0x7fe694008040 comp rx=0 tx=0).stop 2024-02-19T17:14:18.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.916+0000 7fe6aaa00640 1 -- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6a40b2a10 msgr2=0x7fe6a4156080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:18.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.916+0000 7fe6aaa00640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6a40b2a10 0x7fe6a4156080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00c390 tx=0x7fe68c00c790 comp rx=0 tx=0).stop 2024-02-19T17:14:18.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.918+0000 7fe6aaa00640 1 -- 172.21.15.46:0/4187943192 shutdown_connections 2024-02-19T17:14:18.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.918+0000 7fe6aaa00640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe68006b860 0x7fe68006dd20 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:18.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.918+0000 7fe6aaa00640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6a415dde0 0x7fe6a4071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:18.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.918+0000 7fe6aaa00640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a40b3e70 0x7fe6a40714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:18.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.918+0000 7fe6aaa00640 1 --2- 172.21.15.46:0/4187943192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6a40b2a10 0x7fe6a4156080 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:18.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.918+0000 7fe6aaa00640 1 -- 172.21.15.46:0/4187943192 >> 172.21.15.46:0/4187943192 conn(0x7fe6a4066fc0 msgr2=0x7fe6a406d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:18.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.922+0000 7fe6aaa00640 1 -- 172.21.15.46:0/4187943192 shutdown_connections 2024-02-19T17:14:18.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:18.922+0000 7fe6aaa00640 1 -- 172.21.15.46:0/4187943192 wait complete. 2024-02-19T17:14:18.935 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-19T17:14:19.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.203+0000 7f177b000640 1 Processor -- start 2024-02-19T17:14:19.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.203+0000 7f177b000640 1 -- start start 2024-02-19T17:14:19.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.205+0000 7f177b000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17740cf010 0x7f17740d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:19.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.205+0000 7f177b000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17740d21a0 0x7f17740b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:19.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.205+0000 7f177b000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17740b7250 con 0x7f177415dcd0 2024-02-19T17:14:19.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.205+0000 7f177b000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17740d2990 con 0x7f17740cf010 2024-02-19T17:14:19.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.205+0000 7f177b000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17740d2c70 con 0x7f17740d21a0 2024-02-19T17:14:19.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.205+0000 7f1773400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17740cf010 0x7f17740d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:19.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.205+0000 7f1773400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f17740cf010 0x7f17740d1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48128/0 (socket says 172.21.15.46:48128) 2024-02-19T17:14:19.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.205+0000 7f1773400640 1 -- 172.21.15.46:0/994397693 learned_addr learned my addr 172.21.15.46:0/994397693 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:19.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.206+0000 7f1773400640 1 -- 172.21.15.46:0/994397693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17740d21a0 msgr2=0x7f17740b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:19.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.206+0000 7f1779000640 1 --2- 172.21.15.46:0/994397693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17740d21a0 0x7f17740b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:19.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.206+0000 7f1773400640 1 --2- 172.21.15.46:0/994397693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17740d21a0 0x7f17740b76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:19.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.207+0000 7f1773400640 1 -- 172.21.15.46:0/994397693 >> v1:172.21.15.46:6789/0 conn(0x7f177415dcd0 legacy=0x7f17740ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:19.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.207+0000 7f1773400640 1 -- 172.21.15.46:0/994397693 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17740d2f50 con 0x7f17740cf010 2024-02-19T17:14:19.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.207+0000 7f1779000640 1 --2- 172.21.15.46:0/994397693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17740d21a0 0x7f17740b76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:19.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.207+0000 7f1772a00640 1 -- 172.21.15.46:0/994397693 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199107649 0 0) 0x7f17740b7250 con 0x7f177415dcd0 2024-02-19T17:14:19.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.209+0000 7f1773400640 1 --2- 172.21.15.46:0/994397693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17740cf010 0x7f17740d1c60 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f1764009870 tx=0x7f176402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f53f5ef451f69fd server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:19.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.209+0000 7f1772a00640 1 -- 172.21.15.46:0/994397693 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764030840 con 0x7f17740cf010 2024-02-19T17:14:19.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.209+0000 7f1772a00640 1 -- 172.21.15.46:0/994397693 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17640309a0 con 0x7f17740cf010 2024-02-19T17:14:19.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.209+0000 7f1772a00640 1 -- 172.21.15.46:0/994397693 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764030d30 con 0x7f17740cf010 2024-02-19T17:14:19.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.210+0000 7f177b000640 1 -- 172.21.15.46:0/994397693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17740cf010 msgr2=0x7f17740d1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:19.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.210+0000 7f177b000640 1 --2- 172.21.15.46:0/994397693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17740cf010 0x7f17740d1c60 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f1764009870 tx=0x7f176402b980 comp rx=0 tx=0).stop 2024-02-19T17:14:19.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.212+0000 7f177b000640 1 -- 172.21.15.46:0/994397693 shutdown_connections 2024-02-19T17:14:19.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.212+0000 7f177b000640 1 --2- 172.21.15.46:0/994397693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17740d21a0 0x7f17740b76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:19.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.212+0000 7f177b000640 1 --2- 172.21.15.46:0/994397693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17740cf010 0x7f17740d1c60 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:19.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.212+0000 7f177b000640 1 -- 172.21.15.46:0/994397693 >> 172.21.15.46:0/994397693 conn(0x7f17740b53d0 msgr2=0x7f17740b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:19.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.212+0000 7f177b000640 1 -- 172.21.15.46:0/994397693 shutdown_connections 2024-02-19T17:14:19.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.212+0000 7f177b000640 1 -- 172.21.15.46:0/994397693 wait complete. 2024-02-19T17:14:19.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.214+0000 7f177b000640 1 Processor -- start 2024-02-19T17:14:19.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.215+0000 7f177b000640 1 -- start start 2024-02-19T17:14:19.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.217+0000 7f177b000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17740cf010 0x7f177415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:19.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.217+0000 7f177b000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17740d21a0 0x7f177415fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:19.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.217+0000 7f177b000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f177415dcd0 0x7f1774160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:19.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.217+0000 7f177b000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17740c6d90 con 0x7f17740d21a0 2024-02-19T17:14:19.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.217+0000 7f177b000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17740c6180 con 0x7f17740cf010 2024-02-19T17:14:19.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.217+0000 7f177b000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17740c6460 con 0x7f177415dcd0 2024-02-19T17:14:19.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.217+0000 7f1773e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17740cf010 0x7f177415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.217+0000 7f1773e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17740cf010 0x7f177415bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:37516/0 (socket says 172.21.15.46:37516) 2024-02-19T17:14:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.217+0000 7f1773e00640 1 -- 172.21.15.46:0/1354607403 learned_addr learned my addr 172.21.15.46:0/1354607403 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.217+0000 7f1773400640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17740d21a0 0x7f177415fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.218+0000 7f1779000640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f177415dcd0 0x7f1774160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.218+0000 7f1773e00640 1 -- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f177415dcd0 msgr2=0x7f1774160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.218+0000 7f1773e00640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f177415dcd0 0x7f1774160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.218+0000 7f1773e00640 1 -- 172.21.15.46:0/1354607403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17740d21a0 msgr2=0x7f177415fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.218+0000 7f1773e00640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17740d21a0 0x7f177415fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.218+0000 7f1773e00640 1 -- 172.21.15.46:0/1354607403 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17640094d0 con 0x7f17740cf010 2024-02-19T17:14:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.218+0000 7f1773400640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17740d21a0 0x7f177415fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T17:14:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.219+0000 7f1773e00640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17740cf010 0x7f177415bc50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f176000c3c0 tx=0x7f176000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:19.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.223+0000 7f176be00640 1 -- 172.21.15.46:0/1354607403 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600035f0 con 0x7f17740cf010 2024-02-19T17:14:19.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.223+0000 7f176be00640 1 -- 172.21.15.46:0/1354607403 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1760003770 con 0x7f17740cf010 2024-02-19T17:14:19.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.223+0000 7f176be00640 1 -- 172.21.15.46:0/1354607403 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760003b20 con 0x7f17740cf010 2024-02-19T17:14:19.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.223+0000 7f177b000640 1 -- 172.21.15.46:0/1354607403 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17740d2760 con 0x7f17740cf010 2024-02-19T17:14:19.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.223+0000 7f177b000640 1 -- 172.21.15.46:0/1354607403 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17740c6a20 con 0x7f17740cf010 2024-02-19T17:14:19.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.225+0000 7f177b000640 1 -- 172.21.15.46:0/1354607403 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1774067ba0 con 0x7f17740cf010 2024-02-19T17:14:19.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.227+0000 7f176be00640 1 -- 172.21.15.46:0/1354607403 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1760003c80 con 0x7f17740cf010 2024-02-19T17:14:19.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.228+0000 7f176be00640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f175406b860 0x7f175406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:19.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.229+0000 7f176be00640 1 -- 172.21.15.46:0/1354607403 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1760089af0 con 0x7f17740cf010 2024-02-19T17:14:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.230+0000 7f1773400640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f175406b860 0x7f175406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:19.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.234+0000 7f1773400640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f175406b860 0x7f175406dd20 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1764036000 tx=0x7f1764008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:19.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.236+0000 7f176be00640 1 -- 172.21.15.46:0/1354607403 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1760054620 con 0x7f17740cf010 2024-02-19T17:14:19.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.548+0000 7f177b000640 1 -- 172.21.15.46:0/1354607403 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17741615f0 con 0x7f17740cf010 2024-02-19T17:14:19.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.549+0000 7f176be00640 1 -- 172.21.15.46:0/1354607403 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1760017020 con 0x7f17740cf010 2024-02-19T17:14:19.535 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T17:14:19.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.552+0000 7f177b000640 1 -- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f175406b860 msgr2=0x7f175406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:19.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.552+0000 7f177b000640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f175406b860 0x7f175406dd20 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1764036000 tx=0x7f1764008030 comp rx=0 tx=0).stop 2024-02-19T17:14:19.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.552+0000 7f177b000640 1 -- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17740cf010 msgr2=0x7f177415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:19.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.552+0000 7f177b000640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17740cf010 0x7f177415bc50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f176000c3c0 tx=0x7f176000c880 comp rx=0 tx=0).stop 2024-02-19T17:14:19.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.552+0000 7f177b000640 1 -- 172.21.15.46:0/1354607403 shutdown_connections 2024-02-19T17:14:19.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.552+0000 7f177b000640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f175406b860 0x7f175406dd20 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:19.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.552+0000 7f177b000640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f177415dcd0 0x7f1774160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:19.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.552+0000 7f177b000640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17740d21a0 0x7f177415fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:19.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.552+0000 7f177b000640 1 --2- 172.21.15.46:0/1354607403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17740cf010 0x7f177415bc50 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:19.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.552+0000 7f177b000640 1 -- 172.21.15.46:0/1354607403 >> 172.21.15.46:0/1354607403 conn(0x7f17740b53d0 msgr2=0x7f17740ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:19.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.553+0000 7f177b000640 1 -- 172.21.15.46:0/1354607403 shutdown_connections 2024-02-19T17:14:19.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.553+0000 7f177b000640 1 -- 172.21.15.46:0/1354607403 wait complete. 2024-02-19T17:14:19.561 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-19T17:14:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.821+0000 7fcb82800640 1 Processor -- start 2024-02-19T17:14:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.821+0000 7fcb82800640 1 -- start start 2024-02-19T17:14:19.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.822+0000 7fcb82800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcb7c15f470 0x7fcb7c15f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:19.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.822+0000 7fcb82800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7c0cd600 con 0x7fcb7c0b2cc0 2024-02-19T17:14:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.822+0000 7fcb82800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7c0cc560 con 0x7fcb7c0b0ff0 2024-02-19T17:14:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.822+0000 7fcb82800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7c15fe40 con 0x7fcb7c15f470 2024-02-19T17:14:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.822+0000 7fcb7b400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcb7c0b2cc0 0x7fcb7c09a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33136/0 (socket says 172.21.15.46:33136) 2024-02-19T17:14:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.822+0000 7fcb7b400640 1 -- 172.21.15.46:0/222533187 learned_addr learned my addr 172.21.15.46:0/222533187 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.822+0000 7fcb7aa00640 1 --2- 172.21.15.46:0/222533187 >> v2:172.21.15.46:3300/0 conn(0x7fcb7c15f470 0x7fcb7c15f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.823+0000 7fcb7a000640 1 -- 172.21.15.46:0/222533187 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842485999 0 0) 0x7fcb7c0cd600 con 0x7fcb7c0b2cc0 2024-02-19T17:14:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.823+0000 7fcb7a000640 1 -- 172.21.15.46:0/222533187 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb60003520 con 0x7fcb7c0b2cc0 2024-02-19T17:14:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.823+0000 7fcb7aa00640 1 -- 172.21.15.46:0/222533187 >> v1:172.21.15.142:6789/0 conn(0x7fcb7c0b0ff0 legacy=0x7fcb7c0b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:19.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.824+0000 7fcb7aa00640 1 -- 172.21.15.46:0/222533187 >> v1:172.21.15.46:6789/0 conn(0x7fcb7c0b2cc0 legacy=0x7fcb7c09a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:19.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.824+0000 7fcb7aa00640 1 -- 172.21.15.46:0/222533187 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c0cc840 con 0x7fcb7c15f470 2024-02-19T17:14:19.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.825+0000 7fcb7aa00640 1 --2- 172.21.15.46:0/222533187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb7c15f470 0x7fcb7c15f900 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fcb680097a0 tx=0x7fcb6802b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839d5c8291d5d7c5 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:19.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.826+0000 7fcb7a000640 1 -- 172.21.15.46:0/222533187 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c001670 con 0x7fcb7c15f470 2024-02-19T17:14:19.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.826+0000 7fcb7a000640 1 -- 172.21.15.46:0/222533187 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6802e050 con 0x7fcb7c15f470 2024-02-19T17:14:19.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.826+0000 7fcb7a000640 1 -- 172.21.15.46:0/222533187 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68030730 con 0x7fcb7c15f470 2024-02-19T17:14:19.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.827+0000 7fcb82800640 1 -- 172.21.15.46:0/222533187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb7c15f470 msgr2=0x7fcb7c15f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:19.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.827+0000 7fcb82800640 1 --2- 172.21.15.46:0/222533187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb7c15f470 0x7fcb7c15f900 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fcb680097a0 tx=0x7fcb6802b710 comp rx=0 tx=0).stop 2024-02-19T17:14:19.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.827+0000 7fcb82800640 1 -- 172.21.15.46:0/222533187 shutdown_connections 2024-02-19T17:14:19.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.827+0000 7fcb82800640 1 --2- 172.21.15.46:0/222533187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb7c15f470 0x7fcb7c15f900 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:19.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.827+0000 7fcb82800640 1 -- 172.21.15.46:0/222533187 >> 172.21.15.46:0/222533187 conn(0x7fcb7c0b3180 msgr2=0x7fcb7c0b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:19.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.828+0000 7fcb82800640 1 -- 172.21.15.46:0/222533187 shutdown_connections 2024-02-19T17:14:19.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.828+0000 7fcb82800640 1 -- 172.21.15.46:0/222533187 wait complete. 2024-02-19T17:14:19.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.830+0000 7fcb82800640 1 Processor -- start 2024-02-19T17:14:19.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.830+0000 7fcb82800640 1 -- start start 2024-02-19T17:14:19.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.832+0000 7fcb82800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c0b0ff0 0x7fcb7c14d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:19.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.832+0000 7fcb82800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb7c0b2cc0 0x7fcb7c0b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:19.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.832+0000 7fcb82800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb7c15f470 0x7fcb7c0b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:19.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.832+0000 7fcb82800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0cb140 con 0x7fcb7c15f470 2024-02-19T17:14:19.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.832+0000 7fcb82800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0cab80 con 0x7fcb7c0b0ff0 2024-02-19T17:14:19.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.832+0000 7fcb82800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0cae60 con 0x7fcb7c0b2cc0 2024-02-19T17:14:19.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.832+0000 7fcb7aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb7c0b2cc0 0x7fcb7c0b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:19.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.832+0000 7fcb7b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c0b0ff0 0x7fcb7c14d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:19.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.832+0000 7fcb7be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb7c15f470 0x7fcb7c0b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:19.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.832+0000 7fcb7b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c0b0ff0 0x7fcb7c14d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:37532/0 (socket says 172.21.15.46:37532) 2024-02-19T17:14:19.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.832+0000 7fcb7b400640 1 -- 172.21.15.46:0/3568633962 learned_addr learned my addr 172.21.15.46:0/3568633962 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:19.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.833+0000 7fcb7be00640 1 -- 172.21.15.46:0/3568633962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb7c0b2cc0 msgr2=0x7fcb7c0b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:19.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.833+0000 7fcb7be00640 1 --2- 172.21.15.46:0/3568633962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb7c0b2cc0 0x7fcb7c0b6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:19.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.833+0000 7fcb7be00640 1 -- 172.21.15.46:0/3568633962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c0b0ff0 msgr2=0x7fcb7c14d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:19.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.833+0000 7fcb7be00640 1 --2- 172.21.15.46:0/3568633962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c0b0ff0 0x7fcb7c14d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:19.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.833+0000 7fcb7be00640 1 -- 172.21.15.46:0/3568633962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68009400 con 0x7fcb7c15f470 2024-02-19T17:14:19.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.834+0000 7fcb7be00640 1 --2- 172.21.15.46:0/3568633962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb7c15f470 0x7fcb7c0b5ff0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400c780 tx=0x7fcb7400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:19.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.834+0000 7fcb73400640 1 -- 172.21.15.46:0/3568633962 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb74003b70 con 0x7fcb7c15f470 2024-02-19T17:14:19.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.834+0000 7fcb73400640 1 -- 172.21.15.46:0/3568633962 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb74003cf0 con 0x7fcb7c15f470 2024-02-19T17:14:19.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.834+0000 7fcb73400640 1 -- 172.21.15.46:0/3568633962 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb74003ea0 con 0x7fcb7c15f470 2024-02-19T17:14:19.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.834+0000 7fcb82800640 1 -- 172.21.15.46:0/3568633962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7c0c56e0 con 0x7fcb7c15f470 2024-02-19T17:14:19.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.835+0000 7fcb82800640 1 -- 172.21.15.46:0/3568633962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7c14de00 con 0x7fcb7c15f470 2024-02-19T17:14:19.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.836+0000 7fcb82800640 1 -- 172.21.15.46:0/3568633962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb54005290 con 0x7fcb7c15f470 2024-02-19T17:14:19.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.838+0000 7fcb73400640 1 -- 172.21.15.46:0/3568633962 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcb740052b0 con 0x7fcb7c15f470 2024-02-19T17:14:19.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.839+0000 7fcb73400640 1 --2- 172.21.15.46:0/3568633962 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcb5c06b810 0x7fcb5c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:19.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.839+0000 7fcb73400640 1 -- 172.21.15.46:0/3568633962 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb740895f0 con 0x7fcb7c15f470 2024-02-19T17:14:19.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.840+0000 7fcb7b400640 1 --2- 172.21.15.46:0/3568633962 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcb5c06b810 0x7fcb5c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:19.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.842+0000 7fcb7b400640 1 --2- 172.21.15.46:0/3568633962 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcb5c06b810 0x7fcb5c06dcd0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c000f60 tx=0x7fcb6c0019f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:19.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:19.846+0000 7fcb73400640 1 -- 172.21.15.46:0/3568633962 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcb740540b0 con 0x7fcb7c15f470 2024-02-19T17:14:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.143+0000 7fcb82800640 1 -- 172.21.15.46:0/3568633962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb54005ac0 con 0x7fcb7c15f470 2024-02-19T17:14:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.144+0000 7fcb73400640 1 -- 172.21.15.46:0/3568633962 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb74057770 con 0x7fcb7c15f470 2024-02-19T17:14:20.132 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-02-19T17:14:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.148+0000 7fcb82800640 1 -- 172.21.15.46:0/3568633962 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcb5c06b810 msgr2=0x7fcb5c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.148+0000 7fcb82800640 1 --2- 172.21.15.46:0/3568633962 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcb5c06b810 0x7fcb5c06dcd0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c000f60 tx=0x7fcb6c0019f0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.148+0000 7fcb82800640 1 -- 172.21.15.46:0/3568633962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb7c15f470 msgr2=0x7fcb7c0b5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.148+0000 7fcb82800640 1 --2- 172.21.15.46:0/3568633962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb7c15f470 0x7fcb7c0b5ff0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400c780 tx=0x7fcb7400cc40 comp rx=0 tx=0).stop 2024-02-19T17:14:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.148+0000 7fcb82800640 1 -- 172.21.15.46:0/3568633962 shutdown_connections 2024-02-19T17:14:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.148+0000 7fcb82800640 1 --2- 172.21.15.46:0/3568633962 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fcb5c06b810 0x7fcb5c06dcd0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.148+0000 7fcb82800640 1 --2- 172.21.15.46:0/3568633962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb7c15f470 0x7fcb7c0b5ff0 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.148+0000 7fcb82800640 1 --2- 172.21.15.46:0/3568633962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb7c0b2cc0 0x7fcb7c0b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.148+0000 7fcb82800640 1 --2- 172.21.15.46:0/3568633962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb7c0b0ff0 0x7fcb7c14d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.148+0000 7fcb82800640 1 -- 172.21.15.46:0/3568633962 >> 172.21.15.46:0/3568633962 conn(0x7fcb7c0b3180 msgr2=0x7fcb7c0afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:20.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.148+0000 7fcb82800640 1 -- 172.21.15.46:0/3568633962 shutdown_connections 2024-02-19T17:14:20.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.148+0000 7fcb82800640 1 -- 172.21.15.46:0/3568633962 wait complete. 2024-02-19T17:14:20.157 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T17:14:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.411+0000 7fe23a600640 1 Processor -- start 2024-02-19T17:14:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.411+0000 7fe23a600640 1 -- start start 2024-02-19T17:14:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.413+0000 7fe23a600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe234162360 0x7fe2340d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.413+0000 7fe23a600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2340b1360 0x7fe2340b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.413+0000 7fe23a600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2340b1d00 con 0x7fe2340ccfd0 2024-02-19T17:14:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.413+0000 7fe23a600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2340cce20 con 0x7fe234162360 2024-02-19T17:14:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.413+0000 7fe23a600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23406b800 con 0x7fe2340b1360 2024-02-19T17:14:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.414+0000 7fe233400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe234162360 0x7fe2340d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.414+0000 7fe233e00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe2340ccfd0 0x7fe2340cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:49888/0 (socket says 172.21.15.46:49888) 2024-02-19T17:14:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.414+0000 7fe233e00640 1 -- 172.21.15.46:0/1952973674 learned_addr learned my addr 172.21.15.46:0/1952973674 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.414+0000 7fe232a00640 1 --2- 172.21.15.46:0/1952973674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2340b1360 0x7fe2340b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.415+0000 7fe233400640 1 -- 172.21.15.46:0/1952973674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2340b1360 msgr2=0x7fe2340b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.415+0000 7fe233400640 1 --2- 172.21.15.46:0/1952973674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2340b1360 0x7fe2340b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.415+0000 7fe233400640 1 -- 172.21.15.46:0/1952973674 >> v1:172.21.15.142:6789/0 conn(0x7fe2340ccfd0 legacy=0x7fe2340cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.415+0000 7fe233400640 1 -- 172.21.15.46:0/1952973674 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2340ccb40 con 0x7fe234162360 2024-02-19T17:14:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.416+0000 7fe233400640 1 --2- 172.21.15.46:0/1952973674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe234162360 0x7fe2340d1110 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe2240097a0 tx=0x7fe22402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c56369af6dd4b631 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.417+0000 7fe232000640 1 -- 172.21.15.46:0/1952973674 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22402e070 con 0x7fe234162360 2024-02-19T17:14:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.417+0000 7fe232000640 1 -- 172.21.15.46:0/1952973674 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2240315a0 con 0x7fe234162360 2024-02-19T17:14:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.417+0000 7fe232000640 1 -- 172.21.15.46:0/1952973674 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224031930 con 0x7fe234162360 2024-02-19T17:14:20.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.418+0000 7fe23a600640 1 -- 172.21.15.46:0/1952973674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe234162360 msgr2=0x7fe2340d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:20.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.418+0000 7fe23a600640 1 --2- 172.21.15.46:0/1952973674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe234162360 0x7fe2340d1110 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe2240097a0 tx=0x7fe22402b840 comp rx=0 tx=0).stop 2024-02-19T17:14:20.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.419+0000 7fe23a600640 1 -- 172.21.15.46:0/1952973674 shutdown_connections 2024-02-19T17:14:20.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.419+0000 7fe23a600640 1 --2- 172.21.15.46:0/1952973674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2340b1360 0x7fe2340b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.419+0000 7fe23a600640 1 --2- 172.21.15.46:0/1952973674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe234162360 0x7fe2340d1110 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.419+0000 7fe23a600640 1 -- 172.21.15.46:0/1952973674 >> 172.21.15.46:0/1952973674 conn(0x7fe234099a30 msgr2=0x7fe2340d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:20.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.419+0000 7fe23a600640 1 -- 172.21.15.46:0/1952973674 shutdown_connections 2024-02-19T17:14:20.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.419+0000 7fe23a600640 1 -- 172.21.15.46:0/1952973674 wait complete. 2024-02-19T17:14:20.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.422+0000 7fe23a600640 1 Processor -- start 2024-02-19T17:14:20.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.422+0000 7fe23a600640 1 -- start start 2024-02-19T17:14:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.423+0000 7fe23a600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2340b1360 0x7fe2341595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.423+0000 7fe23a600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2340ccfd0 0x7fe2340b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.423+0000 7fe23a600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe234162360 0x7fe2340ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.423+0000 7fe23a600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340b42c0 con 0x7fe234162360 2024-02-19T17:14:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.423+0000 7fe23a600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340b4020 con 0x7fe2340b1360 2024-02-19T17:14:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.423+0000 7fe23a600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340b59a0 con 0x7fe2340ccfd0 2024-02-19T17:14:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.423+0000 7fe233e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe234162360 0x7fe2340ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.423+0000 7fe232a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2340ccfd0 0x7fe2340b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:20.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.423+0000 7fe233e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe234162360 0x7fe2340ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48168/0 (socket says 172.21.15.46:48168) 2024-02-19T17:14:20.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.423+0000 7fe233e00640 1 -- 172.21.15.46:0/4062932842 learned_addr learned my addr 172.21.15.46:0/4062932842 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:20.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.423+0000 7fe233400640 1 --2- 172.21.15.46:0/4062932842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2340b1360 0x7fe2341595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:20.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.424+0000 7fe233e00640 1 -- 172.21.15.46:0/4062932842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2340ccfd0 msgr2=0x7fe2340b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:20.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.424+0000 7fe233e00640 1 --2- 172.21.15.46:0/4062932842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2340ccfd0 0x7fe2340b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.424+0000 7fe233e00640 1 -- 172.21.15.46:0/4062932842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2340b1360 msgr2=0x7fe2341595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.424+0000 7fe233e00640 1 --2- 172.21.15.46:0/4062932842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2340b1360 0x7fe2341595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.424+0000 7fe233e00640 1 -- 172.21.15.46:0/4062932842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe224009400 con 0x7fe234162360 2024-02-19T17:14:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.424+0000 7fe233e00640 1 --2- 172.21.15.46:0/4062932842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe234162360 0x7fe2340ae350 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00c9f0 tx=0x7fe22c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.424+0000 7fe22b400640 1 -- 172.21.15.46:0/4062932842 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c00ab70 con 0x7fe234162360 2024-02-19T17:14:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.424+0000 7fe22b400640 1 -- 172.21.15.46:0/4062932842 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c00acd0 con 0x7fe234162360 2024-02-19T17:14:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.424+0000 7fe23a600640 1 -- 172.21.15.46:0/4062932842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2340b5c80 con 0x7fe234162360 2024-02-19T17:14:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.424+0000 7fe22b400640 1 -- 172.21.15.46:0/4062932842 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c012600 con 0x7fe234162360 2024-02-19T17:14:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.425+0000 7fe23a600640 1 -- 172.21.15.46:0/4062932842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2340b5690 con 0x7fe234162360 2024-02-19T17:14:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.426+0000 7fe23a600640 1 -- 172.21.15.46:0/4062932842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2340b5ec0 con 0x7fe234162360 2024-02-19T17:14:20.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.427+0000 7fe22b400640 1 -- 172.21.15.46:0/4062932842 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe22c007070 con 0x7fe234162360 2024-02-19T17:14:20.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.429+0000 7fe22b400640 1 --2- 172.21.15.46:0/4062932842 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe21406b810 0x7fe21406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:20.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.429+0000 7fe22b400640 1 -- 172.21.15.46:0/4062932842 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe22c089ec0 con 0x7fe234162360 2024-02-19T17:14:20.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.430+0000 7fe233400640 1 --2- 172.21.15.46:0/4062932842 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe21406b810 0x7fe21406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:20.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.431+0000 7fe233400640 1 --2- 172.21.15.46:0/4062932842 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe21406b810 0x7fe21406dcd0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fe224036000 tx=0x7fe22403d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:20.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.437+0000 7fe22b400640 1 -- 172.21.15.46:0/4062932842 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe2340b5ec0 con 0x7fe234162360 2024-02-19T17:14:20.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.774+0000 7fe23a600640 1 -- 172.21.15.46:0/4062932842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2340c4ec0 con 0x7fe234162360 2024-02-19T17:14:20.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.776+0000 7fe22b400640 1 -- 172.21.15.46:0/4062932842 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fe2340c4ec0 con 0x7fe234162360 2024-02-19T17:14:20.762 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:20.762 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2121507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2121507890},{"type":"v1","addr":"172.21.15.142:6835","nonce":2121507890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3952092655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3952092655},{"type":"v1","addr":"172.21.15.46:6835","nonce":3952092655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1741774776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1741774776},{"type":"v1","addr":"172.21.15.142:6837","nonce":1741774776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:59:16.065049+0000","modified":"2024-02-19T06:59:19.096312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6834/1322569769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1322569769},{"type":"v1","addr":"172.21.15.46:6834","nonce":1322569769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-19T17:14:20.762 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-02-19T17:14:20.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.779+0000 7fe23a600640 1 -- 172.21.15.46:0/4062932842 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe21406b810 msgr2=0x7fe21406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:20.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.779+0000 7fe23a600640 1 --2- 172.21.15.46:0/4062932842 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe21406b810 0x7fe21406dcd0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fe224036000 tx=0x7fe22403d040 comp rx=0 tx=0).stop 2024-02-19T17:14:20.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.779+0000 7fe23a600640 1 -- 172.21.15.46:0/4062932842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe234162360 msgr2=0x7fe2340ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:20.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.779+0000 7fe23a600640 1 --2- 172.21.15.46:0/4062932842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe234162360 0x7fe2340ae350 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00c9f0 tx=0x7fe22c00ceb0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.779+0000 7fe23a600640 1 -- 172.21.15.46:0/4062932842 shutdown_connections 2024-02-19T17:14:20.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.779+0000 7fe23a600640 1 --2- 172.21.15.46:0/4062932842 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe21406b810 0x7fe21406dcd0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.779+0000 7fe23a600640 1 --2- 172.21.15.46:0/4062932842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe234162360 0x7fe2340ae350 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.779+0000 7fe23a600640 1 --2- 172.21.15.46:0/4062932842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2340ccfd0 0x7fe2340b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.779+0000 7fe23a600640 1 --2- 172.21.15.46:0/4062932842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2340b1360 0x7fe2341595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:20.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.779+0000 7fe23a600640 1 -- 172.21.15.46:0/4062932842 >> 172.21.15.46:0/4062932842 conn(0x7fe234099a30 msgr2=0x7fe2340ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:20.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.780+0000 7fe23a600640 1 -- 172.21.15.46:0/4062932842 shutdown_connections 2024-02-19T17:14:20.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:20.780+0000 7fe23a600640 1 -- 172.21.15.46:0/4062932842 wait complete. 2024-02-19T17:14:20.786 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T17:14:21.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.041+0000 7f5606c00640 1 Processor -- start 2024-02-19T17:14:21.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.042+0000 7f5606c00640 1 -- start start 2024-02-19T17:14:21.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.044+0000 7f5606c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5600145260 0x7f560015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:21.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.044+0000 7f5606c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5600071000 0x7f5600071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:21.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.044+0000 7f5606c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560015ce10 con 0x7f560015f440 2024-02-19T17:14:21.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.044+0000 7f5606c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56000719c0 con 0x7f5600071000 2024-02-19T17:14:21.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.044+0000 7f5606c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56000cbde0 con 0x7f5600145260 2024-02-19T17:14:21.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.044+0000 7f55ffe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5600145260 0x7f560015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:21.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.044+0000 7f55ff400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5600071000 0x7f5600071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:21.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.044+0000 7f55ff400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5600071000 0x7f5600071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:37568/0 (socket says 172.21.15.46:37568) 2024-02-19T17:14:21.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.044+0000 7f55ff400640 1 -- 172.21.15.46:0/2811431127 learned_addr learned my addr 172.21.15.46:0/2811431127 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:21.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.045+0000 7f55ff400640 1 -- 172.21.15.46:0/2811431127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5600145260 msgr2=0x7f560015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:21.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.045+0000 7f55ff400640 1 --2- 172.21.15.46:0/2811431127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5600145260 0x7f560015c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.045+0000 7f55ff400640 1 -- 172.21.15.46:0/2811431127 >> v1:172.21.15.142:6789/0 conn(0x7f560015f440 legacy=0x7f560015f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:21.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.045+0000 7f55ff400640 1 -- 172.21.15.46:0/2811431127 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56000cc080 con 0x7f5600071000 2024-02-19T17:14:21.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.047+0000 7f55ff400640 1 --2- 172.21.15.46:0/2811431127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5600071000 0x7f5600071480 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009870 tx=0x7f55ec02b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39bcdea75688d171 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:21.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.047+0000 7f55fea00640 1 -- 172.21.15.46:0/2811431127 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec031890 con 0x7f5600071000 2024-02-19T17:14:21.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.047+0000 7f55fea00640 1 -- 172.21.15.46:0/2811431127 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0319f0 con 0x7f5600071000 2024-02-19T17:14:21.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.047+0000 7f55fea00640 1 -- 172.21.15.46:0/2811431127 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec031dc0 con 0x7f5600071000 2024-02-19T17:14:21.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.048+0000 7f5606c00640 1 -- 172.21.15.46:0/2811431127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5600071000 msgr2=0x7f5600071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:21.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.048+0000 7f5606c00640 1 --2- 172.21.15.46:0/2811431127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5600071000 0x7f5600071480 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009870 tx=0x7f55ec02b930 comp rx=0 tx=0).stop 2024-02-19T17:14:21.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.049+0000 7f5606c00640 1 -- 172.21.15.46:0/2811431127 shutdown_connections 2024-02-19T17:14:21.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.049+0000 7f5606c00640 1 --2- 172.21.15.46:0/2811431127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5600071000 0x7f5600071480 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.049+0000 7f5606c00640 1 --2- 172.21.15.46:0/2811431127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5600145260 0x7f560015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.049+0000 7f5606c00640 1 -- 172.21.15.46:0/2811431127 >> 172.21.15.46:0/2811431127 conn(0x7f5600066f70 msgr2=0x7f560006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:21.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.049+0000 7f5606c00640 1 -- 172.21.15.46:0/2811431127 shutdown_connections 2024-02-19T17:14:21.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.049+0000 7f5606c00640 1 -- 172.21.15.46:0/2811431127 wait complete. 2024-02-19T17:14:21.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.051+0000 7f5606c00640 1 Processor -- start 2024-02-19T17:14:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.051+0000 7f5606c00640 1 -- start start 2024-02-19T17:14:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.053+0000 7f5606c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5600071000 0x7f56001f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:21.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.053+0000 7f5606c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5600145260 0x7f560015b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.053+0000 7f5606c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f560015f440 0x7f56000b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.053+0000 7f55ffe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5600071000 0x7f56001f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.053+0000 7f55ffe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5600071000 0x7f56001f87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:34604/0 (socket says 172.21.15.46:34604) 2024-02-19T17:14:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.053+0000 7f55ffe00640 1 -- 172.21.15.46:0/3223668894 learned_addr learned my addr 172.21.15.46:0/3223668894 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.053+0000 7f5606c00640 1 -- 172.21.15.46:0/3223668894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5600139240 con 0x7f5600145260 2024-02-19T17:14:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.053+0000 7f5606c00640 1 -- 172.21.15.46:0/3223668894 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56001f8d20 con 0x7f560015f440 2024-02-19T17:14:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.053+0000 7f5606c00640 1 -- 172.21.15.46:0/3223668894 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56000b27d0 con 0x7f5600071000 2024-02-19T17:14:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.053+0000 7f5604c00640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f560015f440 0x7f56000b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.054+0000 7f55ffe00640 1 -- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f560015f440 msgr2=0x7f56000b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.054+0000 7f55ffe00640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f560015f440 0x7f56000b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.054+0000 7f55ffe00640 1 -- 172.21.15.46:0/3223668894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5600145260 msgr2=0x7f560015b010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T17:14:21.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.055+0000 7f55ff400640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5600145260 0x7f560015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:21.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.055+0000 7f55ffe00640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5600145260 0x7f560015b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.055+0000 7f55ffe00640 1 -- 172.21.15.46:0/3223668894 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec0094d0 con 0x7f5600071000 2024-02-19T17:14:21.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.055+0000 7f55ffe00640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5600071000 0x7f56001f87e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f55f000d860 tx=0x7f55f000dd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:21.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.056+0000 7f55f7e00640 1 -- 172.21.15.46:0/3223668894 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f000c940 con 0x7f5600071000 2024-02-19T17:14:21.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.056+0000 7f55f7e00640 1 -- 172.21.15.46:0/3223668894 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f000caa0 con 0x7f5600071000 2024-02-19T17:14:21.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.056+0000 7f55f7e00640 1 -- 172.21.15.46:0/3223668894 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f000ce30 con 0x7f5600071000 2024-02-19T17:14:21.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.057+0000 7f5606c00640 1 -- 172.21.15.46:0/3223668894 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56000b2ab0 con 0x7f5600071000 2024-02-19T17:14:21.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.057+0000 7f5606c00640 1 -- 172.21.15.46:0/3223668894 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56000b3070 con 0x7f5600071000 2024-02-19T17:14:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.059+0000 7f5606c00640 1 -- 172.21.15.46:0/3223668894 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5600067ba0 con 0x7f5600071000 2024-02-19T17:14:21.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.063+0000 7f55f7e00640 1 -- 172.21.15.46:0/3223668894 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f55f0015410 con 0x7f5600071000 2024-02-19T17:14:21.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.064+0000 7f55f7e00640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f55e006b810 0x7f55e006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:21.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.064+0000 7f55f7e00640 1 -- 172.21.15.46:0/3223668894 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55f008a290 con 0x7f5600071000 2024-02-19T17:14:21.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.065+0000 7f55ff400640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f55e006b810 0x7f55e006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:21.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.068+0000 7f55ff400640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f55e006b810 0x7f55e006dcd0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f55ec036000 tx=0x7f55ec03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:21.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.070+0000 7f55f7e00640 1 -- 172.21.15.46:0/3223668894 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f55f0054dd0 con 0x7f5600071000 2024-02-19T17:14:21.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.373+0000 7f5606c00640 1 -- 172.21.15.46:0/3223668894 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56000d0290 con 0x7f5600071000 2024-02-19T17:14:21.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.375+0000 7f55f7e00640 1 -- 172.21.15.46:0/3223668894 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f55f001a090 con 0x7f5600071000 2024-02-19T17:14:21.362 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:21.362 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":35,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:59:17.589125+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:59:14.017896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-19T06:59:15.078011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T17:14:21.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.378+0000 7f5606c00640 1 -- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f55e006b810 msgr2=0x7f55e006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:21.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.378+0000 7f5606c00640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f55e006b810 0x7f55e006dcd0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f55ec036000 tx=0x7f55ec03c040 comp rx=0 tx=0).stop 2024-02-19T17:14:21.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.378+0000 7f5606c00640 1 -- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5600071000 msgr2=0x7f56001f87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:21.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.378+0000 7f5606c00640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5600071000 0x7f56001f87e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f55f000d860 tx=0x7f55f000dd20 comp rx=0 tx=0).stop 2024-02-19T17:14:21.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.378+0000 7f5606c00640 1 -- 172.21.15.46:0/3223668894 shutdown_connections 2024-02-19T17:14:21.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.378+0000 7f5606c00640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f55e006b810 0x7f55e006dcd0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.378+0000 7f5606c00640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f560015f440 0x7f56000b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.378+0000 7f5606c00640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5600145260 0x7f560015b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.378+0000 7f5606c00640 1 --2- 172.21.15.46:0/3223668894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5600071000 0x7f56001f87e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.378+0000 7f5606c00640 1 -- 172.21.15.46:0/3223668894 >> 172.21.15.46:0/3223668894 conn(0x7f5600066f70 msgr2=0x7f5600144510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:21.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.378+0000 7f5606c00640 1 -- 172.21.15.46:0/3223668894 shutdown_connections 2024-02-19T17:14:21.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.378+0000 7f5606c00640 1 -- 172.21.15.46:0/3223668894 wait complete. 2024-02-19T17:14:21.386 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-19T17:14:21.386 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T17:14:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.635+0000 7f4b5b800640 1 Processor -- start 2024-02-19T17:14:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.636+0000 7f4b5b800640 1 -- start start 2024-02-19T17:14:21.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.637+0000 7f4b5b800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5415e480 0x7f4b5406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:21.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.637+0000 7f4b5b800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b5415e860 0x7f4b5415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:21.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.637+0000 7f4b5b800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5406c630 con 0x7f4b540cbce0 2024-02-19T17:14:21.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.637+0000 7f4b5b800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5406dc10 con 0x7f4b5415e860 2024-02-19T17:14:21.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.637+0000 7f4b5b800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5406c910 con 0x7f4b5415e480 2024-02-19T17:14:21.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.638+0000 7f4b58e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5415e480 0x7f4b5406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:21.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.638+0000 7f4b53e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4b540cbce0 0x7f4b540cc140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33152/0 (socket says 172.21.15.46:33152) 2024-02-19T17:14:21.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.638+0000 7f4b53e00640 1 -- 172.21.15.46:0/3594265490 learned_addr learned my addr 172.21.15.46:0/3594265490 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:21.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.638+0000 7f4b59800640 1 --2- 172.21.15.46:0/3594265490 >> v2:172.21.15.142:3300/0 conn(0x7f4b5415e860 0x7f4b5415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:21.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.639+0000 7f4b58e00640 1 -- 172.21.15.46:0/3594265490 >> v2:172.21.15.142:3300/0 conn(0x7f4b5415e860 msgr2=0x7f4b5415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:21.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.639+0000 7f4b58e00640 1 --2- 172.21.15.46:0/3594265490 >> v2:172.21.15.142:3300/0 conn(0x7f4b5415e860 0x7f4b5415ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.639+0000 7f4b58e00640 1 -- 172.21.15.46:0/3594265490 >> v1:172.21.15.46:6789/0 conn(0x7f4b540cbce0 legacy=0x7f4b540cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:21.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.639+0000 7f4b58e00640 1 -- 172.21.15.46:0/3594265490 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5406cbf0 con 0x7f4b5415e480 2024-02-19T17:14:21.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.639+0000 7f4b59800640 1 --2- 172.21.15.46:0/3594265490 >> v2:172.21.15.142:3300/0 conn(0x7f4b5415e860 0x7f4b5415ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T17:14:21.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.640+0000 7f4b58e00640 1 --2- 172.21.15.46:0/3594265490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5415e480 0x7f4b5406d6d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b480097a0 tx=0x7f4b4802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b34902702f6604d server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:21.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.640+0000 7f4b53400640 1 -- 172.21.15.46:0/3594265490 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4802d040 con 0x7f4b5415e480 2024-02-19T17:14:21.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.640+0000 7f4b53400640 1 -- 172.21.15.46:0/3594265490 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b48031810 con 0x7f4b5415e480 2024-02-19T17:14:21.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.640+0000 7f4b53400640 1 -- 172.21.15.46:0/3594265490 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48031ba0 con 0x7f4b5415e480 2024-02-19T17:14:21.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.641+0000 7f4b5b800640 1 -- 172.21.15.46:0/3594265490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5415e480 msgr2=0x7f4b5406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:21.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.641+0000 7f4b5b800640 1 --2- 172.21.15.46:0/3594265490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5415e480 0x7f4b5406d6d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b480097a0 tx=0x7f4b4802b8b0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.642+0000 7f4b5b800640 1 -- 172.21.15.46:0/3594265490 shutdown_connections 2024-02-19T17:14:21.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.642+0000 7f4b5b800640 1 --2- 172.21.15.46:0/3594265490 >> v2:172.21.15.142:3300/0 conn(0x7f4b5415e860 0x7f4b5415ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.642+0000 7f4b5b800640 1 --2- 172.21.15.46:0/3594265490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5415e480 0x7f4b5406d6d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.642+0000 7f4b5b800640 1 -- 172.21.15.46:0/3594265490 >> 172.21.15.46:0/3594265490 conn(0x7f4b540b3180 msgr2=0x7f4b540b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:21.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.642+0000 7f4b5b800640 1 -- 172.21.15.46:0/3594265490 shutdown_connections 2024-02-19T17:14:21.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.642+0000 7f4b5b800640 1 -- 172.21.15.46:0/3594265490 wait complete. 2024-02-19T17:14:21.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.645+0000 7f4b5b800640 1 Processor -- start 2024-02-19T17:14:21.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.645+0000 7f4b5b800640 1 -- start start 2024-02-19T17:14:21.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.648+0000 7f4b5b800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b540cbce0 0x7f4b540c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:21.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.648+0000 7f4b5b800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b5415e480 0x7f4b54152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:21.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.648+0000 7f4b5b800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b5415e860 0x7f4b5415bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:21.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.648+0000 7f4b5b800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5415b250 con 0x7f4b5415e480 2024-02-19T17:14:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.648+0000 7f4b5b800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b540c57b0 con 0x7f4b5415e860 2024-02-19T17:14:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.648+0000 7f4b5b800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b540c7fe0 con 0x7f4b540cbce0 2024-02-19T17:14:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.648+0000 7f4b53e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b5415e480 0x7f4b54152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.648+0000 7f4b58e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b540cbce0 0x7f4b540c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.648+0000 7f4b53e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b5415e480 0x7f4b54152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48178/0 (socket says 172.21.15.46:48178) 2024-02-19T17:14:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.648+0000 7f4b53e00640 1 -- 172.21.15.46:0/3525498516 learned_addr learned my addr 172.21.15.46:0/3525498516 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.648+0000 7f4b59800640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b5415e860 0x7f4b5415bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.649+0000 7f4b53e00640 1 -- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b540cbce0 msgr2=0x7f4b540c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.649+0000 7f4b53e00640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b540cbce0 0x7f4b540c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.649+0000 7f4b53e00640 1 -- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b5415e860 msgr2=0x7f4b5415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.649+0000 7f4b53e00640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b5415e860 0x7f4b5415bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.649+0000 7f4b53e00640 1 -- 172.21.15.46:0/3525498516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c009a70 con 0x7f4b5415e480 2024-02-19T17:14:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.649+0000 7f4b58e00640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b540cbce0 0x7f4b540c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T17:14:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.649+0000 7f4b59800640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b5415e860 0x7f4b5415bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:21.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.649+0000 7f4b53e00640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b5415e480 0x7f4b54152980 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000c4b0 tx=0x7f4b4000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:21.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.650+0000 7f4b50c00640 1 -- 172.21.15.46:0/3525498516 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40005ce0 con 0x7f4b5415e480 2024-02-19T17:14:21.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.650+0000 7f4b50c00640 1 -- 172.21.15.46:0/3525498516 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b40005e40 con 0x7f4b5415e480 2024-02-19T17:14:21.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.650+0000 7f4b50c00640 1 -- 172.21.15.46:0/3525498516 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40005ce0 con 0x7f4b5415e480 2024-02-19T17:14:21.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.651+0000 7f4b5b800640 1 -- 172.21.15.46:0/3525498516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b48009400 con 0x7f4b5415e480 2024-02-19T17:14:21.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.651+0000 7f4b5b800640 1 -- 172.21.15.46:0/3525498516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5415b780 con 0x7f4b5415e480 2024-02-19T17:14:21.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.653+0000 7f4b5b800640 1 -- 172.21.15.46:0/3525498516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b54067ba0 con 0x7f4b5415e480 2024-02-19T17:14:21.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.654+0000 7f4b50c00640 1 -- 172.21.15.46:0/3525498516 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4b40007070 con 0x7f4b5415e480 2024-02-19T17:14:21.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.656+0000 7f4b50c00640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f4b3406b870 0x7f4b3406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:21.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.656+0000 7f4b50c00640 1 -- 172.21.15.46:0/3525498516 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b40089270 con 0x7f4b5415e480 2024-02-19T17:14:21.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.656+0000 7f4b58e00640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f4b3406b870 0x7f4b3406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:21.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.660+0000 7f4b58e00640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f4b3406b870 0x7f4b3406dd30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4b48036000 tx=0x7f4b4803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:21.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:21.662+0000 7f4b50c00640 1 -- 172.21.15.46:0/3525498516 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4b40053d30 con 0x7f4b5415e480 2024-02-19T17:14:22.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.021+0000 7f4b5b800640 1 -- 172.21.15.46:0/3525498516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b540ae450 con 0x7f4b5415e480 2024-02-19T17:14:22.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.022+0000 7f4b50c00640 1 -- 172.21.15.46:0/3525498516 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f4b400573f0 con 0x7f4b5415e480 2024-02-19T17:14:22.007 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:22.008 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2121507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2121507890},{"type":"v1","addr":"172.21.15.142:6835","nonce":2121507890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3952092655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3952092655},{"type":"v1","addr":"172.21.15.46:6835","nonce":3952092655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1741774776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1741774776},{"type":"v1","addr":"172.21.15.142:6837","nonce":1741774776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:59:16.065049+0000","modified":"2024-02-19T06:59:19.096312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6834/1322569769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1322569769},{"type":"v1","addr":"172.21.15.46:6834","nonce":1322569769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-19T17:14:22.008 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-02-19T17:14:22.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.025+0000 7f4b5b800640 1 -- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f4b3406b870 msgr2=0x7f4b3406dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:22.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.025+0000 7f4b5b800640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f4b3406b870 0x7f4b3406dd30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4b48036000 tx=0x7f4b4803c040 comp rx=0 tx=0).stop 2024-02-19T17:14:22.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.025+0000 7f4b5b800640 1 -- 172.21.15.46:0/3525498516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b5415e480 msgr2=0x7f4b54152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:22.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.025+0000 7f4b5b800640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b5415e480 0x7f4b54152980 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000c4b0 tx=0x7f4b4000c970 comp rx=0 tx=0).stop 2024-02-19T17:14:22.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.025+0000 7f4b5b800640 1 -- 172.21.15.46:0/3525498516 shutdown_connections 2024-02-19T17:14:22.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.025+0000 7f4b5b800640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f4b3406b870 0x7f4b3406dd30 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.025+0000 7f4b5b800640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b5415e860 0x7f4b5415bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.026+0000 7f4b5b800640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b5415e480 0x7f4b54152980 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.026+0000 7f4b5b800640 1 --2- 172.21.15.46:0/3525498516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b540cbce0 0x7f4b540c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.026+0000 7f4b5b800640 1 -- 172.21.15.46:0/3525498516 >> 172.21.15.46:0/3525498516 conn(0x7f4b540b3180 msgr2=0x7f4b54099a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:22.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.026+0000 7f4b5b800640 1 -- 172.21.15.46:0/3525498516 shutdown_connections 2024-02-19T17:14:22.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.026+0000 7f4b5b800640 1 -- 172.21.15.46:0/3525498516 wait complete. 2024-02-19T17:14:22.035 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T17:14:22.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.288+0000 7f9482200640 1 Processor -- start 2024-02-19T17:14:22.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.289+0000 7f9482200640 1 -- start start 2024-02-19T17:14:22.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.290+0000 7f9482200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f947c0b1a70 0x7f947c0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:22.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.290+0000 7f9482200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f947c0aff20 0x7f947c0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:22.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.291+0000 7f9482200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c0ccb40 con 0x7f947c162360 2024-02-19T17:14:22.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.291+0000 7f9482200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c0cce20 con 0x7f947c0b1a70 2024-02-19T17:14:22.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.291+0000 7f9482200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c06b800 con 0x7f947c0aff20 2024-02-19T17:14:22.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.291+0000 7f947be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f947c0aff20 0x7f947c0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:22.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.291+0000 7f947be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f947c0aff20 0x7f947c0b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:34626/0 (socket says 172.21.15.46:34626) 2024-02-19T17:14:22.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.291+0000 7f947be00640 1 -- 172.21.15.46:0/857059456 learned_addr learned my addr 172.21.15.46:0/857059456 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:22.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.291+0000 7f947aa00640 1 --2- 172.21.15.46:0/857059456 >> v2:172.21.15.142:3300/0 conn(0x7f947c0b1a70 0x7f947c0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:22.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.292+0000 7f947be00640 1 -- 172.21.15.46:0/857059456 >> v2:172.21.15.142:3300/0 conn(0x7f947c0b1a70 msgr2=0x7f947c0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:22.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.292+0000 7f947a000640 1 -- 172.21.15.46:0/857059456 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140406693 0 0) 0x7f947c0ccb40 con 0x7f947c162360 2024-02-19T17:14:22.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.292+0000 7f947be00640 1 --2- 172.21.15.46:0/857059456 >> v2:172.21.15.142:3300/0 conn(0x7f947c0b1a70 0x7f947c0d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.292+0000 7f947be00640 1 -- 172.21.15.46:0/857059456 >> v1:172.21.15.142:6789/0 conn(0x7f947c162360 legacy=0x7f947c0b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:22.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.292+0000 7f947be00640 1 -- 172.21.15.46:0/857059456 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c06ad20 con 0x7f947c0aff20 2024-02-19T17:14:22.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.293+0000 7f947be00640 1 --2- 172.21.15.46:0/857059456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f947c0aff20 0x7f947c0b0370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9474009e50 tx=0x7f947402bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8966d0b154853ea5 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:22.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.294+0000 7f947a000640 1 -- 172.21.15.46:0/857059456 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947402ca80 con 0x7f947c0aff20 2024-02-19T17:14:22.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.294+0000 7f947a000640 1 -- 172.21.15.46:0/857059456 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947402cbe0 con 0x7f947c0aff20 2024-02-19T17:14:22.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.294+0000 7f947a000640 1 -- 172.21.15.46:0/857059456 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94740343f0 con 0x7f947c0aff20 2024-02-19T17:14:22.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.295+0000 7f9482200640 1 -- 172.21.15.46:0/857059456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f947c0aff20 msgr2=0x7f947c0b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:22.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.295+0000 7f9482200640 1 --2- 172.21.15.46:0/857059456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f947c0aff20 0x7f947c0b0370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9474009e50 tx=0x7f947402bee0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.295+0000 7f9482200640 1 -- 172.21.15.46:0/857059456 shutdown_connections 2024-02-19T17:14:22.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.295+0000 7f9482200640 1 --2- 172.21.15.46:0/857059456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f947c0aff20 0x7f947c0b0370 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.295+0000 7f9482200640 1 --2- 172.21.15.46:0/857059456 >> v2:172.21.15.142:3300/0 conn(0x7f947c0b1a70 0x7f947c0d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.295+0000 7f9482200640 1 -- 172.21.15.46:0/857059456 >> 172.21.15.46:0/857059456 conn(0x7f947c099a30 msgr2=0x7f947c0d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:22.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.295+0000 7f9482200640 1 -- 172.21.15.46:0/857059456 shutdown_connections 2024-02-19T17:14:22.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.295+0000 7f9482200640 1 -- 172.21.15.46:0/857059456 wait complete. 2024-02-19T17:14:22.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.297+0000 7f9482200640 1 Processor -- start 2024-02-19T17:14:22.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.298+0000 7f9482200640 1 -- start start 2024-02-19T17:14:22.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.299+0000 7f9482200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f947c0aff20 0x7f947c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:22.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.299+0000 7f9482200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c0b1a70 0x7f947c0b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:22.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.299+0000 7f9482200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f947c162360 0x7f947c0b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:22.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.299+0000 7f9482200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c14f2f0 con 0x7f947c0b1a70 2024-02-19T17:14:22.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.299+0000 7f9482200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0ca000 con 0x7f947c0aff20 2024-02-19T17:14:22.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.299+0000 7f9482200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0c93f0 con 0x7f947c162360 2024-02-19T17:14:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.300+0000 7f947be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f947c162360 0x7f947c0b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.300+0000 7f947be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f947c162360 0x7f947c0b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:34640/0 (socket says 172.21.15.46:34640) 2024-02-19T17:14:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.300+0000 7f947be00640 1 -- 172.21.15.46:0/1889719604 learned_addr learned my addr 172.21.15.46:0/1889719604 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.300+0000 7f947aa00640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c0b1a70 0x7f947c0b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.301+0000 7f947b400640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f947c0aff20 0x7f947c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.301+0000 7f947aa00640 1 -- 172.21.15.46:0/1889719604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f947c162360 msgr2=0x7f947c0b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.301+0000 7f947aa00640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f947c162360 0x7f947c0b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.301+0000 7f947aa00640 1 -- 172.21.15.46:0/1889719604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f947c0aff20 msgr2=0x7f947c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.301+0000 7f947aa00640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f947c0aff20 0x7f947c0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.301+0000 7f947aa00640 1 -- 172.21.15.46:0/1889719604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9474009b30 con 0x7f947c0b1a70 2024-02-19T17:14:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.302+0000 7f947aa00640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c0b1a70 0x7f947c0b3140 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f946800d780 tx=0x7f946800dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.302+0000 7f9473400640 1 -- 172.21.15.46:0/1889719604 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946800de90 con 0x7f947c0b1a70 2024-02-19T17:14:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.302+0000 7f9482200640 1 -- 172.21.15.46:0/1889719604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c0c96d0 con 0x7f947c0b1a70 2024-02-19T17:14:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.302+0000 7f9473400640 1 -- 172.21.15.46:0/1889719604 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946800de90 con 0x7f947c0b1a70 2024-02-19T17:14:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.304+0000 7f9482200640 1 -- 172.21.15.46:0/1889719604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c0c9c90 con 0x7f947c0b1a70 2024-02-19T17:14:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.304+0000 7f9473400640 1 -- 172.21.15.46:0/1889719604 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946800b6c0 con 0x7f947c0b1a70 2024-02-19T17:14:22.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.306+0000 7f9473400640 1 -- 172.21.15.46:0/1889719604 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f946800b820 con 0x7f947c0b1a70 2024-02-19T17:14:22.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.307+0000 7f9473400640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f945c06b870 0x7f945c06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:22.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.308+0000 7f9473400640 1 -- 172.21.15.46:0/1889719604 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9468089940 con 0x7f947c0b1a70 2024-02-19T17:14:22.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.309+0000 7f9482200640 1 -- 172.21.15.46:0/1889719604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9454005290 con 0x7f947c0b1a70 2024-02-19T17:14:22.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.309+0000 7f947b400640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f945c06b870 0x7f945c06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:22.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.312+0000 7f947b400640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f945c06b870 0x7f945c06dd30 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f946c000f60 tx=0x7f946c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:22.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.319+0000 7f9473400640 1 -- 172.21.15.46:0/1889719604 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f946805e070 con 0x7f947c0b1a70 2024-02-19T17:14:22.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.687+0000 7f9482200640 1 -- 172.21.15.46:0/1889719604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9454005810 con 0x7f947c0b1a70 2024-02-19T17:14:22.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.687+0000 7f9473400640 1 -- 172.21.15.46:0/1889719604 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f94680543a0 con 0x7f947c0b1a70 2024-02-19T17:14:22.673 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:22.673 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2121507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2121507890},{"type":"v1","addr":"172.21.15.142:6835","nonce":2121507890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3952092655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3952092655},{"type":"v1","addr":"172.21.15.46:6835","nonce":3952092655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1741774776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1741774776},{"type":"v1","addr":"172.21.15.142:6837","nonce":1741774776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T06:59:16.065049+0000","modified":"2024-02-19T06:59:19.096312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6834/1322569769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1322569769},{"type":"v1","addr":"172.21.15.46:6834","nonce":1322569769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-19T17:14:22.674 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-02-19T17:14:22.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.691+0000 7f9482200640 1 -- 172.21.15.46:0/1889719604 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f945c06b870 msgr2=0x7f945c06dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:22.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.691+0000 7f9482200640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f945c06b870 0x7f945c06dd30 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f946c000f60 tx=0x7f946c009040 comp rx=0 tx=0).stop 2024-02-19T17:14:22.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.691+0000 7f9482200640 1 -- 172.21.15.46:0/1889719604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c0b1a70 msgr2=0x7f947c0b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:22.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.691+0000 7f9482200640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c0b1a70 0x7f947c0b3140 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f946800d780 tx=0x7f946800dc40 comp rx=0 tx=0).stop 2024-02-19T17:14:22.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.691+0000 7f9482200640 1 -- 172.21.15.46:0/1889719604 shutdown_connections 2024-02-19T17:14:22.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.691+0000 7f9482200640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f945c06b870 0x7f945c06dd30 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.691+0000 7f9482200640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f947c162360 0x7f947c0b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.691+0000 7f9482200640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c0b1a70 0x7f947c0b3140 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.691+0000 7f9482200640 1 --2- 172.21.15.46:0/1889719604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f947c0aff20 0x7f947c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.691+0000 7f9482200640 1 -- 172.21.15.46:0/1889719604 >> 172.21.15.46:0/1889719604 conn(0x7f947c099a30 msgr2=0x7f947c0ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:22.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.691+0000 7f9482200640 1 -- 172.21.15.46:0/1889719604 shutdown_connections 2024-02-19T17:14:22.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.691+0000 7f9482200640 1 -- 172.21.15.46:0/1889719604 wait complete. 2024-02-19T17:14:22.702 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T17:14:22.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.947+0000 7fc012a00640 1 Processor -- start 2024-02-19T17:14:22.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.947+0000 7fc012a00640 1 -- start start 2024-02-19T17:14:22.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.949+0000 7fc012a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00c159500 0x7fc00c071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:22.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.949+0000 7fc012a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc00c0ce460 0x7fc00c071540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:22.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.949+0000 7fc012a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc00c0cbde0 0x7fc00c0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:22.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.949+0000 7fc012a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c0cd090 con 0x7fc00c0cbde0 2024-02-19T17:14:22.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.949+0000 7fc012a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c06d4d0 con 0x7fc00c0ce460 2024-02-19T17:14:22.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.949+0000 7fc012a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c1598e0 con 0x7fc00c159500 2024-02-19T17:14:22.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.949+0000 7fc010a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc00c0cbde0 0x7fc00c0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:22.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.950+0000 7fc010a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc00c0cbde0 0x7fc00c0cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48204/0 (socket says 172.21.15.46:48204) 2024-02-19T17:14:22.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.950+0000 7fc010a00640 1 -- 172.21.15.46:0/3823129214 learned_addr learned my addr 172.21.15.46:0/3823129214 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:22.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.950+0000 7fc00be00640 1 --2- 172.21.15.46:0/3823129214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00c159500 0x7fc00c071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:22.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.950+0000 7fc010a00640 1 -- 172.21.15.46:0/3823129214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00c159500 msgr2=0x7fc00c071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:22.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.950+0000 7fc010a00640 1 --2- 172.21.15.46:0/3823129214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00c159500 0x7fc00c071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.950+0000 7fc010a00640 1 -- 172.21.15.46:0/3823129214 >> v2:172.21.15.142:3300/0 conn(0x7fc00c0ce460 msgr2=0x7fc00c071540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:22.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.950+0000 7fc010a00640 1 --2- 172.21.15.46:0/3823129214 >> v2:172.21.15.142:3300/0 conn(0x7fc00c0ce460 0x7fc00c071540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.950+0000 7fc010a00640 1 -- 172.21.15.46:0/3823129214 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c0ccad0 con 0x7fc00c0cbde0 2024-02-19T17:14:22.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.950+0000 7fc00be00640 1 --2- 172.21.15.46:0/3823129214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00c159500 0x7fc00c071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:22.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.951+0000 7fc010a00640 1 --2- 172.21.15.46:0/3823129214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc00c0cbde0 0x7fc00c0cc270 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7fc00c072290 tx=0x7fc00402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d16d4e15789afa5 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:22.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.952+0000 7fc00b400640 1 -- 172.21.15.46:0/3823129214 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00402ca80 con 0x7fc00c0cbde0 2024-02-19T17:14:22.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.952+0000 7fc00b400640 1 -- 172.21.15.46:0/3823129214 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00402cbe0 con 0x7fc00c0cbde0 2024-02-19T17:14:22.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.952+0000 7fc00b400640 1 -- 172.21.15.46:0/3823129214 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0040343f0 con 0x7fc00c0cbde0 2024-02-19T17:14:22.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.952+0000 7fc012a00640 1 -- 172.21.15.46:0/3823129214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc00c0cbde0 msgr2=0x7fc00c0cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:22.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.952+0000 7fc012a00640 1 --2- 172.21.15.46:0/3823129214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc00c0cbde0 0x7fc00c0cc270 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7fc00c072290 tx=0x7fc00402bee0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.953+0000 7fc012a00640 1 -- 172.21.15.46:0/3823129214 shutdown_connections 2024-02-19T17:14:22.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.953+0000 7fc012a00640 1 --2- 172.21.15.46:0/3823129214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc00c0cbde0 0x7fc00c0cc270 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.953+0000 7fc012a00640 1 --2- 172.21.15.46:0/3823129214 >> v2:172.21.15.142:3300/0 conn(0x7fc00c0ce460 0x7fc00c071540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.953+0000 7fc012a00640 1 --2- 172.21.15.46:0/3823129214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00c159500 0x7fc00c071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.953+0000 7fc012a00640 1 -- 172.21.15.46:0/3823129214 >> 172.21.15.46:0/3823129214 conn(0x7fc00c066f70 msgr2=0x7fc00c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:22.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.953+0000 7fc012a00640 1 -- 172.21.15.46:0/3823129214 shutdown_connections 2024-02-19T17:14:22.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.953+0000 7fc012a00640 1 -- 172.21.15.46:0/3823129214 wait complete. 2024-02-19T17:14:22.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.955+0000 7fc012a00640 1 Processor -- start 2024-02-19T17:14:22.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.956+0000 7fc012a00640 1 -- start start 2024-02-19T17:14:22.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.957+0000 7fc012a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc00c0cbde0 0x7fc00c0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:22.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.957+0000 7fc012a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc00c0ce460 0x7fc00c0b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:22.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.957+0000 7fc012a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00c159500 0x7fc00c15f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:22.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.957+0000 7fc012a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c13b9c0 con 0x7fc00c0ce460 2024-02-19T17:14:22.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.957+0000 7fc012a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c13adb0 con 0x7fc00c0cbde0 2024-02-19T17:14:22.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.957+0000 7fc012a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c13b090 con 0x7fc00c159500 2024-02-19T17:14:22.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.958+0000 7fc00be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc00c0cbde0 0x7fc00c0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:22.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.958+0000 7fc00be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc00c0cbde0 0x7fc00c0c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:37608/0 (socket says 172.21.15.46:37608) 2024-02-19T17:14:22.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.958+0000 7fc00be00640 1 -- 172.21.15.46:0/437301347 learned_addr learned my addr 172.21.15.46:0/437301347 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:22.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.958+0000 7fc003e00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc00c0ce460 0x7fc00c0b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:22.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.958+0000 7fc010a00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00c159500 0x7fc00c15f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.958+0000 7fc00be00640 1 -- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00c159500 msgr2=0x7fc00c15f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.958+0000 7fc00be00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00c159500 0x7fc00c15f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.958+0000 7fc00be00640 1 -- 172.21.15.46:0/437301347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc00c0ce460 msgr2=0x7fc00c0b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.959+0000 7fc00be00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc00c0ce460 0x7fc00c0b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.959+0000 7fc00be00640 1 -- 172.21.15.46:0/437301347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc004009b30 con 0x7fc00c0cbde0 2024-02-19T17:14:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.959+0000 7fc003e00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc00c0ce460 0x7fc00c0b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T17:14:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.959+0000 7fc00be00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc00c0cbde0 0x7fc00c0c4d90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00c7f0 tx=0x7fbffc00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.960+0000 7fc008c00640 1 -- 172.21.15.46:0/437301347 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc007a30 con 0x7fc00c0cbde0 2024-02-19T17:14:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.960+0000 7fc008c00640 1 -- 172.21.15.46:0/437301347 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc007b90 con 0x7fc00c0cbde0 2024-02-19T17:14:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.960+0000 7fc012a00640 1 -- 172.21.15.46:0/437301347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c13b370 con 0x7fc00c0cbde0 2024-02-19T17:14:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.960+0000 7fc008c00640 1 -- 172.21.15.46:0/437301347 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00ce40 con 0x7fc00c0cbde0 2024-02-19T17:14:22.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.961+0000 7fc012a00640 1 -- 172.21.15.46:0/437301347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c13be50 con 0x7fc00c0cbde0 2024-02-19T17:14:22.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.962+0000 7fc012a00640 1 -- 172.21.15.46:0/437301347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00c067ba0 con 0x7fc00c0cbde0 2024-02-19T17:14:22.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.964+0000 7fc008c00640 1 -- 172.21.15.46:0/437301347 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbffc0113f0 con 0x7fc00c0cbde0 2024-02-19T17:14:22.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.966+0000 7fc008c00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbfe806b810 0x7fbfe806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:22.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.968+0000 7fc008c00640 1 -- 172.21.15.46:0/437301347 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbffc08a470 con 0x7fc00c0cbde0 2024-02-19T17:14:22.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.969+0000 7fc003e00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbfe806b810 0x7fbfe806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:22.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.970+0000 7fc003e00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbfe806b810 0x7fbfe806dcd0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0b3b90 tx=0x7fbff4009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:22.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:22.977+0000 7fc008c00640 1 -- 172.21.15.46:0/437301347 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbffc054e10 con 0x7fc00c0cbde0 2024-02-19T17:14:23.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.275+0000 7fc012a00640 1 -- 172.21.15.46:0/437301347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc00c071e40 con 0x7fc00c0cbde0 2024-02-19T17:14:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.277+0000 7fc008c00640 1 -- 172.21.15.46:0/437301347 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16669 (secure 0 0 0) 0x7fbffc0584d0 con 0x7fc00c0cbde0 2024-02-19T17:14:23.263 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:23.263 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":35,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T06:59:17.589125+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-19T06:59:14.017896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-19T06:59:15.078011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T17:14:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.279+0000 7fc012a00640 1 -- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbfe806b810 msgr2=0x7fbfe806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.279+0000 7fc012a00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbfe806b810 0x7fbfe806dcd0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0b3b90 tx=0x7fbff4009060 comp rx=0 tx=0).stop 2024-02-19T17:14:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.279+0000 7fc012a00640 1 -- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc00c0cbde0 msgr2=0x7fc00c0c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:23.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.279+0000 7fc012a00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc00c0cbde0 0x7fc00c0c4d90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00c7f0 tx=0x7fbffc00cbf0 comp rx=0 tx=0).stop 2024-02-19T17:14:23.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.280+0000 7fc012a00640 1 -- 172.21.15.46:0/437301347 shutdown_connections 2024-02-19T17:14:23.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.280+0000 7fc012a00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbfe806b810 0x7fbfe806dcd0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:23.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.280+0000 7fc012a00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00c159500 0x7fc00c15f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:23.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.280+0000 7fc012a00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc00c0ce460 0x7fc00c0b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:23.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.280+0000 7fc012a00640 1 --2- 172.21.15.46:0/437301347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc00c0cbde0 0x7fc00c0c4d90 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:23.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.280+0000 7fc012a00640 1 -- 172.21.15.46:0/437301347 >> 172.21.15.46:0/437301347 conn(0x7fc00c066f70 msgr2=0x7fc00c0ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:23.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.280+0000 7fc012a00640 1 -- 172.21.15.46:0/437301347 shutdown_connections 2024-02-19T17:14:23.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.280+0000 7fc012a00640 1 -- 172.21.15.46:0/437301347 wait complete. 2024-02-19T17:14:23.290 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-19T17:14:23.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.545+0000 7f35df400640 1 Processor -- start 2024-02-19T17:14:23.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.545+0000 7f35df400640 1 -- start start 2024-02-19T17:14:23.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.547+0000 7f35df400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d806ea20 0x7f35d80cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:23.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.547+0000 7f35df400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d815fec0 con 0x7f35d81452d0 2024-02-19T17:14:23.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.547+0000 7f35df400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d80cfcf0 con 0x7f35d80cf890 2024-02-19T17:14:23.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.547+0000 7f35df400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d80ccf00 con 0x7f35d806ea20 2024-02-19T17:14:23.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.547+0000 7f35dca00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f35d81452d0 0x7f35d80cf180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33166/0 (socket says 172.21.15.46:33166) 2024-02-19T17:14:23.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.547+0000 7f35dca00640 1 -- 172.21.15.46:0/3620553782 learned_addr learned my addr 172.21.15.46:0/3620553782 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:23.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.548+0000 7f35d7e00640 1 --2- 172.21.15.46:0/3620553782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d806ea20 0x7f35d80cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:23.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.548+0000 7f35d7400640 1 -- 172.21.15.46:0/3620553782 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272069130 0 0) 0x7f35d815fec0 con 0x7f35d81452d0 2024-02-19T17:14:23.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.548+0000 7f35d7400640 1 -- 172.21.15.46:0/3620553782 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35c0003520 con 0x7f35d81452d0 2024-02-19T17:14:23.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.548+0000 7f35d7400640 1 -- 172.21.15.46:0/3620553782 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154737916 0 0) 0x7f35d80cfcf0 con 0x7f35d80cf890 2024-02-19T17:14:23.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.548+0000 7f35d7400640 1 -- 172.21.15.46:0/3620553782 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35d815fec0 con 0x7f35d80cf890 2024-02-19T17:14:23.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.548+0000 7f35d7e00640 1 -- 172.21.15.46:0/3620553782 >> v1:172.21.15.142:6789/0 conn(0x7f35d80cf890 legacy=0x7f35d806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:23.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.548+0000 7f35d7e00640 1 -- 172.21.15.46:0/3620553782 >> v1:172.21.15.46:6789/0 conn(0x7f35d81452d0 legacy=0x7f35d80cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:23.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.548+0000 7f35d7e00640 1 -- 172.21.15.46:0/3620553782 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d815f590 con 0x7f35d806ea20 2024-02-19T17:14:23.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.551+0000 7f35d7e00640 1 --2- 172.21.15.46:0/3620553782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d806ea20 0x7f35d80cc870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f35c40097d0 tx=0x7f35c402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738b0a118c5ba99 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:23.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.552+0000 7f35d7400640 1 -- 172.21.15.46:0/3620553782 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4030800 con 0x7f35d806ea20 2024-02-19T17:14:23.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.552+0000 7f35d7400640 1 -- 172.21.15.46:0/3620553782 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c4030960 con 0x7f35d806ea20 2024-02-19T17:14:23.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.552+0000 7f35d7400640 1 -- 172.21.15.46:0/3620553782 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4030cf0 con 0x7f35d806ea20 2024-02-19T17:14:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.552+0000 7f35df400640 1 -- 172.21.15.46:0/3620553782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d806ea20 msgr2=0x7f35d80cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.552+0000 7f35df400640 1 --2- 172.21.15.46:0/3620553782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d806ea20 0x7f35d80cc870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f35c40097d0 tx=0x7f35c402b940 comp rx=0 tx=0).stop 2024-02-19T17:14:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.553+0000 7f35df400640 1 -- 172.21.15.46:0/3620553782 shutdown_connections 2024-02-19T17:14:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.553+0000 7f35df400640 1 --2- 172.21.15.46:0/3620553782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d806ea20 0x7f35d80cc870 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.553+0000 7f35df400640 1 -- 172.21.15.46:0/3620553782 >> 172.21.15.46:0/3620553782 conn(0x7f35d8066f70 msgr2=0x7f35d806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.553+0000 7f35df400640 1 -- 172.21.15.46:0/3620553782 shutdown_connections 2024-02-19T17:14:23.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.553+0000 7f35df400640 1 -- 172.21.15.46:0/3620553782 wait complete. 2024-02-19T17:14:23.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.555+0000 7f35df400640 1 Processor -- start 2024-02-19T17:14:23.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.555+0000 7f35df400640 1 -- start start 2024-02-19T17:14:23.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.556+0000 7f35df400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d806ea20 0x7f35d8136ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:23.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.556+0000 7f35df400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d80cf890 0x7f35d8140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:23.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.556+0000 7f35df400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35d81452d0 0x7f35d81405a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:23.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.556+0000 7f35df400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d81e90d0 con 0x7f35d81452d0 2024-02-19T17:14:23.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.556+0000 7f35df400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d81e84c0 con 0x7f35d806ea20 2024-02-19T17:14:23.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.556+0000 7f35df400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d81e87a0 con 0x7f35d80cf890 2024-02-19T17:14:23.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.556+0000 7f35d7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d80cf890 0x7f35d8140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:23.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.557+0000 7f35dd400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35d81452d0 0x7f35d81405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:23.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.557+0000 7f35dd400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35d81452d0 0x7f35d81405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48228/0 (socket says 172.21.15.46:48228) 2024-02-19T17:14:23.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.557+0000 7f35dd400640 1 -- 172.21.15.46:0/942582464 learned_addr learned my addr 172.21.15.46:0/942582464 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:23.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.557+0000 7f35dd400640 1 -- 172.21.15.46:0/942582464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d80cf890 msgr2=0x7f35d8140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:23.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.557+0000 7f35dd400640 1 --2- 172.21.15.46:0/942582464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d80cf890 0x7f35d8140060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:23.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.557+0000 7f35dd400640 1 -- 172.21.15.46:0/942582464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d806ea20 msgr2=0x7f35d8136ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:23.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.557+0000 7f35dd400640 1 --2- 172.21.15.46:0/942582464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d806ea20 0x7f35d8136ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:23.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.557+0000 7f35dd400640 1 -- 172.21.15.46:0/942582464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c4009400 con 0x7f35d81452d0 2024-02-19T17:14:23.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.558+0000 7f35dd400640 1 --2- 172.21.15.46:0/942582464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35d81452d0 0x7f35d81405a0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c7a0 tx=0x7f35d000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:23.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.562+0000 7f35d4c00640 1 -- 172.21.15.46:0/942582464 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0003b70 con 0x7f35d81452d0 2024-02-19T17:14:23.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.562+0000 7f35d4c00640 1 -- 172.21.15.46:0/942582464 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d0003cf0 con 0x7f35d81452d0 2024-02-19T17:14:23.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.562+0000 7f35d4c00640 1 -- 172.21.15.46:0/942582464 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d000aa90 con 0x7f35d81452d0 2024-02-19T17:14:23.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.563+0000 7f35df400640 1 -- 172.21.15.46:0/942582464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d81e8a80 con 0x7f35d81452d0 2024-02-19T17:14:23.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.563+0000 7f35df400640 1 -- 172.21.15.46:0/942582464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d81e7720 con 0x7f35d81452d0 2024-02-19T17:14:23.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.565+0000 7f35df400640 1 -- 172.21.15.46:0/942582464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d8067ba0 con 0x7f35d81452d0 2024-02-19T17:14:23.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.568+0000 7f35d4c00640 1 -- 172.21.15.46:0/942582464 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f35d000abf0 con 0x7f35d81452d0 2024-02-19T17:14:23.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.569+0000 7f35d4c00640 1 --2- 172.21.15.46:0/942582464 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f35b806b860 0x7f35b806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:23.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.569+0000 7f35d4c00640 1 -- 172.21.15.46:0/942582464 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35d008ab70 con 0x7f35d81452d0 2024-02-19T17:14:23.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.570+0000 7f35dca00640 1 --2- 172.21.15.46:0/942582464 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f35b806b860 0x7f35b806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:23.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.572+0000 7f35d4c00640 1 -- 172.21.15.46:0/942582464 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f35d0055570 con 0x7f35d81452d0 2024-02-19T17:14:23.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.573+0000 7f35dca00640 1 --2- 172.21.15.46:0/942582464 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f35b806b860 0x7f35b806dd20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f35cc001570 tx=0x7f35cc007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:23.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.912+0000 7f35df400640 1 -- 172.21.15.46:0/942582464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f35d80b2560 con 0x7f35d81452d0 2024-02-19T17:14:23.971 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-02-19T17:14:23.985+0000 7fac5be00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T17:14:23.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.987+0000 7f35d4c00640 1 -- 172.21.15.46:0/942582464 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f35d80b2560 con 0x7f35d81452d0 2024-02-19T17:14:23.973 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-19T17:14:23.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.991+0000 7f35df400640 1 -- 172.21.15.46:0/942582464 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f35b806b860 msgr2=0x7f35b806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:23.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.991+0000 7f35df400640 1 --2- 172.21.15.46:0/942582464 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f35b806b860 0x7f35b806dd20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f35cc001570 tx=0x7f35cc007930 comp rx=0 tx=0).stop 2024-02-19T17:14:23.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.991+0000 7f35df400640 1 -- 172.21.15.46:0/942582464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35d81452d0 msgr2=0x7f35d81405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:23.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.991+0000 7f35df400640 1 --2- 172.21.15.46:0/942582464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35d81452d0 0x7f35d81405a0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c7a0 tx=0x7f35d000cc60 comp rx=0 tx=0).stop 2024-02-19T17:14:23.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.991+0000 7f35df400640 1 -- 172.21.15.46:0/942582464 shutdown_connections 2024-02-19T17:14:23.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.991+0000 7f35df400640 1 --2- 172.21.15.46:0/942582464 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f35b806b860 0x7f35b806dd20 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:23.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.991+0000 7f35df400640 1 --2- 172.21.15.46:0/942582464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35d81452d0 0x7f35d81405a0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:23.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.991+0000 7f35df400640 1 --2- 172.21.15.46:0/942582464 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d80cf890 0x7f35d8140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:23.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.991+0000 7f35df400640 1 --2- 172.21.15.46:0/942582464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d806ea20 0x7f35d8136ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:23.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.991+0000 7f35df400640 1 -- 172.21.15.46:0/942582464 >> 172.21.15.46:0/942582464 conn(0x7f35d8066f70 msgr2=0x7f35d815dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:23.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.991+0000 7f35df400640 1 -- 172.21.15.46:0/942582464 shutdown_connections 2024-02-19T17:14:23.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:23.991+0000 7f35df400640 1 -- 172.21.15.46:0/942582464 wait complete. 2024-02-19T17:14:24.001 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-19T17:14:24.196 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-02-19T17:14:24.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.211+0000 7f79f6200640 1 Processor -- start 2024-02-19T17:14:24.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.211+0000 7f79f6200640 1 -- start start 2024-02-19T17:14:24.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.213+0000 7f79f6200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f79f0160f50 0x7f79f00cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:24.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.213+0000 7f79f6200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f79f00d2330 0x7f79f00d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:24.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.214+0000 7f79f6200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f00d19f0 con 0x7f79f00d0b30 2024-02-19T17:14:24.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.214+0000 7f79f6200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f00ceed0 con 0x7f79f0160f50 2024-02-19T17:14:24.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.214+0000 7f79eea00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f79f00d0b30 0x7f79f00d1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33180/0 (socket says 172.21.15.46:33180) 2024-02-19T17:14:24.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.214+0000 7f79eea00640 1 -- 172.21.15.46:0/3265464478 learned_addr learned my addr 172.21.15.46:0/3265464478 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:24.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.214+0000 7f79ef400640 1 --2- 172.21.15.46:0/3265464478 >> v2:172.21.15.46:3300/0 conn(0x7f79f0160f50 0x7f79f00cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:24.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.214+0000 7f79f6200640 1 -- 172.21.15.46:0/3265464478 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f00ce5e0 con 0x7f79f00d2330 2024-02-19T17:14:24.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.214+0000 7f79efe00640 1 --2- 172.21.15.46:0/3265464478 >> v2:172.21.15.142:3300/0 conn(0x7f79f00d2330 0x7f79f00d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:24.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.214+0000 7f79ee000640 1 -- 172.21.15.46:0/3265464478 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135826592 0 0) 0x7f79f00d19f0 con 0x7f79f00d0b30 2024-02-19T17:14:24.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.214+0000 7f79ef400640 1 -- 172.21.15.46:0/3265464478 >> v2:172.21.15.142:3300/0 conn(0x7f79f00d2330 msgr2=0x7f79f00d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.214+0000 7f79ef400640 1 --2- 172.21.15.46:0/3265464478 >> v2:172.21.15.142:3300/0 conn(0x7f79f00d2330 0x7f79f00d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.214+0000 7f79ef400640 1 -- 172.21.15.46:0/3265464478 >> v1:172.21.15.46:6789/0 conn(0x7f79f00d0b30 legacy=0x7f79f00d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.214+0000 7f79ef400640 1 -- 172.21.15.46:0/3265464478 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f0161330 con 0x7f79f0160f50 2024-02-19T17:14:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.215+0000 7f79ef400640 1 --2- 172.21.15.46:0/3265464478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0160f50 0x7f79f00cf360 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f79f008cb30 tx=0x7f79e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6372264da89a6927 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.216+0000 7f79ee000640 1 -- 172.21.15.46:0/3265464478 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0031830 con 0x7f79f0160f50 2024-02-19T17:14:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.216+0000 7f79ee000640 1 -- 172.21.15.46:0/3265464478 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e0031990 con 0x7f79f0160f50 2024-02-19T17:14:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.216+0000 7f79ee000640 1 -- 172.21.15.46:0/3265464478 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0031d20 con 0x7f79f0160f50 2024-02-19T17:14:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.216+0000 7f79f6200640 1 -- 172.21.15.46:0/3265464478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0160f50 msgr2=0x7f79f00cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:24.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.216+0000 7f79f6200640 1 --2- 172.21.15.46:0/3265464478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0160f50 0x7f79f00cf360 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f79f008cb30 tx=0x7f79e002b8d0 comp rx=0 tx=0).stop 2024-02-19T17:14:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.217+0000 7f79f6200640 1 -- 172.21.15.46:0/3265464478 shutdown_connections 2024-02-19T17:14:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.217+0000 7f79f6200640 1 --2- 172.21.15.46:0/3265464478 >> v2:172.21.15.142:3300/0 conn(0x7f79f00d2330 0x7f79f00d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.217+0000 7f79f6200640 1 --2- 172.21.15.46:0/3265464478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0160f50 0x7f79f00cf360 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.217+0000 7f79f6200640 1 -- 172.21.15.46:0/3265464478 >> 172.21.15.46:0/3265464478 conn(0x7f79f008afc0 msgr2=0x7f79f00d38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.217+0000 7f79f6200640 1 -- 172.21.15.46:0/3265464478 shutdown_connections 2024-02-19T17:14:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.217+0000 7f79f6200640 1 -- 172.21.15.46:0/3265464478 wait complete. 2024-02-19T17:14:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.219+0000 7f79f6200640 1 Processor -- start 2024-02-19T17:14:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.219+0000 7f79f6200640 1 -- start start 2024-02-19T17:14:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.220+0000 7f79f6200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f00d0b30 0x7f79f0151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.220+0000 7f79f6200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f00d2330 0x7f79f00cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.220+0000 7f79f6200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0160f50 0x7f79f00cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.220+0000 7f79f6200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f0152260 con 0x7f79f0160f50 2024-02-19T17:14:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.220+0000 7f79f6200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00b7200 con 0x7f79f00d2330 2024-02-19T17:14:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.220+0000 7f79f6200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00b74e0 con 0x7f79f00d0b30 2024-02-19T17:14:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.220+0000 7f79efe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0160f50 0x7f79f00cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.220+0000 7f79efe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0160f50 0x7f79f00cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48262/0 (socket says 172.21.15.46:48262) 2024-02-19T17:14:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.220+0000 7f79efe00640 1 -- 172.21.15.46:0/3182558017 learned_addr learned my addr 172.21.15.46:0/3182558017 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.220+0000 7f79eea00640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f00d2330 0x7f79f00cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.220+0000 7f79ef400640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f00d0b30 0x7f79f0151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.220+0000 7f79efe00640 1 -- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f00d0b30 msgr2=0x7f79f0151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.220+0000 7f79efe00640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f00d0b30 0x7f79f0151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.221+0000 7f79efe00640 1 -- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f00d2330 msgr2=0x7f79f00cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.221+0000 7f79efe00640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f00d2330 0x7f79f00cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.221+0000 7f79efe00640 1 -- 172.21.15.46:0/3182558017 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0009400 con 0x7f79f0160f50 2024-02-19T17:14:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.221+0000 7f79ef400640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f00d0b30 0x7f79f0151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.221+0000 7f79efe00640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0160f50 0x7f79f00cc3c0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f79e8007e40 tx=0x7f79e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.221+0000 7f79e7400640 1 -- 172.21.15.46:0/3182558017 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8014620 con 0x7f79f0160f50 2024-02-19T17:14:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.221+0000 7f79e7400640 1 -- 172.21.15.46:0/3182558017 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e800ee90 con 0x7f79f0160f50 2024-02-19T17:14:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.221+0000 7f79e7400640 1 -- 172.21.15.46:0/3182558017 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e80149e0 con 0x7f79f0160f50 2024-02-19T17:14:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.221+0000 7f79f6200640 1 -- 172.21.15.46:0/3182558017 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f00b77c0 con 0x7f79f0160f50 2024-02-19T17:14:24.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.221+0000 7f79f6200640 1 -- 172.21.15.46:0/3182558017 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f00b7aa0 con 0x7f79f0160f50 2024-02-19T17:14:24.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.222+0000 7f79f6200640 1 -- 172.21.15.46:0/3182558017 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f00c8820 con 0x7f79f0160f50 2024-02-19T17:14:24.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.223+0000 7f79e7400640 1 -- 172.21.15.46:0/3182558017 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f79e8014b40 con 0x7f79f0160f50 2024-02-19T17:14:24.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.224+0000 7f79e7400640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f79d006b810 0x7f79d006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:24.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.224+0000 7f79e7400640 1 -- 172.21.15.46:0/3182558017 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f79e808ac10 con 0x7f79f0160f50 2024-02-19T17:14:24.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.225+0000 7f79ef400640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f79d006b810 0x7f79d006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:24.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.225+0000 7f79ef400640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f79d006b810 0x7f79d006dcd0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f79e0036000 tx=0x7f79e003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:24.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.228+0000 7f79e7400640 1 -- 172.21.15.46:0/3182558017 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f79e80555c0 con 0x7f79f0160f50 2024-02-19T17:14:24.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.464+0000 7f79f6200640 1 -- 172.21.15.46:0/3182558017 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f79f00682b0 con 0x7f79f0160f50 2024-02-19T17:14:24.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.991+0000 7f79e7400640 1 -- 172.21.15.46:0/3182558017 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f79e8058c80 con 0x7f79f0160f50 2024-02-19T17:14:24.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.994+0000 7f79f6200640 1 -- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f79d006b810 msgr2=0x7f79d006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:24.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.994+0000 7f79f6200640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f79d006b810 0x7f79d006dcd0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f79e0036000 tx=0x7f79e003c040 comp rx=0 tx=0).stop 2024-02-19T17:14:24.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.994+0000 7f79f6200640 1 -- 172.21.15.46:0/3182558017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0160f50 msgr2=0x7f79f00cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:24.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.995+0000 7f79f6200640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0160f50 0x7f79f00cc3c0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f79e8007e40 tx=0x7f79e800e4b0 comp rx=0 tx=0).stop 2024-02-19T17:14:24.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.995+0000 7f79f6200640 1 -- 172.21.15.46:0/3182558017 shutdown_connections 2024-02-19T17:14:24.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.995+0000 7f79f6200640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f79d006b810 0x7f79d006dcd0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:24.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.995+0000 7f79f6200640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0160f50 0x7f79f00cc3c0 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:24.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.995+0000 7f79f6200640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f00d2330 0x7f79f00cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:24.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.995+0000 7f79f6200640 1 --2- 172.21.15.46:0/3182558017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f00d0b30 0x7f79f0151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:24.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.995+0000 7f79f6200640 1 -- 172.21.15.46:0/3182558017 >> 172.21.15.46:0/3182558017 conn(0x7f79f008afc0 msgr2=0x7f79f00cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:24.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.995+0000 7f79f6200640 1 -- 172.21.15.46:0/3182558017 shutdown_connections 2024-02-19T17:14:24.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:24.995+0000 7f79f6200640 1 -- 172.21.15.46:0/3182558017 wait complete. 2024-02-19T17:14:25.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-19T17:14:25.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.245+0000 7f528e200640 1 Processor -- start 2024-02-19T17:14:25.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.245+0000 7f528e200640 1 -- start start 2024-02-19T17:14:25.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.247+0000 7f528e200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52880cc840 0x7f52880b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:25.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.247+0000 7f528e200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5288072990 0x7f52880ac130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:25.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.247+0000 7f528e200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5288098db0 con 0x7f52880cf520 2024-02-19T17:14:25.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.247+0000 7f528e200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52880b36e0 con 0x7f5288072990 2024-02-19T17:14:25.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.247+0000 7f528e200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528815bad0 con 0x7f52880cc840 2024-02-19T17:14:25.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.247+0000 7f528ce00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f52880cf520 0x7f52880cf900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33190/0 (socket says 172.21.15.46:33190) 2024-02-19T17:14:25.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.247+0000 7f528ce00640 1 -- 172.21.15.46:0/2787925880 learned_addr learned my addr 172.21.15.46:0/2787925880 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:25.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.247+0000 7f528d800640 1 --2- 172.21.15.46:0/2787925880 >> v2:172.21.15.142:3300/0 conn(0x7f5288072990 0x7f52880ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:25.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287e00640 1 --2- 172.21.15.46:0/2787925880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52880cc840 0x7f52880b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:25.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911352095 0 0) 0x7f527c001110 con 0x7f52880cf520 2024-02-19T17:14:25.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5270003520 con 0x7f52880cf520 2024-02-19T17:14:25.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3402622587 0 0) 0x7f5270003520 con 0x7f52880cf520 2024-02-19T17:14:25.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52880cc840 msgr2=0x7f52880b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 --2- 172.21.15.46:0/2787925880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52880cc840 0x7f52880b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 >> v2:172.21.15.142:3300/0 conn(0x7f5288072990 msgr2=0x7f52880ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 --2- 172.21.15.46:0/2787925880 >> v2:172.21.15.142:3300/0 conn(0x7f5288072990 0x7f52880ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52880731c0 con 0x7f52880cf520 2024-02-19T17:14:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f527c001800 con 0x7f52880cf520 2024-02-19T17:14:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 >> v1:172.21.15.46:6789/0 conn(0x7f52880cf520 legacy=0x7f52880cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 --2- 172.21.15.46:0/2787925880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5270003970 0x7f5270003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 --2- 172.21.15.46:0/2787925880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52880cc840 0x7f52700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 --2- 172.21.15.46:0/2787925880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5270004d00 0x7f5270005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52880b36e0 con 0x7f5270004d00 2024-02-19T17:14:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528815bad0 con 0x7f5270003970 2024-02-19T17:14:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.248+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527000b9b0 con 0x7f52880cc840 2024-02-19T17:14:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.249+0000 7f528d800640 1 --2- 172.21.15.46:0/2787925880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5270004d00 0x7f5270005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.249+0000 7f5287e00640 1 --2- 172.21.15.46:0/2787925880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52880cc840 0x7f52700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.249+0000 7f528d800640 1 -- 172.21.15.46:0/2787925880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52880cc840 msgr2=0x7f52700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.249+0000 7f528ce00640 1 --2- 172.21.15.46:0/2787925880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5270003970 0x7f5270003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.249+0000 7f528d800640 1 --2- 172.21.15.46:0/2787925880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52880cc840 0x7f52700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.249+0000 7f528d800640 1 -- 172.21.15.46:0/2787925880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5270003970 msgr2=0x7f5270003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.249+0000 7f528d800640 1 --2- 172.21.15.46:0/2787925880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5270003970 0x7f5270003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.249+0000 7f528d800640 1 -- 172.21.15.46:0/2787925880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5270003520 con 0x7f5270004d00 2024-02-19T17:14:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.249+0000 7f5287e00640 1 --2- 172.21.15.46:0/2787925880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52880cc840 0x7f52700047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:25.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.250+0000 7f528d800640 1 --2- 172.21.15.46:0/2787925880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5270004d00 0x7f5270005180 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f5280009fc0 tx=0x7f52700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3283bd1503d71e2f server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:25.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.250+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528002cc30 con 0x7f5270004d00 2024-02-19T17:14:25.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.250+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528000f040 con 0x7f5270004d00 2024-02-19T17:14:25.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.250+0000 7f5287400640 1 -- 172.21.15.46:0/2787925880 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280034440 con 0x7f5270004d00 2024-02-19T17:14:25.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.251+0000 7f528e200640 1 -- 172.21.15.46:0/2787925880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5270004d00 msgr2=0x7f5270005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:25.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.251+0000 7f528e200640 1 --2- 172.21.15.46:0/2787925880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5270004d00 0x7f5270005180 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f5280009fc0 tx=0x7f52700057f0 comp rx=0 tx=0).stop 2024-02-19T17:14:25.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.251+0000 7f528d800640 1 -- 172.21.15.46:0/2787925880 reap_dead start 2024-02-19T17:14:25.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.251+0000 7f528e200640 1 -- 172.21.15.46:0/2787925880 shutdown_connections 2024-02-19T17:14:25.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.251+0000 7f528e200640 1 -- 172.21.15.46:0/2787925880 >> 172.21.15.46:0/2787925880 conn(0x7f528806ad60 msgr2=0x7f528806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:25.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.251+0000 7f528e200640 1 -- 172.21.15.46:0/2787925880 shutdown_connections 2024-02-19T17:14:25.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.251+0000 7f528e200640 1 -- 172.21.15.46:0/2787925880 wait complete. 2024-02-19T17:14:25.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.253+0000 7f528e200640 1 Processor -- start 2024-02-19T17:14:25.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.253+0000 7f528e200640 1 -- start start 2024-02-19T17:14:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.254+0000 7f528e200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5270004d00 0x7f52881f7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.254+0000 7f528e200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52880cceb0 0x7f5288159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.254+0000 7f528e200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52880c63b0 0x7f52880ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.254+0000 7f528e200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5288159740 con 0x7f52880c63b0 2024-02-19T17:14:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.254+0000 7f528e200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52880cdfc0 con 0x7f52880cceb0 2024-02-19T17:14:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.254+0000 7f528e200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52880cd3b0 con 0x7f5270004d00 2024-02-19T17:14:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.254+0000 7f528d800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52880c63b0 0x7f52880ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.254+0000 7f528d800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52880c63b0 0x7f52880ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48274/0 (socket says 172.21.15.46:48274) 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.254+0000 7f528d800640 1 -- 172.21.15.46:0/3176540012 learned_addr learned my addr 172.21.15.46:0/3176540012 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.254+0000 7f5287e00640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52880cceb0 0x7f5288159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.254+0000 7f528ce00640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5270004d00 0x7f52881f7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.254+0000 7f528d800640 1 -- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5270004d00 msgr2=0x7f52881f7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.255+0000 7f528d800640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5270004d00 0x7f52881f7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.255+0000 7f528d800640 1 -- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52880cceb0 msgr2=0x7f5288159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.255+0000 7f528d800640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52880cceb0 0x7f5288159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.255+0000 7f528d800640 1 -- 172.21.15.46:0/3176540012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52880cd690 con 0x7f52880c63b0 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.255+0000 7f5287e00640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52880cceb0 0x7f5288159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.255+0000 7f528ce00640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5270004d00 0x7f52881f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.255+0000 7f528d800640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52880c63b0 0x7f52880ad1a0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f5280037040 tx=0x7f5280009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.255+0000 7f5284c00640 1 -- 172.21.15.46:0/3176540012 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280043070 con 0x7f52880c63b0 2024-02-19T17:14:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.255+0000 7f5284c00640 1 -- 172.21.15.46:0/3176540012 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5280034b50 con 0x7f52880c63b0 2024-02-19T17:14:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.255+0000 7f5284c00640 1 -- 172.21.15.46:0/3176540012 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528002dea0 con 0x7f52880c63b0 2024-02-19T17:14:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.255+0000 7f528e200640 1 -- 172.21.15.46:0/3176540012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52880cd970 con 0x7f52880c63b0 2024-02-19T17:14:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.255+0000 7f528e200640 1 -- 172.21.15.46:0/3176540012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52881e58d0 con 0x7f52880c63b0 2024-02-19T17:14:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.256+0000 7f528e200640 1 -- 172.21.15.46:0/3176540012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528804eee0 con 0x7f52880c63b0 2024-02-19T17:14:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.257+0000 7f5284c00640 1 -- 172.21.15.46:0/3176540012 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f528003e440 con 0x7f52880c63b0 2024-02-19T17:14:25.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.258+0000 7f5284c00640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f526c06b840 0x7f526c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:25.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.258+0000 7f5284c00640 1 -- 172.21.15.46:0/3176540012 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f52800abe40 con 0x7f52880c63b0 2024-02-19T17:14:25.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.259+0000 7f528ce00640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f526c06b840 0x7f526c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:25.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.260+0000 7f528ce00640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f526c06b840 0x7f526c06dd00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f527c007970 tx=0x7f527c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:25.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.263+0000 7f5284c00640 1 -- 172.21.15.46:0/3176540012 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52800767f0 con 0x7f52880c63b0 2024-02-19T17:14:25.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:25.454+0000 7f528e200640 1 -- 172.21.15.46:0/3176540012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f52881598e0 con 0x7f52880c63b0 2024-02-19T17:14:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.001+0000 7f5284c00640 1 -- 172.21.15.46:0/3176540012 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5280039020 con 0x7f52880c63b0 2024-02-19T17:14:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2024-02-19T17:14:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.004+0000 7f528e200640 1 -- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f526c06b840 msgr2=0x7f526c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.004+0000 7f528e200640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f526c06b840 0x7f526c06dd00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f527c007970 tx=0x7f527c009040 comp rx=0 tx=0).stop 2024-02-19T17:14:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.005+0000 7f528e200640 1 -- 172.21.15.46:0/3176540012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52880c63b0 msgr2=0x7f52880ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.005+0000 7f528e200640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52880c63b0 0x7f52880ad1a0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f5280037040 tx=0x7f5280009750 comp rx=0 tx=0).stop 2024-02-19T17:14:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.005+0000 7f528e200640 1 -- 172.21.15.46:0/3176540012 shutdown_connections 2024-02-19T17:14:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.005+0000 7f528e200640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f526c06b840 0x7f526c06dd00 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.005+0000 7f528e200640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52880c63b0 0x7f52880ad1a0 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.005+0000 7f528e200640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52880cceb0 0x7f5288159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.005+0000 7f528e200640 1 --2- 172.21.15.46:0/3176540012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5270004d00 0x7f52881f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.005+0000 7f528e200640 1 -- 172.21.15.46:0/3176540012 >> 172.21.15.46:0/3176540012 conn(0x7f528806ad60 msgr2=0x7f5288071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.005+0000 7f528e200640 1 -- 172.21.15.46:0/3176540012 shutdown_connections 2024-02-19T17:14:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.005+0000 7f528e200640 1 -- 172.21.15.46:0/3176540012 wait complete. 2024-02-19T17:14:26.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-19T17:14:26.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.335+0000 7f792a600640 1 Processor -- start 2024-02-19T17:14:26.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.336+0000 7f792a600640 1 -- start start 2024-02-19T17:14:26.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.337+0000 7f792a600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f792415efd0 0x7f79240c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:26.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.337+0000 7f792a600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7924099a30 0x7f7924099e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:26.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.337+0000 7f792a600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79240cc200 con 0x7f79240b2640 2024-02-19T17:14:26.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.337+0000 7f792a600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792409a3a0 con 0x7f792415efd0 2024-02-19T17:14:26.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.337+0000 7f792a600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79240cfdc0 con 0x7f7924099a30 2024-02-19T17:14:26.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.338+0000 7f7923e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7924099a30 0x7f7924099e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:26.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.338+0000 7f7922a00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f79240b2640 0x7f792409a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:57298/0 (socket says 172.21.15.46:57298) 2024-02-19T17:14:26.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.338+0000 7f7922a00640 1 -- 172.21.15.46:0/1713126511 learned_addr learned my addr 172.21.15.46:0/1713126511 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:26.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.338+0000 7f7923400640 1 --2- 172.21.15.46:0/1713126511 >> v2:172.21.15.46:3300/0 conn(0x7f792415efd0 0x7f79240c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:26.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.338+0000 7f7923e00640 1 -- 172.21.15.46:0/1713126511 >> v2:172.21.15.46:3300/0 conn(0x7f792415efd0 msgr2=0x7f79240c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:26.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.338+0000 7f7922000640 1 -- 172.21.15.46:0/1713126511 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802690588 0 0) 0x7f79240cc200 con 0x7f79240b2640 2024-02-19T17:14:26.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.338+0000 7f7923e00640 1 --2- 172.21.15.46:0/1713126511 >> v2:172.21.15.46:3300/0 conn(0x7f792415efd0 0x7f79240c51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:26.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.339+0000 7f7923e00640 1 -- 172.21.15.46:0/1713126511 >> v1:172.21.15.142:6789/0 conn(0x7f79240b2640 legacy=0x7f792409a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:26.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.339+0000 7f7923e00640 1 -- 172.21.15.46:0/1713126511 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79240d00a0 con 0x7f7924099a30 2024-02-19T17:14:26.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.339+0000 7f7923400640 1 --2- 172.21.15.46:0/1713126511 >> v2:172.21.15.46:3300/0 conn(0x7f792415efd0 0x7f79240c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T17:14:26.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.340+0000 7f7923e00640 1 --2- 172.21.15.46:0/1713126511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7924099a30 0x7f7924099e60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f791c009d90 tx=0x7f791c02be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93f05762c0334ee9 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:26.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.341+0000 7f7922000640 1 -- 172.21.15.46:0/1713126511 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c02cbd0 con 0x7f7924099a30 2024-02-19T17:14:26.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.341+0000 7f7922000640 1 -- 172.21.15.46:0/1713126511 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c02cd30 con 0x7f7924099a30 2024-02-19T17:14:26.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.341+0000 7f7922000640 1 -- 172.21.15.46:0/1713126511 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c02cea0 con 0x7f7924099a30 2024-02-19T17:14:26.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.342+0000 7f792a600640 1 -- 172.21.15.46:0/1713126511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7924099a30 msgr2=0x7f7924099e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:26.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.342+0000 7f792a600640 1 --2- 172.21.15.46:0/1713126511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7924099a30 0x7f7924099e60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f791c009d90 tx=0x7f791c02be20 comp rx=0 tx=0).stop 2024-02-19T17:14:26.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.342+0000 7f792a600640 1 -- 172.21.15.46:0/1713126511 shutdown_connections 2024-02-19T17:14:26.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.342+0000 7f792a600640 1 --2- 172.21.15.46:0/1713126511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7924099a30 0x7f7924099e60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:26.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.342+0000 7f792a600640 1 --2- 172.21.15.46:0/1713126511 >> v2:172.21.15.46:3300/0 conn(0x7f792415efd0 0x7f79240c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:26.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.342+0000 7f792a600640 1 -- 172.21.15.46:0/1713126511 >> 172.21.15.46:0/1713126511 conn(0x7f79240b3150 msgr2=0x7f79240b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:26.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.343+0000 7f792a600640 1 -- 172.21.15.46:0/1713126511 shutdown_connections 2024-02-19T17:14:26.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.343+0000 7f792a600640 1 -- 172.21.15.46:0/1713126511 wait complete. 2024-02-19T17:14:26.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.345+0000 7f792a600640 1 Processor -- start 2024-02-19T17:14:26.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.346+0000 7f792a600640 1 -- start start 2024-02-19T17:14:26.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.348+0000 7f792a600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7924099a30 0x7f79240b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:26.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.348+0000 7f792a600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79240b2640 0x7f7924155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:26.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.348+0000 7f792a600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f792415efd0 0x7f792415c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:26.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.348+0000 7f792a600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792415dfa0 con 0x7f79240b2640 2024-02-19T17:14:26.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.348+0000 7f792a600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7924157070 con 0x7f792415efd0 2024-02-19T17:14:26.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.348+0000 7f792a600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792415d670 con 0x7f7924099a30 2024-02-19T17:14:26.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.348+0000 7f7923400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7924099a30 0x7f79240b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:26.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.348+0000 7f7923400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7924099a30 0x7f79240b4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:38568/0 (socket says 172.21.15.46:38568) 2024-02-19T17:14:26.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.348+0000 7f7923400640 1 -- 172.21.15.46:0/2133202014 learned_addr learned my addr 172.21.15.46:0/2133202014 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:26.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.349+0000 7f7923e00640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f792415efd0 0x7f792415c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:26.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.349+0000 7f7922a00640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79240b2640 0x7f7924155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:26.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.350+0000 7f7922a00640 1 -- 172.21.15.46:0/2133202014 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7924099a30 msgr2=0x7f79240b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:26.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.350+0000 7f7922a00640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7924099a30 0x7f79240b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:26.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.350+0000 7f7922a00640 1 -- 172.21.15.46:0/2133202014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f792415efd0 msgr2=0x7f792415c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:26.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.350+0000 7f7922a00640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f792415efd0 0x7f792415c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:26.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.350+0000 7f7922a00640 1 -- 172.21.15.46:0/2133202014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c009a70 con 0x7f79240b2640 2024-02-19T17:14:26.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.351+0000 7f7922a00640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79240b2640 0x7f7924155010 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f791000c410 tx=0x7f791000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:26.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.351+0000 7f791b400640 1 -- 172.21.15.46:0/2133202014 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100074e0 con 0x7f79240b2640 2024-02-19T17:14:26.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.351+0000 7f791b400640 1 -- 172.21.15.46:0/2133202014 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7910007640 con 0x7f79240b2640 2024-02-19T17:14:26.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.351+0000 7f791b400640 1 -- 172.21.15.46:0/2133202014 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910004a20 con 0x7f79240b2640 2024-02-19T17:14:26.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.351+0000 7f792a600640 1 -- 172.21.15.46:0/2133202014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792415d950 con 0x7f79240b2640 2024-02-19T17:14:26.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.351+0000 7f792a600640 1 -- 172.21.15.46:0/2133202014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7924155550 con 0x7f79240b2640 2024-02-19T17:14:26.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.353+0000 7f792a600640 1 -- 172.21.15.46:0/2133202014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7924067ba0 con 0x7f79240b2640 2024-02-19T17:14:26.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.354+0000 7f791b400640 1 -- 172.21.15.46:0/2133202014 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7910004b80 con 0x7f79240b2640 2024-02-19T17:14:26.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.356+0000 7f791b400640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f790406b860 0x7f790406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:26.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.356+0000 7f791b400640 1 -- 172.21.15.46:0/2133202014 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f7910089cf0 con 0x7f79240b2640 2024-02-19T17:14:26.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.357+0000 7f7923400640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f790406b860 0x7f790406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:26.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.358+0000 7f7923400640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f790406b860 0x7f790406dd20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f79240c4d80 tx=0x7f7914008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:26.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.363+0000 7f791b400640 1 -- 172.21.15.46:0/2133202014 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f79100549a0 con 0x7f79240b2640 2024-02-19T17:14:26.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:26.657+0000 7f792a600640 1 -- 172.21.15.46:0/2133202014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f79240c55b0 con 0x7f79240b2640 2024-02-19T17:14:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.013+0000 7f791b400640 1 -- 172.21.15.46:0/2133202014 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7910058060 con 0x7f79240b2640 2024-02-19T17:14:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2024-02-19T17:14:27.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.017+0000 7f792a600640 1 -- 172.21.15.46:0/2133202014 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f790406b860 msgr2=0x7f790406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:27.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.017+0000 7f792a600640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f790406b860 0x7f790406dd20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f79240c4d80 tx=0x7f7914008040 comp rx=0 tx=0).stop 2024-02-19T17:14:27.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.017+0000 7f792a600640 1 -- 172.21.15.46:0/2133202014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79240b2640 msgr2=0x7f7924155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:27.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.017+0000 7f792a600640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79240b2640 0x7f7924155010 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f791000c410 tx=0x7f791000c8d0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.018+0000 7f792a600640 1 -- 172.21.15.46:0/2133202014 shutdown_connections 2024-02-19T17:14:27.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.018+0000 7f792a600640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f790406b860 0x7f790406dd20 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.018+0000 7f792a600640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f792415efd0 0x7f792415c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.018+0000 7f792a600640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79240b2640 0x7f7924155010 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.018+0000 7f792a600640 1 --2- 172.21.15.46:0/2133202014 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7924099a30 0x7f79240b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.018+0000 7f792a600640 1 -- 172.21.15.46:0/2133202014 >> 172.21.15.46:0/2133202014 conn(0x7f79240b3150 msgr2=0x7f79240cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:27.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.018+0000 7f792a600640 1 -- 172.21.15.46:0/2133202014 shutdown_connections 2024-02-19T17:14:27.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.018+0000 7f792a600640 1 -- 172.21.15.46:0/2133202014 wait complete. 2024-02-19T17:14:27.035 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-02-19T17:14:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.344+0000 7fddc3200640 1 Processor -- start 2024-02-19T17:14:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.344+0000 7fddc3200640 1 -- start start 2024-02-19T17:14:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.346+0000 7fddc3200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fddbc0b1a70 0x7fddbc159990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.346+0000 7fddc3200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fddbc0b25f0 0x7fddbc0b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.346+0000 7fddc3200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddbc15aa80 con 0x7fddbc072250 2024-02-19T17:14:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.347+0000 7fddc3200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddbc160580 con 0x7fddbc0b1a70 2024-02-19T17:14:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.347+0000 7fddc3200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddbc0b0680 con 0x7fddbc0b25f0 2024-02-19T17:14:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.347+0000 7fddc1e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fddbc0b1a70 0x7fddbc159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.347+0000 7fddc1400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fddbc0b25f0 0x7fddbc0b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.347+0000 7fddc1400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fddbc0b25f0 0x7fddbc0b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:39342/0 (socket says 172.21.15.46:39342) 2024-02-19T17:14:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.347+0000 7fddc1400640 1 -- 172.21.15.46:0/2583352852 learned_addr learned my addr 172.21.15.46:0/2583352852 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.348+0000 7fddc1e00640 1 -- 172.21.15.46:0/2583352852 >> v2:172.21.15.142:3300/0 conn(0x7fddbc0b25f0 msgr2=0x7fddbc0b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.348+0000 7fddc1e00640 1 --2- 172.21.15.46:0/2583352852 >> v2:172.21.15.142:3300/0 conn(0x7fddbc0b25f0 0x7fddbc0b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.348+0000 7fddc1e00640 1 -- 172.21.15.46:0/2583352852 >> v1:172.21.15.142:6789/0 conn(0x7fddbc072250 legacy=0x7fddbc072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.348+0000 7fddc1e00640 1 -- 172.21.15.46:0/2583352852 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc0b0960 con 0x7fddbc0b1a70 2024-02-19T17:14:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.350+0000 7fddc1e00640 1 --2- 172.21.15.46:0/2583352852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddbc0b1a70 0x7fddbc159990 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fddbc09d580 tx=0x7fddb802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8453cd9da2735b4e server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.351+0000 7fddc0a00640 1 -- 172.21.15.46:0/2583352852 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb802cc00 con 0x7fddbc0b1a70 2024-02-19T17:14:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.351+0000 7fddc0a00640 1 -- 172.21.15.46:0/2583352852 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb802cd60 con 0x7fddbc0b1a70 2024-02-19T17:14:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.351+0000 7fddc0a00640 1 -- 172.21.15.46:0/2583352852 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb802cc00 con 0x7fddbc0b1a70 2024-02-19T17:14:27.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.352+0000 7fddc3200640 1 -- 172.21.15.46:0/2583352852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddbc0b1a70 msgr2=0x7fddbc159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:27.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.352+0000 7fddc3200640 1 --2- 172.21.15.46:0/2583352852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddbc0b1a70 0x7fddbc159990 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fddbc09d580 tx=0x7fddb802be50 comp rx=0 tx=0).stop 2024-02-19T17:14:27.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.353+0000 7fddc3200640 1 -- 172.21.15.46:0/2583352852 shutdown_connections 2024-02-19T17:14:27.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.353+0000 7fddc3200640 1 --2- 172.21.15.46:0/2583352852 >> v2:172.21.15.142:3300/0 conn(0x7fddbc0b25f0 0x7fddbc0b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.353+0000 7fddc3200640 1 --2- 172.21.15.46:0/2583352852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddbc0b1a70 0x7fddbc159990 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.353+0000 7fddc3200640 1 -- 172.21.15.46:0/2583352852 >> 172.21.15.46:0/2583352852 conn(0x7fddbc0b0f50 msgr2=0x7fddbc0b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:27.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.357+0000 7fddc3200640 1 -- 172.21.15.46:0/2583352852 shutdown_connections 2024-02-19T17:14:27.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.357+0000 7fddc3200640 1 -- 172.21.15.46:0/2583352852 wait complete. 2024-02-19T17:14:27.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.360+0000 7fddc3200640 1 Processor -- start 2024-02-19T17:14:27.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.360+0000 7fddc3200640 1 -- start start 2024-02-19T17:14:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.361+0000 7fddc3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddbc072250 0x7fddbc0ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:27.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.361+0000 7fddc3200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddbc0b1a70 0x7fddbc0af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.362+0000 7fddc3200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddbc0b25f0 0x7fddbc15d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.362+0000 7fddc3200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc0ce7f0 con 0x7fddbc0b1a70 2024-02-19T17:14:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.362+0000 7fddc3200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc0cf8e0 con 0x7fddbc072250 2024-02-19T17:14:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.362+0000 7fddc3200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc0aee30 con 0x7fddbc0b25f0 2024-02-19T17:14:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.362+0000 7fddc1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddbc072250 0x7fddbc0ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:27.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.362+0000 7fddc2800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddbc0b25f0 0x7fddbc15d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:27.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.362+0000 7fddc2800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddbc0b25f0 0x7fddbc15d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:38578/0 (socket says 172.21.15.46:38578) 2024-02-19T17:14:27.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.362+0000 7fddc2800640 1 -- 172.21.15.46:0/1074694185 learned_addr learned my addr 172.21.15.46:0/1074694185 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.362+0000 7fddc1400640 1 --2- 172.21.15.46:0/1074694185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddbc0b1a70 0x7fddbc0af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.363+0000 7fddc1400640 1 -- 172.21.15.46:0/1074694185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddbc0b25f0 msgr2=0x7fddbc15d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.363+0000 7fddc1400640 1 --2- 172.21.15.46:0/1074694185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddbc0b25f0 0x7fddbc15d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.363+0000 7fddc1400640 1 -- 172.21.15.46:0/1074694185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddbc072250 msgr2=0x7fddbc0ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.363+0000 7fddc1400640 1 --2- 172.21.15.46:0/1074694185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddbc072250 0x7fddbc0ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.363+0000 7fddc1400640 1 -- 172.21.15.46:0/1074694185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb8009a70 con 0x7fddbc0b1a70 2024-02-19T17:14:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.364+0000 7fddc1400640 1 --2- 172.21.15.46:0/1074694185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddbc0b1a70 0x7fddbc0af5f0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fddb000e9b0 tx=0x7fddb000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.364+0000 7fddb6000640 1 -- 172.21.15.46:0/1074694185 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000c790 con 0x7fddbc0b1a70 2024-02-19T17:14:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.364+0000 7fddb6000640 1 -- 172.21.15.46:0/1074694185 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb000c8f0 con 0x7fddbc0b1a70 2024-02-19T17:14:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.364+0000 7fddb6000640 1 -- 172.21.15.46:0/1074694185 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000cc60 con 0x7fddbc0b1a70 2024-02-19T17:14:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.365+0000 7fddc3200640 1 -- 172.21.15.46:0/1074694185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddbc0aeac0 con 0x7fddbc0b1a70 2024-02-19T17:14:27.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.365+0000 7fddc3200640 1 -- 172.21.15.46:0/1074694185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddbc0af0d0 con 0x7fddbc0b1a70 2024-02-19T17:14:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.368+0000 7fddb6000640 1 -- 172.21.15.46:0/1074694185 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fddb0013470 con 0x7fddbc0b1a70 2024-02-19T17:14:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.368+0000 7fddc3200640 1 -- 172.21.15.46:0/1074694185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddbc0aec80 con 0x7fddbc0b1a70 2024-02-19T17:14:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.370+0000 7fddb6000640 1 --2- 172.21.15.46:0/1074694185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdda007c820 0x7fdda007ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.370+0000 7fddb6000640 1 -- 172.21.15.46:0/1074694185 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fddb0089f80 con 0x7fddbc0b1a70 2024-02-19T17:14:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.371+0000 7fddc1e00640 1 --2- 172.21.15.46:0/1074694185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdda007c820 0x7fdda007ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.372+0000 7fddc1e00640 1 --2- 172.21.15.46:0/1074694185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdda007c820 0x7fdda007ece0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fddb8036000 tx=0x7fddb8030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:27.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.380+0000 7fddb6000640 1 -- 172.21.15.46:0/1074694185 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fddb00bd8c0 con 0x7fddbc0b1a70 2024-02-19T17:14:27.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.775+0000 7fddc3200640 1 -- 172.21.15.46:0/1074694185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fddbc04ef50 con 0x7fddbc0b1a70 2024-02-19T17:14:27.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.796+0000 7fddb6000640 1 -- 172.21.15.46:0/1074694185 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fddb0054d50 con 0x7fddbc0b1a70 2024-02-19T17:14:27.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.803+0000 7fddc3200640 1 -- 172.21.15.46:0/1074694185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdda007c820 msgr2=0x7fdda007ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:27.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.803+0000 7fddc3200640 1 --2- 172.21.15.46:0/1074694185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdda007c820 0x7fdda007ece0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fddb8036000 tx=0x7fddb8030000 comp rx=0 tx=0).stop 2024-02-19T17:14:27.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.803+0000 7fddc3200640 1 -- 172.21.15.46:0/1074694185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddbc0b1a70 msgr2=0x7fddbc0af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:27.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.803+0000 7fddc3200640 1 --2- 172.21.15.46:0/1074694185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddbc0b1a70 0x7fddbc0af5f0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fddb000e9b0 tx=0x7fddb000ee70 comp rx=0 tx=0).stop 2024-02-19T17:14:27.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.803+0000 7fddc3200640 1 -- 172.21.15.46:0/1074694185 shutdown_connections 2024-02-19T17:14:27.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.803+0000 7fddc3200640 1 --2- 172.21.15.46:0/1074694185 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fdda007c820 0x7fdda007ece0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.803+0000 7fddc3200640 1 --2- 172.21.15.46:0/1074694185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddbc0b25f0 0x7fddbc15d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.803+0000 7fddc3200640 1 --2- 172.21.15.46:0/1074694185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddbc0b1a70 0x7fddbc0af5f0 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.803+0000 7fddc3200640 1 --2- 172.21.15.46:0/1074694185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddbc072250 0x7fddbc0ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:27.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.803+0000 7fddc3200640 1 -- 172.21.15.46:0/1074694185 >> 172.21.15.46:0/1074694185 conn(0x7fddbc0b0f50 msgr2=0x7fddbc15e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:27.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.803+0000 7fddc3200640 1 -- 172.21.15.46:0/1074694185 shutdown_connections 2024-02-19T17:14:27.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:27.804+0000 7fddc3200640 1 -- 172.21.15.46:0/1074694185 wait complete. 2024-02-19T17:14:27.819 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-02-19T17:14:28.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.121+0000 7fe714800640 1 Processor -- start 2024-02-19T17:14:28.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.121+0000 7fe714800640 1 -- start start 2024-02-19T17:14:28.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.124+0000 7fe714800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe70c071710 0x7fe70c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:28.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.124+0000 7fe714800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c06e180 con 0x7fe70c06da10 2024-02-19T17:14:28.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.124+0000 7fe712800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe70c06da10 0x7fe70c0b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59516/0 (socket says 172.21.15.46:59516) 2024-02-19T17:14:28.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.125+0000 7fe712800640 1 -- 172.21.15.46:0/3725084718 learned_addr learned my addr 172.21.15.46:0/3725084718 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:28.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.125+0000 7fe714800640 1 -- 172.21.15.46:0/3725084718 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c06e460 con 0x7fe70c1541c0 2024-02-19T17:14:28.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.125+0000 7fe714800640 1 -- 172.21.15.46:0/3725084718 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c06e740 con 0x7fe70c071710 2024-02-19T17:14:28.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.126+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017496368 0 0) 0x7fe70c06e180 con 0x7fe70c06da10 2024-02-19T17:14:28.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.126+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f4003520 con 0x7fe70c06da10 2024-02-19T17:14:28.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.126+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107401746 0 0) 0x7fe70c06e460 con 0x7fe70c1541c0 2024-02-19T17:14:28.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.127+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe70c06e180 con 0x7fe70c1541c0 2024-02-19T17:14:28.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.127+0000 7fe711400640 1 --2- 172.21.15.46:0/3725084718 >> v2:172.21.15.142:3300/0 conn(0x7fe70c071710 0x7fe70c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:28.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.127+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1205434147 0 0) 0x7fe6f4003520 con 0x7fe70c06da10 2024-02-19T17:14:28.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.127+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 >> v2:172.21.15.142:3300/0 conn(0x7fe70c071710 msgr2=0x7fe70c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:28.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.127+0000 7fe710a00640 1 --2- 172.21.15.46:0/3725084718 >> v2:172.21.15.142:3300/0 conn(0x7fe70c071710 0x7fe70c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:28.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.127+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 >> v1:172.21.15.142:6789/0 conn(0x7fe70c1541c0 legacy=0x7fe70c071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:28.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.127+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c0b2810 con 0x7fe70c06da10 2024-02-19T17:14:28.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.128+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fe6fc004f40 con 0x7fe70c06da10 2024-02-19T17:14:28.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.128+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 >> v1:172.21.15.46:6789/0 conn(0x7fe70c06da10 legacy=0x7fe70c0b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:28.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.128+0000 7fe710a00640 1 --2- 172.21.15.46:0/3725084718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f4004c00 0x7fe6f4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:28.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.128+0000 7fe710a00640 1 --2- 172.21.15.46:0/3725084718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6f4003760 0x7fe6f4003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:28.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.128+0000 7fe710a00640 1 --2- 172.21.15.46:0/3725084718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6f4004190 0x7fe6f400dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:28.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.128+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c06e740 con 0x7fe6f4004c00 2024-02-19T17:14:28.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.128+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f400e3e0 con 0x7fe6f4003760 2024-02-19T17:14:28.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.128+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f400e5a0 con 0x7fe6f4004190 2024-02-19T17:14:28.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.129+0000 7fe711e00640 1 --2- 172.21.15.46:0/3725084718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f4004c00 0x7fe6f4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:28.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.129+0000 7fe712800640 1 --2- 172.21.15.46:0/3725084718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6f4004190 0x7fe6f400dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:28.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.130+0000 7fe711e00640 1 -- 172.21.15.46:0/3725084718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6f4004190 msgr2=0x7fe6f400dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.130+0000 7fe711e00640 1 --2- 172.21.15.46:0/3725084718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6f4004190 0x7fe6f400dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.130+0000 7fe711e00640 1 -- 172.21.15.46:0/3725084718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6f4003760 msgr2=0x7fe6f4003be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-19T17:14:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.130+0000 7fe711e00640 1 --2- 172.21.15.46:0/3725084718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6f4003760 0x7fe6f4003be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.130+0000 7fe711e00640 1 -- 172.21.15.46:0/3725084718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f4003520 con 0x7fe6f4004c00 2024-02-19T17:14:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.130+0000 7fe712800640 1 -- 172.21.15.46:0/3725084718 reap_dead start 2024-02-19T17:14:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.132+0000 7fe711e00640 1 --2- 172.21.15.46:0/3725084718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f4004c00 0x7fe6f4005000 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fe708001f50 tx=0x7fe6f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ea0f9f31a82e3f server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.133+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708003b70 con 0x7fe6f4004c00 2024-02-19T17:14:28.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.133+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe708003cd0 con 0x7fe6f4004c00 2024-02-19T17:14:28.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.134+0000 7fe710a00640 1 -- 172.21.15.46:0/3725084718 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7080052f0 con 0x7fe6f4004c00 2024-02-19T17:14:28.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.135+0000 7fe714800640 1 -- 172.21.15.46:0/3725084718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f4004c00 msgr2=0x7fe6f4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:28.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.135+0000 7fe714800640 1 --2- 172.21.15.46:0/3725084718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f4004c00 0x7fe6f4005000 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fe708001f50 tx=0x7fe6f40057f0 comp rx=0 tx=0).stop 2024-02-19T17:14:28.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.136+0000 7fe714800640 1 -- 172.21.15.46:0/3725084718 shutdown_connections 2024-02-19T17:14:28.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.136+0000 7fe714800640 1 --2- 172.21.15.46:0/3725084718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6f4004c00 0x7fe6f4005000 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:28.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.136+0000 7fe714800640 1 -- 172.21.15.46:0/3725084718 >> 172.21.15.46:0/3725084718 conn(0x7fe70c066cd0 msgr2=0x7fe70c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:28.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.137+0000 7fe714800640 1 -- 172.21.15.46:0/3725084718 shutdown_connections 2024-02-19T17:14:28.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.137+0000 7fe714800640 1 -- 172.21.15.46:0/3725084718 wait complete. 2024-02-19T17:14:28.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.140+0000 7fe714800640 1 Processor -- start 2024-02-19T17:14:28.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.143+0000 7fe714800640 1 -- start start 2024-02-19T17:14:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.146+0000 7fe714800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6f4004c00 0x7fe70c202ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.146+0000 7fe714800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe70c15c8e0 0x7fe70c15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.146+0000 7fe714800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe70c0a8570 0x7fe70c0a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.146+0000 7fe711400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe70c15c8e0 0x7fe70c15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.146+0000 7fe711400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe70c15c8e0 0x7fe70c15cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:39366/0 (socket says 172.21.15.46:39366) 2024-02-19T17:14:28.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.147+0000 7fe711e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6f4004c00 0x7fe70c202ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.147+0000 7fe711e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6f4004c00 0x7fe70c202ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:38600/0 (socket says 172.21.15.46:38600) 2024-02-19T17:14:28.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.148+0000 7fe712800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe70c0a8570 0x7fe70c0a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.149+0000 7fe712800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe70c0a8570 0x7fe70c0a89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43820/0 (socket says 172.21.15.46:43820) 2024-02-19T17:14:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.149+0000 7fe711400640 1 -- 172.21.15.46:0/874598150 learned_addr learned my addr 172.21.15.46:0/874598150 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.149+0000 7fe714800640 1 -- 172.21.15.46:0/874598150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c15d2a0 con 0x7fe70c0a8570 2024-02-19T17:14:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.149+0000 7fe714800640 1 -- 172.21.15.46:0/874598150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0a8f30 con 0x7fe70c15c8e0 2024-02-19T17:14:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.149+0000 7fe714800640 1 -- 172.21.15.46:0/874598150 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c203020 con 0x7fe6f4004c00 2024-02-19T17:14:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.150+0000 7fe711e00640 1 -- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe70c15c8e0 msgr2=0x7fe70c15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.151+0000 7fe711e00640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe70c15c8e0 0x7fe70c15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.151+0000 7fe711e00640 1 -- 172.21.15.46:0/874598150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe70c0a8570 msgr2=0x7fe70c0a89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.151+0000 7fe711e00640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe70c0a8570 0x7fe70c0a89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.151+0000 7fe711e00640 1 -- 172.21.15.46:0/874598150 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c1fffb0 con 0x7fe6f4004c00 2024-02-19T17:14:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.151+0000 7fe712800640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe70c0a8570 0x7fe70c0a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T17:14:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.151+0000 7fe711400640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe70c15c8e0 0x7fe70c15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T17:14:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.151+0000 7fe711e00640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6f4004c00 0x7fe70c202ae0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe708004000 tx=0x7fe70802e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.152+0000 7fe706000640 1 -- 172.21.15.46:0/874598150 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70803c040 con 0x7fe6f4004c00 2024-02-19T17:14:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.152+0000 7fe706000640 1 -- 172.21.15.46:0/874598150 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7080054e0 con 0x7fe6f4004c00 2024-02-19T17:14:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.152+0000 7fe706000640 1 -- 172.21.15.46:0/874598150 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708005870 con 0x7fe6f4004c00 2024-02-19T17:14:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.152+0000 7fe714800640 1 -- 172.21.15.46:0/874598150 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c200290 con 0x7fe6f4004c00 2024-02-19T17:14:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.152+0000 7fe714800640 1 -- 172.21.15.46:0/874598150 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c200850 con 0x7fe6f4004c00 2024-02-19T17:14:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.154+0000 7fe714800640 1 -- 172.21.15.46:0/874598150 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c067ba0 con 0x7fe6f4004c00 2024-02-19T17:14:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.157+0000 7fe706000640 1 -- 172.21.15.46:0/874598150 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe70802d500 con 0x7fe6f4004c00 2024-02-19T17:14:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.158+0000 7fe706000640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe6f006b8e0 0x7fe6f006dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.158+0000 7fe706000640 1 -- 172.21.15.46:0/874598150 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe708031070 con 0x7fe6f4004c00 2024-02-19T17:14:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.160+0000 7fe711400640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe6f006b8e0 0x7fe6f006dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:28.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.164+0000 7fe711400640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe6f006b8e0 0x7fe6f006dda0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe70c15d4a0 tx=0x7fe700008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:28.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.166+0000 7fe706000640 1 -- 172.21.15.46:0/874598150 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe708076410 con 0x7fe6f4004c00 2024-02-19T17:14:28.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:28.688+0000 7fe714800640 1 -- 172.21.15.46:0/874598150 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fe70c06d530 con 0x7fe6f4004c00 2024-02-19T17:14:29.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:29.037+0000 7fe706000640 1 -- 172.21.15.46:0/874598150 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v18588) v1 ==== 144+0+0 (secure 0 0 0) 0x7fe708079ad0 con 0x7fe6f4004c00 2024-02-19T17:14:29.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:29.042+0000 7fe714800640 1 -- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe6f006b8e0 msgr2=0x7fe6f006dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:29.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:29.042+0000 7fe714800640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe6f006b8e0 0x7fe6f006dda0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe70c15d4a0 tx=0x7fe700008040 comp rx=0 tx=0).stop 2024-02-19T17:14:29.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:29.042+0000 7fe714800640 1 -- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6f4004c00 msgr2=0x7fe70c202ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:29.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:29.042+0000 7fe714800640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6f4004c00 0x7fe70c202ae0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe708004000 tx=0x7fe70802e000 comp rx=0 tx=0).stop 2024-02-19T17:14:29.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:29.043+0000 7fe714800640 1 -- 172.21.15.46:0/874598150 shutdown_connections 2024-02-19T17:14:29.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:29.043+0000 7fe714800640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fe6f006b8e0 0x7fe6f006dda0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:29.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:29.043+0000 7fe714800640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe70c0a8570 0x7fe70c0a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:29.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:29.043+0000 7fe714800640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe70c15c8e0 0x7fe70c15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:29.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:29.043+0000 7fe714800640 1 --2- 172.21.15.46:0/874598150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6f4004c00 0x7fe70c202ae0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:29.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:29.043+0000 7fe714800640 1 -- 172.21.15.46:0/874598150 >> 172.21.15.46:0/874598150 conn(0x7fe70c066cd0 msgr2=0x7fe70c0b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:29.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:29.046+0000 7fe714800640 1 -- 172.21.15.46:0/874598150 shutdown_connections 2024-02-19T17:14:29.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:29.046+0000 7fe714800640 1 -- 172.21.15.46:0/874598150 wait complete. 2024-02-19T17:14:29.069 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2024-02-19T17:14:29.069 INFO:tasks.cephfs_test_runner: 2024-02-19T17:14:29.069 INFO:tasks.cephfs_test_runner:====================================================================== 2024-02-19T17:14:29.069 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-19T17:14:29.069 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_25296a8f176256aea5ed8b5850b25167dce0ae33/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_25296a8f176256aea5ed8b5850b25167dce0ae33/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_25296a8f176256aea5ed8b5850b25167dce0ae33/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner: 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner:Ran 1 test in 36953.897s 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner: 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner: 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner:====================================================================== 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-19T17:14:29.070 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-19T17:14:29.071 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-02-19T17:14:29.071 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_25296a8f176256aea5ed8b5850b25167dce0ae33/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-02-19T17:14:29.071 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_25296a8f176256aea5ed8b5850b25167dce0ae33/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-02-19T17:14:29.071 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_25296a8f176256aea5ed8b5850b25167dce0ae33/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-02-19T17:14:29.071 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2024-02-19T17:14:29.071 INFO:tasks.cephfs_test_runner: 2024-02-19T17:14:29.071 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_25296a8f176256aea5ed8b5850b25167dce0ae33/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-19T17:14:29.306 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=07a036254e62413a8e078885a03ff0a4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_25296a8f176256aea5ed8b5850b25167dce0ae33/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-19T17:14:29.308 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-02-19T17:14:29.318 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-02-19T17:14:29.325 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-02-19T17:14:29.325 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T17:14:29.325 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T17:14:29.387 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054609,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500052k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250024k,nr_inodes=812506,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500052k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-02-19T17:14:29.387 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T17:14:29.387 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T17:14:29.436 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054609,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500052k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250024k,nr_inodes=812506,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500052k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-02-19T17:14:29.436 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T17:14:29.437 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T17:14:29.489 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053823,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-02-19T17:14:29.489 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T17:14:29.489 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T17:14:29.532 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053823,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498796k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-02-19T17:14:29.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T17:14:29.532 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-02-19T17:14:29.679 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-19T17:14:29.679 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-02-19T17:14:29.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T17:14:29.681 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T17:14:29.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T17:14:29.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-02-19T17:14:29.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T17:14:29.835 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-02-19T17:14:29.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T17:14:29.961 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-02-19T17:14:30.054 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-19T17:14:30.055 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-02-19T17:14:30.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T17:14:30.056 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T17:14:30.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T17:14:30.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-19T17:14:30.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T17:14:30.211 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-02-19T17:14:30.325 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-19T17:14:30.334 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-19T17:14:30.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-19T17:14:30.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.538+0000 7fac88c00640 1 Processor -- start 2024-02-19T17:14:30.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.538+0000 7fac88c00640 1 -- start start 2024-02-19T17:14:30.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.539+0000 7fac88c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac84071000 0x7fac840714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:30.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.539+0000 7fac88c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fac8406d4f0 0x7fac8406d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:30.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.539+0000 7fac88c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac840cbde0 con 0x7fac84145260 2024-02-19T17:14:30.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.539+0000 7fac88c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac840719f0 con 0x7fac84071000 2024-02-19T17:14:30.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.539+0000 7fac88c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac840cc080 con 0x7fac8406d4f0 2024-02-19T17:14:30.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.540+0000 7fac81400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac84071000 0x7fac840714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:30.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.540+0000 7fac81400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac84071000 0x7fac840714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43830/0 (socket says 172.21.15.46:43830) 2024-02-19T17:14:30.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.540+0000 7fac81400640 1 -- 172.21.15.46:0/4109507038 learned_addr learned my addr 172.21.15.46:0/4109507038 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:30.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.540+0000 7fac81e00640 1 --1- 172.21.15.46:0/4109507038 >> v1:172.21.15.46:6789/0 conn(0x7fac84145260 0x7fac8415c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59530/0 (socket says 172.21.15.46:59530) 2024-02-19T17:14:30.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.540+0000 7fac82800640 1 --2- 172.21.15.46:0/4109507038 >> v2:172.21.15.142:3300/0 conn(0x7fac8406d4f0 0x7fac8406d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:30.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.540+0000 7fac81400640 1 -- 172.21.15.46:0/4109507038 >> v2:172.21.15.142:3300/0 conn(0x7fac8406d4f0 msgr2=0x7fac8406d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:30.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.540+0000 7fac81400640 1 --2- 172.21.15.46:0/4109507038 >> v2:172.21.15.142:3300/0 conn(0x7fac8406d4f0 0x7fac8406d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:30.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.540+0000 7fac81400640 1 -- 172.21.15.46:0/4109507038 >> v1:172.21.15.46:6789/0 conn(0x7fac84145260 legacy=0x7fac8415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:30.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.540+0000 7fac81400640 1 -- 172.21.15.46:0/4109507038 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac840cc360 con 0x7fac84071000 2024-02-19T17:14:30.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.542+0000 7fac81400640 1 --2- 172.21.15.46:0/4109507038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac84071000 0x7fac840714b0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7fac841604e0 tx=0x7fac6c02b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88031edb69b39502 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:30.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.542+0000 7fac80a00640 1 -- 172.21.15.46:0/4109507038 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c031890 con 0x7fac84071000 2024-02-19T17:14:30.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.542+0000 7fac80a00640 1 -- 172.21.15.46:0/4109507038 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c0319f0 con 0x7fac84071000 2024-02-19T17:14:30.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.542+0000 7fac80a00640 1 -- 172.21.15.46:0/4109507038 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c031d80 con 0x7fac84071000 2024-02-19T17:14:30.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.543+0000 7fac88c00640 1 -- 172.21.15.46:0/4109507038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac84071000 msgr2=0x7fac840714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:30.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.543+0000 7fac88c00640 1 --2- 172.21.15.46:0/4109507038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac84071000 0x7fac840714b0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7fac841604e0 tx=0x7fac6c02b930 comp rx=0 tx=0).stop 2024-02-19T17:14:30.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.543+0000 7fac88c00640 1 -- 172.21.15.46:0/4109507038 shutdown_connections 2024-02-19T17:14:30.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.543+0000 7fac88c00640 1 --2- 172.21.15.46:0/4109507038 >> v2:172.21.15.142:3300/0 conn(0x7fac8406d4f0 0x7fac8406d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:30.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.543+0000 7fac88c00640 1 --2- 172.21.15.46:0/4109507038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac84071000 0x7fac840714b0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:30.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.543+0000 7fac88c00640 1 -- 172.21.15.46:0/4109507038 >> 172.21.15.46:0/4109507038 conn(0x7fac84066f70 msgr2=0x7fac8406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:30.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.543+0000 7fac88c00640 1 -- 172.21.15.46:0/4109507038 shutdown_connections 2024-02-19T17:14:30.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.543+0000 7fac88c00640 1 -- 172.21.15.46:0/4109507038 wait complete. 2024-02-19T17:14:30.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.544+0000 7fac88c00640 1 Processor -- start 2024-02-19T17:14:30.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.545+0000 7fac88c00640 1 -- start start 2024-02-19T17:14:30.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.545+0000 7fac88c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8406d4f0 0x7fac8414d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:30.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.545+0000 7fac88c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac84071000 0x7fac8415e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:30.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac88c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac84145260 0x7fac84139580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:30.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac88c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8415e970 con 0x7fac84145260 2024-02-19T17:14:30.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac88c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8413bc50 con 0x7fac8406d4f0 2024-02-19T17:14:30.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac88c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8415ee80 con 0x7fac84071000 2024-02-19T17:14:30.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac82800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac84145260 0x7fac84139580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:30.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac82800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac84145260 0x7fac84139580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43840/0 (socket says 172.21.15.46:43840) 2024-02-19T17:14:30.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac82800640 1 -- 172.21.15.46:0/3196154390 learned_addr learned my addr 172.21.15.46:0/3196154390 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:30.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac81400640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac84071000 0x7fac8415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:30.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac81e00640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8406d4f0 0x7fac8414d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:30.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac82800640 1 -- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac84071000 msgr2=0x7fac8415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:30.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac82800640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac84071000 0x7fac8415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:30.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac82800640 1 -- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8406d4f0 msgr2=0x7fac8414d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:30.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac82800640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8406d4f0 0x7fac8414d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:30.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac82800640 1 -- 172.21.15.46:0/3196154390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6c0094d0 con 0x7fac84145260 2024-02-19T17:14:30.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.546+0000 7fac81e00640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8406d4f0 0x7fac8414d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:30.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.547+0000 7fac82800640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac84145260 0x7fac84139580 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00d800 tx=0x7fac7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:30.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.547+0000 7fac7a000640 1 -- 172.21.15.46:0/3196154390 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c00b6c0 con 0x7fac84145260 2024-02-19T17:14:30.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.547+0000 7fac7a000640 1 -- 172.21.15.46:0/3196154390 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c00b840 con 0x7fac84145260 2024-02-19T17:14:30.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.547+0000 7fac7a000640 1 -- 172.21.15.46:0/3196154390 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c00bbf0 con 0x7fac84145260 2024-02-19T17:14:30.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.547+0000 7fac88c00640 1 -- 172.21.15.46:0/3196154390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8415eba0 con 0x7fac84145260 2024-02-19T17:14:30.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.547+0000 7fac88c00640 1 -- 172.21.15.46:0/3196154390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8413b8e0 con 0x7fac84145260 2024-02-19T17:14:30.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.548+0000 7fac88c00640 1 -- 172.21.15.46:0/3196154390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8413bde0 con 0x7fac84145260 2024-02-19T17:14:30.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.550+0000 7fac7a000640 1 -- 172.21.15.46:0/3196154390 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fac7c00bd50 con 0x7fac84145260 2024-02-19T17:14:30.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.551+0000 7fac7a000640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fac6006b810 0x7fac6006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:30.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.551+0000 7fac7a000640 1 -- 172.21.15.46:0/3196154390 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fac7c08a440 con 0x7fac84145260 2024-02-19T17:14:30.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.552+0000 7fac81e00640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fac6006b810 0x7fac6006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:30.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.553+0000 7fac81e00640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fac6006b810 0x7fac6006dcd0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fac74007fd0 tx=0x7fac74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:30.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.555+0000 7fac7a000640 1 -- 172.21.15.46:0/3196154390 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac7c055150 con 0x7fac84145260 2024-02-19T17:14:30.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.747+0000 7fac88c00640 1 -- 172.21.15.46:0/3196154390 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac84067ba0 con 0x7fac6006b810 2024-02-19T17:14:30.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.754+0000 7fac7a000640 1 -- 172.21.15.46:0/3196154390 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48833 (secure 0 0 0) 0x7fac84067ba0 con 0x7fac6006b810 2024-02-19T17:14:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:30.741 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-02-19T17:14:30.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.757+0000 7fac88c00640 1 -- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fac6006b810 msgr2=0x7fac6006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:30.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.757+0000 7fac88c00640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fac6006b810 0x7fac6006dcd0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fac74007fd0 tx=0x7fac74009040 comp rx=0 tx=0).stop 2024-02-19T17:14:30.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.757+0000 7fac88c00640 1 -- 172.21.15.46:0/3196154390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac84145260 msgr2=0x7fac84139580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:30.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.757+0000 7fac88c00640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac84145260 0x7fac84139580 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00d800 tx=0x7fac7c00dcc0 comp rx=0 tx=0).stop 2024-02-19T17:14:30.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.757+0000 7fac88c00640 1 -- 172.21.15.46:0/3196154390 shutdown_connections 2024-02-19T17:14:30.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.757+0000 7fac88c00640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fac6006b810 0x7fac6006dcd0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:30.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.757+0000 7fac88c00640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac84145260 0x7fac84139580 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:30.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.757+0000 7fac88c00640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac84071000 0x7fac8415e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:30.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.757+0000 7fac88c00640 1 --2- 172.21.15.46:0/3196154390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8406d4f0 0x7fac8414d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:30.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.757+0000 7fac88c00640 1 -- 172.21.15.46:0/3196154390 >> 172.21.15.46:0/3196154390 conn(0x7fac84066f70 msgr2=0x7fac84142f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:30.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.758+0000 7fac88c00640 1 -- 172.21.15.46:0/3196154390 shutdown_connections 2024-02-19T17:14:30.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.758+0000 7fac88c00640 1 -- 172.21.15.46:0/3196154390 wait complete. 2024-02-19T17:14:30.759 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":18528,"stamp":"2024-02-19T17:14:30.477855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":35581260,"kb_used_data":23547396,"kb_used_omap":2838,"kb_used_meta":11931305,"kb_avail":719393460,"statfs":{"total":773094113280,"available":736658903040,"internally_reserved":0,"allocated":24112533504,"data_stored":24062076864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2906559,"internal_metadata":12217656897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":131,"apply_latency_ms":131,"commit_latency_ns":131000000,"apply_latency_ns":131000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36283882520,"num_objects":-31306,"num_object_clones":0,"num_object_copies":-62612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-31306,"num_whiteouts":0,"num_read":-1467137,"num_read_kb":-105747993,"num_write":-7466933,"num_write_kb":-160876526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2152,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.461007"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":506,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-19T17:14:26.012195+0000","last_change":"2024-02-19T06:57:45.353063+0000","last_active":"2024-02-19T17:14:26.012195+0000","last_peered":"2024-02-19T17:14:26.012195+0000","last_clean":"2024-02-19T17:14:26.012195+0000","last_became_active":"2024-02-19T06:57:45.350602+0000","last_became_peered":"2024-02-19T06:57:45.350602+0000","last_unstale":"2024-02-19T17:14:26.012195+0000","last_undegraded":"2024-02-19T17:14:26.012195+0000","last_fullsized":"2024-02-19T17:14:26.012195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_clean_scrub_stamp":"2024-02-19T06:57:44.230095+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:04:42.513180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424516845,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4435688,"kb_used_data":2633184,"kb_used_omap":46,"kb_used_meta":1785617,"kb_avail":89936152,"statfs":{"total":96636764160,"available":92094619648,"internally_reserved":0,"allocated":2696380416,"data_stored":2690574658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47262,"internal_metadata":1828472674},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":1.0229999999999999,"15min":0.99399999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.107,"5min":9.6859999999999999,"15min":9.6859999999999999},"last":1.246},{"interface":"front","average":{"1min":0.77900000000000003,"5min":1.1080000000000001,"15min":1.036},"min":{"1min":0.46000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.4159999999999999,"5min":12.372,"15min":12.372},"last":0.93000000000000005}]},{"osd":1,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.361,"15min":5.3079999999999998},"min":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.4660000000000002,"5min":29.341000000000001,"15min":1340.5419999999999},"last":1.7310000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.3140000000000001,"15min":5.3019999999999996},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.992,"5min":25.664999999999999,"15min":1340.414},"last":1.8220000000000001}]},{"osd":2,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.1419999999999999,"15min":1.071},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38500000000000001},"max":{"1min":1.6799999999999999,"5min":4.0709999999999997,"15min":6.4770000000000003},"last":1.758},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.292,"15min":1.2110000000000001},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.432},"max":{"1min":2.5059999999999998,"5min":11.471,"15min":11.471},"last":1.516}]},{"osd":3,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1739999999999999,"15min":1.242},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.2639999999999998,"5min":9.4450000000000003,"15min":9.4450000000000003},"last":1.9690000000000001},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.331,"15min":1.266},"min":{"1min":0.55900000000000005,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":2.5449999999999999,"5min":11.388,"15min":11.388},"last":2.137}]},{"osd":4,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.92500000000000004,"15min":0.95199999999999996},"min":{"1min":0.45900000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.121,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":1.355},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.093,"15min":1.036},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":2.331,"5min":10.106999999999999,"15min":10.106999999999999},"last":1.101}]},{"osd":5,"last update":"Mon Feb 19 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.113,"15min":1.089},"min":{"1min":0.41099999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.069,"5min":11.430999999999999,"15min":11.430999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.0209999999999999,"15min":1.0269999999999999},"min":{"1min":0.45600000000000002,"5min":0.441,"15min":0.441},"max":{"1min":3.327,"5min":5.391,"15min":5.391},"last":1.6859999999999999}]},{"osd":7,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.097,"15min":1.0760000000000001},"min":{"1min":0.55300000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.3700000000000001,"5min":9.9800000000000004,"15min":9.9800000000000004},"last":1.552},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.292,"15min":1.1910000000000001},"min":{"1min":0.66800000000000004,"5min":0.46400000000000002,"15min":0.46300000000000002},"max":{"1min":2.9079999999999999,"5min":12.414999999999999,"15min":12.414999999999999},"last":1.5880000000000001}]}]},{"osd":5,"up_from":15,"seq":64424516843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1426932,"kb_used_data":424,"kb_used_omap":473,"kb_used_meta":1426022,"kb_avail":92944908,"statfs":{"total":96636764160,"available":95175585792,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":484739,"internal_metadata":1460247165},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":1.0880000000000001,"15min":1.0640000000000001},"min":{"1min":0.34200000000000003,"5min":0.33000000000000002,"15min":0.27100000000000002},"max":{"1min":1.2330000000000001,"5min":9.8399999999999999,"15min":9.8399999999999999},"last":1.083},{"interface":"front","average":{"1min":1.083,"5min":1.2090000000000001,"15min":1.157},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.0919999999999996,"5min":5.1980000000000004,"15min":6.9539999999999997},"last":2.6179999999999999}]},{"osd":1,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.3380000000000001,"15min":3.8090000000000002},"min":{"1min":0.45300000000000001,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":1.1060000000000001,"5min":16.93,"15min":560.22000000000003},"last":2.468},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.345,"15min":3.8519999999999999},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.36199999999999999},"max":{"1min":3.7999999999999998,"5min":9.2360000000000007,"15min":559.36300000000006},"last":0.69899999999999995}]},{"osd":2,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4870000000000001,"15min":1.266},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":4.0129999999999999,"5min":23.012,"15min":23.012},"last":1.032},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.2809999999999999,"15min":1.2070000000000001},"min":{"1min":0.50800000000000001,"5min":0.432,"15min":0.41999999999999998},"max":{"1min":2.4380000000000002,"5min":5.4379999999999997,"15min":5.5529999999999999},"last":1.5149999999999999}]},{"osd":3,"last update":"Mon Feb 19 17:14:14 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.448,"15min":1.5209999999999999},"min":{"1min":0.53200000000000003,"5min":0.43099999999999999,"15min":0.41099999999999998},"max":{"1min":3.8969999999999998,"5min":23.094000000000001,"15min":78.207999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.75,"15min":1.667},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":4.0519999999999996,"5min":36.241999999999997,"15min":78.245000000000005},"last":2.0790000000000002}]},{"osd":4,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":1.091,"15min":0.97099999999999997},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":1.423,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.47},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.1919999999999999,"15min":1.0089999999999999},"min":{"1min":0.48099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.855,"5min":14.992000000000001,"15min":14.992000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1220000000000001,"15min":1.036},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":3.968,"5min":6.6989999999999998,"15min":6.6989999999999998},"last":1.7529999999999999},{"interface":"front","average":{"1min":0.997,"5min":1.3300000000000001,"15min":1.127},"min":{"1min":0.53200000000000003,"5min":0.47599999999999998,"15min":0.41399999999999998},"max":{"1min":3.3580000000000001,"5min":16.837,"15min":16.837},"last":2.2719999999999998}]},{"osd":7,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.173,"15min":1.0549999999999999},"min":{"1min":0.48699999999999999,"5min":0.46400000000000002,"15min":0.42899999999999999},"max":{"1min":3.9340000000000002,"5min":7.2969999999999997,"15min":7.2969999999999997},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.6459999999999999,"15min":1.2529999999999999},"min":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.39400000000000002},"max":{"1min":4.1289999999999996,"5min":35.945,"15min":35.945},"last":1.7090000000000001}]}]},{"osd":7,"up_from":14,"seq":60129549546,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6418160,"kb_used_data":5174628,"kb_used_omap":237,"kb_used_meta":1243282,"kb_avail":87953680,"statfs":{"total":96636764160,"available":90064568320,"internally_reserved":0,"allocated":5298819072,"data_stored":5288253325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":243426,"internal_metadata":1273121054},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":1.1639999999999999,"15min":1.5409999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":1.794,"5min":16.071999999999999,"15min":135.33099999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":1.736,"15min":1.75},"min":{"1min":0.39400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1,"5min":42.113,"15min":134.83000000000001},"last":1.6799999999999999}]},{"osd":1,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":1.109,"15min":2.823},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.806,"5min":14.302,"15min":440.32799999999997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.8080000000000001,"15min":3.0619999999999998},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.35399999999999998},"max":{"1min":1.8169999999999999,"5min":45.880000000000003,"15min":442.47500000000002},"last":4.6349999999999998}]},{"osd":2,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.7210000000000001,"15min":1.5609999999999999},"min":{"1min":0.443,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.863,"5min":45.709000000000003,"15min":77.938999999999993},"last":1.7450000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.5349999999999999,"15min":1.4870000000000001},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.38300000000000001},"max":{"1min":1.109,"5min":42.390999999999998,"15min":79.799000000000007},"last":1.956}]},{"osd":3,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":2.5059999999999998,"15min":1.8260000000000001},"min":{"1min":0.46200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.915,"5min":126.935,"15min":126.935},"last":1.399},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.3520000000000001,"15min":1.4590000000000001},"min":{"1min":0.48099999999999998,"5min":0.44800000000000001,"15min":0.41499999999999998},"max":{"1min":2.8319999999999999,"5min":14.634,"15min":72.626000000000005},"last":0.60599999999999998}]},{"osd":4,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":1.538,"15min":1.109},"min":{"1min":0.443,"5min":0.37,"15min":0.36399999999999999},"max":{"1min":1.4259999999999999,"5min":42.188000000000002,"15min":42.188000000000002},"last":1.2390000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.121,"15min":0.98099999999999998},"min":{"1min":0.45000000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.8480000000000001,"5min":22.009,"15min":22.009},"last":1.3540000000000001}]},{"osd":5,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":1.655,"15min":1.22},"min":{"1min":0.55000000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.5579999999999998,"5min":68.173000000000002,"15min":68.173000000000002},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":2.1000000000000001,"15min":1.343},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.436},"max":{"1min":1.7849999999999999,"5min":45.917999999999999,"15min":45.917999999999999},"last":1.1970000000000001}]},{"osd":6,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.716,"15min":1.2569999999999999},"min":{"1min":0.53500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.8799999999999999,"5min":67.986999999999995,"15min":67.986999999999995},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.288,"15min":1.131},"min":{"1min":0.70599999999999996,"5min":0.48799999999999999,"15min":0.47999999999999998},"max":{"1min":2.1819999999999999,"5min":13.959,"15min":13.959},"last":1.2829999999999999}]}]},{"osd":4,"up_from":14,"seq":60129549545,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":3476768,"kb_used_data":1827424,"kb_used_omap":500,"kb_used_meta":1594763,"kb_avail":90895072,"statfs":{"total":96636764160,"available":93076553728,"internally_reserved":0,"allocated":1871282176,"data_stored":1867064203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":512202,"internal_metadata":1633038134},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2450000000000001,"15min":1.0880000000000001},"min":{"1min":0.32400000000000001,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":4.3840000000000003,"5min":28.562999999999999,"15min":28.562999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.113,"15min":1.0509999999999999},"min":{"1min":0.443,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.6429999999999998,"5min":13.212,"15min":13.212},"last":1.2130000000000001}]},{"osd":1,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2669999999999999,"15min":6.7649999999999997},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.34499999999999997},"max":{"1min":4.3719999999999999,"5min":28.440000000000001,"15min":1591.5709999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.111,"15min":6.7800000000000002},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":4.3109999999999999,"5min":4.3109999999999999,"15min":1590.9179999999999},"last":1.252}]},{"osd":2,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.343,"15min":1.151},"min":{"1min":0.433,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":9.077,"5min":16.189,"15min":16.189},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.044,"15min":1.167},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.5150000000000001,"5min":5.8680000000000003,"15min":6.0190000000000001},"last":0.92500000000000004}]},{"osd":3,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.339,"15min":1.169},"min":{"1min":0.55900000000000005,"5min":0.45900000000000002,"15min":0.432},"max":{"1min":4.7290000000000001,"5min":16.074999999999999,"15min":16.074999999999999},"last":1.169},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1799999999999999,"15min":1.2050000000000001},"min":{"1min":0.45100000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.4550000000000001,"5min":5.907,"15min":5.9390000000000001},"last":1.044}]},{"osd":5,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":0.96399999999999997,"15min":0.94899999999999995},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.38900000000000001},"max":{"1min":7.5620000000000003,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":1.143},{"interface":"front","average":{"1min":1.339,"5min":1.0800000000000001,"15min":1.0309999999999999},"min":{"1min":0.45800000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.7039999999999997,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":1.286}]},{"osd":6,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.179,"15min":0.999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":7.6440000000000001,"5min":16.228999999999999,"15min":16.228999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.048,"15min":0.99299999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.40500000000000003},"max":{"1min":4.8680000000000003,"5min":4.8680000000000003,"15min":6.0549999999999997},"last":1.0049999999999999}]},{"osd":7,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.111,"15min":1.0900000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.49199999999999999},"max":{"1min":4.556,"5min":4.556,"15min":5.415},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.3220000000000001,"15min":1.1180000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":8.5350000000000001,"5min":16.149999999999999,"15min":16.149999999999999},"last":1.3420000000000001}]}]},{"osd":3,"up_from":14,"seq":60129549517,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2579708,"kb_used_data":1028600,"kb_used_omap":50,"kb_used_meta":1522317,"kb_avail":91792132,"statfs":{"total":96636764160,"available":93995143168,"internally_reserved":0,"allocated":1053286400,"data_stored":1050707602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51317,"internal_metadata":1558853515},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:28 2024","interfaces":[{"interface":"back","average":{"1min":2.1110000000000002,"5min":1.3540000000000001,"15min":1.371},"min":{"1min":0.36899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":14.741,"5min":14.741,"15min":14.741},"last":14.741},{"interface":"front","average":{"1min":1.8240000000000001,"5min":1.3220000000000001,"15min":1.3999999999999999},"min":{"1min":0.39000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.8019999999999996,"5min":8.8019999999999996,"15min":8.8019999999999996},"last":8.8019999999999996}]},{"osd":1,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":1.5209999999999999,"15min":2.7069999999999999},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":2.6299999999999999,"5min":23.510000000000002,"15min":278.68099999999998},"last":9.6980000000000004},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.427,"15min":2.7519999999999998},"min":{"1min":0.41599999999999998,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":2.5910000000000002,"5min":8.0559999999999992,"15min":279.06599999999997},"last":10.582000000000001}]},{"osd":2,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":2.7389999999999999,"15min":2.0760000000000001},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.351,"5min":121.10299999999999,"15min":121.10299999999999},"last":14.67},{"interface":"front","average":{"1min":0.91100000000000003,"5min":2.6320000000000001,"15min":1.986},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.33800000000000002},"max":{"1min":2.0470000000000002,"5min":118.05800000000001,"15min":118.05800000000001},"last":8.7639999999999993}]},{"osd":4,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.788,"15min":1.627},"min":{"1min":0.43099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.153,"5min":35.975999999999999,"15min":35.975999999999999},"last":5.3109999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.556,"15min":1.637},"min":{"1min":0.48799999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.2519999999999998,"5min":12.666,"15min":12.666},"last":14.837}]},{"osd":5,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.536,"15min":1.5720000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.9860000000000002,"5min":8.7669999999999995,"15min":8.7669999999999995},"last":9.7680000000000007},{"interface":"front","average":{"1min":1.306,"5min":1.5600000000000001,"15min":1.667},"min":{"1min":0.79900000000000004,"5min":0.498,"15min":0.48699999999999999},"max":{"1min":2.1930000000000001,"5min":8.8819999999999997,"15min":8.8819999999999997},"last":14.794}]},{"osd":6,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.546,"15min":1.6839999999999999},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.47099999999999997},"max":{"1min":2.8719999999999999,"5min":9.0860000000000003,"15min":9.0860000000000003},"last":5.3579999999999997},{"interface":"front","average":{"1min":1.335,"5min":1.575,"15min":1.651},"min":{"1min":0.64100000000000001,"5min":0.59499999999999997,"15min":0.53800000000000003},"max":{"1min":3.7530000000000001,"5min":15.616,"15min":15.616},"last":9.6310000000000002}]},{"osd":7,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.516,"15min":1.7150000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48799999999999999},"max":{"1min":3.9009999999999998,"5min":10.589,"15min":10.589},"last":8.8369999999999997},{"interface":"front","average":{"1min":1.393,"5min":1.5369999999999999,"15min":1.6990000000000001},"min":{"1min":0.71999999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":4.8109999999999999,"5min":7.3780000000000001,"15min":7.3780000000000001},"last":5.1989999999999998}]}]},{"osd":2,"up_from":14,"seq":60129549532,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5729216,"kb_used_data":3967412,"kb_used_omap":768,"kb_used_meta":1761023,"kb_avail":88642624,"statfs":{"total":96636764160,"available":90770046976,"internally_reserved":0,"allocated":4062629888,"data_stored":4054402925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":786953,"internal_metadata":1803288055},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.99399999999999999,"15min":1.417},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":2.8839999999999999,"5min":6.6719999999999997,"15min":65.132000000000005},"last":1.3740000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.1599999999999999,"15min":1.591},"min":{"1min":0.39700000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.4510000000000001,"5min":11.308999999999999,"15min":70.902000000000001},"last":0.91200000000000003}]},{"osd":1,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.4990000000000001,"15min":5.6379999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.71,"5min":11.342000000000001,"15min":1038.0440000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":1.419,"15min":5.5419999999999998},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.33600000000000002},"max":{"1min":1.6899999999999999,"5min":8.0749999999999993,"15min":1037.0899999999999},"last":1.2390000000000001}]},{"osd":3,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.218,"15min":1.427},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.29299999999999998},"max":{"1min":1.7410000000000001,"5min":5.0629999999999997,"15min":7.71},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.573,"15min":1.6839999999999999},"min":{"1min":0.57999999999999996,"5min":0.44,"15min":0.318},"max":{"1min":2.6699999999999999,"5min":11.372,"15min":11.816000000000001},"last":1.27}]},{"osd":4,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.794,"15min":2.2229999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.581,"5min":26.771000000000001,"15min":189.965},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.716,"15min":2.1680000000000001},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.41199999999999998},"max":{"1min":2.46,"5min":27.465,"15min":193.35400000000001},"last":1.448}]},{"osd":5,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.212,"15min":1.395},"min":{"1min":0.54000000000000004,"5min":0.44500000000000001,"15min":0.38500000000000001},"max":{"1min":2.8650000000000002,"5min":5.024,"15min":6.6159999999999997},"last":1.097},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.556,"15min":1.5980000000000001},"min":{"1min":0.749,"5min":0.59899999999999998,"15min":0.52100000000000002},"max":{"1min":3.831,"5min":11.218999999999999,"15min":11.218999999999999},"last":1.2110000000000001}]},{"osd":6,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.5680000000000001,"15min":1.514},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9690000000000001,"5min":6.6319999999999997,"15min":6.6319999999999997},"last":1.506},{"interface":"front","average":{"1min":1.202,"5min":1.3460000000000001,"15min":1.5069999999999999},"min":{"1min":0.501,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.8180000000000001,"5min":7.9409999999999998,"15min":7.9409999999999998},"last":0.998}]},{"osd":7,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.534,"15min":1.5669999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.46300000000000002},"max":{"1min":3.8090000000000002,"5min":5.5049999999999999,"15min":6.1680000000000001},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.556,"15min":1.589},"min":{"1min":0.68500000000000005,"5min":0.63,"15min":0.435},"max":{"1min":2.2290000000000001,"5min":23.437000000000001,"15min":23.437000000000001},"last":1.1830000000000001}]}]},{"osd":1,"up_from":14,"seq":60129549521,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7022300,"kb_used_data":5301264,"kb_used_omap":490,"kb_used_meta":1720533,"kb_avail":87349540,"statfs":{"total":96636764160,"available":89445928960,"internally_reserved":0,"allocated":5428494336,"data_stored":5416968797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":502102,"internal_metadata":1761826474},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":1.3460000000000001,"15min":1.296},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":2.2149999999999999,"5min":14.206,"15min":14.206},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":1.5069999999999999,"15min":1.367},"min":{"1min":0.41199999999999998,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":2.056,"5min":14.311,"15min":14.311},"last":0.96399999999999997}]},{"osd":2,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.3109999999999999,"15min":1.663},"min":{"1min":0.41899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.4649999999999999,"5min":13.16,"15min":82.034999999999997},"last":1.9530000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.6100000000000001,"15min":1.8580000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32000000000000001},"max":{"1min":3.407,"5min":13.068,"15min":83.215999999999994},"last":1.2889999999999999}]},{"osd":3,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.8160000000000001,"15min":1.972},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.37},"max":{"1min":3.536,"5min":9.5449999999999999,"15min":79.706999999999994},"last":1.016},{"interface":"front","average":{"1min":1.02,"5min":1.8009999999999999,"15min":1.9059999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.782,"5min":18.905000000000001,"15min":84.069000000000003},"last":1.2150000000000001}]},{"osd":4,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.4830000000000001,"15min":1.4419999999999999},"min":{"1min":0.46700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.2010000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":1.506},{"interface":"front","average":{"1min":1.139,"5min":1.5209999999999999,"15min":1.472},"min":{"1min":0.55600000000000005,"5min":0.46400000000000002,"15min":0.39900000000000002},"max":{"1min":3.6640000000000001,"5min":13.253,"15min":13.253},"last":2.2930000000000001}]},{"osd":5,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.6799999999999999,"15min":1.651},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.47599999999999998},"max":{"1min":3.3519999999999999,"5min":13.005000000000001,"15min":13.760999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.6259999999999999,"15min":1.516},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":3.2429999999999999,"5min":9.8770000000000007,"15min":9.8770000000000007},"last":1.631}]},{"osd":6,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.5800000000000001,"15min":1.54},"min":{"1min":0.51000000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.6779999999999999,"5min":13.206,"15min":13.206},"last":2.3319999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.609,"15min":1.6359999999999999},"min":{"1min":0.54600000000000004,"5min":0.496,"15min":0.496},"max":{"1min":3.4449999999999998,"5min":9.125,"15min":13.862},"last":1.3779999999999999}]},{"osd":7,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.6020000000000001,"15min":1.585},"min":{"1min":0.64200000000000002,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":2.7490000000000001,"5min":13.311999999999999,"15min":13.311999999999999},"last":2.488},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.7490000000000001,"15min":1.7569999999999999},"min":{"1min":0.59799999999999998,"5min":0.53300000000000003,"15min":0.52200000000000002},"max":{"1min":3.4940000000000002,"5min":13.115,"15min":13.819000000000001},"last":1.5489999999999999}]}]},{"osd":0,"up_from":14,"seq":60129549541,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4492488,"kb_used_data":3614460,"kb_used_omap":272,"kb_used_meta":877743,"kb_avail":89879352,"statfs":{"total":96636764160,"available":92036456448,"internally_reserved":0,"allocated":3701207040,"data_stored":3693933889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":278558,"internal_metadata":898809826},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":1.431,"15min":1.3240000000000001},"min":{"1min":0.29599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.0219999999999998,"5min":20.481999999999999,"15min":20.481999999999999},"last":1.101},{"interface":"front","average":{"1min":0.79900000000000004,"5min":1.204,"15min":1.3899999999999999},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":1.613,"5min":5.6619999999999999,"15min":7.8680000000000003},"last":1.4890000000000001}]},{"osd":2,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":1.331,"15min":1.2989999999999999},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.30599999999999999},"max":{"1min":2.0910000000000002,"5min":5.3289999999999997,"15min":5.8490000000000002},"last":1.143},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.5820000000000001,"15min":1.452},"min":{"1min":0.36699999999999999,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":1.357,"5min":28.132999999999999,"15min":28.132999999999999},"last":0.89700000000000002}]},{"osd":3,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":1.635,"15min":1.411},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":1.466,"5min":12.734,"15min":12.734},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":2.153,"15min":1.7509999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.34699999999999998},"max":{"1min":3.141,"5min":21.021999999999998,"15min":21.021999999999998},"last":0.745}]},{"osd":4,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":1.732,"15min":1.504},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.516,"5min":13.388,"15min":13.388},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.5920000000000001,"15min":1.4570000000000001},"min":{"1min":0.55200000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.0579999999999998,"5min":10.034000000000001,"15min":10.034000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.466,"15min":1.5229999999999999},"min":{"1min":0.53400000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.069,"5min":7.9370000000000003,"15min":7.9370000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.6379999999999999,"15min":1.498},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.496},"max":{"1min":2.9830000000000001,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":0.78500000000000003}]},{"osd":6,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.494,"15min":1.5309999999999999},"min":{"1min":0.61899999999999999,"5min":0.49099999999999999,"15min":0.46200000000000002},"max":{"1min":2.5760000000000001,"5min":10.573,"15min":10.573},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.7290000000000001,"15min":1.5780000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":1.5529999999999999,"5min":15.301,"15min":15.301},"last":0.69299999999999995}]},{"osd":7,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.681,"15min":1.651},"min":{"1min":0.63100000000000001,"5min":0.50700000000000001,"15min":0.45700000000000002},"max":{"1min":1.994,"5min":17.152000000000001,"15min":17.152000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.6080000000000001,"15min":1.502},"min":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.52000000000000002},"max":{"1min":1.585,"5min":11.932,"15min":11.932},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T17:14:30.761 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-19T17:14:30.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.988+0000 7f0454e00640 1 Processor -- start 2024-02-19T17:14:30.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.988+0000 7f0454e00640 1 -- start start 2024-02-19T17:14:30.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.990+0000 7f0454e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f045015a670 0x7f04500ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:30.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.990+0000 7f0454e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04500cdde0 con 0x7f045006da30 2024-02-19T17:14:30.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.990+0000 7f0454e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045006df10 con 0x7f04500ce7b0 2024-02-19T17:14:30.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.990+0000 7f0454e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04500cd4b0 con 0x7f045015a670 2024-02-19T17:14:30.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.990+0000 7f044de00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f045015a670 0x7f04500ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:30.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.990+0000 7f044de00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f045015a670 0x7f04500ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43844/0 (socket says 172.21.15.46:43844) 2024-02-19T17:14:30.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.990+0000 7f044de00640 1 -- 172.21.15.46:0/4097537608 learned_addr learned my addr 172.21.15.46:0/4097537608 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:30.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.991+0000 7f044de00640 1 -- 172.21.15.46:0/4097537608 >> v1:172.21.15.142:6789/0 conn(0x7f04500ce7b0 legacy=0x7f04500cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:30.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.991+0000 7f044de00640 1 -- 172.21.15.46:0/4097537608 >> v1:172.21.15.46:6789/0 conn(0x7f045006da30 legacy=0x7f04500b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:30.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.991+0000 7f044de00640 1 -- 172.21.15.46:0/4097537608 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04500cd790 con 0x7f045015a670 2024-02-19T17:14:30.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.992+0000 7f044de00640 1 --2- 172.21.15.46:0/4097537608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045015a670 0x7f04500ce270 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f0440009e50 tx=0x7f044002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2a6635ca918afb server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:30.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.992+0000 7f044d400640 1 -- 172.21.15.46:0/4097537608 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044002cb10 con 0x7f045015a670 2024-02-19T17:14:30.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.992+0000 7f044d400640 1 -- 172.21.15.46:0/4097537608 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044002cc70 con 0x7f045015a670 2024-02-19T17:14:30.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.992+0000 7f044d400640 1 -- 172.21.15.46:0/4097537608 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04400343f0 con 0x7f045015a670 2024-02-19T17:14:30.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.993+0000 7f0454e00640 1 -- 172.21.15.46:0/4097537608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045015a670 msgr2=0x7f04500ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:30.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.993+0000 7f0454e00640 1 --2- 172.21.15.46:0/4097537608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045015a670 0x7f04500ce270 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f0440009e50 tx=0x7f044002bf70 comp rx=0 tx=0).stop 2024-02-19T17:14:30.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.993+0000 7f0454e00640 1 -- 172.21.15.46:0/4097537608 shutdown_connections 2024-02-19T17:14:30.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.993+0000 7f0454e00640 1 --2- 172.21.15.46:0/4097537608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045015a670 0x7f04500ce270 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:30.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.993+0000 7f0454e00640 1 -- 172.21.15.46:0/4097537608 >> 172.21.15.46:0/4097537608 conn(0x7f0450066f70 msgr2=0x7f045006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:30.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.993+0000 7f0454e00640 1 -- 172.21.15.46:0/4097537608 shutdown_connections 2024-02-19T17:14:30.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.993+0000 7f0454e00640 1 -- 172.21.15.46:0/4097537608 wait complete. 2024-02-19T17:14:30.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.995+0000 7f0454e00640 1 Processor -- start 2024-02-19T17:14:30.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.995+0000 7f0454e00640 1 -- start start 2024-02-19T17:14:30.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.996+0000 7f0454e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f045006da30 0x7f0450141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:30.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.996+0000 7f0454e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500ce7b0 0x7f045015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:30.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.996+0000 7f0454e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045015a670 0x7f045015c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:30.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.996+0000 7f0454e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045015d480 con 0x7f045015a670 2024-02-19T17:14:30.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.996+0000 7f0454e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0450155090 con 0x7f045006da30 2024-02-19T17:14:30.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.996+0000 7f0454e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045015c800 con 0x7f04500ce7b0 2024-02-19T17:14:30.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.996+0000 7f044e800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045015a670 0x7f045015c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:30.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.996+0000 7f044e800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045015a670 0x7f045015c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43852/0 (socket says 172.21.15.46:43852) 2024-02-19T17:14:30.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.996+0000 7f044e800640 1 -- 172.21.15.46:0/4124524213 learned_addr learned my addr 172.21.15.46:0/4124524213 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:30.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.996+0000 7f0445400640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500ce7b0 0x7f045015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:30.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.996+0000 7f044de00640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f045006da30 0x7f0450141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:30.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.997+0000 7f044e800640 1 -- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500ce7b0 msgr2=0x7f045015bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:30.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.997+0000 7f044e800640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500ce7b0 0x7f045015bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:30.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.997+0000 7f044e800640 1 -- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f045006da30 msgr2=0x7f0450141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:30.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.997+0000 7f044e800640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f045006da30 0x7f0450141ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:30.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.997+0000 7f044e800640 1 -- 172.21.15.46:0/4124524213 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0440009b30 con 0x7f045015a670 2024-02-19T17:14:30.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.997+0000 7f044e800640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045015a670 0x7f045015c160 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f044800c410 tx=0x7f044800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:30.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.997+0000 7f0446a00640 1 -- 172.21.15.46:0/4124524213 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448011790 con 0x7f045015a670 2024-02-19T17:14:30.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.997+0000 7f0446a00640 1 -- 172.21.15.46:0/4124524213 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04480118f0 con 0x7f045015a670 2024-02-19T17:14:30.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.997+0000 7f0446a00640 1 -- 172.21.15.46:0/4124524213 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448011ce0 con 0x7f045015a670 2024-02-19T17:14:30.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.997+0000 7f0454e00640 1 -- 172.21.15.46:0/4124524213 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045015cae0 con 0x7f045015a670 2024-02-19T17:14:30.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.997+0000 7f0454e00640 1 -- 172.21.15.46:0/4124524213 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045015d0a0 con 0x7f045015a670 2024-02-19T17:14:30.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.999+0000 7f0454e00640 1 -- 172.21.15.46:0/4124524213 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0450067ba0 con 0x7f045015a670 2024-02-19T17:14:30.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:30.999+0000 7f0446a00640 1 -- 172.21.15.46:0/4124524213 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f044801c460 con 0x7f045015a670 2024-02-19T17:14:30.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.001+0000 7f0446a00640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f042c06b840 0x7f042c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:30.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.001+0000 7f0446a00640 1 -- 172.21.15.46:0/4124524213 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0448089b00 con 0x7f045015a670 2024-02-19T17:14:30.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.001+0000 7f044de00640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f042c06b840 0x7f042c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:30.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.002+0000 7f044de00640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f042c06b840 0x7f042c06dd00 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0440035000 tx=0x7f0440030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:30.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.005+0000 7f0446a00640 1 -- 172.21.15.46:0/4124524213 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0448054820 con 0x7f045015a670 2024-02-19T17:14:31.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.197+0000 7f0454e00640 1 -- 172.21.15.46:0/4124524213 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f045006e1a0 con 0x7f042c06b840 2024-02-19T17:14:31.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.204+0000 7f0446a00640 1 -- 172.21.15.46:0/4124524213 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48833 (secure 0 0 0) 0x7f045006e1a0 con 0x7f042c06b840 2024-02-19T17:14:31.190 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:31.191 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-02-19T17:14:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.207+0000 7f0454e00640 1 -- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f042c06b840 msgr2=0x7f042c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.207+0000 7f0454e00640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f042c06b840 0x7f042c06dd00 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0440035000 tx=0x7f0440030000 comp rx=0 tx=0).stop 2024-02-19T17:14:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.207+0000 7f0454e00640 1 -- 172.21.15.46:0/4124524213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045015a670 msgr2=0x7f045015c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.207+0000 7f0454e00640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045015a670 0x7f045015c160 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f044800c410 tx=0x7f044800c8d0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.207+0000 7f0454e00640 1 -- 172.21.15.46:0/4124524213 shutdown_connections 2024-02-19T17:14:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.207+0000 7f0454e00640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f042c06b840 0x7f042c06dd00 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.207+0000 7f0454e00640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f045015a670 0x7f045015c160 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.207+0000 7f0454e00640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500ce7b0 0x7f045015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.207+0000 7f0454e00640 1 --2- 172.21.15.46:0/4124524213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f045006da30 0x7f0450141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.207+0000 7f0454e00640 1 -- 172.21.15.46:0/4124524213 >> 172.21.15.46:0/4124524213 conn(0x7f0450066f70 msgr2=0x7f045015df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:31.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.207+0000 7f0454e00640 1 -- 172.21.15.46:0/4124524213 shutdown_connections 2024-02-19T17:14:31.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.207+0000 7f0454e00640 1 -- 172.21.15.46:0/4124524213 wait complete. 2024-02-19T17:14:31.212 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":18528,"stamp":"2024-02-19T17:14:30.477855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":35581260,"kb_used_data":23547396,"kb_used_omap":2838,"kb_used_meta":11931305,"kb_avail":719393460,"statfs":{"total":773094113280,"available":736658903040,"internally_reserved":0,"allocated":24112533504,"data_stored":24062076864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2906559,"internal_metadata":12217656897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":131,"apply_latency_ms":131,"commit_latency_ns":131000000,"apply_latency_ns":131000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36283882520,"num_objects":-31306,"num_object_clones":0,"num_object_copies":-62612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-31306,"num_whiteouts":0,"num_read":-1467137,"num_read_kb":-105747993,"num_write":-7466933,"num_write_kb":-160876526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2152,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.461007"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":506,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-19T17:14:26.012195+0000","last_change":"2024-02-19T06:57:45.353063+0000","last_active":"2024-02-19T17:14:26.012195+0000","last_peered":"2024-02-19T17:14:26.012195+0000","last_clean":"2024-02-19T17:14:26.012195+0000","last_became_active":"2024-02-19T06:57:45.350602+0000","last_became_peered":"2024-02-19T06:57:45.350602+0000","last_unstale":"2024-02-19T17:14:26.012195+0000","last_undegraded":"2024-02-19T17:14:26.012195+0000","last_fullsized":"2024-02-19T17:14:26.012195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_clean_scrub_stamp":"2024-02-19T06:57:44.230095+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:04:42.513180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424516845,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4435688,"kb_used_data":2633184,"kb_used_omap":46,"kb_used_meta":1785617,"kb_avail":89936152,"statfs":{"total":96636764160,"available":92094619648,"internally_reserved":0,"allocated":2696380416,"data_stored":2690574658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47262,"internal_metadata":1828472674},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":1.0229999999999999,"15min":0.99399999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.107,"5min":9.6859999999999999,"15min":9.6859999999999999},"last":1.246},{"interface":"front","average":{"1min":0.77900000000000003,"5min":1.1080000000000001,"15min":1.036},"min":{"1min":0.46000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.4159999999999999,"5min":12.372,"15min":12.372},"last":0.93000000000000005}]},{"osd":1,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.361,"15min":5.3079999999999998},"min":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.4660000000000002,"5min":29.341000000000001,"15min":1340.5419999999999},"last":1.7310000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.3140000000000001,"15min":5.3019999999999996},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.992,"5min":25.664999999999999,"15min":1340.414},"last":1.8220000000000001}]},{"osd":2,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.1419999999999999,"15min":1.071},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38500000000000001},"max":{"1min":1.6799999999999999,"5min":4.0709999999999997,"15min":6.4770000000000003},"last":1.758},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.292,"15min":1.2110000000000001},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.432},"max":{"1min":2.5059999999999998,"5min":11.471,"15min":11.471},"last":1.516}]},{"osd":3,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1739999999999999,"15min":1.242},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.2639999999999998,"5min":9.4450000000000003,"15min":9.4450000000000003},"last":1.9690000000000001},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.331,"15min":1.266},"min":{"1min":0.55900000000000005,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":2.5449999999999999,"5min":11.388,"15min":11.388},"last":2.137}]},{"osd":4,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.92500000000000004,"15min":0.95199999999999996},"min":{"1min":0.45900000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.121,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":1.355},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.093,"15min":1.036},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":2.331,"5min":10.106999999999999,"15min":10.106999999999999},"last":1.101}]},{"osd":5,"last update":"Mon Feb 19 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.113,"15min":1.089},"min":{"1min":0.41099999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.069,"5min":11.430999999999999,"15min":11.430999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.0209999999999999,"15min":1.0269999999999999},"min":{"1min":0.45600000000000002,"5min":0.441,"15min":0.441},"max":{"1min":3.327,"5min":5.391,"15min":5.391},"last":1.6859999999999999}]},{"osd":7,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.097,"15min":1.0760000000000001},"min":{"1min":0.55300000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.3700000000000001,"5min":9.9800000000000004,"15min":9.9800000000000004},"last":1.552},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.292,"15min":1.1910000000000001},"min":{"1min":0.66800000000000004,"5min":0.46400000000000002,"15min":0.46300000000000002},"max":{"1min":2.9079999999999999,"5min":12.414999999999999,"15min":12.414999999999999},"last":1.5880000000000001}]}]},{"osd":5,"up_from":15,"seq":64424516843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1426932,"kb_used_data":424,"kb_used_omap":473,"kb_used_meta":1426022,"kb_avail":92944908,"statfs":{"total":96636764160,"available":95175585792,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":484739,"internal_metadata":1460247165},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":1.0880000000000001,"15min":1.0640000000000001},"min":{"1min":0.34200000000000003,"5min":0.33000000000000002,"15min":0.27100000000000002},"max":{"1min":1.2330000000000001,"5min":9.8399999999999999,"15min":9.8399999999999999},"last":1.083},{"interface":"front","average":{"1min":1.083,"5min":1.2090000000000001,"15min":1.157},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.0919999999999996,"5min":5.1980000000000004,"15min":6.9539999999999997},"last":2.6179999999999999}]},{"osd":1,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.3380000000000001,"15min":3.8090000000000002},"min":{"1min":0.45300000000000001,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":1.1060000000000001,"5min":16.93,"15min":560.22000000000003},"last":2.468},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.345,"15min":3.8519999999999999},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.36199999999999999},"max":{"1min":3.7999999999999998,"5min":9.2360000000000007,"15min":559.36300000000006},"last":0.69899999999999995}]},{"osd":2,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4870000000000001,"15min":1.266},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":4.0129999999999999,"5min":23.012,"15min":23.012},"last":1.032},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.2809999999999999,"15min":1.2070000000000001},"min":{"1min":0.50800000000000001,"5min":0.432,"15min":0.41999999999999998},"max":{"1min":2.4380000000000002,"5min":5.4379999999999997,"15min":5.5529999999999999},"last":1.5149999999999999}]},{"osd":3,"last update":"Mon Feb 19 17:14:14 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.448,"15min":1.5209999999999999},"min":{"1min":0.53200000000000003,"5min":0.43099999999999999,"15min":0.41099999999999998},"max":{"1min":3.8969999999999998,"5min":23.094000000000001,"15min":78.207999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.75,"15min":1.667},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":4.0519999999999996,"5min":36.241999999999997,"15min":78.245000000000005},"last":2.0790000000000002}]},{"osd":4,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":1.091,"15min":0.97099999999999997},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":1.423,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.47},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.1919999999999999,"15min":1.0089999999999999},"min":{"1min":0.48099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.855,"5min":14.992000000000001,"15min":14.992000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1220000000000001,"15min":1.036},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":3.968,"5min":6.6989999999999998,"15min":6.6989999999999998},"last":1.7529999999999999},{"interface":"front","average":{"1min":0.997,"5min":1.3300000000000001,"15min":1.127},"min":{"1min":0.53200000000000003,"5min":0.47599999999999998,"15min":0.41399999999999998},"max":{"1min":3.3580000000000001,"5min":16.837,"15min":16.837},"last":2.2719999999999998}]},{"osd":7,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.173,"15min":1.0549999999999999},"min":{"1min":0.48699999999999999,"5min":0.46400000000000002,"15min":0.42899999999999999},"max":{"1min":3.9340000000000002,"5min":7.2969999999999997,"15min":7.2969999999999997},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.6459999999999999,"15min":1.2529999999999999},"min":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.39400000000000002},"max":{"1min":4.1289999999999996,"5min":35.945,"15min":35.945},"last":1.7090000000000001}]}]},{"osd":7,"up_from":14,"seq":60129549546,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6418160,"kb_used_data":5174628,"kb_used_omap":237,"kb_used_meta":1243282,"kb_avail":87953680,"statfs":{"total":96636764160,"available":90064568320,"internally_reserved":0,"allocated":5298819072,"data_stored":5288253325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":243426,"internal_metadata":1273121054},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":1.1639999999999999,"15min":1.5409999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":1.794,"5min":16.071999999999999,"15min":135.33099999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":1.736,"15min":1.75},"min":{"1min":0.39400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1,"5min":42.113,"15min":134.83000000000001},"last":1.6799999999999999}]},{"osd":1,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":1.109,"15min":2.823},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.806,"5min":14.302,"15min":440.32799999999997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.8080000000000001,"15min":3.0619999999999998},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.35399999999999998},"max":{"1min":1.8169999999999999,"5min":45.880000000000003,"15min":442.47500000000002},"last":4.6349999999999998}]},{"osd":2,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.7210000000000001,"15min":1.5609999999999999},"min":{"1min":0.443,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.863,"5min":45.709000000000003,"15min":77.938999999999993},"last":1.7450000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.5349999999999999,"15min":1.4870000000000001},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.38300000000000001},"max":{"1min":1.109,"5min":42.390999999999998,"15min":79.799000000000007},"last":1.956}]},{"osd":3,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":2.5059999999999998,"15min":1.8260000000000001},"min":{"1min":0.46200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.915,"5min":126.935,"15min":126.935},"last":1.399},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.3520000000000001,"15min":1.4590000000000001},"min":{"1min":0.48099999999999998,"5min":0.44800000000000001,"15min":0.41499999999999998},"max":{"1min":2.8319999999999999,"5min":14.634,"15min":72.626000000000005},"last":0.60599999999999998}]},{"osd":4,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":1.538,"15min":1.109},"min":{"1min":0.443,"5min":0.37,"15min":0.36399999999999999},"max":{"1min":1.4259999999999999,"5min":42.188000000000002,"15min":42.188000000000002},"last":1.2390000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.121,"15min":0.98099999999999998},"min":{"1min":0.45000000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.8480000000000001,"5min":22.009,"15min":22.009},"last":1.3540000000000001}]},{"osd":5,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":1.655,"15min":1.22},"min":{"1min":0.55000000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.5579999999999998,"5min":68.173000000000002,"15min":68.173000000000002},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":2.1000000000000001,"15min":1.343},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.436},"max":{"1min":1.7849999999999999,"5min":45.917999999999999,"15min":45.917999999999999},"last":1.1970000000000001}]},{"osd":6,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.716,"15min":1.2569999999999999},"min":{"1min":0.53500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.8799999999999999,"5min":67.986999999999995,"15min":67.986999999999995},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.288,"15min":1.131},"min":{"1min":0.70599999999999996,"5min":0.48799999999999999,"15min":0.47999999999999998},"max":{"1min":2.1819999999999999,"5min":13.959,"15min":13.959},"last":1.2829999999999999}]}]},{"osd":4,"up_from":14,"seq":60129549545,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":3476768,"kb_used_data":1827424,"kb_used_omap":500,"kb_used_meta":1594763,"kb_avail":90895072,"statfs":{"total":96636764160,"available":93076553728,"internally_reserved":0,"allocated":1871282176,"data_stored":1867064203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":512202,"internal_metadata":1633038134},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2450000000000001,"15min":1.0880000000000001},"min":{"1min":0.32400000000000001,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":4.3840000000000003,"5min":28.562999999999999,"15min":28.562999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.113,"15min":1.0509999999999999},"min":{"1min":0.443,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.6429999999999998,"5min":13.212,"15min":13.212},"last":1.2130000000000001}]},{"osd":1,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2669999999999999,"15min":6.7649999999999997},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.34499999999999997},"max":{"1min":4.3719999999999999,"5min":28.440000000000001,"15min":1591.5709999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.111,"15min":6.7800000000000002},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":4.3109999999999999,"5min":4.3109999999999999,"15min":1590.9179999999999},"last":1.252}]},{"osd":2,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.343,"15min":1.151},"min":{"1min":0.433,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":9.077,"5min":16.189,"15min":16.189},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.044,"15min":1.167},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.5150000000000001,"5min":5.8680000000000003,"15min":6.0190000000000001},"last":0.92500000000000004}]},{"osd":3,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.339,"15min":1.169},"min":{"1min":0.55900000000000005,"5min":0.45900000000000002,"15min":0.432},"max":{"1min":4.7290000000000001,"5min":16.074999999999999,"15min":16.074999999999999},"last":1.169},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1799999999999999,"15min":1.2050000000000001},"min":{"1min":0.45100000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.4550000000000001,"5min":5.907,"15min":5.9390000000000001},"last":1.044}]},{"osd":5,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":0.96399999999999997,"15min":0.94899999999999995},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.38900000000000001},"max":{"1min":7.5620000000000003,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":1.143},{"interface":"front","average":{"1min":1.339,"5min":1.0800000000000001,"15min":1.0309999999999999},"min":{"1min":0.45800000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.7039999999999997,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":1.286}]},{"osd":6,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.179,"15min":0.999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":7.6440000000000001,"5min":16.228999999999999,"15min":16.228999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.048,"15min":0.99299999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.40500000000000003},"max":{"1min":4.8680000000000003,"5min":4.8680000000000003,"15min":6.0549999999999997},"last":1.0049999999999999}]},{"osd":7,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.111,"15min":1.0900000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.49199999999999999},"max":{"1min":4.556,"5min":4.556,"15min":5.415},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.3220000000000001,"15min":1.1180000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":8.5350000000000001,"5min":16.149999999999999,"15min":16.149999999999999},"last":1.3420000000000001}]}]},{"osd":3,"up_from":14,"seq":60129549517,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2579708,"kb_used_data":1028600,"kb_used_omap":50,"kb_used_meta":1522317,"kb_avail":91792132,"statfs":{"total":96636764160,"available":93995143168,"internally_reserved":0,"allocated":1053286400,"data_stored":1050707602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51317,"internal_metadata":1558853515},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:28 2024","interfaces":[{"interface":"back","average":{"1min":2.1110000000000002,"5min":1.3540000000000001,"15min":1.371},"min":{"1min":0.36899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":14.741,"5min":14.741,"15min":14.741},"last":14.741},{"interface":"front","average":{"1min":1.8240000000000001,"5min":1.3220000000000001,"15min":1.3999999999999999},"min":{"1min":0.39000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.8019999999999996,"5min":8.8019999999999996,"15min":8.8019999999999996},"last":8.8019999999999996}]},{"osd":1,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":1.5209999999999999,"15min":2.7069999999999999},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":2.6299999999999999,"5min":23.510000000000002,"15min":278.68099999999998},"last":9.6980000000000004},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.427,"15min":2.7519999999999998},"min":{"1min":0.41599999999999998,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":2.5910000000000002,"5min":8.0559999999999992,"15min":279.06599999999997},"last":10.582000000000001}]},{"osd":2,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":2.7389999999999999,"15min":2.0760000000000001},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.351,"5min":121.10299999999999,"15min":121.10299999999999},"last":14.67},{"interface":"front","average":{"1min":0.91100000000000003,"5min":2.6320000000000001,"15min":1.986},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.33800000000000002},"max":{"1min":2.0470000000000002,"5min":118.05800000000001,"15min":118.05800000000001},"last":8.7639999999999993}]},{"osd":4,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.788,"15min":1.627},"min":{"1min":0.43099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.153,"5min":35.975999999999999,"15min":35.975999999999999},"last":5.3109999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.556,"15min":1.637},"min":{"1min":0.48799999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.2519999999999998,"5min":12.666,"15min":12.666},"last":14.837}]},{"osd":5,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.536,"15min":1.5720000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.9860000000000002,"5min":8.7669999999999995,"15min":8.7669999999999995},"last":9.7680000000000007},{"interface":"front","average":{"1min":1.306,"5min":1.5600000000000001,"15min":1.667},"min":{"1min":0.79900000000000004,"5min":0.498,"15min":0.48699999999999999},"max":{"1min":2.1930000000000001,"5min":8.8819999999999997,"15min":8.8819999999999997},"last":14.794}]},{"osd":6,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.546,"15min":1.6839999999999999},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.47099999999999997},"max":{"1min":2.8719999999999999,"5min":9.0860000000000003,"15min":9.0860000000000003},"last":5.3579999999999997},{"interface":"front","average":{"1min":1.335,"5min":1.575,"15min":1.651},"min":{"1min":0.64100000000000001,"5min":0.59499999999999997,"15min":0.53800000000000003},"max":{"1min":3.7530000000000001,"5min":15.616,"15min":15.616},"last":9.6310000000000002}]},{"osd":7,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.516,"15min":1.7150000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48799999999999999},"max":{"1min":3.9009999999999998,"5min":10.589,"15min":10.589},"last":8.8369999999999997},{"interface":"front","average":{"1min":1.393,"5min":1.5369999999999999,"15min":1.6990000000000001},"min":{"1min":0.71999999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":4.8109999999999999,"5min":7.3780000000000001,"15min":7.3780000000000001},"last":5.1989999999999998}]}]},{"osd":2,"up_from":14,"seq":60129549532,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5729216,"kb_used_data":3967412,"kb_used_omap":768,"kb_used_meta":1761023,"kb_avail":88642624,"statfs":{"total":96636764160,"available":90770046976,"internally_reserved":0,"allocated":4062629888,"data_stored":4054402925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":786953,"internal_metadata":1803288055},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.99399999999999999,"15min":1.417},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":2.8839999999999999,"5min":6.6719999999999997,"15min":65.132000000000005},"last":1.3740000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.1599999999999999,"15min":1.591},"min":{"1min":0.39700000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.4510000000000001,"5min":11.308999999999999,"15min":70.902000000000001},"last":0.91200000000000003}]},{"osd":1,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.4990000000000001,"15min":5.6379999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.71,"5min":11.342000000000001,"15min":1038.0440000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":1.419,"15min":5.5419999999999998},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.33600000000000002},"max":{"1min":1.6899999999999999,"5min":8.0749999999999993,"15min":1037.0899999999999},"last":1.2390000000000001}]},{"osd":3,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.218,"15min":1.427},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.29299999999999998},"max":{"1min":1.7410000000000001,"5min":5.0629999999999997,"15min":7.71},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.573,"15min":1.6839999999999999},"min":{"1min":0.57999999999999996,"5min":0.44,"15min":0.318},"max":{"1min":2.6699999999999999,"5min":11.372,"15min":11.816000000000001},"last":1.27}]},{"osd":4,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.794,"15min":2.2229999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.581,"5min":26.771000000000001,"15min":189.965},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.716,"15min":2.1680000000000001},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.41199999999999998},"max":{"1min":2.46,"5min":27.465,"15min":193.35400000000001},"last":1.448}]},{"osd":5,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.212,"15min":1.395},"min":{"1min":0.54000000000000004,"5min":0.44500000000000001,"15min":0.38500000000000001},"max":{"1min":2.8650000000000002,"5min":5.024,"15min":6.6159999999999997},"last":1.097},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.556,"15min":1.5980000000000001},"min":{"1min":0.749,"5min":0.59899999999999998,"15min":0.52100000000000002},"max":{"1min":3.831,"5min":11.218999999999999,"15min":11.218999999999999},"last":1.2110000000000001}]},{"osd":6,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.5680000000000001,"15min":1.514},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9690000000000001,"5min":6.6319999999999997,"15min":6.6319999999999997},"last":1.506},{"interface":"front","average":{"1min":1.202,"5min":1.3460000000000001,"15min":1.5069999999999999},"min":{"1min":0.501,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.8180000000000001,"5min":7.9409999999999998,"15min":7.9409999999999998},"last":0.998}]},{"osd":7,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.534,"15min":1.5669999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.46300000000000002},"max":{"1min":3.8090000000000002,"5min":5.5049999999999999,"15min":6.1680000000000001},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.556,"15min":1.589},"min":{"1min":0.68500000000000005,"5min":0.63,"15min":0.435},"max":{"1min":2.2290000000000001,"5min":23.437000000000001,"15min":23.437000000000001},"last":1.1830000000000001}]}]},{"osd":1,"up_from":14,"seq":60129549521,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7022300,"kb_used_data":5301264,"kb_used_omap":490,"kb_used_meta":1720533,"kb_avail":87349540,"statfs":{"total":96636764160,"available":89445928960,"internally_reserved":0,"allocated":5428494336,"data_stored":5416968797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":502102,"internal_metadata":1761826474},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":1.3460000000000001,"15min":1.296},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":2.2149999999999999,"5min":14.206,"15min":14.206},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":1.5069999999999999,"15min":1.367},"min":{"1min":0.41199999999999998,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":2.056,"5min":14.311,"15min":14.311},"last":0.96399999999999997}]},{"osd":2,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.3109999999999999,"15min":1.663},"min":{"1min":0.41899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.4649999999999999,"5min":13.16,"15min":82.034999999999997},"last":1.9530000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.6100000000000001,"15min":1.8580000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32000000000000001},"max":{"1min":3.407,"5min":13.068,"15min":83.215999999999994},"last":1.2889999999999999}]},{"osd":3,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.8160000000000001,"15min":1.972},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.37},"max":{"1min":3.536,"5min":9.5449999999999999,"15min":79.706999999999994},"last":1.016},{"interface":"front","average":{"1min":1.02,"5min":1.8009999999999999,"15min":1.9059999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.782,"5min":18.905000000000001,"15min":84.069000000000003},"last":1.2150000000000001}]},{"osd":4,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.4830000000000001,"15min":1.4419999999999999},"min":{"1min":0.46700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.2010000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":1.506},{"interface":"front","average":{"1min":1.139,"5min":1.5209999999999999,"15min":1.472},"min":{"1min":0.55600000000000005,"5min":0.46400000000000002,"15min":0.39900000000000002},"max":{"1min":3.6640000000000001,"5min":13.253,"15min":13.253},"last":2.2930000000000001}]},{"osd":5,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.6799999999999999,"15min":1.651},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.47599999999999998},"max":{"1min":3.3519999999999999,"5min":13.005000000000001,"15min":13.760999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.6259999999999999,"15min":1.516},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":3.2429999999999999,"5min":9.8770000000000007,"15min":9.8770000000000007},"last":1.631}]},{"osd":6,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.5800000000000001,"15min":1.54},"min":{"1min":0.51000000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.6779999999999999,"5min":13.206,"15min":13.206},"last":2.3319999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.609,"15min":1.6359999999999999},"min":{"1min":0.54600000000000004,"5min":0.496,"15min":0.496},"max":{"1min":3.4449999999999998,"5min":9.125,"15min":13.862},"last":1.3779999999999999}]},{"osd":7,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.6020000000000001,"15min":1.585},"min":{"1min":0.64200000000000002,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":2.7490000000000001,"5min":13.311999999999999,"15min":13.311999999999999},"last":2.488},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.7490000000000001,"15min":1.7569999999999999},"min":{"1min":0.59799999999999998,"5min":0.53300000000000003,"15min":0.52200000000000002},"max":{"1min":3.4940000000000002,"5min":13.115,"15min":13.819000000000001},"last":1.5489999999999999}]}]},{"osd":0,"up_from":14,"seq":60129549541,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4492488,"kb_used_data":3614460,"kb_used_omap":272,"kb_used_meta":877743,"kb_avail":89879352,"statfs":{"total":96636764160,"available":92036456448,"internally_reserved":0,"allocated":3701207040,"data_stored":3693933889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":278558,"internal_metadata":898809826},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":1.431,"15min":1.3240000000000001},"min":{"1min":0.29599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.0219999999999998,"5min":20.481999999999999,"15min":20.481999999999999},"last":1.101},{"interface":"front","average":{"1min":0.79900000000000004,"5min":1.204,"15min":1.3899999999999999},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":1.613,"5min":5.6619999999999999,"15min":7.8680000000000003},"last":1.4890000000000001}]},{"osd":2,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":1.331,"15min":1.2989999999999999},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.30599999999999999},"max":{"1min":2.0910000000000002,"5min":5.3289999999999997,"15min":5.8490000000000002},"last":1.143},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.5820000000000001,"15min":1.452},"min":{"1min":0.36699999999999999,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":1.357,"5min":28.132999999999999,"15min":28.132999999999999},"last":0.89700000000000002}]},{"osd":3,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":1.635,"15min":1.411},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":1.466,"5min":12.734,"15min":12.734},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":2.153,"15min":1.7509999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.34699999999999998},"max":{"1min":3.141,"5min":21.021999999999998,"15min":21.021999999999998},"last":0.745}]},{"osd":4,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":1.732,"15min":1.504},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.516,"5min":13.388,"15min":13.388},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.5920000000000001,"15min":1.4570000000000001},"min":{"1min":0.55200000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.0579999999999998,"5min":10.034000000000001,"15min":10.034000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.466,"15min":1.5229999999999999},"min":{"1min":0.53400000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.069,"5min":7.9370000000000003,"15min":7.9370000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.6379999999999999,"15min":1.498},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.496},"max":{"1min":2.9830000000000001,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":0.78500000000000003}]},{"osd":6,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.494,"15min":1.5309999999999999},"min":{"1min":0.61899999999999999,"5min":0.49099999999999999,"15min":0.46200000000000002},"max":{"1min":2.5760000000000001,"5min":10.573,"15min":10.573},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.7290000000000001,"15min":1.5780000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":1.5529999999999999,"5min":15.301,"15min":15.301},"last":0.69299999999999995}]},{"osd":7,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.681,"15min":1.651},"min":{"1min":0.63100000000000001,"5min":0.50700000000000001,"15min":0.45700000000000002},"max":{"1min":1.994,"5min":17.152000000000001,"15min":17.152000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.6080000000000001,"15min":1.502},"min":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.52000000000000002},"max":{"1min":1.585,"5min":11.932,"15min":11.932},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T17:14:31.213 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-19T17:14:31.213 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-19T17:14:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.441+0000 7f7e13200640 1 Processor -- start 2024-02-19T17:14:31.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.441+0000 7f7e13200640 1 -- start start 2024-02-19T17:14:31.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.442+0000 7f7e13200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7e1415b540 0x7f7e140cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.442+0000 7f7e13200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e140cb150 0x7f7e140cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.442+0000 7f7e13200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140cb5f0 con 0x7f7e1415fd50 2024-02-19T17:14:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.442+0000 7f7e13200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1415f270 con 0x7f7e1415b540 2024-02-19T17:14:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.442+0000 7f7e13200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1415f550 con 0x7f7e140cb150 2024-02-19T17:14:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.442+0000 7f7e11e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7e1415b540 0x7f7e140cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.443+0000 7f7e11e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7e1415b540 0x7f7e140cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43868/0 (socket says 172.21.15.46:43868) 2024-02-19T17:14:31.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.443+0000 7f7e11e00640 1 -- 172.21.15.46:0/2685474713 learned_addr learned my addr 172.21.15.46:0/2685474713 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:31.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.443+0000 7f7e0be00640 1 --2- 172.21.15.46:0/2685474713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e140cb150 0x7f7e140cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:31.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.443+0000 7f7e11e00640 1 -- 172.21.15.46:0/2685474713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e140cb150 msgr2=0x7f7e140cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:31.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.443+0000 7f7e11e00640 1 --2- 172.21.15.46:0/2685474713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e140cb150 0x7f7e140cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.443+0000 7f7e11e00640 1 -- 172.21.15.46:0/2685474713 >> v1:172.21.15.142:6789/0 conn(0x7f7e1415fd50 legacy=0x7f7e140c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:31.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.443+0000 7f7e11e00640 1 -- 172.21.15.46:0/2685474713 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1415f830 con 0x7f7e1415b540 2024-02-19T17:14:31.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.444+0000 7f7e11e00640 1 --2- 172.21.15.46:0/2685474713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e1415b540 0x7f7e140cac10 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009870 tx=0x7f7e0402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854196e71532fa3 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:31.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.445+0000 7f7e11400640 1 -- 172.21.15.46:0/2685474713 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04031640 con 0x7f7e1415b540 2024-02-19T17:14:31.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.445+0000 7f7e11400640 1 -- 172.21.15.46:0/2685474713 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e040317a0 con 0x7f7e1415b540 2024-02-19T17:14:31.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.445+0000 7f7e11400640 1 -- 172.21.15.46:0/2685474713 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04031b30 con 0x7f7e1415b540 2024-02-19T17:14:31.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.445+0000 7f7e13200640 1 -- 172.21.15.46:0/2685474713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e1415b540 msgr2=0x7f7e140cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:31.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.445+0000 7f7e13200640 1 --2- 172.21.15.46:0/2685474713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e1415b540 0x7f7e140cac10 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009870 tx=0x7f7e0402b8f0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.445+0000 7f7e13200640 1 -- 172.21.15.46:0/2685474713 shutdown_connections 2024-02-19T17:14:31.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.445+0000 7f7e13200640 1 --2- 172.21.15.46:0/2685474713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e140cb150 0x7f7e140cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.445+0000 7f7e13200640 1 --2- 172.21.15.46:0/2685474713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e1415b540 0x7f7e140cac10 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.445+0000 7f7e13200640 1 -- 172.21.15.46:0/2685474713 >> 172.21.15.46:0/2685474713 conn(0x7f7e1406afa0 msgr2=0x7f7e1406b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:31.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.445+0000 7f7e13200640 1 -- 172.21.15.46:0/2685474713 shutdown_connections 2024-02-19T17:14:31.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.445+0000 7f7e13200640 1 -- 172.21.15.46:0/2685474713 wait complete. 2024-02-19T17:14:31.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.447+0000 7f7e13200640 1 Processor -- start 2024-02-19T17:14:31.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.447+0000 7f7e13200640 1 -- start start 2024-02-19T17:14:31.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.448+0000 7f7e13200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e140cb150 0x7f7e140acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.448+0000 7f7e13200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e1415b540 0x7f7e140b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.448+0000 7f7e13200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e1415fd50 0x7f7e140b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.448+0000 7f7e13200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140ad380 con 0x7f7e1415b540 2024-02-19T17:14:31.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.448+0000 7f7e13200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140ad660 con 0x7f7e1415fd50 2024-02-19T17:14:31.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.448+0000 7f7e13200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140ad940 con 0x7f7e140cb150 2024-02-19T17:14:31.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.449+0000 7f7e0be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e1415b540 0x7f7e140b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.449+0000 7f7e0be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e1415b540 0x7f7e140b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43878/0 (socket says 172.21.15.46:43878) 2024-02-19T17:14:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.449+0000 7f7e0be00640 1 -- 172.21.15.46:0/969204129 learned_addr learned my addr 172.21.15.46:0/969204129 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.449+0000 7f7e11e00640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e140cb150 0x7f7e140acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.449+0000 7f7e12800640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e1415fd50 0x7f7e140b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.449+0000 7f7e0be00640 1 -- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e140cb150 msgr2=0x7f7e140acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.449+0000 7f7e0be00640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e140cb150 0x7f7e140acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.449+0000 7f7e0be00640 1 -- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e1415fd50 msgr2=0x7f7e140b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.449+0000 7f7e0be00640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e1415fd50 0x7f7e140b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.449+0000 7f7e0be00640 1 -- 172.21.15.46:0/969204129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040094d0 con 0x7f7e1415b540 2024-02-19T17:14:31.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.450+0000 7f7e0be00640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e1415b540 0x7f7e140b1330 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00d800 tx=0x7f7dfc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:31.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.450+0000 7f7e0a000640 1 -- 172.21.15.46:0/969204129 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc00b6c0 con 0x7f7e1415b540 2024-02-19T17:14:31.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.450+0000 7f7e0a000640 1 -- 172.21.15.46:0/969204129 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc00b820 con 0x7f7e1415b540 2024-02-19T17:14:31.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.450+0000 7f7e13200640 1 -- 172.21.15.46:0/969204129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e140adc20 con 0x7f7e1415b540 2024-02-19T17:14:31.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.450+0000 7f7e0a000640 1 -- 172.21.15.46:0/969204129 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc00bbb0 con 0x7f7e1415b540 2024-02-19T17:14:31.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.450+0000 7f7e13200640 1 -- 172.21.15.46:0/969204129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e140ad090 con 0x7f7e1415b540 2024-02-19T17:14:31.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.451+0000 7f7e13200640 1 -- 172.21.15.46:0/969204129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1406b9b0 con 0x7f7e1415b540 2024-02-19T17:14:31.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.452+0000 7f7e0a000640 1 -- 172.21.15.46:0/969204129 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7dfc00bd10 con 0x7f7e1415b540 2024-02-19T17:14:31.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.453+0000 7f7e0a000640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7df006b810 0x7f7df006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.453+0000 7f7e0a000640 1 -- 172.21.15.46:0/969204129 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7dfc08a370 con 0x7f7e1415b540 2024-02-19T17:14:31.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.454+0000 7f7e11e00640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7df006b810 0x7f7df006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:31.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.455+0000 7f7e11e00640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7df006b810 0x7f7df006dcd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f7e04036000 tx=0x7f7e0403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:31.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.458+0000 7f7e0a000640 1 -- 172.21.15.46:0/969204129 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7dfc055080 con 0x7f7e1415b540 2024-02-19T17:14:31.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.652+0000 7f7e13200640 1 -- 172.21.15.46:0/969204129 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e1415c930 con 0x7f7df006b810 2024-02-19T17:14:31.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.660+0000 7f7e0a000640 1 -- 172.21.15.46:0/969204129 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48833 (secure 0 0 0) 0x7f7e04044400 con 0x7f7df006b810 2024-02-19T17:14:31.646 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:31.647 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-02-19T17:14:31.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.662+0000 7f7e13200640 1 -- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7df006b810 msgr2=0x7f7df006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:31.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.662+0000 7f7e13200640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7df006b810 0x7f7df006dcd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f7e04036000 tx=0x7f7e0403c040 comp rx=0 tx=0).stop 2024-02-19T17:14:31.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.662+0000 7f7e13200640 1 -- 172.21.15.46:0/969204129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e1415b540 msgr2=0x7f7e140b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:31.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.662+0000 7f7e13200640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e1415b540 0x7f7e140b1330 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00d800 tx=0x7f7dfc00dcc0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.663+0000 7f7e13200640 1 -- 172.21.15.46:0/969204129 shutdown_connections 2024-02-19T17:14:31.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.663+0000 7f7e13200640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f7df006b810 0x7f7df006dcd0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.663+0000 7f7e13200640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e1415fd50 0x7f7e140b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.663+0000 7f7e13200640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e1415b540 0x7f7e140b1330 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.663+0000 7f7e13200640 1 --2- 172.21.15.46:0/969204129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e140cb150 0x7f7e140acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.663+0000 7f7e13200640 1 -- 172.21.15.46:0/969204129 >> 172.21.15.46:0/969204129 conn(0x7f7e1406afa0 msgr2=0x7f7e140b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:31.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.663+0000 7f7e13200640 1 -- 172.21.15.46:0/969204129 shutdown_connections 2024-02-19T17:14:31.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.663+0000 7f7e13200640 1 -- 172.21.15.46:0/969204129 wait complete. 2024-02-19T17:14:31.668 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":18528,"stamp":"2024-02-19T17:14:30.477855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":35581260,"kb_used_data":23547396,"kb_used_omap":2838,"kb_used_meta":11931305,"kb_avail":719393460,"statfs":{"total":773094113280,"available":736658903040,"internally_reserved":0,"allocated":24112533504,"data_stored":24062076864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2906559,"internal_metadata":12217656897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":131,"apply_latency_ms":131,"commit_latency_ns":131000000,"apply_latency_ns":131000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36283882520,"num_objects":-31306,"num_object_clones":0,"num_object_copies":-62612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-31306,"num_whiteouts":0,"num_read":-1467137,"num_read_kb":-105747993,"num_write":-7466933,"num_write_kb":-160876526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2152,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.461007"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":506,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-02-19T17:14:26.012195+0000","last_change":"2024-02-19T06:57:45.353063+0000","last_active":"2024-02-19T17:14:26.012195+0000","last_peered":"2024-02-19T17:14:26.012195+0000","last_clean":"2024-02-19T17:14:26.012195+0000","last_became_active":"2024-02-19T06:57:45.350602+0000","last_became_peered":"2024-02-19T06:57:45.350602+0000","last_unstale":"2024-02-19T17:14:26.012195+0000","last_undegraded":"2024-02-19T17:14:26.012195+0000","last_fullsized":"2024-02-19T17:14:26.012195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_clean_scrub_stamp":"2024-02-19T06:57:44.230095+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:04:42.513180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424516845,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4435688,"kb_used_data":2633184,"kb_used_omap":46,"kb_used_meta":1785617,"kb_avail":89936152,"statfs":{"total":96636764160,"available":92094619648,"internally_reserved":0,"allocated":2696380416,"data_stored":2690574658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47262,"internal_metadata":1828472674},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":1.0229999999999999,"15min":0.99399999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.107,"5min":9.6859999999999999,"15min":9.6859999999999999},"last":1.246},{"interface":"front","average":{"1min":0.77900000000000003,"5min":1.1080000000000001,"15min":1.036},"min":{"1min":0.46000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.4159999999999999,"5min":12.372,"15min":12.372},"last":0.93000000000000005}]},{"osd":1,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.361,"15min":5.3079999999999998},"min":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.4660000000000002,"5min":29.341000000000001,"15min":1340.5419999999999},"last":1.7310000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.3140000000000001,"15min":5.3019999999999996},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.992,"5min":25.664999999999999,"15min":1340.414},"last":1.8220000000000001}]},{"osd":2,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.1419999999999999,"15min":1.071},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38500000000000001},"max":{"1min":1.6799999999999999,"5min":4.0709999999999997,"15min":6.4770000000000003},"last":1.758},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.292,"15min":1.2110000000000001},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.432},"max":{"1min":2.5059999999999998,"5min":11.471,"15min":11.471},"last":1.516}]},{"osd":3,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1739999999999999,"15min":1.242},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.2639999999999998,"5min":9.4450000000000003,"15min":9.4450000000000003},"last":1.9690000000000001},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.331,"15min":1.266},"min":{"1min":0.55900000000000005,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":2.5449999999999999,"5min":11.388,"15min":11.388},"last":2.137}]},{"osd":4,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.92500000000000004,"15min":0.95199999999999996},"min":{"1min":0.45900000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.121,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":1.355},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.093,"15min":1.036},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":2.331,"5min":10.106999999999999,"15min":10.106999999999999},"last":1.101}]},{"osd":5,"last update":"Mon Feb 19 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.113,"15min":1.089},"min":{"1min":0.41099999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.069,"5min":11.430999999999999,"15min":11.430999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.0209999999999999,"15min":1.0269999999999999},"min":{"1min":0.45600000000000002,"5min":0.441,"15min":0.441},"max":{"1min":3.327,"5min":5.391,"15min":5.391},"last":1.6859999999999999}]},{"osd":7,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.097,"15min":1.0760000000000001},"min":{"1min":0.55300000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.3700000000000001,"5min":9.9800000000000004,"15min":9.9800000000000004},"last":1.552},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.292,"15min":1.1910000000000001},"min":{"1min":0.66800000000000004,"5min":0.46400000000000002,"15min":0.46300000000000002},"max":{"1min":2.9079999999999999,"5min":12.414999999999999,"15min":12.414999999999999},"last":1.5880000000000001}]}]},{"osd":5,"up_from":15,"seq":64424516843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1426932,"kb_used_data":424,"kb_used_omap":473,"kb_used_meta":1426022,"kb_avail":92944908,"statfs":{"total":96636764160,"available":95175585792,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":484739,"internal_metadata":1460247165},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":1.0880000000000001,"15min":1.0640000000000001},"min":{"1min":0.34200000000000003,"5min":0.33000000000000002,"15min":0.27100000000000002},"max":{"1min":1.2330000000000001,"5min":9.8399999999999999,"15min":9.8399999999999999},"last":1.083},{"interface":"front","average":{"1min":1.083,"5min":1.2090000000000001,"15min":1.157},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.0919999999999996,"5min":5.1980000000000004,"15min":6.9539999999999997},"last":2.6179999999999999}]},{"osd":1,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.3380000000000001,"15min":3.8090000000000002},"min":{"1min":0.45300000000000001,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":1.1060000000000001,"5min":16.93,"15min":560.22000000000003},"last":2.468},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.345,"15min":3.8519999999999999},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.36199999999999999},"max":{"1min":3.7999999999999998,"5min":9.2360000000000007,"15min":559.36300000000006},"last":0.69899999999999995}]},{"osd":2,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4870000000000001,"15min":1.266},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":4.0129999999999999,"5min":23.012,"15min":23.012},"last":1.032},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.2809999999999999,"15min":1.2070000000000001},"min":{"1min":0.50800000000000001,"5min":0.432,"15min":0.41999999999999998},"max":{"1min":2.4380000000000002,"5min":5.4379999999999997,"15min":5.5529999999999999},"last":1.5149999999999999}]},{"osd":3,"last update":"Mon Feb 19 17:14:14 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.448,"15min":1.5209999999999999},"min":{"1min":0.53200000000000003,"5min":0.43099999999999999,"15min":0.41099999999999998},"max":{"1min":3.8969999999999998,"5min":23.094000000000001,"15min":78.207999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.75,"15min":1.667},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":4.0519999999999996,"5min":36.241999999999997,"15min":78.245000000000005},"last":2.0790000000000002}]},{"osd":4,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":1.091,"15min":0.97099999999999997},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":1.423,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.47},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.1919999999999999,"15min":1.0089999999999999},"min":{"1min":0.48099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.855,"5min":14.992000000000001,"15min":14.992000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1220000000000001,"15min":1.036},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":3.968,"5min":6.6989999999999998,"15min":6.6989999999999998},"last":1.7529999999999999},{"interface":"front","average":{"1min":0.997,"5min":1.3300000000000001,"15min":1.127},"min":{"1min":0.53200000000000003,"5min":0.47599999999999998,"15min":0.41399999999999998},"max":{"1min":3.3580000000000001,"5min":16.837,"15min":16.837},"last":2.2719999999999998}]},{"osd":7,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.173,"15min":1.0549999999999999},"min":{"1min":0.48699999999999999,"5min":0.46400000000000002,"15min":0.42899999999999999},"max":{"1min":3.9340000000000002,"5min":7.2969999999999997,"15min":7.2969999999999997},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.6459999999999999,"15min":1.2529999999999999},"min":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.39400000000000002},"max":{"1min":4.1289999999999996,"5min":35.945,"15min":35.945},"last":1.7090000000000001}]}]},{"osd":7,"up_from":14,"seq":60129549546,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6418160,"kb_used_data":5174628,"kb_used_omap":237,"kb_used_meta":1243282,"kb_avail":87953680,"statfs":{"total":96636764160,"available":90064568320,"internally_reserved":0,"allocated":5298819072,"data_stored":5288253325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":243426,"internal_metadata":1273121054},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":1.1639999999999999,"15min":1.5409999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":1.794,"5min":16.071999999999999,"15min":135.33099999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":1.736,"15min":1.75},"min":{"1min":0.39400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1,"5min":42.113,"15min":134.83000000000001},"last":1.6799999999999999}]},{"osd":1,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":1.109,"15min":2.823},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.806,"5min":14.302,"15min":440.32799999999997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.8080000000000001,"15min":3.0619999999999998},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.35399999999999998},"max":{"1min":1.8169999999999999,"5min":45.880000000000003,"15min":442.47500000000002},"last":4.6349999999999998}]},{"osd":2,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.7210000000000001,"15min":1.5609999999999999},"min":{"1min":0.443,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.863,"5min":45.709000000000003,"15min":77.938999999999993},"last":1.7450000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.5349999999999999,"15min":1.4870000000000001},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.38300000000000001},"max":{"1min":1.109,"5min":42.390999999999998,"15min":79.799000000000007},"last":1.956}]},{"osd":3,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":2.5059999999999998,"15min":1.8260000000000001},"min":{"1min":0.46200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.915,"5min":126.935,"15min":126.935},"last":1.399},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.3520000000000001,"15min":1.4590000000000001},"min":{"1min":0.48099999999999998,"5min":0.44800000000000001,"15min":0.41499999999999998},"max":{"1min":2.8319999999999999,"5min":14.634,"15min":72.626000000000005},"last":0.60599999999999998}]},{"osd":4,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":1.538,"15min":1.109},"min":{"1min":0.443,"5min":0.37,"15min":0.36399999999999999},"max":{"1min":1.4259999999999999,"5min":42.188000000000002,"15min":42.188000000000002},"last":1.2390000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.121,"15min":0.98099999999999998},"min":{"1min":0.45000000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.8480000000000001,"5min":22.009,"15min":22.009},"last":1.3540000000000001}]},{"osd":5,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":1.655,"15min":1.22},"min":{"1min":0.55000000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.5579999999999998,"5min":68.173000000000002,"15min":68.173000000000002},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":2.1000000000000001,"15min":1.343},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.436},"max":{"1min":1.7849999999999999,"5min":45.917999999999999,"15min":45.917999999999999},"last":1.1970000000000001}]},{"osd":6,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.716,"15min":1.2569999999999999},"min":{"1min":0.53500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.8799999999999999,"5min":67.986999999999995,"15min":67.986999999999995},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.288,"15min":1.131},"min":{"1min":0.70599999999999996,"5min":0.48799999999999999,"15min":0.47999999999999998},"max":{"1min":2.1819999999999999,"5min":13.959,"15min":13.959},"last":1.2829999999999999}]}]},{"osd":4,"up_from":14,"seq":60129549545,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":3476768,"kb_used_data":1827424,"kb_used_omap":500,"kb_used_meta":1594763,"kb_avail":90895072,"statfs":{"total":96636764160,"available":93076553728,"internally_reserved":0,"allocated":1871282176,"data_stored":1867064203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":512202,"internal_metadata":1633038134},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2450000000000001,"15min":1.0880000000000001},"min":{"1min":0.32400000000000001,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":4.3840000000000003,"5min":28.562999999999999,"15min":28.562999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.113,"15min":1.0509999999999999},"min":{"1min":0.443,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.6429999999999998,"5min":13.212,"15min":13.212},"last":1.2130000000000001}]},{"osd":1,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2669999999999999,"15min":6.7649999999999997},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.34499999999999997},"max":{"1min":4.3719999999999999,"5min":28.440000000000001,"15min":1591.5709999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.111,"15min":6.7800000000000002},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":4.3109999999999999,"5min":4.3109999999999999,"15min":1590.9179999999999},"last":1.252}]},{"osd":2,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.343,"15min":1.151},"min":{"1min":0.433,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":9.077,"5min":16.189,"15min":16.189},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.044,"15min":1.167},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.5150000000000001,"5min":5.8680000000000003,"15min":6.0190000000000001},"last":0.92500000000000004}]},{"osd":3,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.339,"15min":1.169},"min":{"1min":0.55900000000000005,"5min":0.45900000000000002,"15min":0.432},"max":{"1min":4.7290000000000001,"5min":16.074999999999999,"15min":16.074999999999999},"last":1.169},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1799999999999999,"15min":1.2050000000000001},"min":{"1min":0.45100000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.4550000000000001,"5min":5.907,"15min":5.9390000000000001},"last":1.044}]},{"osd":5,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":0.96399999999999997,"15min":0.94899999999999995},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.38900000000000001},"max":{"1min":7.5620000000000003,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":1.143},{"interface":"front","average":{"1min":1.339,"5min":1.0800000000000001,"15min":1.0309999999999999},"min":{"1min":0.45800000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.7039999999999997,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":1.286}]},{"osd":6,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.179,"15min":0.999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":7.6440000000000001,"5min":16.228999999999999,"15min":16.228999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.048,"15min":0.99299999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.40500000000000003},"max":{"1min":4.8680000000000003,"5min":4.8680000000000003,"15min":6.0549999999999997},"last":1.0049999999999999}]},{"osd":7,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.111,"15min":1.0900000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.49199999999999999},"max":{"1min":4.556,"5min":4.556,"15min":5.415},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.3220000000000001,"15min":1.1180000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":8.5350000000000001,"5min":16.149999999999999,"15min":16.149999999999999},"last":1.3420000000000001}]}]},{"osd":3,"up_from":14,"seq":60129549517,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2579708,"kb_used_data":1028600,"kb_used_omap":50,"kb_used_meta":1522317,"kb_avail":91792132,"statfs":{"total":96636764160,"available":93995143168,"internally_reserved":0,"allocated":1053286400,"data_stored":1050707602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51317,"internal_metadata":1558853515},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:28 2024","interfaces":[{"interface":"back","average":{"1min":2.1110000000000002,"5min":1.3540000000000001,"15min":1.371},"min":{"1min":0.36899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":14.741,"5min":14.741,"15min":14.741},"last":14.741},{"interface":"front","average":{"1min":1.8240000000000001,"5min":1.3220000000000001,"15min":1.3999999999999999},"min":{"1min":0.39000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.8019999999999996,"5min":8.8019999999999996,"15min":8.8019999999999996},"last":8.8019999999999996}]},{"osd":1,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":1.5209999999999999,"15min":2.7069999999999999},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":2.6299999999999999,"5min":23.510000000000002,"15min":278.68099999999998},"last":9.6980000000000004},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.427,"15min":2.7519999999999998},"min":{"1min":0.41599999999999998,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":2.5910000000000002,"5min":8.0559999999999992,"15min":279.06599999999997},"last":10.582000000000001}]},{"osd":2,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":2.7389999999999999,"15min":2.0760000000000001},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.351,"5min":121.10299999999999,"15min":121.10299999999999},"last":14.67},{"interface":"front","average":{"1min":0.91100000000000003,"5min":2.6320000000000001,"15min":1.986},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.33800000000000002},"max":{"1min":2.0470000000000002,"5min":118.05800000000001,"15min":118.05800000000001},"last":8.7639999999999993}]},{"osd":4,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.788,"15min":1.627},"min":{"1min":0.43099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.153,"5min":35.975999999999999,"15min":35.975999999999999},"last":5.3109999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.556,"15min":1.637},"min":{"1min":0.48799999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.2519999999999998,"5min":12.666,"15min":12.666},"last":14.837}]},{"osd":5,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.536,"15min":1.5720000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.9860000000000002,"5min":8.7669999999999995,"15min":8.7669999999999995},"last":9.7680000000000007},{"interface":"front","average":{"1min":1.306,"5min":1.5600000000000001,"15min":1.667},"min":{"1min":0.79900000000000004,"5min":0.498,"15min":0.48699999999999999},"max":{"1min":2.1930000000000001,"5min":8.8819999999999997,"15min":8.8819999999999997},"last":14.794}]},{"osd":6,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.546,"15min":1.6839999999999999},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.47099999999999997},"max":{"1min":2.8719999999999999,"5min":9.0860000000000003,"15min":9.0860000000000003},"last":5.3579999999999997},{"interface":"front","average":{"1min":1.335,"5min":1.575,"15min":1.651},"min":{"1min":0.64100000000000001,"5min":0.59499999999999997,"15min":0.53800000000000003},"max":{"1min":3.7530000000000001,"5min":15.616,"15min":15.616},"last":9.6310000000000002}]},{"osd":7,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.516,"15min":1.7150000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48799999999999999},"max":{"1min":3.9009999999999998,"5min":10.589,"15min":10.589},"last":8.8369999999999997},{"interface":"front","average":{"1min":1.393,"5min":1.5369999999999999,"15min":1.6990000000000001},"min":{"1min":0.71999999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":4.8109999999999999,"5min":7.3780000000000001,"15min":7.3780000000000001},"last":5.1989999999999998}]}]},{"osd":2,"up_from":14,"seq":60129549532,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5729216,"kb_used_data":3967412,"kb_used_omap":768,"kb_used_meta":1761023,"kb_avail":88642624,"statfs":{"total":96636764160,"available":90770046976,"internally_reserved":0,"allocated":4062629888,"data_stored":4054402925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":786953,"internal_metadata":1803288055},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.99399999999999999,"15min":1.417},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":2.8839999999999999,"5min":6.6719999999999997,"15min":65.132000000000005},"last":1.3740000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.1599999999999999,"15min":1.591},"min":{"1min":0.39700000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.4510000000000001,"5min":11.308999999999999,"15min":70.902000000000001},"last":0.91200000000000003}]},{"osd":1,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.4990000000000001,"15min":5.6379999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.71,"5min":11.342000000000001,"15min":1038.0440000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":1.419,"15min":5.5419999999999998},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.33600000000000002},"max":{"1min":1.6899999999999999,"5min":8.0749999999999993,"15min":1037.0899999999999},"last":1.2390000000000001}]},{"osd":3,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.218,"15min":1.427},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.29299999999999998},"max":{"1min":1.7410000000000001,"5min":5.0629999999999997,"15min":7.71},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.573,"15min":1.6839999999999999},"min":{"1min":0.57999999999999996,"5min":0.44,"15min":0.318},"max":{"1min":2.6699999999999999,"5min":11.372,"15min":11.816000000000001},"last":1.27}]},{"osd":4,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.794,"15min":2.2229999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.581,"5min":26.771000000000001,"15min":189.965},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.716,"15min":2.1680000000000001},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.41199999999999998},"max":{"1min":2.46,"5min":27.465,"15min":193.35400000000001},"last":1.448}]},{"osd":5,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.212,"15min":1.395},"min":{"1min":0.54000000000000004,"5min":0.44500000000000001,"15min":0.38500000000000001},"max":{"1min":2.8650000000000002,"5min":5.024,"15min":6.6159999999999997},"last":1.097},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.556,"15min":1.5980000000000001},"min":{"1min":0.749,"5min":0.59899999999999998,"15min":0.52100000000000002},"max":{"1min":3.831,"5min":11.218999999999999,"15min":11.218999999999999},"last":1.2110000000000001}]},{"osd":6,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.5680000000000001,"15min":1.514},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9690000000000001,"5min":6.6319999999999997,"15min":6.6319999999999997},"last":1.506},{"interface":"front","average":{"1min":1.202,"5min":1.3460000000000001,"15min":1.5069999999999999},"min":{"1min":0.501,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.8180000000000001,"5min":7.9409999999999998,"15min":7.9409999999999998},"last":0.998}]},{"osd":7,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.534,"15min":1.5669999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.46300000000000002},"max":{"1min":3.8090000000000002,"5min":5.5049999999999999,"15min":6.1680000000000001},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.556,"15min":1.589},"min":{"1min":0.68500000000000005,"5min":0.63,"15min":0.435},"max":{"1min":2.2290000000000001,"5min":23.437000000000001,"15min":23.437000000000001},"last":1.1830000000000001}]}]},{"osd":1,"up_from":14,"seq":60129549521,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7022300,"kb_used_data":5301264,"kb_used_omap":490,"kb_used_meta":1720533,"kb_avail":87349540,"statfs":{"total":96636764160,"available":89445928960,"internally_reserved":0,"allocated":5428494336,"data_stored":5416968797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":502102,"internal_metadata":1761826474},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":1.3460000000000001,"15min":1.296},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":2.2149999999999999,"5min":14.206,"15min":14.206},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":1.5069999999999999,"15min":1.367},"min":{"1min":0.41199999999999998,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":2.056,"5min":14.311,"15min":14.311},"last":0.96399999999999997}]},{"osd":2,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.3109999999999999,"15min":1.663},"min":{"1min":0.41899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.4649999999999999,"5min":13.16,"15min":82.034999999999997},"last":1.9530000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.6100000000000001,"15min":1.8580000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32000000000000001},"max":{"1min":3.407,"5min":13.068,"15min":83.215999999999994},"last":1.2889999999999999}]},{"osd":3,"last update":"Mon Feb 19 17:13:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.8160000000000001,"15min":1.972},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.37},"max":{"1min":3.536,"5min":9.5449999999999999,"15min":79.706999999999994},"last":1.016},{"interface":"front","average":{"1min":1.02,"5min":1.8009999999999999,"15min":1.9059999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.782,"5min":18.905000000000001,"15min":84.069000000000003},"last":1.2150000000000001}]},{"osd":4,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.4830000000000001,"15min":1.4419999999999999},"min":{"1min":0.46700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.2010000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":1.506},{"interface":"front","average":{"1min":1.139,"5min":1.5209999999999999,"15min":1.472},"min":{"1min":0.55600000000000005,"5min":0.46400000000000002,"15min":0.39900000000000002},"max":{"1min":3.6640000000000001,"5min":13.253,"15min":13.253},"last":2.2930000000000001}]},{"osd":5,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.6799999999999999,"15min":1.651},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.47599999999999998},"max":{"1min":3.3519999999999999,"5min":13.005000000000001,"15min":13.760999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.6259999999999999,"15min":1.516},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":3.2429999999999999,"5min":9.8770000000000007,"15min":9.8770000000000007},"last":1.631}]},{"osd":6,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.5800000000000001,"15min":1.54},"min":{"1min":0.51000000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.6779999999999999,"5min":13.206,"15min":13.206},"last":2.3319999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.609,"15min":1.6359999999999999},"min":{"1min":0.54600000000000004,"5min":0.496,"15min":0.496},"max":{"1min":3.4449999999999998,"5min":9.125,"15min":13.862},"last":1.3779999999999999}]},{"osd":7,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.6020000000000001,"15min":1.585},"min":{"1min":0.64200000000000002,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":2.7490000000000001,"5min":13.311999999999999,"15min":13.311999999999999},"last":2.488},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.7490000000000001,"15min":1.7569999999999999},"min":{"1min":0.59799999999999998,"5min":0.53300000000000003,"15min":0.52200000000000002},"max":{"1min":3.4940000000000002,"5min":13.115,"15min":13.819000000000001},"last":1.5489999999999999}]}]},{"osd":0,"up_from":14,"seq":60129549541,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4492488,"kb_used_data":3614460,"kb_used_omap":272,"kb_used_meta":877743,"kb_avail":89879352,"statfs":{"total":96636764160,"available":92036456448,"internally_reserved":0,"allocated":3701207040,"data_stored":3693933889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":278558,"internal_metadata":898809826},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":1.431,"15min":1.3240000000000001},"min":{"1min":0.29599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.0219999999999998,"5min":20.481999999999999,"15min":20.481999999999999},"last":1.101},{"interface":"front","average":{"1min":0.79900000000000004,"5min":1.204,"15min":1.3899999999999999},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":1.613,"5min":5.6619999999999999,"15min":7.8680000000000003},"last":1.4890000000000001}]},{"osd":2,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":1.331,"15min":1.2989999999999999},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.30599999999999999},"max":{"1min":2.0910000000000002,"5min":5.3289999999999997,"15min":5.8490000000000002},"last":1.143},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.5820000000000001,"15min":1.452},"min":{"1min":0.36699999999999999,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":1.357,"5min":28.132999999999999,"15min":28.132999999999999},"last":0.89700000000000002}]},{"osd":3,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":1.635,"15min":1.411},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":1.466,"5min":12.734,"15min":12.734},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":2.153,"15min":1.7509999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.34699999999999998},"max":{"1min":3.141,"5min":21.021999999999998,"15min":21.021999999999998},"last":0.745}]},{"osd":4,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":1.732,"15min":1.504},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.516,"5min":13.388,"15min":13.388},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.5920000000000001,"15min":1.4570000000000001},"min":{"1min":0.55200000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.0579999999999998,"5min":10.034000000000001,"15min":10.034000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.466,"15min":1.5229999999999999},"min":{"1min":0.53400000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.069,"5min":7.9370000000000003,"15min":7.9370000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.6379999999999999,"15min":1.498},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.496},"max":{"1min":2.9830000000000001,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":0.78500000000000003}]},{"osd":6,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.494,"15min":1.5309999999999999},"min":{"1min":0.61899999999999999,"5min":0.49099999999999999,"15min":0.46200000000000002},"max":{"1min":2.5760000000000001,"5min":10.573,"15min":10.573},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.7290000000000001,"15min":1.5780000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":1.5529999999999999,"5min":15.301,"15min":15.301},"last":0.69299999999999995}]},{"osd":7,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.681,"15min":1.651},"min":{"1min":0.63100000000000001,"5min":0.50700000000000001,"15min":0.45700000000000002},"max":{"1min":1.994,"5min":17.152000000000001,"15min":17.152000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.6080000000000001,"15min":1.502},"min":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.52000000000000002},"max":{"1min":1.585,"5min":11.932,"15min":11.932},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T17:14:31.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T17:14:31.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.901+0000 7ff49b200640 1 Processor -- start 2024-02-19T17:14:31.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.901+0000 7ff49b200640 1 -- start start 2024-02-19T17:14:31.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.902+0000 7ff49b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4940b2ae0 0x7ff4940d25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.902+0000 7ff49b200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff494161ba0 con 0x7ff4940d0310 2024-02-19T17:14:31.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.903+0000 7ff49b200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff494161e80 con 0x7ff4940b2590 2024-02-19T17:14:31.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.903+0000 7ff49b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff494162820 con 0x7ff4940b2ae0 2024-02-19T17:14:31.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.903+0000 7ff493e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff4940d0310 0x7ff4940d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59546/0 (socket says 172.21.15.46:59546) 2024-02-19T17:14:31.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.903+0000 7ff493e00640 1 -- 172.21.15.46:0/363581055 learned_addr learned my addr 172.21.15.46:0/363581055 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.903+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515938072 0 0) 0x7ff494161ba0 con 0x7ff4940d0310 2024-02-19T17:14:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.903+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff478003520 con 0x7ff4940d0310 2024-02-19T17:14:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.903+0000 7ff499200640 1 --2- 172.21.15.46:0/363581055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4940b2ae0 0x7ff4940d25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1001449712 0 0) 0x7ff478003520 con 0x7ff4940d0310 2024-02-19T17:14:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4940b2ae0 msgr2=0x7ff4940d25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff492a00640 1 --2- 172.21.15.46:0/363581055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4940b2ae0 0x7ff4940d25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 >> v1:172.21.15.142:6789/0 conn(0x7ff4940b2590 legacy=0x7ff4940d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:31.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff494162160 con 0x7ff4940d0310 2024-02-19T17:14:31.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7ff484001670 con 0x7ff4940d0310 2024-02-19T17:14:31.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 >> v1:172.21.15.46:6789/0 conn(0x7ff4940d0310 legacy=0x7ff4940d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:31.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff492a00640 1 --2- 172.21.15.46:0/363581055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4940b2ae0 0x7ff4780039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff492a00640 1 --2- 172.21.15.46:0/363581055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff478004020 0x7ff4780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff492a00640 1 --2- 172.21.15.46:0/363581055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff478004d00 0x7ff478005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff494162820 con 0x7ff478004020 2024-02-19T17:14:31.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47800bbc0 con 0x7ff478004d00 2024-02-19T17:14:31.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47800bd80 con 0x7ff4940b2ae0 2024-02-19T17:14:31.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.904+0000 7ff493400640 1 --2- 172.21.15.46:0/363581055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff478004020 0x7ff4780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:31.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.905+0000 7ff499200640 1 --2- 172.21.15.46:0/363581055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff478004d00 0x7ff478005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:31.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.905+0000 7ff493400640 1 -- 172.21.15.46:0/363581055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4940b2ae0 msgr2=0x7ff4780039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:31.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.905+0000 7ff493400640 1 --2- 172.21.15.46:0/363581055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4940b2ae0 0x7ff4780039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.905+0000 7ff493400640 1 -- 172.21.15.46:0/363581055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff478004d00 msgr2=0x7ff478005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:31.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.905+0000 7ff493400640 1 --2- 172.21.15.46:0/363581055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff478004d00 0x7ff478005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.905+0000 7ff493400640 1 -- 172.21.15.46:0/363581055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff478003520 con 0x7ff478004020 2024-02-19T17:14:31.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.906+0000 7ff493400640 1 --2- 172.21.15.46:0/363581055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff478004020 0x7ff4780047c0 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7ff47c001770 tx=0x7ff4780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a423f49dd8a7c29 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:31.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.906+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c0052d0 con 0x7ff478004020 2024-02-19T17:14:31.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.906+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c02e050 con 0x7ff478004020 2024-02-19T17:14:31.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.906+0000 7ff492a00640 1 -- 172.21.15.46:0/363581055 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c003640 con 0x7ff478004020 2024-02-19T17:14:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.907+0000 7ff49b200640 1 -- 172.21.15.46:0/363581055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff478004020 msgr2=0x7ff4780047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.907+0000 7ff49b200640 1 --2- 172.21.15.46:0/363581055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff478004020 0x7ff4780047c0 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7ff47c001770 tx=0x7ff4780057f0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.907+0000 7ff499200640 1 -- 172.21.15.46:0/363581055 reap_dead start 2024-02-19T17:14:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.907+0000 7ff49b200640 1 -- 172.21.15.46:0/363581055 shutdown_connections 2024-02-19T17:14:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.907+0000 7ff49b200640 1 -- 172.21.15.46:0/363581055 >> 172.21.15.46:0/363581055 conn(0x7ff49406be20 msgr2=0x7ff49406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.907+0000 7ff49b200640 1 -- 172.21.15.46:0/363581055 shutdown_connections 2024-02-19T17:14:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.907+0000 7ff49b200640 1 -- 172.21.15.46:0/363581055 wait complete. 2024-02-19T17:14:31.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.909+0000 7ff49b200640 1 Processor -- start 2024-02-19T17:14:31.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.909+0000 7ff49b200640 1 -- start start 2024-02-19T17:14:31.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.910+0000 7ff49b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff478004020 0x7ff4940c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.910+0000 7ff49b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4940cc430 0x7ff494160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.910+0000 7ff49b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff494149a40 0x7ff494160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.910+0000 7ff49b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940c9b30 con 0x7ff478004020 2024-02-19T17:14:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.910+0000 7ff49b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940cc960 con 0x7ff4940cc430 2024-02-19T17:14:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.910+0000 7ff49b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940c9db0 con 0x7ff494149a40 2024-02-19T17:14:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.910+0000 7ff493e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff478004020 0x7ff4940c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.910+0000 7ff493e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff478004020 0x7ff4940c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43898/0 (socket says 172.21.15.46:43898) 2024-02-19T17:14:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.910+0000 7ff493e00640 1 -- 172.21.15.46:0/1350360461 learned_addr learned my addr 172.21.15.46:0/1350360461 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.911+0000 7ff493400640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4940cc430 0x7ff494160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.911+0000 7ff493e00640 1 -- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff494149a40 msgr2=0x7ff494160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.911+0000 7ff499200640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff494149a40 0x7ff494160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.911+0000 7ff493e00640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff494149a40 0x7ff494160680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.911+0000 7ff493e00640 1 -- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4940cc430 msgr2=0x7ff494160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.911+0000 7ff493e00640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4940cc430 0x7ff494160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.911+0000 7ff493e00640 1 -- 172.21.15.46:0/1350360461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4940ca090 con 0x7ff478004020 2024-02-19T17:14:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.911+0000 7ff493400640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4940cc430 0x7ff494160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.911+0000 7ff493e00640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff478004020 0x7ff4940c7430 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7ff48400c730 tx=0x7ff48400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:31.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.911+0000 7ff48be00640 1 -- 172.21.15.46:0/1350360461 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4840072d0 con 0x7ff478004020 2024-02-19T17:14:31.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.912+0000 7ff48be00640 1 -- 172.21.15.46:0/1350360461 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff484007470 con 0x7ff478004020 2024-02-19T17:14:31.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.912+0000 7ff48be00640 1 -- 172.21.15.46:0/1350360461 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4840047e0 con 0x7ff478004020 2024-02-19T17:14:31.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.912+0000 7ff49b200640 1 -- 172.21.15.46:0/1350360461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49415a2d0 con 0x7ff478004020 2024-02-19T17:14:31.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.912+0000 7ff49b200640 1 -- 172.21.15.46:0/1350360461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49414c060 con 0x7ff478004020 2024-02-19T17:14:31.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.913+0000 7ff49b200640 1 -- 172.21.15.46:0/1350360461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4940ca220 con 0x7ff478004020 2024-02-19T17:14:31.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.914+0000 7ff48be00640 1 -- 172.21.15.46:0/1350360461 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff484004b50 con 0x7ff478004020 2024-02-19T17:14:31.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.915+0000 7ff48be00640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff47006b810 0x7ff47006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:31.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.915+0000 7ff48be00640 1 -- 172.21.15.46:0/1350360461 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff484089910 con 0x7ff478004020 2024-02-19T17:14:31.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.915+0000 7ff493400640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff47006b810 0x7ff47006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.917+0000 7ff493400640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff47006b810 0x7ff47006dcd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff47c033000 tx=0x7ff47c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:31.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:31.919+0000 7ff48be00640 1 -- 172.21.15.46:0/1350360461 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff4840546c0 con 0x7ff478004020 2024-02-19T17:14:32.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.120+0000 7ff49b200640 1 -- 172.21.15.46:0/1350360461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff494161ba0 con 0x7ff478004020 2024-02-19T17:14:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.123+0000 7ff48be00640 1 -- 172.21.15.46:0/1350360461 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13020 (secure 0 0 0) 0x7ff484018020 con 0x7ff478004020 2024-02-19T17:14:32.109 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:32.109 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":38,"fsid":"858a958e-c459-4ec6-89ff-1327e8665984","created":"2024-02-19T06:57:30.527563+0000","modified":"2024-02-19T17:14:27.002538+0000","last_up_change":"2024-02-19T06:57:43.225610+0000","last_in_change":"2024-02-19T06:57:34.095888+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T06:57:43.741269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32e44df5-7121-4e93-9704-0f2a33fd2223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6809","nonce":3877139085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6811","nonce":3877139085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6816","nonce":3877139085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3877139085},{"type":"v1","addr":"172.21.15.46:6813","nonce":3877139085}]},"public_addr":"172.21.15.46:6809/3877139085","cluster_addr":"172.21.15.46:6811/3877139085","heartbeat_back_addr":"172.21.15.46:6816/3877139085","heartbeat_front_addr":"172.21.15.46:6813/3877139085","state":["exists","up"]},{"osd":1,"uuid":"5d2fc204-f8dd-4aa0-9b76-5d4d2a7707fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6817","nonce":3031745429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6819","nonce":3031745429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6823","nonce":3031745429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3031745429},{"type":"v1","addr":"172.21.15.46:6821","nonce":3031745429}]},"public_addr":"172.21.15.46:6817/3031745429","cluster_addr":"172.21.15.46:6819/3031745429","heartbeat_back_addr":"172.21.15.46:6823/3031745429","heartbeat_front_addr":"172.21.15.46:6821/3031745429","state":["exists","up"]},{"osd":2,"uuid":"d6e6d8e0-b34b-40f6-8178-844f431ece4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6801","nonce":1495872287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6803","nonce":1495872287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6807","nonce":1495872287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1495872287},{"type":"v1","addr":"172.21.15.46:6805","nonce":1495872287}]},"public_addr":"172.21.15.46:6801/1495872287","cluster_addr":"172.21.15.46:6803/1495872287","heartbeat_back_addr":"172.21.15.46:6807/1495872287","heartbeat_front_addr":"172.21.15.46:6805/1495872287","state":["exists","up"]},{"osd":3,"uuid":"e7245607-ce11-4972-b684-0e71b5e690f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6825","nonce":319601708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6827","nonce":319601708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6831","nonce":319601708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":319601708},{"type":"v1","addr":"172.21.15.46:6829","nonce":319601708}]},"public_addr":"172.21.15.46:6825/319601708","cluster_addr":"172.21.15.46:6827/319601708","heartbeat_back_addr":"172.21.15.46:6831/319601708","heartbeat_front_addr":"172.21.15.46:6829/319601708","state":["exists","up"]},{"osd":4,"uuid":"49d431b2-5dd9-4bc8-a94d-f12603470f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6801","nonce":4262903338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6803","nonce":4262903338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6807","nonce":4262903338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":4262903338},{"type":"v1","addr":"172.21.15.142:6805","nonce":4262903338}]},"public_addr":"172.21.15.142:6801/4262903338","cluster_addr":"172.21.15.142:6803/4262903338","heartbeat_back_addr":"172.21.15.142:6807/4262903338","heartbeat_front_addr":"172.21.15.142:6805/4262903338","state":["exists","up"]},{"osd":5,"uuid":"558aa125-1d1a-48c3-bb8a-c04e1c95b0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6809","nonce":1219840819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6811","nonce":1219840819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6815","nonce":1219840819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1219840819},{"type":"v1","addr":"172.21.15.142:6813","nonce":1219840819}]},"public_addr":"172.21.15.142:6809/1219840819","cluster_addr":"172.21.15.142:6811/1219840819","heartbeat_back_addr":"172.21.15.142:6815/1219840819","heartbeat_front_addr":"172.21.15.142:6813/1219840819","state":["exists","up"]},{"osd":6,"uuid":"752fd739-8486-4611-a766-0f306e7d4a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6817","nonce":2395736986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6819","nonce":2395736986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6823","nonce":2395736986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2395736986},{"type":"v1","addr":"172.21.15.142:6821","nonce":2395736986}]},"public_addr":"172.21.15.142:6817/2395736986","cluster_addr":"172.21.15.142:6819/2395736986","heartbeat_back_addr":"172.21.15.142:6823/2395736986","heartbeat_front_addr":"172.21.15.142:6821/2395736986","state":["exists","up"]},{"osd":7,"uuid":"3e66acbb-eff2-4e3f-8aa3-d7cbb14cf01f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6825","nonce":4235520298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6827","nonce":4235520298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6831","nonce":4235520298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4235520298},{"type":"v1","addr":"172.21.15.142:6829","nonce":4235520298}]},"public_addr":"172.21.15.142:6825/4235520298","cluster_addr":"172.21.15.142:6827/4235520298","heartbeat_back_addr":"172.21.15.142:6831/4235520298","heartbeat_front_addr":"172.21.15.142:6829/4235520298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404952+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.698986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.404961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.693141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.314731+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.671609+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.731650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T06:57:39.463871+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6834/1322569769":"2024-02-20T17:14:23.928246+0000","172.21.15.46:6832/1322569769":"2024-02-20T17:14:23.928246+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T17:14:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.125+0000 7ff49b200640 1 -- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff47006b810 msgr2=0x7ff47006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.125+0000 7ff49b200640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff47006b810 0x7ff47006dcd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff47c033000 tx=0x7ff47c009030 comp rx=0 tx=0).stop 2024-02-19T17:14:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.126+0000 7ff49b200640 1 -- 172.21.15.46:0/1350360461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff478004020 msgr2=0x7ff4940c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.126+0000 7ff49b200640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff478004020 0x7ff4940c7430 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7ff48400c730 tx=0x7ff48400cbf0 comp rx=0 tx=0).stop 2024-02-19T17:14:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.126+0000 7ff49b200640 1 -- 172.21.15.46:0/1350360461 shutdown_connections 2024-02-19T17:14:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.126+0000 7ff49b200640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff47006b810 0x7ff47006dcd0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.126+0000 7ff49b200640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff494149a40 0x7ff494160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.126+0000 7ff49b200640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4940cc430 0x7ff494160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.126+0000 7ff49b200640 1 --2- 172.21.15.46:0/1350360461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff478004020 0x7ff4940c7430 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.126+0000 7ff49b200640 1 -- 172.21.15.46:0/1350360461 >> 172.21.15.46:0/1350360461 conn(0x7ff49406be20 msgr2=0x7ff4940b73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.126+0000 7ff49b200640 1 -- 172.21.15.46:0/1350360461 shutdown_connections 2024-02-19T17:14:32.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:32.126+0000 7ff49b200640 1 -- 172.21.15.46:0/1350360461 wait complete. 2024-02-19T17:14:33.133 INFO:tasks.ceph:Scrubbing osd.0 2024-02-19T17:14:33.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-19T17:14:33.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.384+0000 7ff8aa400640 1 Processor -- start 2024-02-19T17:14:33.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.384+0000 7ff8aa400640 1 -- start start 2024-02-19T17:14:33.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.386+0000 7ff8aa400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff8a40cf520 0x7ff8a40cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.386+0000 7ff8aa400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a4098db0 con 0x7ff8a40b3b00 2024-02-19T17:14:33.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.386+0000 7ff8aa400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a415bad0 con 0x7ff8a4072990 2024-02-19T17:14:33.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.386+0000 7ff8aa400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a40b36e0 con 0x7ff8a40cf520 2024-02-19T17:14:33.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.386+0000 7ff8a9000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff8a40cf520 0x7ff8a40cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.386+0000 7ff8a9000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff8a40cf520 0x7ff8a40cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43908/0 (socket says 172.21.15.46:43908) 2024-02-19T17:14:33.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.386+0000 7ff8a9000640 1 -- 172.21.15.46:0/2950127612 learned_addr learned my addr 172.21.15.46:0/2950127612 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:33.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.387+0000 7ff8a9000640 1 -- 172.21.15.46:0/2950127612 >> v1:172.21.15.142:6789/0 conn(0x7ff8a4072990 legacy=0x7ff8a40ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.387+0000 7ff8a9000640 1 -- 172.21.15.46:0/2950127612 >> v1:172.21.15.46:6789/0 conn(0x7ff8a40b3b00 legacy=0x7ff8a40cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.387+0000 7ff8a9000640 1 -- 172.21.15.46:0/2950127612 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a40731c0 con 0x7ff8a40cf520 2024-02-19T17:14:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.388+0000 7ff8a9000640 1 --2- 172.21.15.46:0/2950127612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8a40cf520 0x7ff8a40cc840 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7ff898009870 tx=0x7ff89802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff596fbf940d6590 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.389+0000 7ff8a3400640 1 -- 172.21.15.46:0/2950127612 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898030860 con 0x7ff8a40cf520 2024-02-19T17:14:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.389+0000 7ff8a3400640 1 -- 172.21.15.46:0/2950127612 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8980309c0 con 0x7ff8a40cf520 2024-02-19T17:14:33.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.389+0000 7ff8a3400640 1 -- 172.21.15.46:0/2950127612 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898030d50 con 0x7ff8a40cf520 2024-02-19T17:14:33.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.389+0000 7ff8aa400640 1 -- 172.21.15.46:0/2950127612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8a40cf520 msgr2=0x7ff8a40cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.389+0000 7ff8aa400640 1 --2- 172.21.15.46:0/2950127612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8a40cf520 0x7ff8a40cc840 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7ff898009870 tx=0x7ff89802b9a0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.389+0000 7ff8aa400640 1 -- 172.21.15.46:0/2950127612 shutdown_connections 2024-02-19T17:14:33.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.389+0000 7ff8aa400640 1 --2- 172.21.15.46:0/2950127612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8a40cf520 0x7ff8a40cc840 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.389+0000 7ff8aa400640 1 -- 172.21.15.46:0/2950127612 >> 172.21.15.46:0/2950127612 conn(0x7ff8a406ad60 msgr2=0x7ff8a406b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:33.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.390+0000 7ff8aa400640 1 -- 172.21.15.46:0/2950127612 shutdown_connections 2024-02-19T17:14:33.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.390+0000 7ff8aa400640 1 -- 172.21.15.46:0/2950127612 wait complete. 2024-02-19T17:14:33.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.391+0000 7ff8aa400640 1 Processor -- start 2024-02-19T17:14:33.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.392+0000 7ff8aa400640 1 -- start start 2024-02-19T17:14:33.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.392+0000 7ff8aa400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8a4072990 0x7ff8a40c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.392+0000 7ff8aa400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8a40b3b00 0x7ff8a40acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8aa400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8a40cf520 0x7ff8a40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8aa400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40c7c00 con 0x7ff8a40b3b00 2024-02-19T17:14:33.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8aa400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40c8560 con 0x7ff8a40cf520 2024-02-19T17:14:33.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8aa400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40cedc0 con 0x7ff8a4072990 2024-02-19T17:14:33.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8a3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8a40b3b00 0x7ff8a40acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8a3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8a40b3b00 0x7ff8a40acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43916/0 (socket says 172.21.15.46:43916) 2024-02-19T17:14:33.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8a3e00640 1 -- 172.21.15.46:0/3108792132 learned_addr learned my addr 172.21.15.46:0/3108792132 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:33.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8a9000640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8a4072990 0x7ff8a40c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8a9a00640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8a40cf520 0x7ff8a40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8a3e00640 1 -- 172.21.15.46:0/3108792132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8a4072990 msgr2=0x7ff8a40c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8a3e00640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8a4072990 0x7ff8a40c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8a3e00640 1 -- 172.21.15.46:0/3108792132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8a40cf520 msgr2=0x7ff8a40ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8a3e00640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8a40cf520 0x7ff8a40ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8a3e00640 1 -- 172.21.15.46:0/3108792132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8980094d0 con 0x7ff8a40b3b00 2024-02-19T17:14:33.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.393+0000 7ff8a9a00640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8a40cf520 0x7ff8a40ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:33.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.394+0000 7ff8a3e00640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8a40b3b00 0x7ff8a40acef0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7ff89000c400 tx=0x7ff89000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:33.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.394+0000 7ff8a0c00640 1 -- 172.21.15.46:0/3108792132 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8900052d0 con 0x7ff8a40b3b00 2024-02-19T17:14:33.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.394+0000 7ff8a0c00640 1 -- 172.21.15.46:0/3108792132 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff890005430 con 0x7ff8a40b3b00 2024-02-19T17:14:33.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.394+0000 7ff8a0c00640 1 -- 172.21.15.46:0/3108792132 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890003830 con 0x7ff8a40b3b00 2024-02-19T17:14:33.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.394+0000 7ff8aa400640 1 -- 172.21.15.46:0/3108792132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a40c7540 con 0x7ff8a40b3b00 2024-02-19T17:14:33.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.394+0000 7ff8aa400640 1 -- 172.21.15.46:0/3108792132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a40c7180 con 0x7ff8a40b3b00 2024-02-19T17:14:33.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.395+0000 7ff8aa400640 1 -- 172.21.15.46:0/3108792132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff8a406f7a0 con 0x7ff8a40b3b00 2024-02-19T17:14:33.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.396+0000 7ff8a0c00640 1 -- 172.21.15.46:0/3108792132 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff890003990 con 0x7ff8a40b3b00 2024-02-19T17:14:33.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.397+0000 7ff8a0c00640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff88406b810 0x7ff88406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.397+0000 7ff8a0c00640 1 -- 172.21.15.46:0/3108792132 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff890089a10 con 0x7ff8a40b3b00 2024-02-19T17:14:33.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.398+0000 7ff8a0c00640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] conn(0x7ff8840716d0 0x7ff884073af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.398+0000 7ff8a0c00640 1 -- 172.21.15.46:0/3108792132 --> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8840741a0 con 0x7ff8840716d0 2024-02-19T17:14:33.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.398+0000 7ff8a0c00640 1 -- 172.21.15.46:0/3108792132 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff890089e60 con 0x7ff8a40b3b00 2024-02-19T17:14:33.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.398+0000 7ff8a9000640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff88406b810 0x7ff88406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.398+0000 7ff8a9a00640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] conn(0x7ff8840716d0 0x7ff884073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.399+0000 7ff8a9a00640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] conn(0x7ff8840716d0 0x7ff884073af0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:33.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.399+0000 7ff8a9000640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff88406b810 0x7ff88406dcd0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff898036000 tx=0x7ff89803b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:33.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.409+0000 7ff8a0c00640 1 -- 172.21.15.46:0/3108792132 <== osd.0 v2:172.21.15.46:6808/3877139085 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff8840741a0 con 0x7ff8840716d0 2024-02-19T17:14:33.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.425+0000 7ff8aa400640 1 -- 172.21.15.46:0/3108792132 --> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff8a40b2d80 con 0x7ff8840716d0 2024-02-19T17:14:33.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.427+0000 7ff8a0c00640 1 -- 172.21.15.46:0/3108792132 <== osd.0 v2:172.21.15.46:6808/3877139085 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff89c001e00 con 0x7ff8840716d0 2024-02-19T17:14:33.413 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T17:14:33.413 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-19T17:14:33.413 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T17:14:33.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.427+0000 7ff8aa400640 1 -- 172.21.15.46:0/3108792132 >> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] conn(0x7ff8840716d0 msgr2=0x7ff884073af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.427+0000 7ff8aa400640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.46:6808/3877139085,v1:172.21.15.46:6809/3877139085] conn(0x7ff8840716d0 0x7ff884073af0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.428+0000 7ff8aa400640 1 -- 172.21.15.46:0/3108792132 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff88406b810 msgr2=0x7ff88406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.428+0000 7ff8aa400640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7ff88406b810 0x7ff88406dcd0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff898036000 tx=0x7ff89803b040 comp rx=0 tx=0).stop 2024-02-19T17:14:33.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.428+0000 7ff8aa400640 1 -- 172.21.15.46:0/3108792132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8a40b3b00 msgr2=0x7ff8a40acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.428+0000 7ff8aa400640 1 --2- 172.21.15.46:0/3108792132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8a40b3b00 0x7ff8a40acef0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7ff89000c400 tx=0x7ff89000c8c0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.428+0000 7ff8a9a00640 1 -- 172.21.15.46:0/3108792132 reap_dead start 2024-02-19T17:14:33.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.428+0000 7ff8aa400640 1 -- 172.21.15.46:0/3108792132 shutdown_connections 2024-02-19T17:14:33.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.428+0000 7ff8aa400640 1 -- 172.21.15.46:0/3108792132 >> 172.21.15.46:0/3108792132 conn(0x7ff8a406ad60 msgr2=0x7ff8a40c4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:33.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.428+0000 7ff8aa400640 1 -- 172.21.15.46:0/3108792132 shutdown_connections 2024-02-19T17:14:33.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.428+0000 7ff8aa400640 1 -- 172.21.15.46:0/3108792132 wait complete. 2024-02-19T17:14:33.435 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-19T17:14:33.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.676+0000 7f67d9600640 1 Processor -- start 2024-02-19T17:14:33.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.676+0000 7f67d9600640 1 -- start start 2024-02-19T17:14:33.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.678+0000 7f67d9600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67d415b610 0x7f67d415fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.678+0000 7f67d9600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f67d40cf690 0x7f67d40cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.678+0000 7f67d9600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d40d0030 con 0x7f67d415b9f0 2024-02-19T17:14:33.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.678+0000 7f67d9600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d40cdc00 con 0x7f67d40cf690 2024-02-19T17:14:33.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.678+0000 7f67d9600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d415c900 con 0x7f67d415b610 2024-02-19T17:14:33.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.678+0000 7f67d8c00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f67d415b9f0 0x7f67d415be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59562/0 (socket says 172.21.15.46:59562) 2024-02-19T17:14:33.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.678+0000 7f67d8c00640 1 -- 172.21.15.46:0/597320222 learned_addr learned my addr 172.21.15.46:0/597320222 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:33.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.678+0000 7f67d3e00640 1 --2- 172.21.15.46:0/597320222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67d415b610 0x7f67d415fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.678+0000 7f67d3400640 1 --2- 172.21.15.46:0/597320222 >> v2:172.21.15.142:3300/0 conn(0x7f67d40cf690 0x7f67d40cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295211359 0 0) 0x7f67d40d0030 con 0x7f67d415b9f0 2024-02-19T17:14:33.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67b8003520 con 0x7f67d415b9f0 2024-02-19T17:14:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3362140338 0 0) 0x7f67b8003520 con 0x7f67d415b9f0 2024-02-19T17:14:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67d415b610 msgr2=0x7f67d415fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 --2- 172.21.15.46:0/597320222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67d415b610 0x7f67d415fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 >> v2:172.21.15.142:3300/0 conn(0x7f67d40cf690 msgr2=0x7f67d40cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 --2- 172.21.15.46:0/597320222 >> v2:172.21.15.142:3300/0 conn(0x7f67d40cf690 0x7f67d40cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d415cbe0 con 0x7f67d415b9f0 2024-02-19T17:14:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f67cc0019f0 con 0x7f67d415b9f0 2024-02-19T17:14:33.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 >> v1:172.21.15.46:6789/0 conn(0x7f67d415b9f0 legacy=0x7f67d415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 --2- 172.21.15.46:0/597320222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67d415b610 0x7f67b8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 --2- 172.21.15.46:0/597320222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67b8003f40 0x7f67b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 --2- 172.21.15.46:0/597320222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b8004d00 0x7f67b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d40cdc00 con 0x7f67b8004d00 2024-02-19T17:14:33.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d415c900 con 0x7f67b8003f40 2024-02-19T17:14:33.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.679+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b800b980 con 0x7f67d415b610 2024-02-19T17:14:33.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.680+0000 7f67d8c00640 1 --2- 172.21.15.46:0/597320222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b8004d00 0x7f67b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.680+0000 7f67d3e00640 1 --2- 172.21.15.46:0/597320222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67d415b610 0x7f67b8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.680+0000 7f67d3400640 1 --2- 172.21.15.46:0/597320222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67b8003f40 0x7f67b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.680+0000 7f67d8c00640 1 -- 172.21.15.46:0/597320222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67d415b610 msgr2=0x7f67b8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:33.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.680+0000 7f67d8c00640 1 --2- 172.21.15.46:0/597320222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67d415b610 0x7f67b8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.680+0000 7f67d8c00640 1 -- 172.21.15.46:0/597320222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67b8003f40 msgr2=0x7f67b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:33.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.680+0000 7f67d8c00640 1 --2- 172.21.15.46:0/597320222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67b8003f40 0x7f67b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.680+0000 7f67d8c00640 1 -- 172.21.15.46:0/597320222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b8003520 con 0x7f67b8004d00 2024-02-19T17:14:33.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.681+0000 7f67d8c00640 1 --2- 172.21.15.46:0/597320222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b8004d00 0x7f67b8005180 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00a7c0 tx=0x7f67b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46f5a65e375bde1 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:33.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.681+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc034630 con 0x7f67b8004d00 2024-02-19T17:14:33.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.681+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc02f070 con 0x7f67b8004d00 2024-02-19T17:14:33.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.681+0000 7f67d2a00640 1 -- 172.21.15.46:0/597320222 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc034a30 con 0x7f67b8004d00 2024-02-19T17:14:33.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.682+0000 7f67d9600640 1 -- 172.21.15.46:0/597320222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b8004d00 msgr2=0x7f67b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.682+0000 7f67d9600640 1 --2- 172.21.15.46:0/597320222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b8004d00 0x7f67b8005180 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00a7c0 tx=0x7f67b80057f0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.682+0000 7f67d8c00640 1 -- 172.21.15.46:0/597320222 reap_dead start 2024-02-19T17:14:33.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.682+0000 7f67d9600640 1 -- 172.21.15.46:0/597320222 shutdown_connections 2024-02-19T17:14:33.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.682+0000 7f67d9600640 1 -- 172.21.15.46:0/597320222 >> 172.21.15.46:0/597320222 conn(0x7f67d40b1200 msgr2=0x7f67d40b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:33.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.682+0000 7f67d9600640 1 -- 172.21.15.46:0/597320222 shutdown_connections 2024-02-19T17:14:33.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.682+0000 7f67d9600640 1 -- 172.21.15.46:0/597320222 wait complete. 2024-02-19T17:14:33.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.684+0000 7f67d9600640 1 Processor -- start 2024-02-19T17:14:33.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.684+0000 7f67d9600640 1 -- start start 2024-02-19T17:14:33.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.685+0000 7f67d9600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67d409c4c0 0x7f67d41e6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.685+0000 7f67d9600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67d41e6cb0 0x7f67d4159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.685+0000 7f67d9600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67d409c8a0 0x7f67d4159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.685+0000 7f67d9600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d4099f50 con 0x7f67d409c8a0 2024-02-19T17:14:33.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.685+0000 7f67d9600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d415a2c0 con 0x7f67d41e6cb0 2024-02-19T17:14:33.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.685+0000 7f67d9600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d4099b90 con 0x7f67d409c4c0 2024-02-19T17:14:33.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.686+0000 7f67d8c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67d409c8a0 0x7f67d4159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.686+0000 7f67d8c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67d409c8a0 0x7f67d4159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43934/0 (socket says 172.21.15.46:43934) 2024-02-19T17:14:33.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.686+0000 7f67d8c00640 1 -- 172.21.15.46:0/471252973 learned_addr learned my addr 172.21.15.46:0/471252973 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:33.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.686+0000 7f67d3e00640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67d409c4c0 0x7f67d41e6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.686+0000 7f67d3400640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67d41e6cb0 0x7f67d4159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.686+0000 7f67d8c00640 1 -- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67d409c4c0 msgr2=0x7f67d41e6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.686+0000 7f67d8c00640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67d409c4c0 0x7f67d41e6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.686+0000 7f67d8c00640 1 -- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67d41e6cb0 msgr2=0x7f67d4159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.686+0000 7f67d8c00640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67d41e6cb0 0x7f67d4159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.686+0000 7f67d8c00640 1 -- 172.21.15.46:0/471252973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d41e71c0 con 0x7f67d409c8a0 2024-02-19T17:14:33.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.687+0000 7f67d8c00640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67d409c8a0 0x7f67d4159d80 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00a760 tx=0x7f67cc001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:33.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.687+0000 7f67cbe00640 1 -- 172.21.15.46:0/471252973 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc034840 con 0x7f67d409c8a0 2024-02-19T17:14:33.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.687+0000 7f67cbe00640 1 -- 172.21.15.46:0/471252973 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc0349a0 con 0x7f67d409c8a0 2024-02-19T17:14:33.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.687+0000 7f67cbe00640 1 -- 172.21.15.46:0/471252973 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc034d10 con 0x7f67d409c8a0 2024-02-19T17:14:33.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.687+0000 7f67d9600640 1 -- 172.21.15.46:0/471252973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d41e74a0 con 0x7f67d409c8a0 2024-02-19T17:14:33.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.687+0000 7f67d9600640 1 -- 172.21.15.46:0/471252973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d41f4940 con 0x7f67d409c8a0 2024-02-19T17:14:33.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.688+0000 7f67d9600640 1 -- 172.21.15.46:0/471252973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d409a090 con 0x7f67d409c8a0 2024-02-19T17:14:33.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.689+0000 7f67cbe00640 1 -- 172.21.15.46:0/471252973 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f67cc031030 con 0x7f67d409c8a0 2024-02-19T17:14:33.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.691+0000 7f67cbe00640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f67b406b810 0x7f67b406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:33.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.691+0000 7f67cbe00640 1 -- 172.21.15.46:0/471252973 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f67cc0ac350 con 0x7f67d409c8a0 2024-02-19T17:14:33.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.691+0000 7f67d3e00640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f67b406b810 0x7f67b406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:33.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.693+0000 7f67d3e00640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f67b406b810 0x7f67b406dcd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f67c4009a10 tx=0x7f67c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:33.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.696+0000 7f67cbe00640 1 -- 172.21.15.46:0/471252973 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f67d409a090 con 0x7f67d409c8a0 2024-02-19T17:14:33.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.897+0000 7f67d9600640 1 -- 172.21.15.46:0/471252973 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f67d4099a10 con 0x7f67b406b810 2024-02-19T17:14:33.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.898+0000 7f67cbe00640 1 -- 172.21.15.46:0/471252973 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f67c4013a10 con 0x7f67b406b810 2024-02-19T17:14:33.884 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2024-02-19T17:14:33.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.901+0000 7f67d9600640 1 -- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f67b406b810 msgr2=0x7f67b406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.901+0000 7f67d9600640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f67b406b810 0x7f67b406dcd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f67c4009a10 tx=0x7f67c4008040 comp rx=0 tx=0).stop 2024-02-19T17:14:33.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.901+0000 7f67d9600640 1 -- 172.21.15.46:0/471252973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67d409c8a0 msgr2=0x7f67d4159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:33.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.901+0000 7f67d9600640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67d409c8a0 0x7f67d4159d80 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00a760 tx=0x7f67cc001cb0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.901+0000 7f67d9600640 1 -- 172.21.15.46:0/471252973 shutdown_connections 2024-02-19T17:14:33.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.901+0000 7f67d9600640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f67b406b810 0x7f67b406dcd0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.901+0000 7f67d9600640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67d409c8a0 0x7f67d4159d80 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.901+0000 7f67d9600640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67d41e6cb0 0x7f67d4159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.901+0000 7f67d9600640 1 --2- 172.21.15.46:0/471252973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67d409c4c0 0x7f67d41e6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:33.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.901+0000 7f67d9600640 1 -- 172.21.15.46:0/471252973 >> 172.21.15.46:0/471252973 conn(0x7f67d40b1200 msgr2=0x7f67d40ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:33.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.901+0000 7f67d9600640 1 -- 172.21.15.46:0/471252973 shutdown_connections 2024-02-19T17:14:33.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:33.902+0000 7f67d9600640 1 -- 172.21.15.46:0/471252973 wait complete. 2024-02-19T17:14:33.907 INFO:tasks.ceph:Scrubbing osd.1 2024-02-19T17:14:33.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-19T17:14:34.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.147+0000 7f9a18000640 1 Processor -- start 2024-02-19T17:14:34.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.148+0000 7f9a18000640 1 -- start start 2024-02-19T17:14:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.149+0000 7f9a18000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9a100cf3d0 0x7f9a100cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.149+0000 7f9a18000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a10145120 0x7f9a1006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.149+0000 7f9a18000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1006ef30 con 0x7f9a1006da50 2024-02-19T17:14:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.149+0000 7f9a18000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a10144990 con 0x7f9a10145120 2024-02-19T17:14:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.149+0000 7f9a18000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a100cfcf0 con 0x7f9a100cf3d0 2024-02-19T17:14:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.150+0000 7f9a14c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a10145120 0x7f9a1006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.150+0000 7f9a14c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a10145120 0x7f9a1006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43942/0 (socket says 172.21.15.46:43942) 2024-02-19T17:14:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.150+0000 7f9a14c00640 1 -- 172.21.15.46:0/1876834556 learned_addr learned my addr 172.21.15.46:0/1876834556 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:34.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.150+0000 7f9a15600640 1 --2- 172.21.15.46:0/1876834556 >> v2:172.21.15.142:3300/0 conn(0x7f9a100cf3d0 0x7f9a100cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.150+0000 7f9a14c00640 1 -- 172.21.15.46:0/1876834556 >> v2:172.21.15.142:3300/0 conn(0x7f9a100cf3d0 msgr2=0x7f9a100cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:34.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.150+0000 7f9a14c00640 1 --2- 172.21.15.46:0/1876834556 >> v2:172.21.15.142:3300/0 conn(0x7f9a100cf3d0 0x7f9a100cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.150+0000 7f9a14c00640 1 -- 172.21.15.46:0/1876834556 >> v1:172.21.15.46:6789/0 conn(0x7f9a1006da50 legacy=0x7f9a1015fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.150+0000 7f9a14c00640 1 -- 172.21.15.46:0/1876834556 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100ccf20 con 0x7f9a10145120 2024-02-19T17:14:34.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.151+0000 7f9a14c00640 1 --2- 172.21.15.46:0/1876834556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a10145120 0x7f9a1006d510 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f9a100b4a70 tx=0x7f9a0002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749dac3b64b7fb90 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:34.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.152+0000 7f9a0fe00640 1 -- 172.21.15.46:0/1876834556 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0002ca80 con 0x7f9a10145120 2024-02-19T17:14:34.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.152+0000 7f9a0fe00640 1 -- 172.21.15.46:0/1876834556 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0002cbe0 con 0x7f9a10145120 2024-02-19T17:14:34.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.152+0000 7f9a0fe00640 1 -- 172.21.15.46:0/1876834556 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000343f0 con 0x7f9a10145120 2024-02-19T17:14:34.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.153+0000 7f9a18000640 1 -- 172.21.15.46:0/1876834556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a10145120 msgr2=0x7f9a1006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.153+0000 7f9a18000640 1 --2- 172.21.15.46:0/1876834556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a10145120 0x7f9a1006d510 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f9a100b4a70 tx=0x7f9a0002bee0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.153+0000 7f9a18000640 1 -- 172.21.15.46:0/1876834556 shutdown_connections 2024-02-19T17:14:34.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.153+0000 7f9a18000640 1 --2- 172.21.15.46:0/1876834556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a10145120 0x7f9a1006d510 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.153+0000 7f9a18000640 1 --2- 172.21.15.46:0/1876834556 >> v2:172.21.15.142:3300/0 conn(0x7f9a100cf3d0 0x7f9a100cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.153+0000 7f9a18000640 1 -- 172.21.15.46:0/1876834556 >> 172.21.15.46:0/1876834556 conn(0x7f9a10066ff0 msgr2=0x7f9a1006abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:34.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.153+0000 7f9a18000640 1 -- 172.21.15.46:0/1876834556 shutdown_connections 2024-02-19T17:14:34.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.153+0000 7f9a18000640 1 -- 172.21.15.46:0/1876834556 wait complete. 2024-02-19T17:14:34.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.155+0000 7f9a18000640 1 Processor -- start 2024-02-19T17:14:34.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.155+0000 7f9a18000640 1 -- start start 2024-02-19T17:14:34.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.156+0000 7f9a18000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a100cf3d0 0x7f9a10139f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.156+0000 7f9a18000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a10145120 0x7f9a1013e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.156+0000 7f9a18000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a1013c310 0x7f9a1013c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.156+0000 7f9a18000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100ae3a0 con 0x7f9a100cf3d0 2024-02-19T17:14:34.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.156+0000 7f9a18000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1013cce0 con 0x7f9a10145120 2024-02-19T17:14:34.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.156+0000 7f9a18000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100acbc0 con 0x7f9a1013c310 2024-02-19T17:14:34.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.156+0000 7f9a15600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a100cf3d0 0x7f9a10139f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.156+0000 7f9a15600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a100cf3d0 0x7f9a10139f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43946/0 (socket says 172.21.15.46:43946) 2024-02-19T17:14:34.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.156+0000 7f9a15600640 1 -- 172.21.15.46:0/223155504 learned_addr learned my addr 172.21.15.46:0/223155504 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:34.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.156+0000 7f9a14c00640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a10145120 0x7f9a1013e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a15600640 1 -- 172.21.15.46:0/223155504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a1013c310 msgr2=0x7f9a1013c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a16000640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a1013c310 0x7f9a1013c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a15600640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a1013c310 0x7f9a1013c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a15600640 1 -- 172.21.15.46:0/223155504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a10145120 msgr2=0x7f9a1013e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a15600640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a10145120 0x7f9a1013e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a15600640 1 -- 172.21.15.46:0/223155504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a00009b30 con 0x7f9a100cf3d0 2024-02-19T17:14:34.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a14c00640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a10145120 0x7f9a1013e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:34.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a16000640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a1013c310 0x7f9a1013c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:34.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a15600640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a100cf3d0 0x7f9a10139f80 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400d830 tx=0x7f9a0400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:34.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a0d600640 1 -- 172.21.15.46:0/223155504 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400b6c0 con 0x7f9a100cf3d0 2024-02-19T17:14:34.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a0d600640 1 -- 172.21.15.46:0/223155504 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0400b820 con 0x7f9a100cf3d0 2024-02-19T17:14:34.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a0d600640 1 -- 172.21.15.46:0/223155504 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400bbb0 con 0x7f9a100cf3d0 2024-02-19T17:14:34.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a18000640 1 -- 172.21.15.46:0/223155504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a100b2c10 con 0x7f9a100cf3d0 2024-02-19T17:14:34.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.157+0000 7f9a18000640 1 -- 172.21.15.46:0/223155504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a100b31d0 con 0x7f9a100cf3d0 2024-02-19T17:14:34.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.158+0000 7f9a18000640 1 -- 172.21.15.46:0/223155504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a1015f500 con 0x7f9a100cf3d0 2024-02-19T17:14:34.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.159+0000 7f9a0d600640 1 -- 172.21.15.46:0/223155504 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9a0401e460 con 0x7f9a100cf3d0 2024-02-19T17:14:34.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.161+0000 7f9a0d600640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f99f406b810 0x7f99f406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.161+0000 7f9a0d600640 1 -- 172.21.15.46:0/223155504 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9a0408a700 con 0x7f9a100cf3d0 2024-02-19T17:14:34.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.161+0000 7f9a0d600640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] conn(0x7f99f40716d0 0x7f99f4073af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.161+0000 7f9a0d600640 1 -- 172.21.15.46:0/223155504 --> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99f40741a0 con 0x7f99f40716d0 2024-02-19T17:14:34.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.161+0000 7f9a0d600640 1 -- 172.21.15.46:0/223155504 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a0408cce0 con 0x7f9a100cf3d0 2024-02-19T17:14:34.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.161+0000 7f9a16000640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] conn(0x7f99f40716d0 0x7f99f4073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.162+0000 7f9a14c00640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f99f406b810 0x7f99f406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.162+0000 7f9a16000640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] conn(0x7f99f40716d0 0x7f99f4073af0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:34.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.163+0000 7f9a0d600640 1 -- 172.21.15.46:0/223155504 <== osd.1 v2:172.21.15.46:6815/3031745429 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f99f40741a0 con 0x7f99f40716d0 2024-02-19T17:14:34.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.163+0000 7f9a14c00640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f99f406b810 0x7f99f406dcd0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9a00035000 tx=0x7f9a00030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:34.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.178+0000 7f9a18000640 1 -- 172.21.15.46:0/223155504 --> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9a100ccc40 con 0x7f99f40716d0 2024-02-19T17:14:34.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.178+0000 7f9a0d600640 1 -- 172.21.15.46:0/223155504 <== osd.1 v2:172.21.15.46:6815/3031745429 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9a08001830 con 0x7f99f40716d0 2024-02-19T17:14:34.164 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T17:14:34.164 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-19T17:14:34.164 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T17:14:34.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.179+0000 7f9a18000640 1 -- 172.21.15.46:0/223155504 >> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] conn(0x7f99f40716d0 msgr2=0x7f99f4073af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.179+0000 7f9a18000640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.46:6815/3031745429,v1:172.21.15.46:6817/3031745429] conn(0x7f99f40716d0 0x7f99f4073af0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.179+0000 7f9a18000640 1 -- 172.21.15.46:0/223155504 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f99f406b810 msgr2=0x7f99f406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.179+0000 7f9a18000640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f99f406b810 0x7f99f406dcd0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9a00035000 tx=0x7f9a00030000 comp rx=0 tx=0).stop 2024-02-19T17:14:34.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.179+0000 7f9a18000640 1 -- 172.21.15.46:0/223155504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a100cf3d0 msgr2=0x7f9a10139f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.179+0000 7f9a18000640 1 --2- 172.21.15.46:0/223155504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a100cf3d0 0x7f9a10139f80 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400d830 tx=0x7f9a0400dcf0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.179+0000 7f9a16000640 1 -- 172.21.15.46:0/223155504 reap_dead start 2024-02-19T17:14:34.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.179+0000 7f9a18000640 1 -- 172.21.15.46:0/223155504 shutdown_connections 2024-02-19T17:14:34.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.179+0000 7f9a18000640 1 -- 172.21.15.46:0/223155504 >> 172.21.15.46:0/223155504 conn(0x7f9a1006da50 msgr2=0x7f9a1015e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:34.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.179+0000 7f9a18000640 1 -- 172.21.15.46:0/223155504 shutdown_connections 2024-02-19T17:14:34.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.179+0000 7f9a18000640 1 -- 172.21.15.46:0/223155504 wait complete. 2024-02-19T17:14:34.186 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-19T17:14:34.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.432+0000 7f8a64a00640 1 Processor -- start 2024-02-19T17:14:34.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.432+0000 7f8a64a00640 1 -- start start 2024-02-19T17:14:34.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.433+0000 7f8a64a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8a600d2370 0x7f8a6006cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.433+0000 7f8a64a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a600b2db0 con 0x7f8a60161430 2024-02-19T17:14:34.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.433+0000 7f8a64a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a60162060 con 0x7f8a6015d770 2024-02-19T17:14:34.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.433+0000 7f8a64a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6006d510 con 0x7f8a600d2370 2024-02-19T17:14:34.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.434+0000 7f8a5fe00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8a60161430 0x7f8a60161870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59588/0 (socket says 172.21.15.46:59588) 2024-02-19T17:14:34.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.434+0000 7f8a5fe00640 1 -- 172.21.15.46:0/3241425598 learned_addr learned my addr 172.21.15.46:0/3241425598 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:34.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.434+0000 7f8a5ea00640 1 --2- 172.21.15.46:0/3241425598 >> v2:172.21.15.142:3300/0 conn(0x7f8a600d2370 0x7f8a6006cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.434+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152740324 0 0) 0x7f8a600b2db0 con 0x7f8a60161430 2024-02-19T17:14:34.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.434+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a44003520 con 0x7f8a60161430 2024-02-19T17:14:34.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3759478401 0 0) 0x7f8a44003520 con 0x7f8a60161430 2024-02-19T17:14:34.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 >> v2:172.21.15.142:3300/0 conn(0x7f8a600d2370 msgr2=0x7f8a6006cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:34.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5e000640 1 --2- 172.21.15.46:0/3241425598 >> v2:172.21.15.142:3300/0 conn(0x7f8a600d2370 0x7f8a6006cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 >> v1:172.21.15.142:6789/0 conn(0x7f8a6015d770 legacy=0x7f8a600d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a60162340 con 0x7f8a60161430 2024-02-19T17:14:34.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f8a580019f0 con 0x7f8a60161430 2024-02-19T17:14:34.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 >> v1:172.21.15.46:6789/0 conn(0x7f8a60161430 legacy=0x7f8a60161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5e000640 1 --2- 172.21.15.46:0/3241425598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a440039c0 0x7f8a44003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5e000640 1 --2- 172.21.15.46:0/3241425598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a440047c0 0x7f8a44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5e000640 1 --2- 172.21.15.46:0/3241425598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a44005180 0x7f8a4400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6006d510 con 0x7f8a440039c0 2024-02-19T17:14:34.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4400c080 con 0x7f8a44005180 2024-02-19T17:14:34.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4400c240 con 0x7f8a440047c0 2024-02-19T17:14:34.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5ea00640 1 --2- 172.21.15.46:0/3241425598 >> v2:172.21.15.142:3300/0 conn(0x7f8a600d2370 0x7f8a6006cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T17:14:34.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5f400640 1 --2- 172.21.15.46:0/3241425598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a440039c0 0x7f8a44003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.435+0000 7f8a5fe00640 1 --2- 172.21.15.46:0/3241425598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a44005180 0x7f8a4400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.436+0000 7f8a5ea00640 1 --2- 172.21.15.46:0/3241425598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a440047c0 0x7f8a44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.436+0000 7f8a5f400640 1 -- 172.21.15.46:0/3241425598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a440047c0 msgr2=0x7f8a44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:34.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.436+0000 7f8a5f400640 1 --2- 172.21.15.46:0/3241425598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a440047c0 0x7f8a44004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.436+0000 7f8a5f400640 1 -- 172.21.15.46:0/3241425598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a44005180 msgr2=0x7f8a4400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:34.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.436+0000 7f8a5f400640 1 --2- 172.21.15.46:0/3241425598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a44005180 0x7f8a4400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.436+0000 7f8a5f400640 1 -- 172.21.15.46:0/3241425598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a44003520 con 0x7f8a440039c0 2024-02-19T17:14:34.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.436+0000 7f8a5fe00640 1 -- 172.21.15.46:0/3241425598 reap_dead start 2024-02-19T17:14:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.437+0000 7f8a5f400640 1 --2- 172.21.15.46:0/3241425598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a440039c0 0x7f8a44003de0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f8a50001750 tx=0x7f8a440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8feecb1ccea155 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.437+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a500052d0 con 0x7f8a440039c0 2024-02-19T17:14:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.437+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5002e050 con 0x7f8a440039c0 2024-02-19T17:14:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.437+0000 7f8a5e000640 1 -- 172.21.15.46:0/3241425598 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50003830 con 0x7f8a440039c0 2024-02-19T17:14:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.438+0000 7f8a64a00640 1 -- 172.21.15.46:0/3241425598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a440039c0 msgr2=0x7f8a44003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.438+0000 7f8a64a00640 1 --2- 172.21.15.46:0/3241425598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a440039c0 0x7f8a44003de0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f8a50001750 tx=0x7f8a440057f0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.438+0000 7f8a64a00640 1 -- 172.21.15.46:0/3241425598 shutdown_connections 2024-02-19T17:14:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.438+0000 7f8a64a00640 1 --2- 172.21.15.46:0/3241425598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a440039c0 0x7f8a44003de0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.438+0000 7f8a64a00640 1 -- 172.21.15.46:0/3241425598 >> 172.21.15.46:0/3241425598 conn(0x7f8a6009ca00 msgr2=0x7f8a6008afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:34.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.438+0000 7f8a64a00640 1 -- 172.21.15.46:0/3241425598 shutdown_connections 2024-02-19T17:14:34.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.438+0000 7f8a64a00640 1 -- 172.21.15.46:0/3241425598 wait complete. 2024-02-19T17:14:34.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.440+0000 7f8a64a00640 1 Processor -- start 2024-02-19T17:14:34.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.440+0000 7f8a64a00640 1 -- start start 2024-02-19T17:14:34.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.441+0000 7f8a64a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a440039c0 0x7f8a6015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.441+0000 7f8a64a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a600b1030 0x7f8a600b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.441+0000 7f8a64a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a600c8e60 0x7f8a600c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.441+0000 7f8a64a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600ca170 con 0x7f8a440039c0 2024-02-19T17:14:34.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.441+0000 7f8a64a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6014a860 con 0x7f8a600b1030 2024-02-19T17:14:34.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.441+0000 7f8a64a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600b19f0 con 0x7f8a600c8e60 2024-02-19T17:14:34.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.441+0000 7f8a5f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a440039c0 0x7f8a6015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.441+0000 7f8a5f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a440039c0 0x7f8a6015a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43952/0 (socket says 172.21.15.46:43952) 2024-02-19T17:14:34.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.441+0000 7f8a5f400640 1 -- 172.21.15.46:0/2273714877 learned_addr learned my addr 172.21.15.46:0/2273714877 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:34.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.442+0000 7f8a5ea00640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a600b1030 0x7f8a600b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.442+0000 7f8a5f400640 1 -- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a600c8e60 msgr2=0x7f8a600c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.442+0000 7f8a5f400640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a600c8e60 0x7f8a600c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.442+0000 7f8a5f400640 1 -- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a600b1030 msgr2=0x7f8a600b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.442+0000 7f8a5f400640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a600b1030 0x7f8a600b14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.442+0000 7f8a5f400640 1 -- 172.21.15.46:0/2273714877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a600c9bb0 con 0x7f8a440039c0 2024-02-19T17:14:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.442+0000 7f8a5ea00640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a600b1030 0x7f8a600b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.442+0000 7f8a5f400640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a440039c0 0x7f8a6015a7c0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f8a50005040 tx=0x7f8a50001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.442+0000 7f8a57400640 1 -- 172.21.15.46:0/2273714877 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50007a30 con 0x7f8a440039c0 2024-02-19T17:14:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.443+0000 7f8a57400640 1 -- 172.21.15.46:0/2273714877 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a50007640 con 0x7f8a440039c0 2024-02-19T17:14:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.443+0000 7f8a57400640 1 -- 172.21.15.46:0/2273714877 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50006be0 con 0x7f8a440039c0 2024-02-19T17:14:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.443+0000 7f8a64a00640 1 -- 172.21.15.46:0/2273714877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a600c9e90 con 0x7f8a440039c0 2024-02-19T17:14:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.443+0000 7f8a64a00640 1 -- 172.21.15.46:0/2273714877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6014af30 con 0x7f8a440039c0 2024-02-19T17:14:34.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.444+0000 7f8a64a00640 1 -- 172.21.15.46:0/2273714877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6014aab0 con 0x7f8a440039c0 2024-02-19T17:14:34.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.445+0000 7f8a57400640 1 -- 172.21.15.46:0/2273714877 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8a50006d40 con 0x7f8a440039c0 2024-02-19T17:14:34.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.446+0000 7f8a57400640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8a4006b810 0x7f8a4006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.446+0000 7f8a57400640 1 -- 172.21.15.46:0/2273714877 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8a500aba40 con 0x7f8a440039c0 2024-02-19T17:14:34.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.447+0000 7f8a5ea00640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8a4006b810 0x7f8a4006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.448+0000 7f8a5ea00640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8a4006b810 0x7f8a4006dcd0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8a600b9330 tx=0x7f8a4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:34.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.450+0000 7f8a57400640 1 -- 172.21.15.46:0/2273714877 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8a6014aab0 con 0x7f8a440039c0 2024-02-19T17:14:34.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.649+0000 7f8a64a00640 1 -- 172.21.15.46:0/2273714877 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a6006cab0 con 0x7f8a4006b810 2024-02-19T17:14:34.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.650+0000 7f8a57400640 1 -- 172.21.15.46:0/2273714877 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8a4c0119d0 con 0x7f8a4006b810 2024-02-19T17:14:34.636 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2024-02-19T17:14:34.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.652+0000 7f8a64a00640 1 -- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8a4006b810 msgr2=0x7f8a4006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.652+0000 7f8a64a00640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8a4006b810 0x7f8a4006dcd0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8a600b9330 tx=0x7f8a4c008040 comp rx=0 tx=0).stop 2024-02-19T17:14:34.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.652+0000 7f8a64a00640 1 -- 172.21.15.46:0/2273714877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a440039c0 msgr2=0x7f8a6015a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.652+0000 7f8a64a00640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a440039c0 0x7f8a6015a7c0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f8a50005040 tx=0x7f8a50001120 comp rx=0 tx=0).stop 2024-02-19T17:14:34.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.653+0000 7f8a64a00640 1 -- 172.21.15.46:0/2273714877 shutdown_connections 2024-02-19T17:14:34.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.653+0000 7f8a64a00640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f8a4006b810 0x7f8a4006dcd0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.653+0000 7f8a64a00640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a600c8e60 0x7f8a600c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.653+0000 7f8a64a00640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a600b1030 0x7f8a600b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.653+0000 7f8a64a00640 1 --2- 172.21.15.46:0/2273714877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a440039c0 0x7f8a6015a7c0 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.653+0000 7f8a64a00640 1 -- 172.21.15.46:0/2273714877 >> 172.21.15.46:0/2273714877 conn(0x7f8a6009ca00 msgr2=0x7f8a600b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:34.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.653+0000 7f8a64a00640 1 -- 172.21.15.46:0/2273714877 shutdown_connections 2024-02-19T17:14:34.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.653+0000 7f8a64a00640 1 -- 172.21.15.46:0/2273714877 wait complete. 2024-02-19T17:14:34.659 INFO:tasks.ceph:Scrubbing osd.2 2024-02-19T17:14:34.659 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-19T17:14:34.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.891+0000 7f0615c00640 1 Processor -- start 2024-02-19T17:14:34.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.892+0000 7f0615c00640 1 -- start start 2024-02-19T17:14:34.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.893+0000 7f0615c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f06100cc840 0x7f06100b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.893+0000 7f0615c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0610072990 0x7f06100ac130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.893+0000 7f0615c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0610098db0 con 0x7f06100cf520 2024-02-19T17:14:34.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.893+0000 7f0615c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06100b36e0 con 0x7f06100cc840 2024-02-19T17:14:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.893+0000 7f0615c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061015bad0 con 0x7f0610072990 2024-02-19T17:14:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.893+0000 7f060f400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f06100cc840 0x7f06100b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.894+0000 7f060f400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f06100cc840 0x7f06100b3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43966/0 (socket says 172.21.15.46:43966) 2024-02-19T17:14:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.894+0000 7f060f400640 1 -- 172.21.15.46:0/865072769 learned_addr learned my addr 172.21.15.46:0/865072769 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.894+0000 7f0615200640 1 --2- 172.21.15.46:0/865072769 >> v2:172.21.15.142:3300/0 conn(0x7f0610072990 0x7f06100ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.894+0000 7f060f400640 1 -- 172.21.15.46:0/865072769 >> v2:172.21.15.142:3300/0 conn(0x7f0610072990 msgr2=0x7f06100ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:34.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.894+0000 7f060f400640 1 --2- 172.21.15.46:0/865072769 >> v2:172.21.15.142:3300/0 conn(0x7f0610072990 0x7f06100ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.894+0000 7f060f400640 1 -- 172.21.15.46:0/865072769 >> v1:172.21.15.142:6789/0 conn(0x7f06100cf520 legacy=0x7f06100cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:34.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.894+0000 7f060f400640 1 -- 172.21.15.46:0/865072769 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06100731c0 con 0x7f06100cc840 2024-02-19T17:14:34.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.895+0000 7f060f400640 1 --2- 172.21.15.46:0/865072769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06100cc840 0x7f06100b3b00 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f061009d410 tx=0x7f05f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b9aa6871df17bf server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:34.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.896+0000 7f060ea00640 1 -- 172.21.15.46:0/865072769 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8031870 con 0x7f06100cc840 2024-02-19T17:14:34.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.896+0000 7f060ea00640 1 -- 172.21.15.46:0/865072769 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f80319d0 con 0x7f06100cc840 2024-02-19T17:14:34.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.896+0000 7f060ea00640 1 -- 172.21.15.46:0/865072769 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8031d60 con 0x7f06100cc840 2024-02-19T17:14:34.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.896+0000 7f0615c00640 1 -- 172.21.15.46:0/865072769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06100cc840 msgr2=0x7f06100b3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.896+0000 7f0615c00640 1 --2- 172.21.15.46:0/865072769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06100cc840 0x7f06100b3b00 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f061009d410 tx=0x7f05f802b910 comp rx=0 tx=0).stop 2024-02-19T17:14:34.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.896+0000 7f0615c00640 1 -- 172.21.15.46:0/865072769 shutdown_connections 2024-02-19T17:14:34.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.896+0000 7f0615c00640 1 --2- 172.21.15.46:0/865072769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06100cc840 0x7f06100b3b00 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.896+0000 7f0615c00640 1 --2- 172.21.15.46:0/865072769 >> v2:172.21.15.142:3300/0 conn(0x7f0610072990 0x7f06100ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.896+0000 7f0615c00640 1 -- 172.21.15.46:0/865072769 >> 172.21.15.46:0/865072769 conn(0x7f061006ad60 msgr2=0x7f061006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:34.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.897+0000 7f0615c00640 1 -- 172.21.15.46:0/865072769 shutdown_connections 2024-02-19T17:14:34.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.897+0000 7f0615c00640 1 -- 172.21.15.46:0/865072769 wait complete. 2024-02-19T17:14:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.898+0000 7f0615c00640 1 Processor -- start 2024-02-19T17:14:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.898+0000 7f0615c00640 1 -- start start 2024-02-19T17:14:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.899+0000 7f0615c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0610072990 0x7f06100c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.899+0000 7f0615c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06100cc840 0x7f061015cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.899+0000 7f0615c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06100cf520 0x7f06101f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.899+0000 7f0615c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06100c40e0 con 0x7f06100cc840 2024-02-19T17:14:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.899+0000 7f0615c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06100c34d0 con 0x7f0610072990 2024-02-19T17:14:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.899+0000 7f0615c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06100c37b0 con 0x7f06100cf520 2024-02-19T17:14:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.900+0000 7f060f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06100cc840 0x7f061015cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.900+0000 7f060f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06100cc840 0x7f061015cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43978/0 (socket says 172.21.15.46:43978) 2024-02-19T17:14:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.900+0000 7f060f400640 1 -- 172.21.15.46:0/114154435 learned_addr learned my addr 172.21.15.46:0/114154435 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.900+0000 7f060fe00640 1 --2- 172.21.15.46:0/114154435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0610072990 0x7f06100c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.900+0000 7f060f400640 1 -- 172.21.15.46:0/114154435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06100cf520 msgr2=0x7f06101f0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.900+0000 7f060f400640 1 --2- 172.21.15.46:0/114154435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06100cf520 0x7f06101f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.900+0000 7f060f400640 1 -- 172.21.15.46:0/114154435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0610072990 msgr2=0x7f06100c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.900+0000 7f060f400640 1 --2- 172.21.15.46:0/114154435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0610072990 0x7f06100c2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.900+0000 7f060f400640 1 -- 172.21.15.46:0/114154435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f80094d0 con 0x7f06100cc840 2024-02-19T17:14:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.901+0000 7f060f400640 1 --2- 172.21.15.46:0/114154435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06100cc840 0x7f061015cd20 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f05f802b950 tx=0x7f05f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.901+0000 7f0607e00640 1 -- 172.21.15.46:0/114154435 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f803ad30 con 0x7f06100cc840 2024-02-19T17:14:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.901+0000 7f0607e00640 1 -- 172.21.15.46:0/114154435 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f80443f0 con 0x7f06100cc840 2024-02-19T17:14:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.901+0000 7f0615c00640 1 -- 172.21.15.46:0/114154435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06100c3a90 con 0x7f06100cc840 2024-02-19T17:14:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.901+0000 7f0607e00640 1 -- 172.21.15.46:0/114154435 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f80447a0 con 0x7f06100cc840 2024-02-19T17:14:34.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.901+0000 7f0615c00640 1 -- 172.21.15.46:0/114154435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06101f1350 con 0x7f06100cc840 2024-02-19T17:14:34.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.902+0000 7f0615c00640 1 -- 172.21.15.46:0/114154435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06100b3300 con 0x7f06100cc840 2024-02-19T17:14:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.903+0000 7f0607e00640 1 -- 172.21.15.46:0/114154435 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f05f804d450 con 0x7f06100cc840 2024-02-19T17:14:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.904+0000 7f0607e00640 1 --2- 172.21.15.46:0/114154435 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f05ec06b810 0x7f05ec06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.904+0000 7f0607e00640 1 -- 172.21.15.46:0/114154435 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f05f802d040 con 0x7f06100cc840 2024-02-19T17:14:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.904+0000 7f0607e00640 1 --2- 172.21.15.46:0/114154435 >> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] conn(0x7f05ec0716d0 0x7f05ec073af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.904+0000 7f0607e00640 1 -- 172.21.15.46:0/114154435 --> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05ec0741a0 con 0x7f05ec0716d0 2024-02-19T17:14:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.904+0000 7f0607e00640 1 -- 172.21.15.46:0/114154435 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05f80ae980 con 0x7f06100cc840 2024-02-19T17:14:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.904+0000 7f0615200640 1 --2- 172.21.15.46:0/114154435 >> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] conn(0x7f05ec0716d0 0x7f05ec073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.905+0000 7f060fe00640 1 --2- 172.21.15.46:0/114154435 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f05ec06b810 0x7f05ec06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.905+0000 7f0615200640 1 --2- 172.21.15.46:0/114154435 >> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] conn(0x7f05ec0716d0 0x7f05ec073af0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.906+0000 7f060fe00640 1 --2- 172.21.15.46:0/114154435 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f05ec06b810 0x7f05ec06dcd0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0600007fd0 tx=0x7f0600009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.906+0000 7f0607e00640 1 -- 172.21.15.46:0/114154435 <== osd.2 v2:172.21.15.46:6800/1495872287 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f05ec0741a0 con 0x7f05ec0716d0 2024-02-19T17:14:34.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.921+0000 7f0615c00640 1 -- 172.21.15.46:0/114154435 --> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f06100b2d80 con 0x7f05ec0716d0 2024-02-19T17:14:34.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.921+0000 7f0607e00640 1 -- 172.21.15.46:0/114154435 <== osd.2 v2:172.21.15.46:6800/1495872287 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f06080099d0 con 0x7f05ec0716d0 2024-02-19T17:14:34.907 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T17:14:34.908 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-19T17:14:34.908 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T17:14:34.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.922+0000 7f0615c00640 1 -- 172.21.15.46:0/114154435 >> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] conn(0x7f05ec0716d0 msgr2=0x7f05ec073af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.922+0000 7f0615c00640 1 --2- 172.21.15.46:0/114154435 >> [v2:172.21.15.46:6800/1495872287,v1:172.21.15.46:6801/1495872287] conn(0x7f05ec0716d0 0x7f05ec073af0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.922+0000 7f0615c00640 1 -- 172.21.15.46:0/114154435 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f05ec06b810 msgr2=0x7f05ec06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.922+0000 7f0615c00640 1 --2- 172.21.15.46:0/114154435 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f05ec06b810 0x7f05ec06dcd0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0600007fd0 tx=0x7f0600009040 comp rx=0 tx=0).stop 2024-02-19T17:14:34.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.922+0000 7f0615c00640 1 -- 172.21.15.46:0/114154435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06100cc840 msgr2=0x7f061015cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:34.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.922+0000 7f0615c00640 1 --2- 172.21.15.46:0/114154435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06100cc840 0x7f061015cd20 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f05f802b950 tx=0x7f05f80046c0 comp rx=0 tx=0).stop 2024-02-19T17:14:34.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.922+0000 7f0615200640 1 -- 172.21.15.46:0/114154435 reap_dead start 2024-02-19T17:14:34.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.922+0000 7f0615c00640 1 -- 172.21.15.46:0/114154435 shutdown_connections 2024-02-19T17:14:34.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.922+0000 7f0615c00640 1 -- 172.21.15.46:0/114154435 >> 172.21.15.46:0/114154435 conn(0x7f061006ad60 msgr2=0x7f061006b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:34.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.922+0000 7f0615c00640 1 -- 172.21.15.46:0/114154435 shutdown_connections 2024-02-19T17:14:34.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:34.923+0000 7f0615c00640 1 -- 172.21.15.46:0/114154435 wait complete. 2024-02-19T17:14:34.927 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-19T17:14:35.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.158+0000 7fbd47e00640 1 Processor -- start 2024-02-19T17:14:35.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.159+0000 7fbd47e00640 1 -- start start 2024-02-19T17:14:35.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.160+0000 7fbd47e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4815dc20 0x7fbd4806c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.160+0000 7fbd47e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd48161f20 con 0x7fbd4815d840 2024-02-19T17:14:35.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.160+0000 7fbd47e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd480ce280 con 0x7fbd4806c9b0 2024-02-19T17:14:35.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.160+0000 7fbd47e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd481624a0 con 0x7fbd4815dc20 2024-02-19T17:14:35.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.161+0000 7fbd46a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbd4815d840 0x7fbd48161530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59596/0 (socket says 172.21.15.46:59596) 2024-02-19T17:14:35.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.161+0000 7fbd46a00640 1 -- 172.21.15.46:0/4023433636 learned_addr learned my addr 172.21.15.46:0/4023433636 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:35.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.161+0000 7fbd46000640 1 --2- 172.21.15.46:0/4023433636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4815dc20 0x7fbd4806c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.161+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940351241 0 0) 0x7fbd48161f20 con 0x7fbd4815d840 2024-02-19T17:14:35.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.161+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd2c003520 con 0x7fbd4815d840 2024-02-19T17:14:35.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1005735439 0 0) 0x7fbd2c003520 con 0x7fbd4815d840 2024-02-19T17:14:35.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4815dc20 msgr2=0x7fbd4806c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:35.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd45600640 1 --2- 172.21.15.46:0/4023433636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4815dc20 0x7fbd4806c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 >> v1:172.21.15.142:6789/0 conn(0x7fbd4806c9b0 legacy=0x7fbd480d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd480ce520 con 0x7fbd4815d840 2024-02-19T17:14:35.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7fbd380019f0 con 0x7fbd4815d840 2024-02-19T17:14:35.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 >> v1:172.21.15.46:6789/0 conn(0x7fbd4815d840 legacy=0x7fbd48161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd45600640 1 --2- 172.21.15.46:0/4023433636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2c0039a0 0x7fbd2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd45600640 1 --2- 172.21.15.46:0/4023433636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4815dc20 0x7fbd2c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd45600640 1 --2- 172.21.15.46:0/4023433636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c004d00 0x7fbd2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd481624a0 con 0x7fbd2c0039a0 2024-02-19T17:14:35.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c00ba90 con 0x7fbd2c004d00 2024-02-19T17:14:35.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c00bc50 con 0x7fbd4815dc20 2024-02-19T17:14:35.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd46a00640 1 --2- 172.21.15.46:0/4023433636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2c0039a0 0x7fbd2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.162+0000 7fbd47400640 1 --2- 172.21.15.46:0/4023433636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c004d00 0x7fbd2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.163+0000 7fbd46000640 1 --2- 172.21.15.46:0/4023433636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4815dc20 0x7fbd2c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.163+0000 7fbd46a00640 1 -- 172.21.15.46:0/4023433636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4815dc20 msgr2=0x7fbd2c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:35.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.163+0000 7fbd46a00640 1 --2- 172.21.15.46:0/4023433636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4815dc20 0x7fbd2c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.163+0000 7fbd46a00640 1 -- 172.21.15.46:0/4023433636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c004d00 msgr2=0x7fbd2c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:35.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.163+0000 7fbd46a00640 1 --2- 172.21.15.46:0/4023433636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c004d00 0x7fbd2c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.163+0000 7fbd46a00640 1 -- 172.21.15.46:0/4023433636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c003520 con 0x7fbd2c0039a0 2024-02-19T17:14:35.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.163+0000 7fbd47400640 1 --2- 172.21.15.46:0/4023433636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c004d00 0x7fbd2c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:35.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.164+0000 7fbd46a00640 1 --2- 172.21.15.46:0/4023433636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2c0039a0 0x7fbd2c003dc0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800a700 tx=0x7fbd2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20b87ff9df0764c server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:35.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.164+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38034630 con 0x7fbd2c0039a0 2024-02-19T17:14:35.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.164+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3802f070 con 0x7fbd2c0039a0 2024-02-19T17:14:35.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.164+0000 7fbd45600640 1 -- 172.21.15.46:0/4023433636 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38034a10 con 0x7fbd2c0039a0 2024-02-19T17:14:35.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.165+0000 7fbd47e00640 1 -- 172.21.15.46:0/4023433636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2c0039a0 msgr2=0x7fbd2c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.165+0000 7fbd47e00640 1 --2- 172.21.15.46:0/4023433636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2c0039a0 0x7fbd2c003dc0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800a700 tx=0x7fbd2c0057f0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.165+0000 7fbd47400640 1 -- 172.21.15.46:0/4023433636 reap_dead start 2024-02-19T17:14:35.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.165+0000 7fbd47e00640 1 -- 172.21.15.46:0/4023433636 shutdown_connections 2024-02-19T17:14:35.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.165+0000 7fbd47e00640 1 -- 172.21.15.46:0/4023433636 >> 172.21.15.46:0/4023433636 conn(0x7fbd4809c9d0 msgr2=0x7fbd4808afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:35.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.165+0000 7fbd47e00640 1 -- 172.21.15.46:0/4023433636 shutdown_connections 2024-02-19T17:14:35.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.165+0000 7fbd47e00640 1 -- 172.21.15.46:0/4023433636 wait complete. 2024-02-19T17:14:35.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.167+0000 7fbd47e00640 1 Processor -- start 2024-02-19T17:14:35.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.167+0000 7fbd47e00640 1 -- start start 2024-02-19T17:14:35.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.168+0000 7fbd47e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2c0039a0 0x7fbd480cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.168+0000 7fbd47e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd4815ccd0 0x7fbd480cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.168+0000 7fbd47e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4815fcb0 0x7fbd48160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.168+0000 7fbd47e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48160cc0 con 0x7fbd2c0039a0 2024-02-19T17:14:35.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.168+0000 7fbd47e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd481609e0 con 0x7fbd4815ccd0 2024-02-19T17:14:35.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.168+0000 7fbd47e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480b6640 con 0x7fbd4815fcb0 2024-02-19T17:14:35.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.168+0000 7fbd46a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2c0039a0 0x7fbd480cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.168+0000 7fbd46a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2c0039a0 0x7fbd480cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44004/0 (socket says 172.21.15.46:44004) 2024-02-19T17:14:35.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.168+0000 7fbd46a00640 1 -- 172.21.15.46:0/3898265785 learned_addr learned my addr 172.21.15.46:0/3898265785 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:35.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.168+0000 7fbd46000640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd4815ccd0 0x7fbd480cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.168+0000 7fbd47400640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4815fcb0 0x7fbd48160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.169+0000 7fbd46a00640 1 -- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4815fcb0 msgr2=0x7fbd48160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.169+0000 7fbd46a00640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4815fcb0 0x7fbd48160130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.169+0000 7fbd46a00640 1 -- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd4815ccd0 msgr2=0x7fbd480cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.169+0000 7fbd46a00640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd4815ccd0 0x7fbd480cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.169+0000 7fbd46a00640 1 -- 172.21.15.46:0/3898265785 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd480b6920 con 0x7fbd2c0039a0 2024-02-19T17:14:35.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.169+0000 7fbd46000640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd4815ccd0 0x7fbd480cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T17:14:35.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.169+0000 7fbd46a00640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2c0039a0 0x7fbd480cc8d0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800a700 tx=0x7fbd480ce410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:35.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.169+0000 7fbd3ea00640 1 -- 172.21.15.46:0/3898265785 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38004e20 con 0x7fbd2c0039a0 2024-02-19T17:14:35.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.169+0000 7fbd3ea00640 1 -- 172.21.15.46:0/3898265785 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd380354c0 con 0x7fbd2c0039a0 2024-02-19T17:14:35.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.169+0000 7fbd3ea00640 1 -- 172.21.15.46:0/3898265785 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38035830 con 0x7fbd2c0039a0 2024-02-19T17:14:35.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.169+0000 7fbd47e00640 1 -- 172.21.15.46:0/3898265785 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd480b6c00 con 0x7fbd2c0039a0 2024-02-19T17:14:35.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.170+0000 7fbd47e00640 1 -- 172.21.15.46:0/3898265785 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4815e030 con 0x7fbd2c0039a0 2024-02-19T17:14:35.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.171+0000 7fbd47e00640 1 -- 172.21.15.46:0/3898265785 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd480b6780 con 0x7fbd2c0039a0 2024-02-19T17:14:35.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.172+0000 7fbd3ea00640 1 -- 172.21.15.46:0/3898265785 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbd38031030 con 0x7fbd2c0039a0 2024-02-19T17:14:35.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.173+0000 7fbd3ea00640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbd2406b810 0x7fbd2406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.173+0000 7fbd3ea00640 1 -- 172.21.15.46:0/3898265785 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbd380abf10 con 0x7fbd2c0039a0 2024-02-19T17:14:35.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.173+0000 7fbd46000640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbd2406b810 0x7fbd2406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.175+0000 7fbd46000640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbd2406b810 0x7fbd2406dcd0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbd480b9720 tx=0x7fbd30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:35.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.177+0000 7fbd3ea00640 1 -- 172.21.15.46:0/3898265785 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbd480b6780 con 0x7fbd2c0039a0 2024-02-19T17:14:35.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.378+0000 7fbd47e00640 1 -- 172.21.15.46:0/3898265785 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd48068540 con 0x7fbd2406b810 2024-02-19T17:14:35.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.379+0000 7fbd3ea00640 1 -- 172.21.15.46:0/3898265785 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbd48068540 con 0x7fbd2406b810 2024-02-19T17:14:35.364 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2024-02-19T17:14:35.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.382+0000 7fbd47e00640 1 -- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbd2406b810 msgr2=0x7fbd2406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.382+0000 7fbd47e00640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbd2406b810 0x7fbd2406dcd0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbd480b9720 tx=0x7fbd30008040 comp rx=0 tx=0).stop 2024-02-19T17:14:35.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.382+0000 7fbd47e00640 1 -- 172.21.15.46:0/3898265785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2c0039a0 msgr2=0x7fbd480cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.382+0000 7fbd47e00640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2c0039a0 0x7fbd480cc8d0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800a700 tx=0x7fbd480ce410 comp rx=0 tx=0).stop 2024-02-19T17:14:35.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.382+0000 7fbd47e00640 1 -- 172.21.15.46:0/3898265785 shutdown_connections 2024-02-19T17:14:35.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.382+0000 7fbd47e00640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fbd2406b810 0x7fbd2406dcd0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.382+0000 7fbd47e00640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4815fcb0 0x7fbd48160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.382+0000 7fbd47e00640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd4815ccd0 0x7fbd480cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.382+0000 7fbd47e00640 1 --2- 172.21.15.46:0/3898265785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd2c0039a0 0x7fbd480cc8d0 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.382+0000 7fbd47e00640 1 -- 172.21.15.46:0/3898265785 >> 172.21.15.46:0/3898265785 conn(0x7fbd4809c9d0 msgr2=0x7fbd480d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:35.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.382+0000 7fbd47e00640 1 -- 172.21.15.46:0/3898265785 shutdown_connections 2024-02-19T17:14:35.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.382+0000 7fbd47e00640 1 -- 172.21.15.46:0/3898265785 wait complete. 2024-02-19T17:14:35.388 INFO:tasks.ceph:Scrubbing osd.3 2024-02-19T17:14:35.388 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-19T17:14:35.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.633+0000 7fa628a00640 1 Processor -- start 2024-02-19T17:14:35.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.633+0000 7fa628a00640 1 -- start start 2024-02-19T17:14:35.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.634+0000 7fa628a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa62415d940 0x7fa62406cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.634+0000 7fa628a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa624161400 0x7fa624161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.634+0000 7fa628a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240d1c10 0x7fa6240d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.634+0000 7fa628a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62406d420 con 0x7fa624161400 2024-02-19T17:14:35.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.634+0000 7fa628a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6240d25c0 con 0x7fa62415d940 2024-02-19T17:14:35.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.634+0000 7fa628a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240d1520 con 0x7fa6240d1c10 2024-02-19T17:14:35.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.635+0000 7fa622a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa624161400 0x7fa624161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.635+0000 7fa622a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa624161400 0x7fa624161890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57152/0 (socket says 172.21.15.46:57152) 2024-02-19T17:14:35.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.635+0000 7fa622a00640 1 -- 172.21.15.46:0/2116366139 learned_addr learned my addr 172.21.15.46:0/2116366139 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:35.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.635+0000 7fa623e00640 1 --2- 172.21.15.46:0/2116366139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240d1c10 0x7fa6240d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.635+0000 7fa622a00640 1 -- 172.21.15.46:0/2116366139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240d1c10 msgr2=0x7fa6240d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:35.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.635+0000 7fa623400640 1 --2- 172.21.15.46:0/2116366139 >> v2:172.21.15.142:3300/0 conn(0x7fa62415d940 0x7fa62406cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.635+0000 7fa622a00640 1 --2- 172.21.15.46:0/2116366139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240d1c10 0x7fa6240d2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.635+0000 7fa622a00640 1 -- 172.21.15.46:0/2116366139 >> v2:172.21.15.142:3300/0 conn(0x7fa62415d940 msgr2=0x7fa62406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:35.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.635+0000 7fa622a00640 1 --2- 172.21.15.46:0/2116366139 >> v2:172.21.15.142:3300/0 conn(0x7fa62415d940 0x7fa62406cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.635+0000 7fa622a00640 1 -- 172.21.15.46:0/2116366139 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624161f50 con 0x7fa624161400 2024-02-19T17:14:35.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.635+0000 7fa623400640 1 --2- 172.21.15.46:0/2116366139 >> v2:172.21.15.142:3300/0 conn(0x7fa62415d940 0x7fa62406cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:35.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.636+0000 7fa622a00640 1 --2- 172.21.15.46:0/2116366139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa624161400 0x7fa624161890 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7fa62408d900 tx=0x7fa61002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b048a90f23864d59 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:35.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.637+0000 7fa622000640 1 -- 172.21.15.46:0/2116366139 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610031870 con 0x7fa624161400 2024-02-19T17:14:35.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.637+0000 7fa622000640 1 -- 172.21.15.46:0/2116366139 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6100319d0 con 0x7fa624161400 2024-02-19T17:14:35.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.637+0000 7fa622000640 1 -- 172.21.15.46:0/2116366139 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610031d60 con 0x7fa624161400 2024-02-19T17:14:35.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.637+0000 7fa628a00640 1 -- 172.21.15.46:0/2116366139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa624161400 msgr2=0x7fa624161890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.637+0000 7fa628a00640 1 --2- 172.21.15.46:0/2116366139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa624161400 0x7fa624161890 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7fa62408d900 tx=0x7fa61002b910 comp rx=0 tx=0).stop 2024-02-19T17:14:35.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.638+0000 7fa628a00640 1 -- 172.21.15.46:0/2116366139 shutdown_connections 2024-02-19T17:14:35.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.638+0000 7fa628a00640 1 --2- 172.21.15.46:0/2116366139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240d1c10 0x7fa6240d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.638+0000 7fa628a00640 1 --2- 172.21.15.46:0/2116366139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa624161400 0x7fa624161890 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.638+0000 7fa628a00640 1 --2- 172.21.15.46:0/2116366139 >> v2:172.21.15.142:3300/0 conn(0x7fa62415d940 0x7fa62406cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.638+0000 7fa628a00640 1 -- 172.21.15.46:0/2116366139 >> 172.21.15.46:0/2116366139 conn(0x7fa62409ca70 msgr2=0x7fa62408afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:35.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.638+0000 7fa628a00640 1 -- 172.21.15.46:0/2116366139 shutdown_connections 2024-02-19T17:14:35.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.638+0000 7fa628a00640 1 -- 172.21.15.46:0/2116366139 wait complete. 2024-02-19T17:14:35.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.639+0000 7fa628a00640 1 Processor -- start 2024-02-19T17:14:35.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.640+0000 7fa628a00640 1 -- start start 2024-02-19T17:14:35.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.641+0000 7fa628a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6240d1c10 0x7fa6240b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.641+0000 7fa628a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa62415d940 0x7fa6240b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.641+0000 7fa628a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa624161400 0x7fa6240c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.641+0000 7fa628a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240b7b20 con 0x7fa6240d1c10 2024-02-19T17:14:35.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.641+0000 7fa628a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240b02d0 con 0x7fa62415d940 2024-02-19T17:14:35.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.641+0000 7fa628a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240ca430 con 0x7fa624161400 2024-02-19T17:14:35.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.641+0000 7fa623400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6240d1c10 0x7fa6240b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.641+0000 7fa623400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6240d1c10 0x7fa6240b6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57166/0 (socket says 172.21.15.46:57166) 2024-02-19T17:14:35.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.641+0000 7fa623400640 1 -- 172.21.15.46:0/1639129098 learned_addr learned my addr 172.21.15.46:0/1639129098 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:35.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.641+0000 7fa622a00640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa62415d940 0x7fa6240b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.641+0000 7fa623400640 1 -- 172.21.15.46:0/1639129098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa624161400 msgr2=0x7fa6240c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.641+0000 7fa623e00640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa624161400 0x7fa6240c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.642+0000 7fa623400640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa624161400 0x7fa6240c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.642+0000 7fa623400640 1 -- 172.21.15.46:0/1639129098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa62415d940 msgr2=0x7fa6240b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.642+0000 7fa623400640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa62415d940 0x7fa6240b75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.642+0000 7fa623400640 1 -- 172.21.15.46:0/1639129098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6100094d0 con 0x7fa6240d1c10 2024-02-19T17:14:35.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.642+0000 7fa622a00640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa62415d940 0x7fa6240b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:35.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.642+0000 7fa623e00640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa624161400 0x7fa6240c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:35.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.642+0000 7fa623400640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6240d1c10 0x7fa6240b6fb0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c7f0 tx=0x7fa61400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:35.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.642+0000 7fa61b400640 1 -- 172.21.15.46:0/1639129098 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614007a30 con 0x7fa6240d1c10 2024-02-19T17:14:35.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.642+0000 7fa61b400640 1 -- 172.21.15.46:0/1639129098 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa614007b90 con 0x7fa6240d1c10 2024-02-19T17:14:35.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.642+0000 7fa628a00640 1 -- 172.21.15.46:0/1639129098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6240b0570 con 0x7fa6240d1c10 2024-02-19T17:14:35.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.642+0000 7fa61b400640 1 -- 172.21.15.46:0/1639129098 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61400ce40 con 0x7fa6240d1c10 2024-02-19T17:14:35.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.642+0000 7fa628a00640 1 -- 172.21.15.46:0/1639129098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6240b0b30 con 0x7fa6240d1c10 2024-02-19T17:14:35.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.643+0000 7fa628a00640 1 -- 172.21.15.46:0/1639129098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa62406c9c0 con 0x7fa6240d1c10 2024-02-19T17:14:35.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.644+0000 7fa61b400640 1 -- 172.21.15.46:0/1639129098 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa6140113f0 con 0x7fa6240d1c10 2024-02-19T17:14:35.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.645+0000 7fa61b400640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa60406b810 0x7fa60406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.645+0000 7fa61b400640 1 -- 172.21.15.46:0/1639129098 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa61408a120 con 0x7fa6240d1c10 2024-02-19T17:14:35.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.646+0000 7fa61b400640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] conn(0x7fa6040716d0 0x7fa604073af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.646+0000 7fa61b400640 1 -- 172.21.15.46:0/1639129098 --> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6040741a0 con 0x7fa6040716d0 2024-02-19T17:14:35.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.646+0000 7fa61b400640 1 -- 172.21.15.46:0/1639129098 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa61408c700 con 0x7fa6240d1c10 2024-02-19T17:14:35.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.646+0000 7fa622a00640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa60406b810 0x7fa60406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.646+0000 7fa623e00640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] conn(0x7fa6040716d0 0x7fa604073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.647+0000 7fa623e00640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] conn(0x7fa6040716d0 0x7fa604073af0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:35.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.647+0000 7fa622a00640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa60406b810 0x7fa60406dcd0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa610036000 tx=0x7fa610008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:35.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.648+0000 7fa61b400640 1 -- 172.21.15.46:0/1639129098 <== osd.3 v2:172.21.15.46:6824/319601708 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa6040741a0 con 0x7fa6040716d0 2024-02-19T17:14:35.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.663+0000 7fa628a00640 1 -- 172.21.15.46:0/1639129098 --> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa62406c6e0 con 0x7fa6040716d0 2024-02-19T17:14:35.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.663+0000 7fa61b400640 1 -- 172.21.15.46:0/1639129098 <== osd.3 v2:172.21.15.46:6824/319601708 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa61c008920 con 0x7fa6040716d0 2024-02-19T17:14:35.649 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T17:14:35.649 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-19T17:14:35.649 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T17:14:35.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.664+0000 7fa628a00640 1 -- 172.21.15.46:0/1639129098 >> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] conn(0x7fa6040716d0 msgr2=0x7fa604073af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.664+0000 7fa628a00640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.46:6824/319601708,v1:172.21.15.46:6825/319601708] conn(0x7fa6040716d0 0x7fa604073af0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.664+0000 7fa628a00640 1 -- 172.21.15.46:0/1639129098 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa60406b810 msgr2=0x7fa60406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.664+0000 7fa628a00640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fa60406b810 0x7fa60406dcd0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa610036000 tx=0x7fa610008030 comp rx=0 tx=0).stop 2024-02-19T17:14:35.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.664+0000 7fa628a00640 1 -- 172.21.15.46:0/1639129098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6240d1c10 msgr2=0x7fa6240b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.664+0000 7fa628a00640 1 --2- 172.21.15.46:0/1639129098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6240d1c10 0x7fa6240b6fb0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c7f0 tx=0x7fa61400cbf0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.664+0000 7fa623e00640 1 -- 172.21.15.46:0/1639129098 reap_dead start 2024-02-19T17:14:35.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.664+0000 7fa628a00640 1 -- 172.21.15.46:0/1639129098 shutdown_connections 2024-02-19T17:14:35.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.664+0000 7fa628a00640 1 -- 172.21.15.46:0/1639129098 >> 172.21.15.46:0/1639129098 conn(0x7fa62409ca70 msgr2=0x7fa62408afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:35.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.664+0000 7fa628a00640 1 -- 172.21.15.46:0/1639129098 shutdown_connections 2024-02-19T17:14:35.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.664+0000 7fa628a00640 1 -- 172.21.15.46:0/1639129098 wait complete. 2024-02-19T17:14:35.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-19T17:14:35.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.886+0000 7f8567200640 1 Processor -- start 2024-02-19T17:14:35.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.887+0000 7f8567200640 1 -- start start 2024-02-19T17:14:35.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.888+0000 7f8567200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85680cdd10 0x7f85680ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.888+0000 7f8567200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f856815f3c0 0x7f856815f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.888+0000 7f8567200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85680b1410 con 0x7f8568099a30 2024-02-19T17:14:35.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.888+0000 7f8567200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85680ce630 con 0x7f856815f3c0 2024-02-19T17:14:35.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.888+0000 7f8567200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85680b2420 con 0x7f85680cdd10 2024-02-19T17:14:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.889+0000 7f855d400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f856815f3c0 0x7f856815f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.889+0000 7f855d400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f856815f3c0 0x7f856815f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57180/0 (socket says 172.21.15.46:57180) 2024-02-19T17:14:35.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.889+0000 7f8565e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85680cdd10 0x7f85680ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.889+0000 7f855d400640 1 -- 172.21.15.46:0/3458255 learned_addr learned my addr 172.21.15.46:0/3458255 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:35.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.890+0000 7f855d400640 1 -- 172.21.15.46:0/3458255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85680cdd10 msgr2=0x7f85680ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:35.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.890+0000 7f855d400640 1 --2- 172.21.15.46:0/3458255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85680cdd10 0x7f85680ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.890+0000 7f855d400640 1 -- 172.21.15.46:0/3458255 >> v1:172.21.15.142:6789/0 conn(0x7f8568099a30 legacy=0x7f8568099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.890+0000 7f855d400640 1 -- 172.21.15.46:0/3458255 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85680b1660 con 0x7f856815f3c0 2024-02-19T17:14:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.891+0000 7f855d400640 1 --2- 172.21.15.46:0/3458255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f856815f3c0 0x7f856815f800 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f8550009870 tx=0x7f855002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28704cd7a7c92992 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.891+0000 7f8565400640 1 -- 172.21.15.46:0/3458255 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8550031640 con 0x7f856815f3c0 2024-02-19T17:14:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.892+0000 7f8565400640 1 -- 172.21.15.46:0/3458255 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85500317a0 con 0x7f856815f3c0 2024-02-19T17:14:35.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.892+0000 7f8565400640 1 -- 172.21.15.46:0/3458255 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8550031b30 con 0x7f856815f3c0 2024-02-19T17:14:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.892+0000 7f8567200640 1 -- 172.21.15.46:0/3458255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f856815f3c0 msgr2=0x7f856815f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.892+0000 7f8567200640 1 --2- 172.21.15.46:0/3458255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f856815f3c0 0x7f856815f800 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f8550009870 tx=0x7f855002b8f0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.892+0000 7f8567200640 1 -- 172.21.15.46:0/3458255 shutdown_connections 2024-02-19T17:14:35.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.892+0000 7f8567200640 1 --2- 172.21.15.46:0/3458255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f856815f3c0 0x7f856815f800 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.892+0000 7f8567200640 1 --2- 172.21.15.46:0/3458255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85680cdd10 0x7f85680ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.892+0000 7f8567200640 1 -- 172.21.15.46:0/3458255 >> 172.21.15.46:0/3458255 conn(0x7f85680d14c0 msgr2=0x7f85680d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:35.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.892+0000 7f8567200640 1 -- 172.21.15.46:0/3458255 shutdown_connections 2024-02-19T17:14:35.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.892+0000 7f8567200640 1 -- 172.21.15.46:0/3458255 wait complete. 2024-02-19T17:14:35.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.894+0000 7f8567200640 1 Processor -- start 2024-02-19T17:14:35.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.894+0000 7f8567200640 1 -- start start 2024-02-19T17:14:35.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.895+0000 7f8567200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8568099a30 0x7f85680b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.895+0000 7f8567200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85680cdd10 0x7f85680c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.895+0000 7f8567200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856815f3c0 0x7f85681f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.895+0000 7f8567200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85680b6fb0 con 0x7f85680cdd10 2024-02-19T17:14:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.895+0000 7f8567200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85681591f0 con 0x7f856815f3c0 2024-02-19T17:14:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.895+0000 7f8567200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856806c070 con 0x7f8568099a30 2024-02-19T17:14:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.896+0000 7f855d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85680cdd10 0x7f85680c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.896+0000 7f855d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85680cdd10 0x7f85680c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57184/0 (socket says 172.21.15.46:57184) 2024-02-19T17:14:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.896+0000 7f855d400640 1 -- 172.21.15.46:0/3511016475 learned_addr learned my addr 172.21.15.46:0/3511016475 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.896+0000 7f8565e00640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8568099a30 0x7f85680b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.896+0000 7f8566800640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856815f3c0 0x7f85681f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.896+0000 7f855d400640 1 -- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8568099a30 msgr2=0x7f85680b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.896+0000 7f855d400640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8568099a30 0x7f85680b6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.896+0000 7f855d400640 1 -- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856815f3c0 msgr2=0x7f85681f70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.896+0000 7f855d400640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856815f3c0 0x7f85681f70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:35.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.896+0000 7f855d400640 1 -- 172.21.15.46:0/3511016475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85500094d0 con 0x7f85680cdd10 2024-02-19T17:14:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.896+0000 7f8565e00640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8568099a30 0x7f85680b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T17:14:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.897+0000 7f855d400640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85680cdd10 0x7f85680c8590 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f8550000c00 tx=0x7f85500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.897+0000 7f855ea00640 1 -- 172.21.15.46:0/3511016475 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855003a930 con 0x7f85680cdd10 2024-02-19T17:14:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.897+0000 7f855ea00640 1 -- 172.21.15.46:0/3511016475 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855003aa90 con 0x7f85680cdd10 2024-02-19T17:14:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.897+0000 7f8567200640 1 -- 172.21.15.46:0/3511016475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856806c350 con 0x7f85680cdd10 2024-02-19T17:14:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.897+0000 7f855ea00640 1 -- 172.21.15.46:0/3511016475 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855003ae40 con 0x7f85680cdd10 2024-02-19T17:14:35.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.898+0000 7f8567200640 1 -- 172.21.15.46:0/3511016475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856806c910 con 0x7f85680cdd10 2024-02-19T17:14:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.899+0000 7f8567200640 1 -- 172.21.15.46:0/3511016475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856806cb00 con 0x7f85680cdd10 2024-02-19T17:14:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.900+0000 7f855ea00640 1 -- 172.21.15.46:0/3511016475 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f855002f050 con 0x7f85680cdd10 2024-02-19T17:14:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.901+0000 7f855ea00640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f854406b810 0x7f854406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:35.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.901+0000 7f855ea00640 1 -- 172.21.15.46:0/3511016475 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f85500abd80 con 0x7f85680cdd10 2024-02-19T17:14:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.901+0000 7f8565e00640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f854406b810 0x7f854406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.903+0000 7f8565e00640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f854406b810 0x7f854406dcd0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8558009fd0 tx=0x7f855800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:35.906+0000 7f855ea00640 1 -- 172.21.15.46:0/3511016475 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8550076a00 con 0x7f85680cdd10 2024-02-19T17:14:36.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.110+0000 7f8567200640 1 -- 172.21.15.46:0/3511016475 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8568159520 con 0x7f854406b810 2024-02-19T17:14:36.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.111+0000 7f855ea00640 1 -- 172.21.15.46:0/3511016475 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8568159520 con 0x7f854406b810 2024-02-19T17:14:36.096 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 3 to deep-scrub 2024-02-19T17:14:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.114+0000 7f8567200640 1 -- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f854406b810 msgr2=0x7f854406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.114+0000 7f8567200640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f854406b810 0x7f854406dcd0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8558009fd0 tx=0x7f855800b040 comp rx=0 tx=0).stop 2024-02-19T17:14:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.114+0000 7f8567200640 1 -- 172.21.15.46:0/3511016475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85680cdd10 msgr2=0x7f85680c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.114+0000 7f8567200640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85680cdd10 0x7f85680c8590 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f8550000c00 tx=0x7f85500046c0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.114+0000 7f8567200640 1 -- 172.21.15.46:0/3511016475 shutdown_connections 2024-02-19T17:14:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.114+0000 7f8567200640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f854406b810 0x7f854406dcd0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.114+0000 7f8567200640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856815f3c0 0x7f85681f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.114+0000 7f8567200640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85680cdd10 0x7f85680c8590 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.114+0000 7f8567200640 1 --2- 172.21.15.46:0/3511016475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8568099a30 0x7f85680b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.114+0000 7f8567200640 1 -- 172.21.15.46:0/3511016475 >> 172.21.15.46:0/3511016475 conn(0x7f85680d14c0 msgr2=0x7f8568099e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:36.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.114+0000 7f8567200640 1 -- 172.21.15.46:0/3511016475 shutdown_connections 2024-02-19T17:14:36.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.114+0000 7f8567200640 1 -- 172.21.15.46:0/3511016475 wait complete. 2024-02-19T17:14:36.119 INFO:tasks.ceph:Scrubbing osd.4 2024-02-19T17:14:36.119 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-02-19T17:14:36.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.349+0000 7f1e81800640 1 Processor -- start 2024-02-19T17:14:36.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.349+0000 7f1e81800640 1 -- start start 2024-02-19T17:14:36.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.350+0000 7f1e81800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e7c0cf980 0x7f1e7c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.350+0000 7f1e81800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c0ae0f0 con 0x7f1e7c0cf520 2024-02-19T17:14:36.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.350+0000 7f1e81800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c0cceb0 con 0x7f1e7c0add10 2024-02-19T17:14:36.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.350+0000 7f1e81800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c0cd750 con 0x7f1e7c0cf980 2024-02-19T17:14:36.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.350+0000 7f1e7b400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1e7c0cf520 0x7f1e7c0cdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39872/0 (socket says 172.21.15.46:39872) 2024-02-19T17:14:36.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.351+0000 7f1e7b400640 1 -- 172.21.15.46:0/122815347 learned_addr learned my addr 172.21.15.46:0/122815347 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:36.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.351+0000 7f1e80e00640 1 --2- 172.21.15.46:0/122815347 >> v2:172.21.15.142:3300/0 conn(0x7f1e7c0cf980 0x7f1e7c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.351+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899902920 0 0) 0x7f1e7c0ae0f0 con 0x7f1e7c0cf520 2024-02-19T17:14:36.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.351+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e60005730 con 0x7f1e7c0cf520 2024-02-19T17:14:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.351+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3910054277 0 0) 0x7f1e60005730 con 0x7f1e7c0cf520 2024-02-19T17:14:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.351+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 >> v2:172.21.15.142:3300/0 conn(0x7f1e7c0cf980 msgr2=0x7f1e7c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7aa00640 1 --2- 172.21.15.46:0/122815347 >> v2:172.21.15.142:3300/0 conn(0x7f1e7c0cf980 0x7f1e7c0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 >> v1:172.21.15.142:6789/0 conn(0x7f1e7c0add10 legacy=0x7f1e7c0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c0ac130 con 0x7f1e7c0cf520 2024-02-19T17:14:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 391066734 0 0) 0x7f1e64001670 con 0x7f1e7c0cf520 2024-02-19T17:14:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 >> v1:172.21.15.46:6789/0 conn(0x7f1e7c0cf520 legacy=0x7f1e7c0cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7aa00640 1 --2- 172.21.15.46:0/122815347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e60005bb0 0x7f1e60005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7aa00640 1 --2- 172.21.15.46:0/122815347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e600069d0 0x7f1e60006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7aa00640 1 --2- 172.21.15.46:0/122815347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e600074b0 0x7f1e6000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0cd750 con 0x7f1e600069d0 2024-02-19T17:14:36.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6000e3b0 con 0x7f1e60005bb0 2024-02-19T17:14:36.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6000e570 con 0x7f1e600074b0 2024-02-19T17:14:36.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7b400640 1 --2- 172.21.15.46:0/122815347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e600069d0 0x7f1e60006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7be00640 1 --2- 172.21.15.46:0/122815347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e60005bb0 0x7f1e60005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e80e00640 1 --2- 172.21.15.46:0/122815347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e600074b0 0x7f1e6000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7b400640 1 -- 172.21.15.46:0/122815347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e600074b0 msgr2=0x7f1e6000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:36.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7b400640 1 --2- 172.21.15.46:0/122815347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e600074b0 0x7f1e6000db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7b400640 1 -- 172.21.15.46:0/122815347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e60005bb0 msgr2=0x7f1e60005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:36.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7b400640 1 --2- 172.21.15.46:0/122815347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e60005bb0 0x7f1e60005fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.352+0000 7f1e7b400640 1 -- 172.21.15.46:0/122815347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e60005730 con 0x7f1e600069d0 2024-02-19T17:14:36.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.353+0000 7f1e80e00640 1 -- 172.21.15.46:0/122815347 reap_dead start 2024-02-19T17:14:36.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.354+0000 7f1e7b400640 1 --2- 172.21.15.46:0/122815347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e600069d0 0x7f1e60006e50 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f1e64007fd0 tx=0x7f1e60007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e78e7dc6dab93 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:36.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.354+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64005ad0 con 0x7f1e600069d0 2024-02-19T17:14:36.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.354+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e64005c30 con 0x7f1e600069d0 2024-02-19T17:14:36.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.354+0000 7f1e7aa00640 1 -- 172.21.15.46:0/122815347 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6402ca10 con 0x7f1e600069d0 2024-02-19T17:14:36.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.354+0000 7f1e81800640 1 -- 172.21.15.46:0/122815347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e600069d0 msgr2=0x7f1e60006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.354+0000 7f1e81800640 1 --2- 172.21.15.46:0/122815347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e600069d0 0x7f1e60006e50 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f1e64007fd0 tx=0x7f1e60007a00 comp rx=0 tx=0).stop 2024-02-19T17:14:36.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.355+0000 7f1e81800640 1 -- 172.21.15.46:0/122815347 shutdown_connections 2024-02-19T17:14:36.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.355+0000 7f1e81800640 1 --2- 172.21.15.46:0/122815347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e600069d0 0x7f1e60006e50 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.355+0000 7f1e81800640 1 -- 172.21.15.46:0/122815347 >> 172.21.15.46:0/122815347 conn(0x7f1e7c06ad60 msgr2=0x7f1e7c06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:36.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.355+0000 7f1e81800640 1 -- 172.21.15.46:0/122815347 shutdown_connections 2024-02-19T17:14:36.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.355+0000 7f1e81800640 1 -- 172.21.15.46:0/122815347 wait complete. 2024-02-19T17:14:36.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.356+0000 7f1e81800640 1 Processor -- start 2024-02-19T17:14:36.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.357+0000 7f1e81800640 1 -- start start 2024-02-19T17:14:36.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.357+0000 7f1e81800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e600069d0 0x7f1e7c071b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.357+0000 7f1e81800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e7c0af9a0 0x7f1e7c0988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.357+0000 7f1e81800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e7c157640 0x7f1e7c070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.358+0000 7f1e81800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c06f130 con 0x7f1e600069d0 2024-02-19T17:14:36.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.358+0000 7f1e81800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c153470 con 0x7f1e7c157640 2024-02-19T17:14:36.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.358+0000 7f1e81800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0af0a0 con 0x7f1e7c0af9a0 2024-02-19T17:14:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.358+0000 7f1e7be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e600069d0 0x7f1e7c071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.358+0000 7f1e7be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e600069d0 0x7f1e7c071b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57212/0 (socket says 172.21.15.46:57212) 2024-02-19T17:14:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.358+0000 7f1e7be00640 1 -- 172.21.15.46:0/2233344155 learned_addr learned my addr 172.21.15.46:0/2233344155 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.358+0000 7f1e80e00640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e7c157640 0x7f1e7c070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.358+0000 7f1e7b400640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e7c0af9a0 0x7f1e7c0988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.358+0000 7f1e7be00640 1 -- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e7c0af9a0 msgr2=0x7f1e7c0988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.358+0000 7f1e7be00640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e7c0af9a0 0x7f1e7c0988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.358+0000 7f1e7be00640 1 -- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e7c157640 msgr2=0x7f1e7c070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.358+0000 7f1e7be00640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e7c157640 0x7f1e7c070d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.358+0000 7f1e7be00640 1 -- 172.21.15.46:0/2233344155 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c153730 con 0x7f1e600069d0 2024-02-19T17:14:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.359+0000 7f1e7be00640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e600069d0 0x7f1e7c071b60 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00f960 tx=0x7f1e6c00fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.359+0000 7f1e73e00640 1 -- 172.21.15.46:0/2233344155 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c003b80 con 0x7f1e600069d0 2024-02-19T17:14:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.359+0000 7f1e73e00640 1 -- 172.21.15.46:0/2233344155 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c003ce0 con 0x7f1e600069d0 2024-02-19T17:14:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.359+0000 7f1e73e00640 1 -- 172.21.15.46:0/2233344155 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00da10 con 0x7f1e600069d0 2024-02-19T17:14:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.359+0000 7f1e81800640 1 -- 172.21.15.46:0/2233344155 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c06edc0 con 0x7f1e600069d0 2024-02-19T17:14:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.359+0000 7f1e81800640 1 -- 172.21.15.46:0/2233344155 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c098e30 con 0x7f1e600069d0 2024-02-19T17:14:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.360+0000 7f1e81800640 1 -- 172.21.15.46:0/2233344155 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e7c0cd3e0 con 0x7f1e600069d0 2024-02-19T17:14:36.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.361+0000 7f1e73e00640 1 -- 172.21.15.46:0/2233344155 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1e6c00db70 con 0x7f1e600069d0 2024-02-19T17:14:36.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.362+0000 7f1e73e00640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1e5806b840 0x7f1e5806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.362+0000 7f1e73e00640 1 -- 172.21.15.46:0/2233344155 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1e6c08a1b0 con 0x7f1e600069d0 2024-02-19T17:14:36.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.362+0000 7f1e73e00640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] conn(0x7f1e58071700 0x7f1e58073b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.362+0000 7f1e73e00640 1 -- 172.21.15.46:0/2233344155 --> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e580741d0 con 0x7f1e58071700 2024-02-19T17:14:36.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.362+0000 7f1e73e00640 1 -- 172.21.15.46:0/2233344155 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e6c08c790 con 0x7f1e600069d0 2024-02-19T17:14:36.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.363+0000 7f1e7b400640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1e5806b840 0x7f1e5806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.363+0000 7f1e80e00640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] conn(0x7f1e58071700 0x7f1e58073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.364+0000 7f1e7b400640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1e5806b840 0x7f1e5806dd00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1e64034000 tx=0x7f1e64009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:36.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.364+0000 7f1e80e00640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] conn(0x7f1e58071700 0x7f1e58073b20 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:36.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.366+0000 7f1e73e00640 1 -- 172.21.15.46:0/2233344155 <== osd.4 v2:172.21.15.142:6800/4262903338 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1e580741d0 con 0x7f1e58071700 2024-02-19T17:14:36.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.381+0000 7f1e81800640 1 -- 172.21.15.46:0/2233344155 --> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1e7c071520 con 0x7f1e58071700 2024-02-19T17:14:36.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.382+0000 7f1e73e00640 1 -- 172.21.15.46:0/2233344155 <== osd.4 v2:172.21.15.142:6800/4262903338 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1e7c071520 con 0x7f1e58071700 2024-02-19T17:14:36.367 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T17:14:36.367 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-19T17:14:36.368 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T17:14:36.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.382+0000 7f1e81800640 1 -- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] conn(0x7f1e58071700 msgr2=0x7f1e58073b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.382+0000 7f1e81800640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:6800/4262903338,v1:172.21.15.142:6801/4262903338] conn(0x7f1e58071700 0x7f1e58073b20 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.383+0000 7f1e81800640 1 -- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1e5806b840 msgr2=0x7f1e5806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.383+0000 7f1e81800640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f1e5806b840 0x7f1e5806dd00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1e64034000 tx=0x7f1e64009030 comp rx=0 tx=0).stop 2024-02-19T17:14:36.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.383+0000 7f1e81800640 1 -- 172.21.15.46:0/2233344155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e600069d0 msgr2=0x7f1e7c071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.383+0000 7f1e81800640 1 --2- 172.21.15.46:0/2233344155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e600069d0 0x7f1e7c071b60 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00f960 tx=0x7f1e6c00fe20 comp rx=0 tx=0).stop 2024-02-19T17:14:36.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.383+0000 7f1e80e00640 1 -- 172.21.15.46:0/2233344155 reap_dead start 2024-02-19T17:14:36.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.383+0000 7f1e81800640 1 -- 172.21.15.46:0/2233344155 shutdown_connections 2024-02-19T17:14:36.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.383+0000 7f1e81800640 1 -- 172.21.15.46:0/2233344155 >> 172.21.15.46:0/2233344155 conn(0x7f1e7c06ad60 msgr2=0x7f1e7c15e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:36.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.383+0000 7f1e81800640 1 -- 172.21.15.46:0/2233344155 shutdown_connections 2024-02-19T17:14:36.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.383+0000 7f1e81800640 1 -- 172.21.15.46:0/2233344155 wait complete. 2024-02-19T17:14:36.388 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-02-19T17:14:36.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.628+0000 7f5713c00640 1 Processor -- start 2024-02-19T17:14:36.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.628+0000 7f5713c00640 1 -- start start 2024-02-19T17:14:36.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.630+0000 7f5713c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f570c154b60 0x7f570c0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.630+0000 7f5713c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f570c0b3390 0x7f570c0ae360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.630+0000 7f5713c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570c15eed0 con 0x7f570c0b37f0 2024-02-19T17:14:36.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.630+0000 7f5713c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f570c0ae010 con 0x7f570c0b3390 2024-02-19T17:14:36.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.630+0000 7f5713c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570c15e350 con 0x7f570c154b60 2024-02-19T17:14:36.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.630+0000 7f5711c00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f570c0b37f0 0x7f570c1618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39882/0 (socket says 172.21.15.46:39882) 2024-02-19T17:14:36.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.630+0000 7f5711c00640 1 -- 172.21.15.46:0/1825093945 learned_addr learned my addr 172.21.15.46:0/1825093945 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:36.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.630+0000 7f5711200640 1 --2- 172.21.15.46:0/1825093945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f570c154b60 0x7f570c0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.631+0000 7f570be00640 1 --2- 172.21.15.46:0/1825093945 >> v2:172.21.15.142:3300/0 conn(0x7f570c0b3390 0x7f570c0ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.631+0000 7f570b400640 1 -- 172.21.15.46:0/1825093945 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524763036 0 0) 0x7f570c15eed0 con 0x7f570c0b37f0 2024-02-19T17:14:36.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.631+0000 7f5711200640 1 -- 172.21.15.46:0/1825093945 >> v2:172.21.15.142:3300/0 conn(0x7f570c0b3390 msgr2=0x7f570c0ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:36.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.631+0000 7f5711200640 1 --2- 172.21.15.46:0/1825093945 >> v2:172.21.15.142:3300/0 conn(0x7f570c0b3390 0x7f570c0ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.631+0000 7f5711200640 1 -- 172.21.15.46:0/1825093945 >> v1:172.21.15.46:6789/0 conn(0x7f570c0b37f0 legacy=0x7f570c1618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.631+0000 7f5711200640 1 -- 172.21.15.46:0/1825093945 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c15e630 con 0x7f570c154b60 2024-02-19T17:14:36.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.632+0000 7f5711200640 1 --2- 172.21.15.46:0/1825093945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f570c154b60 0x7f570c0acb80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f57000097d0 tx=0x7f570002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0b1b909e5120b44 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:36.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.633+0000 7f570b400640 1 -- 172.21.15.46:0/1825093945 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570002d040 con 0x7f570c154b60 2024-02-19T17:14:36.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.633+0000 7f570b400640 1 -- 172.21.15.46:0/1825093945 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5700031810 con 0x7f570c154b60 2024-02-19T17:14:36.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.633+0000 7f570b400640 1 -- 172.21.15.46:0/1825093945 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5700031ba0 con 0x7f570c154b60 2024-02-19T17:14:36.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.634+0000 7f5713c00640 1 -- 172.21.15.46:0/1825093945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f570c154b60 msgr2=0x7f570c0acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.634+0000 7f5713c00640 1 --2- 172.21.15.46:0/1825093945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f570c154b60 0x7f570c0acb80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f57000097d0 tx=0x7f570002b8b0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.634+0000 7f5713c00640 1 -- 172.21.15.46:0/1825093945 shutdown_connections 2024-02-19T17:14:36.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.634+0000 7f5713c00640 1 --2- 172.21.15.46:0/1825093945 >> v2:172.21.15.142:3300/0 conn(0x7f570c0b3390 0x7f570c0ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.634+0000 7f5713c00640 1 --2- 172.21.15.46:0/1825093945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f570c154b60 0x7f570c0acb80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.634+0000 7f5713c00640 1 -- 172.21.15.46:0/1825093945 >> 172.21.15.46:0/1825093945 conn(0x7f570c066f70 msgr2=0x7f570c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:36.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.634+0000 7f5713c00640 1 -- 172.21.15.46:0/1825093945 shutdown_connections 2024-02-19T17:14:36.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.634+0000 7f5713c00640 1 -- 172.21.15.46:0/1825093945 wait complete. 2024-02-19T17:14:36.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.636+0000 7f5713c00640 1 Processor -- start 2024-02-19T17:14:36.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.636+0000 7f5713c00640 1 -- start start 2024-02-19T17:14:36.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.637+0000 7f5713c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f570c0b3390 0x7f570c1f7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.637+0000 7f5713c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c154b60 0x7f570c0b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.637+0000 7f5713c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f570c152e60 0x7f570c13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.637+0000 7f5713c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c0b1f00 con 0x7f570c154b60 2024-02-19T17:14:36.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.637+0000 7f5713c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c0af0f0 con 0x7f570c152e60 2024-02-19T17:14:36.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.637+0000 7f5713c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570c0af6b0 con 0x7f570c0b3390 2024-02-19T17:14:36.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.637+0000 7f570be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c154b60 0x7f570c0b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.637+0000 7f570be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c154b60 0x7f570c0b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57224/0 (socket says 172.21.15.46:57224) 2024-02-19T17:14:36.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.637+0000 7f570be00640 1 -- 172.21.15.46:0/1796839537 learned_addr learned my addr 172.21.15.46:0/1796839537 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:36.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.637+0000 7f5711200640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f570c0b3390 0x7f570c1f7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.638+0000 7f5711c00640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f570c152e60 0x7f570c13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.638+0000 7f570be00640 1 -- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f570c0b3390 msgr2=0x7f570c1f7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.638+0000 7f570be00640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f570c0b3390 0x7f570c1f7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.638+0000 7f570be00640 1 -- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f570c152e60 msgr2=0x7f570c13fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.638+0000 7f570be00640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f570c152e60 0x7f570c13fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.638+0000 7f570be00640 1 -- 172.21.15.46:0/1796839537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5700009400 con 0x7f570c154b60 2024-02-19T17:14:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.638+0000 7f570be00640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c154b60 0x7f570c0b19c0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f56f800e9b0 tx=0x7f56f800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.638+0000 7f5708c00640 1 -- 172.21.15.46:0/1796839537 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8009670 con 0x7f570c154b60 2024-02-19T17:14:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.639+0000 7f5708c00640 1 -- 172.21.15.46:0/1796839537 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f800c9a0 con 0x7f570c154b60 2024-02-19T17:14:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.639+0000 7f5708c00640 1 -- 172.21.15.46:0/1796839537 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f800cd50 con 0x7f570c154b60 2024-02-19T17:14:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.639+0000 7f5713c00640 1 -- 172.21.15.46:0/1796839537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570c154fe0 con 0x7f570c154b60 2024-02-19T17:14:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.639+0000 7f5713c00640 1 -- 172.21.15.46:0/1796839537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570c0af340 con 0x7f570c154b60 2024-02-19T17:14:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.640+0000 7f5713c00640 1 -- 172.21.15.46:0/1796839537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f570c155500 con 0x7f570c154b60 2024-02-19T17:14:36.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.641+0000 7f5708c00640 1 -- 172.21.15.46:0/1796839537 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f56f8013470 con 0x7f570c154b60 2024-02-19T17:14:36.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.642+0000 7f5708c00640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f56ec06b840 0x7f56ec06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:36.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.642+0000 7f5708c00640 1 -- 172.21.15.46:0/1796839537 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f56f808a0e0 con 0x7f570c154b60 2024-02-19T17:14:36.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.643+0000 7f5711200640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f56ec06b840 0x7f56ec06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:36.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.644+0000 7f5711200640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f56ec06b840 0x7f56ec06dd00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f5700036000 tx=0x7f570003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:36.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.648+0000 7f5708c00640 1 -- 172.21.15.46:0/1796839537 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56f8054e10 con 0x7f570c154b60 2024-02-19T17:14:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.853+0000 7f5713c00640 1 -- 172.21.15.46:0/1796839537 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f570c15ebf0 con 0x7f56ec06b840 2024-02-19T17:14:36.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.854+0000 7f5708c00640 1 -- 172.21.15.46:0/1796839537 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5700004260 con 0x7f56ec06b840 2024-02-19T17:14:36.840 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 4 to deep-scrub 2024-02-19T17:14:36.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.857+0000 7f5713c00640 1 -- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f56ec06b840 msgr2=0x7f56ec06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.857+0000 7f5713c00640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f56ec06b840 0x7f56ec06dd00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f5700036000 tx=0x7f570003c040 comp rx=0 tx=0).stop 2024-02-19T17:14:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.857+0000 7f5713c00640 1 -- 172.21.15.46:0/1796839537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c154b60 msgr2=0x7f570c0b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.857+0000 7f5713c00640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c154b60 0x7f570c0b19c0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f56f800e9b0 tx=0x7f56f800ee70 comp rx=0 tx=0).stop 2024-02-19T17:14:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.857+0000 7f5713c00640 1 -- 172.21.15.46:0/1796839537 shutdown_connections 2024-02-19T17:14:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.858+0000 7f5713c00640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f56ec06b840 0x7f56ec06dd00 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.858+0000 7f5713c00640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f570c152e60 0x7f570c13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.858+0000 7f5713c00640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c154b60 0x7f570c0b19c0 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.858+0000 7f5713c00640 1 --2- 172.21.15.46:0/1796839537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f570c0b3390 0x7f570c1f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:36.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.858+0000 7f5713c00640 1 -- 172.21.15.46:0/1796839537 >> 172.21.15.46:0/1796839537 conn(0x7f570c066f70 msgr2=0x7f570c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:36.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.858+0000 7f5713c00640 1 -- 172.21.15.46:0/1796839537 shutdown_connections 2024-02-19T17:14:36.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:36.858+0000 7f5713c00640 1 -- 172.21.15.46:0/1796839537 wait complete. 2024-02-19T17:14:36.862 INFO:tasks.ceph:Scrubbing osd.5 2024-02-19T17:14:36.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-02-19T17:14:37.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.103+0000 7fc71ea00640 1 Processor -- start 2024-02-19T17:14:37.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.103+0000 7fc71ea00640 1 -- start start 2024-02-19T17:14:37.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.105+0000 7fc71ea00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7180c22b0 0x7fc7180c2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.105+0000 7fc71ea00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc718161e40 0x7fc7181622d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.105+0000 7fc71ea00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7180c9f30 con 0x7fc7180b2ac0 2024-02-19T17:14:37.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.105+0000 7fc71ea00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7181666d0 con 0x7fc718161e40 2024-02-19T17:14:37.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.105+0000 7fc71ea00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180ae9e0 con 0x7fc7180c22b0 2024-02-19T17:14:37.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.105+0000 7fc71d600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7180c22b0 0x7fc7180c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.105+0000 7fc71e000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc718161e40 0x7fc7181622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.105+0000 7fc71d600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7180c22b0 0x7fc7180c2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:51120/0 (socket says 172.21.15.46:51120) 2024-02-19T17:14:37.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.105+0000 7fc71d600640 1 -- 172.21.15.46:0/1958664970 learned_addr learned my addr 172.21.15.46:0/1958664970 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:37.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.106+0000 7fc71e000640 1 -- 172.21.15.46:0/1958664970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7180c22b0 msgr2=0x7fc7180c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:37.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.106+0000 7fc71e000640 1 --2- 172.21.15.46:0/1958664970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7180c22b0 0x7fc7180c2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.106+0000 7fc71e000640 1 -- 172.21.15.46:0/1958664970 >> v1:172.21.15.142:6789/0 conn(0x7fc7180b2ac0 legacy=0x7fc718165fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.106+0000 7fc71e000640 1 -- 172.21.15.46:0/1958664970 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7180c2bd0 con 0x7fc718161e40 2024-02-19T17:14:37.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.107+0000 7fc71e000640 1 --2- 172.21.15.46:0/1958664970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc718161e40 0x7fc7181622d0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fc710009d90 tx=0x7fc71002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4e322df24be03c server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:37.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.108+0000 7fc717e00640 1 -- 172.21.15.46:0/1958664970 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71002cbc0 con 0x7fc718161e40 2024-02-19T17:14:37.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.108+0000 7fc717e00640 1 -- 172.21.15.46:0/1958664970 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71002cd20 con 0x7fc718161e40 2024-02-19T17:14:37.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.108+0000 7fc717e00640 1 -- 172.21.15.46:0/1958664970 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710034660 con 0x7fc718161e40 2024-02-19T17:14:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.108+0000 7fc71ea00640 1 -- 172.21.15.46:0/1958664970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc718161e40 msgr2=0x7fc7181622d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.108+0000 7fc71ea00640 1 --2- 172.21.15.46:0/1958664970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc718161e40 0x7fc7181622d0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fc710009d90 tx=0x7fc71002be10 comp rx=0 tx=0).stop 2024-02-19T17:14:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.108+0000 7fc71ea00640 1 -- 172.21.15.46:0/1958664970 shutdown_connections 2024-02-19T17:14:37.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.108+0000 7fc71ea00640 1 --2- 172.21.15.46:0/1958664970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc718161e40 0x7fc7181622d0 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.108+0000 7fc71ea00640 1 --2- 172.21.15.46:0/1958664970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7180c22b0 0x7fc7180c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.108+0000 7fc71ea00640 1 -- 172.21.15.46:0/1958664970 >> 172.21.15.46:0/1958664970 conn(0x7fc71806ad60 msgr2=0x7fc71806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:37.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.108+0000 7fc71ea00640 1 -- 172.21.15.46:0/1958664970 shutdown_connections 2024-02-19T17:14:37.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.109+0000 7fc71ea00640 1 -- 172.21.15.46:0/1958664970 wait complete. 2024-02-19T17:14:37.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.110+0000 7fc71ea00640 1 Processor -- start 2024-02-19T17:14:37.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.110+0000 7fc71ea00640 1 -- start start 2024-02-19T17:14:37.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.111+0000 7fc71ea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7180b2ac0 0x7fc7181f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.111+0000 7fc71ea00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7180c22b0 0x7fc7180c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.111+0000 7fc71ea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc718161e40 0x7fc7180c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.111+0000 7fc71ea00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181f8b30 con 0x7fc718161e40 2024-02-19T17:14:37.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.111+0000 7fc71ea00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181f8100 con 0x7fc7180b2ac0 2024-02-19T17:14:37.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.111+0000 7fc71ea00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181f83e0 con 0x7fc7180c22b0 2024-02-19T17:14:37.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.112+0000 7fc71e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc718161e40 0x7fc7180c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.112+0000 7fc71e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc718161e40 0x7fc7180c3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57236/0 (socket says 172.21.15.46:57236) 2024-02-19T17:14:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.112+0000 7fc71e000640 1 -- 172.21.15.46:0/2625190726 learned_addr learned my addr 172.21.15.46:0/2625190726 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.112+0000 7fc71d600640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7180b2ac0 0x7fc7181f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.112+0000 7fc71cc00640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7180c22b0 0x7fc7180c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.112+0000 7fc71e000640 1 -- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7180c22b0 msgr2=0x7fc7180c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.112+0000 7fc71e000640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7180c22b0 0x7fc7180c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.112+0000 7fc71e000640 1 -- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7180b2ac0 msgr2=0x7fc7181f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.112+0000 7fc71e000640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7180b2ac0 0x7fc7181f7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.112+0000 7fc71e000640 1 -- 172.21.15.46:0/2625190726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc710009a70 con 0x7fc718161e40 2024-02-19T17:14:37.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.112+0000 7fc71e000640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc718161e40 0x7fc7180c3a10 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fc710009d90 tx=0x7fc710004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:37.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.113+0000 7fc715600640 1 -- 172.21.15.46:0/2625190726 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710040650 con 0x7fc718161e40 2024-02-19T17:14:37.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.113+0000 7fc715600640 1 -- 172.21.15.46:0/2625190726 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71002ce90 con 0x7fc718161e40 2024-02-19T17:14:37.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.113+0000 7fc715600640 1 -- 172.21.15.46:0/2625190726 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7100409f0 con 0x7fc718161e40 2024-02-19T17:14:37.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.113+0000 7fc71ea00640 1 -- 172.21.15.46:0/2625190726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7181f86c0 con 0x7fc718161e40 2024-02-19T17:14:37.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.113+0000 7fc71ea00640 1 -- 172.21.15.46:0/2625190726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7180c5610 con 0x7fc718161e40 2024-02-19T17:14:37.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.114+0000 7fc71ea00640 1 -- 172.21.15.46:0/2625190726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc7180b1fd0 con 0x7fc718161e40 2024-02-19T17:14:37.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.115+0000 7fc715600640 1 -- 172.21.15.46:0/2625190726 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc710040b50 con 0x7fc718161e40 2024-02-19T17:14:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.116+0000 7fc715600640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc6f806b810 0x7fc6f806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.116+0000 7fc715600640 1 -- 172.21.15.46:0/2625190726 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc7100aca80 con 0x7fc718161e40 2024-02-19T17:14:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.116+0000 7fc715600640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] conn(0x7fc6f80716d0 0x7fc6f8073af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.116+0000 7fc715600640 1 -- 172.21.15.46:0/2625190726 --> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6f80741a0 con 0x7fc6f80716d0 2024-02-19T17:14:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.116+0000 7fc715600640 1 -- 172.21.15.46:0/2625190726 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7100b12a0 con 0x7fc718161e40 2024-02-19T17:14:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.117+0000 7fc71d600640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc6f806b810 0x7fc6f806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.117+0000 7fc71cc00640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] conn(0x7fc6f80716d0 0x7fc6f8073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.117+0000 7fc71d600640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc6f806b810 0x7fc6f806dcd0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009b60 tx=0x7fc70c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:37.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.118+0000 7fc71cc00640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] conn(0x7fc6f80716d0 0x7fc6f8073af0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:37.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.119+0000 7fc715600640 1 -- 172.21.15.46:0/2625190726 <== osd.5 v2:172.21.15.142:6808/1219840819 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc6f80741a0 con 0x7fc6f80716d0 2024-02-19T17:14:37.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.134+0000 7fc71ea00640 1 -- 172.21.15.46:0/2625190726 --> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc7181f7dd0 con 0x7fc6f80716d0 2024-02-19T17:14:37.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.135+0000 7fc715600640 1 -- 172.21.15.46:0/2625190726 <== osd.5 v2:172.21.15.142:6808/1219840819 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc7181f7dd0 con 0x7fc6f80716d0 2024-02-19T17:14:37.121 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T17:14:37.121 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-19T17:14:37.121 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T17:14:37.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.136+0000 7fc71ea00640 1 -- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] conn(0x7fc6f80716d0 msgr2=0x7fc6f8073af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.136+0000 7fc71ea00640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:6808/1219840819,v1:172.21.15.142:6809/1219840819] conn(0x7fc6f80716d0 0x7fc6f8073af0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.136+0000 7fc71ea00640 1 -- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc6f806b810 msgr2=0x7fc6f806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.136+0000 7fc71ea00640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc6f806b810 0x7fc6f806dcd0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009b60 tx=0x7fc70c008040 comp rx=0 tx=0).stop 2024-02-19T17:14:37.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.136+0000 7fc71ea00640 1 -- 172.21.15.46:0/2625190726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc718161e40 msgr2=0x7fc7180c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.136+0000 7fc71ea00640 1 --2- 172.21.15.46:0/2625190726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc718161e40 0x7fc7180c3a10 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fc710009d90 tx=0x7fc710004a40 comp rx=0 tx=0).stop 2024-02-19T17:14:37.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.136+0000 7fc71e000640 1 -- 172.21.15.46:0/2625190726 reap_dead start 2024-02-19T17:14:37.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.136+0000 7fc71ea00640 1 -- 172.21.15.46:0/2625190726 shutdown_connections 2024-02-19T17:14:37.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.136+0000 7fc71ea00640 1 -- 172.21.15.46:0/2625190726 >> 172.21.15.46:0/2625190726 conn(0x7fc71806ad60 msgr2=0x7fc718164a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:37.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.136+0000 7fc71ea00640 1 -- 172.21.15.46:0/2625190726 shutdown_connections 2024-02-19T17:14:37.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.136+0000 7fc71ea00640 1 -- 172.21.15.46:0/2625190726 wait complete. 2024-02-19T17:14:37.141 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-02-19T17:14:37.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.384+0000 7f0174400640 1 Processor -- start 2024-02-19T17:14:37.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.384+0000 7f0174400640 1 -- start start 2024-02-19T17:14:37.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.386+0000 7f0174400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f016c0b3390 0x7f016c0ae360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.386+0000 7f0174400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016c0aecf0 con 0x7f016c0ae8a0 2024-02-19T17:14:37.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.386+0000 7f0174400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016c15eed0 con 0x7f016c154b60 2024-02-19T17:14:37.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.386+0000 7f0174400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016c0ae010 con 0x7f016c0b3390 2024-02-19T17:14:37.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.387+0000 7f0172400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f016c0ae8a0 0x7f016c1618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39894/0 (socket says 172.21.15.46:39894) 2024-02-19T17:14:37.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.387+0000 7f0172400640 1 -- 172.21.15.46:0/2859745811 learned_addr learned my addr 172.21.15.46:0/2859745811 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.387+0000 7f0171000640 1 --2- 172.21.15.46:0/2859745811 >> v2:172.21.15.142:3300/0 conn(0x7f016c0b3390 0x7f016c0ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.387+0000 7f016be00640 1 -- 172.21.15.46:0/2859745811 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897673222 0 0) 0x7f0164001490 con 0x7f016c0ae8a0 2024-02-19T17:14:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.387+0000 7f016be00640 1 -- 172.21.15.46:0/2859745811 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0150003520 con 0x7f016c0ae8a0 2024-02-19T17:14:37.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.387+0000 7f016be00640 1 -- 172.21.15.46:0/2859745811 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3540388095 0 0) 0x7f0150003520 con 0x7f016c0ae8a0 2024-02-19T17:14:37.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.387+0000 7f0171000640 1 -- 172.21.15.46:0/2859745811 >> v1:172.21.15.142:6789/0 conn(0x7f016c154b60 legacy=0x7f016c0acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.387+0000 7f0171000640 1 -- 172.21.15.46:0/2859745811 >> v1:172.21.15.46:6789/0 conn(0x7f016c0ae8a0 legacy=0x7f016c1618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.387+0000 7f0171000640 1 -- 172.21.15.46:0/2859745811 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c15e350 con 0x7f016c0b3390 2024-02-19T17:14:37.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.389+0000 7f0171000640 1 --2- 172.21.15.46:0/2859745811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f016c0b3390 0x7f016c0ae360 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f01580097a0 tx=0x7f015802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28d4e3873df88734 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.389+0000 7f016be00640 1 -- 172.21.15.46:0/2859745811 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015802f050 con 0x7f016c0b3390 2024-02-19T17:14:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.390+0000 7f016be00640 1 -- 172.21.15.46:0/2859745811 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0158031500 con 0x7f016c0b3390 2024-02-19T17:14:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.390+0000 7f016be00640 1 -- 172.21.15.46:0/2859745811 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164001b80 con 0x7f016c0b3390 2024-02-19T17:14:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.390+0000 7f0174400640 1 -- 172.21.15.46:0/2859745811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f016c0b3390 msgr2=0x7f016c0ae360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.390+0000 7f0174400640 1 --2- 172.21.15.46:0/2859745811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f016c0b3390 0x7f016c0ae360 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f01580097a0 tx=0x7f015802b820 comp rx=0 tx=0).stop 2024-02-19T17:14:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.390+0000 7f0174400640 1 -- 172.21.15.46:0/2859745811 shutdown_connections 2024-02-19T17:14:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.390+0000 7f0174400640 1 --2- 172.21.15.46:0/2859745811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f016c0b3390 0x7f016c0ae360 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.390+0000 7f0174400640 1 -- 172.21.15.46:0/2859745811 >> 172.21.15.46:0/2859745811 conn(0x7f016c066f70 msgr2=0x7f016c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.390+0000 7f0174400640 1 -- 172.21.15.46:0/2859745811 shutdown_connections 2024-02-19T17:14:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.390+0000 7f0174400640 1 -- 172.21.15.46:0/2859745811 wait complete. 2024-02-19T17:14:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.392+0000 7f0174400640 1 Processor -- start 2024-02-19T17:14:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.392+0000 7f0174400640 1 -- start start 2024-02-19T17:14:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.393+0000 7f0174400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f016c0ae8a0 0x7f016c156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.393+0000 7f0174400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f016c0b3390 0x7f016c144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.393+0000 7f0174400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f016c154b60 0x7f016c1e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.393+0000 7f0174400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c155f50 con 0x7f016c0b3390 2024-02-19T17:14:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.393+0000 7f0174400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c157310 con 0x7f016c0ae8a0 2024-02-19T17:14:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.393+0000 7f0174400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c155340 con 0x7f016c154b60 2024-02-19T17:14:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.394+0000 7f0171000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f016c0b3390 0x7f016c144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.394+0000 7f0171000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f016c0b3390 0x7f016c144f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57250/0 (socket says 172.21.15.46:57250) 2024-02-19T17:14:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.394+0000 7f0171000640 1 -- 172.21.15.46:0/2921648022 learned_addr learned my addr 172.21.15.46:0/2921648022 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.394+0000 7f0171a00640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f016c0ae8a0 0x7f016c156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.394+0000 7f0172400640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f016c154b60 0x7f016c1e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.394+0000 7f0171000640 1 -- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f016c154b60 msgr2=0x7f016c1e73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.394+0000 7f0171000640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f016c154b60 0x7f016c1e73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.394+0000 7f0171000640 1 -- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f016c0ae8a0 msgr2=0x7f016c156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.394+0000 7f0171000640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f016c0ae8a0 0x7f016c156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.394+0000 7f0171000640 1 -- 172.21.15.46:0/2921648022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158009400 con 0x7f016c0b3390 2024-02-19T17:14:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.394+0000 7f0171000640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f016c0b3390 0x7f016c144f20 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f0158036040 tx=0x7f01580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.395+0000 7f0169600640 1 -- 172.21.15.46:0/2921648022 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015803d940 con 0x7f016c0b3390 2024-02-19T17:14:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.395+0000 7f0169600640 1 -- 172.21.15.46:0/2921648022 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015803daa0 con 0x7f016c0b3390 2024-02-19T17:14:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.395+0000 7f0169600640 1 -- 172.21.15.46:0/2921648022 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015803de10 con 0x7f016c0b3390 2024-02-19T17:14:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.395+0000 7f0174400640 1 -- 172.21.15.46:0/2921648022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016c155620 con 0x7f016c0b3390 2024-02-19T17:14:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.395+0000 7f0174400640 1 -- 172.21.15.46:0/2921648022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016c155be0 con 0x7f016c0b3390 2024-02-19T17:14:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.396+0000 7f0174400640 1 -- 172.21.15.46:0/2921648022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016c156100 con 0x7f016c0b3390 2024-02-19T17:14:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.397+0000 7f0169600640 1 -- 172.21.15.46:0/2921648022 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f015803a040 con 0x7f016c0b3390 2024-02-19T17:14:37.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.398+0000 7f0169600640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f014c06b810 0x7f014c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.398+0000 7f0169600640 1 -- 172.21.15.46:0/2921648022 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f01580abb70 con 0x7f016c0b3390 2024-02-19T17:14:37.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.399+0000 7f0171a00640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f014c06b810 0x7f014c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.400+0000 7f0171a00640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f014c06b810 0x7f014c06dcd0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f016c06cfd0 tx=0x7f015c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:37.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.403+0000 7f0169600640 1 -- 172.21.15.46:0/2921648022 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f016c156100 con 0x7f016c0b3390 2024-02-19T17:14:37.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.599+0000 7f0174400640 1 -- 172.21.15.46:0/2921648022 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f016c15ebf0 con 0x7f014c06b810 2024-02-19T17:14:37.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.601+0000 7f0169600640 1 -- 172.21.15.46:0/2921648022 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f015c001c70 con 0x7f014c06b810 2024-02-19T17:14:37.586 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 5 to deep-scrub 2024-02-19T17:14:37.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.603+0000 7f0174400640 1 -- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f014c06b810 msgr2=0x7f014c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.603+0000 7f0174400640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f014c06b810 0x7f014c06dcd0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f016c06cfd0 tx=0x7f015c009040 comp rx=0 tx=0).stop 2024-02-19T17:14:37.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.603+0000 7f0174400640 1 -- 172.21.15.46:0/2921648022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f016c0b3390 msgr2=0x7f016c144f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.603+0000 7f0174400640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f016c0b3390 0x7f016c144f20 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f0158036040 tx=0x7f01580046c0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.603+0000 7f0174400640 1 -- 172.21.15.46:0/2921648022 shutdown_connections 2024-02-19T17:14:37.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.603+0000 7f0174400640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f014c06b810 0x7f014c06dcd0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.603+0000 7f0174400640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f016c154b60 0x7f016c1e73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.603+0000 7f0174400640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f016c0b3390 0x7f016c144f20 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.603+0000 7f0174400640 1 --2- 172.21.15.46:0/2921648022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f016c0ae8a0 0x7f016c156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.603+0000 7f0174400640 1 -- 172.21.15.46:0/2921648022 >> 172.21.15.46:0/2921648022 conn(0x7f016c066f70 msgr2=0x7f016c06d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:37.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.603+0000 7f0174400640 1 -- 172.21.15.46:0/2921648022 shutdown_connections 2024-02-19T17:14:37.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.604+0000 7f0174400640 1 -- 172.21.15.46:0/2921648022 wait complete. 2024-02-19T17:14:37.609 INFO:tasks.ceph:Scrubbing osd.6 2024-02-19T17:14:37.609 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-02-19T17:14:37.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.852+0000 7f131ca00640 1 Processor -- start 2024-02-19T17:14:37.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.852+0000 7f131ca00640 1 -- start start 2024-02-19T17:14:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.854+0000 7f131ca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13180c22b0 0x7f13180c2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.854+0000 7f131ca00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13180b2ac0 0x7f1318165fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.854+0000 7f131ca00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f13180ca3f0 0x7f13180ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.854+0000 7f131ca00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13180c9f30 con 0x7f13180ca3f0 2024-02-19T17:14:37.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.854+0000 7f131ca00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13180ae9e0 con 0x7f13180b2ac0 2024-02-19T17:14:37.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.854+0000 7f131ca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13180c2bd0 con 0x7f13180c22b0 2024-02-19T17:14:37.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.854+0000 7f1317200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f13180ca3f0 0x7f13180ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.855+0000 7f1317200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f13180ca3f0 0x7f13180ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57256/0 (socket says 172.21.15.46:57256) 2024-02-19T17:14:37.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.855+0000 7f1317200640 1 -- 172.21.15.46:0/3370873079 learned_addr learned my addr 172.21.15.46:0/3370873079 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:37.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.855+0000 7f1316800640 1 --2- 172.21.15.46:0/3370873079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13180c22b0 0x7f13180c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.855+0000 7f130de00640 1 --2- 172.21.15.46:0/3370873079 >> v2:172.21.15.142:3300/0 conn(0x7f13180b2ac0 0x7f1318165fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.855+0000 7f1317200640 1 -- 172.21.15.46:0/3370873079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13180c22b0 msgr2=0x7f13180c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:37.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.855+0000 7f1317200640 1 --2- 172.21.15.46:0/3370873079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13180c22b0 0x7f13180c2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.855+0000 7f1317200640 1 -- 172.21.15.46:0/3370873079 >> v2:172.21.15.142:3300/0 conn(0x7f13180b2ac0 msgr2=0x7f1318165fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:37.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.855+0000 7f1317200640 1 --2- 172.21.15.46:0/3370873079 >> v2:172.21.15.142:3300/0 conn(0x7f13180b2ac0 0x7f1318165fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.855+0000 7f1317200640 1 -- 172.21.15.46:0/3370873079 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180b2fb0 con 0x7f13180ca3f0 2024-02-19T17:14:37.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.856+0000 7f1317200640 1 --2- 172.21.15.46:0/3370873079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13180ca3f0 0x7f13180ca880 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f131806bbd0 tx=0x7f131002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a5d9a0de50a340 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:37.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.857+0000 7f1315e00640 1 -- 172.21.15.46:0/3370873079 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131002c9e0 con 0x7f13180ca3f0 2024-02-19T17:14:37.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.857+0000 7f1315e00640 1 -- 172.21.15.46:0/3370873079 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131002cb40 con 0x7f13180ca3f0 2024-02-19T17:14:37.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.857+0000 7f1315e00640 1 -- 172.21.15.46:0/3370873079 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13100343f0 con 0x7f13180ca3f0 2024-02-19T17:14:37.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.857+0000 7f131ca00640 1 -- 172.21.15.46:0/3370873079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13180ca3f0 msgr2=0x7f13180ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.857+0000 7f131ca00640 1 --2- 172.21.15.46:0/3370873079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13180ca3f0 0x7f13180ca880 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f131806bbd0 tx=0x7f131002be40 comp rx=0 tx=0).stop 2024-02-19T17:14:37.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.857+0000 7f131ca00640 1 -- 172.21.15.46:0/3370873079 shutdown_connections 2024-02-19T17:14:37.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.857+0000 7f131ca00640 1 --2- 172.21.15.46:0/3370873079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13180ca3f0 0x7f13180ca880 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.857+0000 7f131ca00640 1 --2- 172.21.15.46:0/3370873079 >> v2:172.21.15.142:3300/0 conn(0x7f13180b2ac0 0x7f1318165fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.857+0000 7f131ca00640 1 --2- 172.21.15.46:0/3370873079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13180c22b0 0x7f13180c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.857+0000 7f131ca00640 1 -- 172.21.15.46:0/3370873079 >> 172.21.15.46:0/3370873079 conn(0x7f131806ad60 msgr2=0x7f131806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:37.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.857+0000 7f131ca00640 1 -- 172.21.15.46:0/3370873079 shutdown_connections 2024-02-19T17:14:37.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.857+0000 7f131ca00640 1 -- 172.21.15.46:0/3370873079 wait complete. 2024-02-19T17:14:37.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.859+0000 7f131ca00640 1 Processor -- start 2024-02-19T17:14:37.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.859+0000 7f131ca00640 1 -- start start 2024-02-19T17:14:37.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.860+0000 7f131ca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13180b2ac0 0x7f13180c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.860+0000 7f131ca00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13180c22b0 0x7f13180c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.860+0000 7f131ca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13180ca3f0 0x7f13181f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.860+0000 7f131ca00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13180c6250 con 0x7f13180c22b0 2024-02-19T17:14:37.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.860+0000 7f131ca00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13181f74b0 con 0x7f13180ca3f0 2024-02-19T17:14:37.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.860+0000 7f131ca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13181fad20 con 0x7f13180b2ac0 2024-02-19T17:14:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.861+0000 7f130de00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13180c22b0 0x7f13180c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.861+0000 7f130de00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13180c22b0 0x7f13180c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57264/0 (socket says 172.21.15.46:57264) 2024-02-19T17:14:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.861+0000 7f130de00640 1 -- 172.21.15.46:0/3489017017 learned_addr learned my addr 172.21.15.46:0/3489017017 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.861+0000 7f1316800640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13180b2ac0 0x7f13180c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.861+0000 7f1317200640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13180ca3f0 0x7f13181f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.861+0000 7f130de00640 1 -- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13180b2ac0 msgr2=0x7f13180c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.861+0000 7f130de00640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13180b2ac0 0x7f13180c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.861+0000 7f130de00640 1 -- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13180ca3f0 msgr2=0x7f13181f6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.861+0000 7f130de00640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13180ca3f0 0x7f13181f6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.861+0000 7f130de00640 1 -- 172.21.15.46:0/3489017017 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1310009b30 con 0x7f13180c22b0 2024-02-19T17:14:37.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.861+0000 7f1316800640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13180b2ac0 0x7f13180c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T17:14:37.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.862+0000 7f130de00640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13180c22b0 0x7f13180c5d10 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f130000e840 tx=0x7f130000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:37.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.862+0000 7f130f400640 1 -- 172.21.15.46:0/3489017017 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130000c730 con 0x7f13180c22b0 2024-02-19T17:14:37.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.862+0000 7f130f400640 1 -- 172.21.15.46:0/3489017017 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130000c890 con 0x7f13180c22b0 2024-02-19T17:14:37.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.862+0000 7f131ca00640 1 -- 172.21.15.46:0/3489017017 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13181fbaa0 con 0x7f13180c22b0 2024-02-19T17:14:37.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.862+0000 7f130f400640 1 -- 172.21.15.46:0/3489017017 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130000cc40 con 0x7f13180c22b0 2024-02-19T17:14:37.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.862+0000 7f131ca00640 1 -- 172.21.15.46:0/3489017017 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13181fb2a0 con 0x7f13180c22b0 2024-02-19T17:14:37.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.863+0000 7f131ca00640 1 -- 172.21.15.46:0/3489017017 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13180b4220 con 0x7f13180c22b0 2024-02-19T17:14:37.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.864+0000 7f130f400640 1 -- 172.21.15.46:0/3489017017 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1300013470 con 0x7f13180c22b0 2024-02-19T17:14:37.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.865+0000 7f130f400640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f12f406b860 0x7f12f406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.866+0000 7f130f400640 1 -- 172.21.15.46:0/3489017017 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1300089db0 con 0x7f13180c22b0 2024-02-19T17:14:37.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.866+0000 7f130f400640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] conn(0x7f12f4071720 0x7f12f4073b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:37.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.866+0000 7f130f400640 1 -- 172.21.15.46:0/3489017017 --> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12f40741f0 con 0x7f12f4071720 2024-02-19T17:14:37.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.866+0000 7f130f400640 1 -- 172.21.15.46:0/3489017017 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f130008c4c0 con 0x7f13180c22b0 2024-02-19T17:14:37.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.866+0000 7f1316800640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f12f406b860 0x7f12f406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.867+0000 7f1317200640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] conn(0x7f12f4071720 0x7f12f4073b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.867+0000 7f1316800640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f12f406b860 0x7f12f406dd20 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f1308009af0 tx=0x7f1308008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:37.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.868+0000 7f1317200640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] conn(0x7f12f4071720 0x7f12f4073b40 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:37.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.871+0000 7f130f400640 1 -- 172.21.15.46:0/3489017017 <== osd.6 v2:172.21.15.142:6816/2395736986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f12f40741f0 con 0x7f12f4071720 2024-02-19T17:14:37.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.888+0000 7f131ca00640 1 -- 172.21.15.46:0/3489017017 --> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f13180b3850 con 0x7f12f4071720 2024-02-19T17:14:37.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.890+0000 7f130f400640 1 -- 172.21.15.46:0/3489017017 <== osd.6 v2:172.21.15.142:6816/2395736986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f131002c9d0 con 0x7f12f4071720 2024-02-19T17:14:37.875 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T17:14:37.876 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-19T17:14:37.876 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T17:14:37.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.890+0000 7f131ca00640 1 -- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] conn(0x7f12f4071720 msgr2=0x7f12f4073b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.890+0000 7f131ca00640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:6816/2395736986,v1:172.21.15.142:6817/2395736986] conn(0x7f12f4071720 0x7f12f4073b40 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:37.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.891+0000 7f131ca00640 1 -- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f12f406b860 msgr2=0x7f12f406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.891+0000 7f131ca00640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f12f406b860 0x7f12f406dd20 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f1308009af0 tx=0x7f1308008040 comp rx=0 tx=0).stop 2024-02-19T17:14:37.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.891+0000 7f131ca00640 1 -- 172.21.15.46:0/3489017017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13180c22b0 msgr2=0x7f13180c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:37.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.891+0000 7f131ca00640 1 --2- 172.21.15.46:0/3489017017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13180c22b0 0x7f13180c5d10 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f130000e840 tx=0x7f130000ed00 comp rx=0 tx=0).stop 2024-02-19T17:14:37.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.891+0000 7f1317200640 1 -- 172.21.15.46:0/3489017017 reap_dead start 2024-02-19T17:14:37.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.891+0000 7f131ca00640 1 -- 172.21.15.46:0/3489017017 shutdown_connections 2024-02-19T17:14:37.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.891+0000 7f131ca00640 1 -- 172.21.15.46:0/3489017017 >> 172.21.15.46:0/3489017017 conn(0x7f131806ad60 msgr2=0x7f1318161e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:37.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.891+0000 7f131ca00640 1 -- 172.21.15.46:0/3489017017 shutdown_connections 2024-02-19T17:14:37.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:37.891+0000 7f131ca00640 1 -- 172.21.15.46:0/3489017017 wait complete. 2024-02-19T17:14:37.899 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-02-19T17:14:38.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.138+0000 7fc14fe00640 1 Processor -- start 2024-02-19T17:14:38.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.139+0000 7fc14fe00640 1 -- start start 2024-02-19T17:14:38.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.140+0000 7fc14fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc15015d840 0x7fc150161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.140+0000 7fc14fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc150161a70 0x7fc15006c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.140+0000 7fc14fe00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc150161f20 con 0x7fc15015dc20 2024-02-19T17:14:38.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.140+0000 7fc14fe00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1501624a0 con 0x7fc15015d840 2024-02-19T17:14:38.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.140+0000 7fc14fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500ce280 con 0x7fc150161a70 2024-02-19T17:14:38.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.140+0000 7fc14f400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc15015dc20 0x7fc1500d1c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39902/0 (socket says 172.21.15.46:39902) 2024-02-19T17:14:38.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.141+0000 7fc14f400640 1 -- 172.21.15.46:0/2035575068 learned_addr learned my addr 172.21.15.46:0/2035575068 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-02-19T17:14:38.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.141+0000 7fc14ea00640 1 --2- 172.21.15.46:0/2035575068 >> v2:172.21.15.142:3300/0 conn(0x7fc15015d840 0x7fc150161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.141+0000 7fc14e000640 1 --2- 172.21.15.46:0/2035575068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc150161a70 0x7fc15006c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.141+0000 7fc14d600640 1 -- 172.21.15.46:0/2035575068 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084183330 0 0) 0x7fc150161f20 con 0x7fc15015dc20 2024-02-19T17:14:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.141+0000 7fc14d600640 1 -- 172.21.15.46:0/2035575068 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc130003520 con 0x7fc15015dc20 2024-02-19T17:14:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.141+0000 7fc14d600640 1 -- 172.21.15.46:0/2035575068 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1285083875 0 0) 0x7fc130003520 con 0x7fc15015dc20 2024-02-19T17:14:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.141+0000 7fc14ea00640 1 -- 172.21.15.46:0/2035575068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc150161a70 msgr2=0x7fc15006c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.141+0000 7fc14ea00640 1 --2- 172.21.15.46:0/2035575068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc150161a70 0x7fc15006c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.141+0000 7fc14ea00640 1 -- 172.21.15.46:0/2035575068 >> v1:172.21.15.46:6789/0 conn(0x7fc15015dc20 legacy=0x7fc1500d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.141+0000 7fc14ea00640 1 -- 172.21.15.46:0/2035575068 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1500ce520 con 0x7fc15015d840 2024-02-19T17:14:38.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.143+0000 7fc14ea00640 1 --2- 172.21.15.46:0/2035575068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15015d840 0x7fc150161530 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc1400097d0 tx=0x7fc14002b770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbac15a9ced70ed6 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:38.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.143+0000 7fc14d600640 1 -- 172.21.15.46:0/2035575068 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148001670 con 0x7fc15015d840 2024-02-19T17:14:38.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.143+0000 7fc14d600640 1 -- 172.21.15.46:0/2035575068 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14002e050 con 0x7fc15015d840 2024-02-19T17:14:38.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.143+0000 7fc14d600640 1 -- 172.21.15.46:0/2035575068 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140030730 con 0x7fc15015d840 2024-02-19T17:14:38.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.144+0000 7fc14fe00640 1 -- 172.21.15.46:0/2035575068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15015d840 msgr2=0x7fc150161530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.144+0000 7fc14fe00640 1 --2- 172.21.15.46:0/2035575068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15015d840 0x7fc150161530 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc1400097d0 tx=0x7fc14002b770 comp rx=0 tx=0).stop 2024-02-19T17:14:38.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.144+0000 7fc14fe00640 1 -- 172.21.15.46:0/2035575068 shutdown_connections 2024-02-19T17:14:38.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.144+0000 7fc14fe00640 1 --2- 172.21.15.46:0/2035575068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc150161a70 0x7fc15006c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.144+0000 7fc14fe00640 1 --2- 172.21.15.46:0/2035575068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15015d840 0x7fc150161530 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.144+0000 7fc14fe00640 1 -- 172.21.15.46:0/2035575068 >> 172.21.15.46:0/2035575068 conn(0x7fc15009c9d0 msgr2=0x7fc15008afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:38.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.144+0000 7fc14fe00640 1 -- 172.21.15.46:0/2035575068 shutdown_connections 2024-02-19T17:14:38.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.144+0000 7fc14fe00640 1 -- 172.21.15.46:0/2035575068 wait complete. 2024-02-19T17:14:38.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.146+0000 7fc14fe00640 1 Processor -- start 2024-02-19T17:14:38.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.146+0000 7fc14fe00640 1 -- start start 2024-02-19T17:14:38.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.147+0000 7fc14fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15015d840 0x7fc15015e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.147+0000 7fc14fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15015dc20 0x7fc150149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.147+0000 7fc14fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150161a70 0x7fc1500b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.147+0000 7fc14fe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15014a5a0 con 0x7fc150161a70 2024-02-19T17:14:38.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.147+0000 7fc14fe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500b4540 con 0x7fc15015dc20 2024-02-19T17:14:38.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.147+0000 7fc14fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500b4210 con 0x7fc15015d840 2024-02-19T17:14:38.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.147+0000 7fc14f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150161a70 0x7fc1500b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.147+0000 7fc14f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150161a70 0x7fc1500b8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57274/0 (socket says 172.21.15.46:57274) 2024-02-19T17:14:38.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.147+0000 7fc14f400640 1 -- 172.21.15.46:0/1710810309 learned_addr learned my addr 172.21.15.46:0/1710810309 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:38.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.147+0000 7fc14e000640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15015dc20 0x7fc150149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.148+0000 7fc14ea00640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15015d840 0x7fc15015e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.148+0000 7fc14f400640 1 -- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15015d840 msgr2=0x7fc15015e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.148+0000 7fc14f400640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15015d840 0x7fc15015e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.148+0000 7fc14f400640 1 -- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15015dc20 msgr2=0x7fc150149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.148+0000 7fc14f400640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15015dc20 0x7fc150149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.148+0000 7fc14f400640 1 -- 172.21.15.46:0/1710810309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc140009400 con 0x7fc150161a70 2024-02-19T17:14:38.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.148+0000 7fc14f400640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150161a70 0x7fc1500b8b40 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fc1480017a0 tx=0x7fc14800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:38.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.148+0000 7fc146a00640 1 -- 172.21.15.46:0/1710810309 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148005ad0 con 0x7fc150161a70 2024-02-19T17:14:38.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.148+0000 7fc146a00640 1 -- 172.21.15.46:0/1710810309 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc148005c30 con 0x7fc150161a70 2024-02-19T17:14:38.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.148+0000 7fc146a00640 1 -- 172.21.15.46:0/1710810309 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148007070 con 0x7fc150161a70 2024-02-19T17:14:38.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.148+0000 7fc14fe00640 1 -- 172.21.15.46:0/1710810309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc150147690 con 0x7fc150161a70 2024-02-19T17:14:38.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.149+0000 7fc14fe00640 1 -- 172.21.15.46:0/1710810309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc150160d40 con 0x7fc150161a70 2024-02-19T17:14:38.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.150+0000 7fc14fe00640 1 -- 172.21.15.46:0/1710810309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1500b46d0 con 0x7fc150161a70 2024-02-19T17:14:38.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.151+0000 7fc146a00640 1 -- 172.21.15.46:0/1710810309 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc1480071d0 con 0x7fc150161a70 2024-02-19T17:14:38.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.152+0000 7fc146a00640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc12c06b840 0x7fc12c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.152+0000 7fc146a00640 1 -- 172.21.15.46:0/1710810309 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc148089c30 con 0x7fc150161a70 2024-02-19T17:14:38.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.152+0000 7fc14ea00640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc12c06b840 0x7fc12c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.154+0000 7fc14ea00640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc12c06b840 0x7fc12c06dd00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc140034000 tx=0x7fc140008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:38.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.156+0000 7fc146a00640 1 -- 172.21.15.46:0/1710810309 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc148054940 con 0x7fc150161a70 2024-02-19T17:14:38.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.355+0000 7fc14fe00640 1 -- 172.21.15.46:0/1710810309 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc15004eee0 con 0x7fc12c06b840 2024-02-19T17:14:38.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.356+0000 7fc146a00640 1 -- 172.21.15.46:0/1710810309 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc15004eee0 con 0x7fc12c06b840 2024-02-19T17:14:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 6 to deep-scrub 2024-02-19T17:14:38.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.359+0000 7fc14fe00640 1 -- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc12c06b840 msgr2=0x7fc12c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.359+0000 7fc14fe00640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc12c06b840 0x7fc12c06dd00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc140034000 tx=0x7fc140008030 comp rx=0 tx=0).stop 2024-02-19T17:14:38.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.359+0000 7fc14fe00640 1 -- 172.21.15.46:0/1710810309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150161a70 msgr2=0x7fc1500b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.359+0000 7fc14fe00640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150161a70 0x7fc1500b8b40 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fc1480017a0 tx=0x7fc14800cbe0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.359+0000 7fc14fe00640 1 -- 172.21.15.46:0/1710810309 shutdown_connections 2024-02-19T17:14:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.359+0000 7fc14fe00640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc12c06b840 0x7fc12c06dd00 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.359+0000 7fc14fe00640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150161a70 0x7fc1500b8b40 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.359+0000 7fc14fe00640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15015dc20 0x7fc150149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.359+0000 7fc14fe00640 1 --2- 172.21.15.46:0/1710810309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15015d840 0x7fc15015e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.359+0000 7fc14fe00640 1 -- 172.21.15.46:0/1710810309 >> 172.21.15.46:0/1710810309 conn(0x7fc15009c9d0 msgr2=0x7fc1500d3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.360+0000 7fc14fe00640 1 -- 172.21.15.46:0/1710810309 shutdown_connections 2024-02-19T17:14:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.360+0000 7fc14fe00640 1 -- 172.21.15.46:0/1710810309 wait complete. 2024-02-19T17:14:38.365 INFO:tasks.ceph:Scrubbing osd.7 2024-02-19T17:14:38.365 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-02-19T17:14:38.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.608+0000 7fc29b200640 1 Processor -- start 2024-02-19T17:14:38.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.608+0000 7fc29b200640 1 -- start start 2024-02-19T17:14:38.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.610+0000 7fc29b200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc29c0cf520 0x7fc29c0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.610+0000 7fc29b200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc29c0ce540 0x7fc29c0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.610+0000 7fc29b200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c0b41f0 con 0x7fc29c0cceb0 2024-02-19T17:14:38.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.610+0000 7fc29b200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c15dd40 con 0x7fc29c0ce540 2024-02-19T17:14:38.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.610+0000 7fc29b200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c0cfe40 con 0x7fc29c0cf520 2024-02-19T17:14:38.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.610+0000 7fc299400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc29c0ce540 0x7fc29c0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.610+0000 7fc299400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc29c0ce540 0x7fc29c0ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57284/0 (socket says 172.21.15.46:57284) 2024-02-19T17:14:38.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.610+0000 7fc299400640 1 -- 172.21.15.46:0/136931119 learned_addr learned my addr 172.21.15.46:0/136931119 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:38.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.611+0000 7fc299e00640 1 --2- 172.21.15.46:0/136931119 >> v2:172.21.15.142:3300/0 conn(0x7fc29c0cf520 0x7fc29c0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.611+0000 7fc299400640 1 -- 172.21.15.46:0/136931119 >> v2:172.21.15.142:3300/0 conn(0x7fc29c0cf520 msgr2=0x7fc29c0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:38.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.611+0000 7fc299400640 1 --2- 172.21.15.46:0/136931119 >> v2:172.21.15.142:3300/0 conn(0x7fc29c0cf520 0x7fc29c0cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.611+0000 7fc299400640 1 -- 172.21.15.46:0/136931119 >> v1:172.21.15.142:6789/0 conn(0x7fc29c0cceb0 legacy=0x7fc29c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:38.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.611+0000 7fc299400640 1 -- 172.21.15.46:0/136931119 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c15df30 con 0x7fc29c0ce540 2024-02-19T17:14:38.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.612+0000 7fc299400640 1 --2- 172.21.15.46:0/136931119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc29c0ce540 0x7fc29c0ce9d0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0b1f10 tx=0x7fc28c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc6fce984f2f3f1 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:38.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.612+0000 7fc298a00640 1 -- 172.21.15.46:0/136931119 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c031870 con 0x7fc29c0ce540 2024-02-19T17:14:38.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.612+0000 7fc298a00640 1 -- 172.21.15.46:0/136931119 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c0319d0 con 0x7fc29c0ce540 2024-02-19T17:14:38.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.612+0000 7fc298a00640 1 -- 172.21.15.46:0/136931119 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c031d60 con 0x7fc29c0ce540 2024-02-19T17:14:38.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.613+0000 7fc29b200640 1 -- 172.21.15.46:0/136931119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc29c0ce540 msgr2=0x7fc29c0ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.613+0000 7fc29b200640 1 --2- 172.21.15.46:0/136931119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc29c0ce540 0x7fc29c0ce9d0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0b1f10 tx=0x7fc28c02b910 comp rx=0 tx=0).stop 2024-02-19T17:14:38.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.613+0000 7fc29b200640 1 -- 172.21.15.46:0/136931119 shutdown_connections 2024-02-19T17:14:38.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.613+0000 7fc29b200640 1 --2- 172.21.15.46:0/136931119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc29c0ce540 0x7fc29c0ce9d0 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.613+0000 7fc29b200640 1 --2- 172.21.15.46:0/136931119 >> v2:172.21.15.142:3300/0 conn(0x7fc29c0cf520 0x7fc29c0cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.613+0000 7fc29b200640 1 -- 172.21.15.46:0/136931119 >> 172.21.15.46:0/136931119 conn(0x7fc29c06ad60 msgr2=0x7fc29c06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:38.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.613+0000 7fc29b200640 1 -- 172.21.15.46:0/136931119 shutdown_connections 2024-02-19T17:14:38.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.613+0000 7fc29b200640 1 -- 172.21.15.46:0/136931119 wait complete. 2024-02-19T17:14:38.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.615+0000 7fc29b200640 1 Processor -- start 2024-02-19T17:14:38.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.616+0000 7fc29b200640 1 -- start start 2024-02-19T17:14:38.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc29b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc29c0cceb0 0x7fc29c15fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc29b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc29c0ce540 0x7fc29c0c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc29b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc29c0cf520 0x7fc29c15cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc29b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c15f8b0 con 0x7fc29c0ce540 2024-02-19T17:14:38.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc29b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0c8be0 con 0x7fc29c0cf520 2024-02-19T17:14:38.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc29b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c15ef80 con 0x7fc29c0cceb0 2024-02-19T17:14:38.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc299400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc29c0ce540 0x7fc29c0c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc299400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc29c0ce540 0x7fc29c0c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57286/0 (socket says 172.21.15.46:57286) 2024-02-19T17:14:38.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc299400640 1 -- 172.21.15.46:0/1673557195 learned_addr learned my addr 172.21.15.46:0/1673557195 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:38.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc299e00640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc29c0cceb0 0x7fc29c15fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc29a800640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc29c0cf520 0x7fc29c15cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc299400640 1 -- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc29c0cceb0 msgr2=0x7fc29c15fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc299400640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc29c0cceb0 0x7fc29c15fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc299400640 1 -- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc29c0cf520 msgr2=0x7fc29c15cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc299400640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc29c0cf520 0x7fc29c15cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc299400640 1 -- 172.21.15.46:0/1673557195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c0094d0 con 0x7fc29c0ce540 2024-02-19T17:14:38.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.617+0000 7fc299e00640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc29c0cceb0 0x7fc29c15fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:38.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.618+0000 7fc299400640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc29c0ce540 0x7fc29c0c82e0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fc28c02b950 tx=0x7fc28c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:38.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.618+0000 7fc292000640 1 -- 172.21.15.46:0/1673557195 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c03ad30 con 0x7fc29c0ce540 2024-02-19T17:14:38.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.618+0000 7fc292000640 1 -- 172.21.15.46:0/1673557195 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c0443f0 con 0x7fc29c0ce540 2024-02-19T17:14:38.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.618+0000 7fc29b200640 1 -- 172.21.15.46:0/1673557195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c15f260 con 0x7fc29c0ce540 2024-02-19T17:14:38.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.618+0000 7fc292000640 1 -- 172.21.15.46:0/1673557195 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0447a0 con 0x7fc29c0ce540 2024-02-19T17:14:38.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.618+0000 7fc29b200640 1 -- 172.21.15.46:0/1673557195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c160280 con 0x7fc29c0ce540 2024-02-19T17:14:38.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.619+0000 7fc29b200640 1 -- 172.21.15.46:0/1673557195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc29c15e7d0 con 0x7fc29c0ce540 2024-02-19T17:14:38.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.621+0000 7fc292000640 1 -- 172.21.15.46:0/1673557195 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc28c04d450 con 0x7fc29c0ce540 2024-02-19T17:14:38.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.622+0000 7fc292000640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc27806b840 0x7fc27806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.622+0000 7fc292000640 1 -- 172.21.15.46:0/1673557195 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc28c02d040 con 0x7fc29c0ce540 2024-02-19T17:14:38.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.622+0000 7fc292000640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] conn(0x7fc278071700 0x7fc278073b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.622+0000 7fc292000640 1 -- 172.21.15.46:0/1673557195 --> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2780741d0 con 0x7fc278071700 2024-02-19T17:14:38.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.622+0000 7fc292000640 1 -- 172.21.15.46:0/1673557195 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc28c0accd0 con 0x7fc29c0ce540 2024-02-19T17:14:38.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.622+0000 7fc299e00640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc27806b840 0x7fc27806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.623+0000 7fc29a800640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] conn(0x7fc278071700 0x7fc278073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.624+0000 7fc29a800640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] conn(0x7fc278071700 0x7fc278073b20 crc :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:38.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.624+0000 7fc299e00640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc27806b840 0x7fc27806dd00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc284006fd0 tx=0x7fc284008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:38.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.626+0000 7fc292000640 1 -- 172.21.15.46:0/1673557195 <== osd.7 v2:172.21.15.142:6824/4235520298 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc2780741d0 con 0x7fc278071700 2024-02-19T17:14:38.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.641+0000 7fc29b200640 1 -- 172.21.15.46:0/1673557195 --> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc29c15e4f0 con 0x7fc278071700 2024-02-19T17:14:38.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.642+0000 7fc292000640 1 -- 172.21.15.46:0/1673557195 <== osd.7 v2:172.21.15.142:6824/4235520298 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc294007e70 con 0x7fc278071700 2024-02-19T17:14:38.627 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T17:14:38.627 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-19T17:14:38.628 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T17:14:38.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.642+0000 7fc29b200640 1 -- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] conn(0x7fc278071700 msgr2=0x7fc278073b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.642+0000 7fc29b200640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:6824/4235520298,v1:172.21.15.142:6825/4235520298] conn(0x7fc278071700 0x7fc278073b20 crc :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.642+0000 7fc29b200640 1 -- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc27806b840 msgr2=0x7fc27806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.642+0000 7fc29b200640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc27806b840 0x7fc27806dd00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc284006fd0 tx=0x7fc284008040 comp rx=0 tx=0).stop 2024-02-19T17:14:38.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.642+0000 7fc29b200640 1 -- 172.21.15.46:0/1673557195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc29c0ce540 msgr2=0x7fc29c0c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.642+0000 7fc29b200640 1 --2- 172.21.15.46:0/1673557195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc29c0ce540 0x7fc29c0c82e0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fc28c02b950 tx=0x7fc28c0046c0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.642+0000 7fc29a800640 1 -- 172.21.15.46:0/1673557195 reap_dead start 2024-02-19T17:14:38.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.642+0000 7fc29b200640 1 -- 172.21.15.46:0/1673557195 shutdown_connections 2024-02-19T17:14:38.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.642+0000 7fc29b200640 1 -- 172.21.15.46:0/1673557195 >> 172.21.15.46:0/1673557195 conn(0x7fc29c06ad60 msgr2=0x7fc29c0725b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:38.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.643+0000 7fc29b200640 1 -- 172.21.15.46:0/1673557195 shutdown_connections 2024-02-19T17:14:38.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.643+0000 7fc29b200640 1 -- 172.21.15.46:0/1673557195 wait complete. 2024-02-19T17:14:38.648 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-02-19T17:14:38.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.888+0000 7fc5b9600640 1 Processor -- start 2024-02-19T17:14:38.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.888+0000 7fc5b9600640 1 -- start start 2024-02-19T17:14:38.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.890+0000 7fc5b9600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5b406d020 0x7fc5b4071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.890+0000 7fc5b9600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc5b4071540 0x7fc5b4150680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.890+0000 7fc5b9600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b406e180 con 0x7fc5b415a7f0 2024-02-19T17:14:38.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.890+0000 7fc5b9600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b40719d0 con 0x7fc5b4071540 2024-02-19T17:14:38.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.890+0000 7fc5b9600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b406ece0 con 0x7fc5b406d020 2024-02-19T17:14:38.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.890+0000 7fc5b3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc5b4071540 0x7fc5b4150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.890+0000 7fc5b3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc5b4071540 0x7fc5b4150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57290/0 (socket says 172.21.15.46:57290) 2024-02-19T17:14:38.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.890+0000 7fc5b3400640 1 -- 172.21.15.46:0/3183345394 learned_addr learned my addr 172.21.15.46:0/3183345394 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:38.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.891+0000 7fc5b2000640 1 --2- 172.21.15.46:0/3183345394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5b406d020 0x7fc5b4071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.891+0000 7fc5b3400640 1 -- 172.21.15.46:0/3183345394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5b406d020 msgr2=0x7fc5b4071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:38.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.891+0000 7fc5b3400640 1 --2- 172.21.15.46:0/3183345394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5b406d020 0x7fc5b4071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.891+0000 7fc5b3400640 1 -- 172.21.15.46:0/3183345394 >> v1:172.21.15.142:6789/0 conn(0x7fc5b415a7f0 legacy=0x7fc5b415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.891+0000 7fc5b3400640 1 -- 172.21.15.46:0/3183345394 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b406d570 con 0x7fc5b4071540 2024-02-19T17:14:38.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.891+0000 7fc5b2000640 1 --2- 172.21.15.46:0/3183345394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5b406d020 0x7fc5b4071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:38.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.892+0000 7fc5b3400640 1 --2- 172.21.15.46:0/3183345394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b4071540 0x7fc5b4150680 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00d150 tx=0x7fc5ac02e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b5354876a84702 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:38.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.892+0000 7fc5b1600640 1 -- 172.21.15.46:0/3183345394 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac038400 con 0x7fc5b4071540 2024-02-19T17:14:38.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.892+0000 7fc5b1600640 1 -- 172.21.15.46:0/3183345394 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac032070 con 0x7fc5b4071540 2024-02-19T17:14:38.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.892+0000 7fc5b1600640 1 -- 172.21.15.46:0/3183345394 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac038780 con 0x7fc5b4071540 2024-02-19T17:14:38.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.893+0000 7fc5b9600640 1 -- 172.21.15.46:0/3183345394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b4071540 msgr2=0x7fc5b4150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.893+0000 7fc5b9600640 1 --2- 172.21.15.46:0/3183345394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b4071540 0x7fc5b4150680 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00d150 tx=0x7fc5ac02e160 comp rx=0 tx=0).stop 2024-02-19T17:14:38.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.893+0000 7fc5b9600640 1 -- 172.21.15.46:0/3183345394 shutdown_connections 2024-02-19T17:14:38.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.893+0000 7fc5b9600640 1 --2- 172.21.15.46:0/3183345394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b4071540 0x7fc5b4150680 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.893+0000 7fc5b9600640 1 --2- 172.21.15.46:0/3183345394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5b406d020 0x7fc5b4071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.893+0000 7fc5b9600640 1 -- 172.21.15.46:0/3183345394 >> 172.21.15.46:0/3183345394 conn(0x7fc5b4066f70 msgr2=0x7fc5b406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:38.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.893+0000 7fc5b9600640 1 -- 172.21.15.46:0/3183345394 shutdown_connections 2024-02-19T17:14:38.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.893+0000 7fc5b9600640 1 -- 172.21.15.46:0/3183345394 wait complete. 2024-02-19T17:14:38.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.895+0000 7fc5b9600640 1 Processor -- start 2024-02-19T17:14:38.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.895+0000 7fc5b9600640 1 -- start start 2024-02-19T17:14:38.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.896+0000 7fc5b9600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5b406d020 0x7fc5b414e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.896+0000 7fc5b9600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b4071540 0x7fc5b4157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.896+0000 7fc5b9600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5b415a7f0 0x7fc5b41593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.896+0000 7fc5b9600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b414e940 con 0x7fc5b4071540 2024-02-19T17:14:38.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.896+0000 7fc5b9600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41504f0 con 0x7fc5b406d020 2024-02-19T17:14:38.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.896+0000 7fc5b9600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41501c0 con 0x7fc5b415a7f0 2024-02-19T17:14:38.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.896+0000 7fc5b2000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b4071540 0x7fc5b4157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.896+0000 7fc5b2000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b4071540 0x7fc5b4157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57296/0 (socket says 172.21.15.46:57296) 2024-02-19T17:14:38.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.896+0000 7fc5b2000640 1 -- 172.21.15.46:0/1626429307 learned_addr learned my addr 172.21.15.46:0/1626429307 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:38.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.897+0000 7fc5b2a00640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5b406d020 0x7fc5b414e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.897+0000 7fc5b3400640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5b415a7f0 0x7fc5b41593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.897+0000 7fc5b2000640 1 -- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5b415a7f0 msgr2=0x7fc5b41593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.897+0000 7fc5b2000640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5b415a7f0 0x7fc5b41593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.897+0000 7fc5b2000640 1 -- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5b406d020 msgr2=0x7fc5b414e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:38.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.897+0000 7fc5b2000640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5b406d020 0x7fc5b414e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:38.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.897+0000 7fc5b2000640 1 -- 172.21.15.46:0/1626429307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac00bd40 con 0x7fc5b4071540 2024-02-19T17:14:38.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.897+0000 7fc5b2000640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b4071540 0x7fc5b4157680 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000c7f0 tx=0x7fc5a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.897+0000 7fc5aaa00640 1 -- 172.21.15.46:0/1626429307 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0007820 con 0x7fc5b4071540 2024-02-19T17:14:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.898+0000 7fc5aaa00640 1 -- 172.21.15.46:0/1626429307 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0007980 con 0x7fc5b4071540 2024-02-19T17:14:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.898+0000 7fc5aaa00640 1 -- 172.21.15.46:0/1626429307 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0007cf0 con 0x7fc5b4071540 2024-02-19T17:14:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.898+0000 7fc5b9600640 1 -- 172.21.15.46:0/1626429307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b4157ff0 con 0x7fc5b4071540 2024-02-19T17:14:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.898+0000 7fc5b9600640 1 -- 172.21.15.46:0/1626429307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b41585b0 con 0x7fc5b4071540 2024-02-19T17:14:38.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.899+0000 7fc5b9600640 1 -- 172.21.15.46:0/1626429307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b41587d0 con 0x7fc5b4071540 2024-02-19T17:14:38.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.900+0000 7fc5aaa00640 1 -- 172.21.15.46:0/1626429307 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc5a00113f0 con 0x7fc5b4071540 2024-02-19T17:14:38.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.901+0000 7fc5aaa00640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc59406b840 0x7fc59406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:38.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.901+0000 7fc5aaa00640 1 -- 172.21.15.46:0/1626429307 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc5a008a230 con 0x7fc5b4071540 2024-02-19T17:14:38.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.901+0000 7fc5b2a00640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc59406b840 0x7fc59406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:38.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.902+0000 7fc5b2a00640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc59406b840 0x7fc59406dd00 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4001640 tx=0x7fc5a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:38.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:38.905+0000 7fc5aaa00640 1 -- 172.21.15.46:0/1626429307 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc5a0054eb0 con 0x7fc5b4071540 2024-02-19T17:14:39.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.105+0000 7fc5b9600640 1 -- 172.21.15.46:0/1626429307 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5b40cb2c0 con 0x7fc59406b840 2024-02-19T17:14:39.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.106+0000 7fc5aaa00640 1 -- 172.21.15.46:0/1626429307 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc5b40cb2c0 con 0x7fc59406b840 2024-02-19T17:14:39.092 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 7 to deep-scrub 2024-02-19T17:14:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.109+0000 7fc5b9600640 1 -- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc59406b840 msgr2=0x7fc59406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.109+0000 7fc5b9600640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc59406b840 0x7fc59406dd00 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4001640 tx=0x7fc5a4009040 comp rx=0 tx=0).stop 2024-02-19T17:14:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.109+0000 7fc5b9600640 1 -- 172.21.15.46:0/1626429307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b4071540 msgr2=0x7fc5b4157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.109+0000 7fc5b9600640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b4071540 0x7fc5b4157680 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000c7f0 tx=0x7fc5a000ccb0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.109+0000 7fc5b9600640 1 -- 172.21.15.46:0/1626429307 shutdown_connections 2024-02-19T17:14:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.109+0000 7fc5b9600640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fc59406b840 0x7fc59406dd00 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.109+0000 7fc5b9600640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5b415a7f0 0x7fc5b41593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.109+0000 7fc5b9600640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b4071540 0x7fc5b4157680 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.109+0000 7fc5b9600640 1 --2- 172.21.15.46:0/1626429307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5b406d020 0x7fc5b414e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.109+0000 7fc5b9600640 1 -- 172.21.15.46:0/1626429307 >> 172.21.15.46:0/1626429307 conn(0x7fc5b4066f70 msgr2=0x7fc5b40b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.109+0000 7fc5b9600640 1 -- 172.21.15.46:0/1626429307 shutdown_connections 2024-02-19T17:14:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.109+0000 7fc5b9600640 1 -- 172.21.15.46:0/1626429307 wait complete. 2024-02-19T17:14:39.116 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-19T17:14:39.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.346+0000 7f45c2000640 1 Processor -- start 2024-02-19T17:14:39.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.347+0000 7f45c2000640 1 -- start start 2024-02-19T17:14:39.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.348+0000 7f45c2000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45bc0cdc00 0x7f45bc0cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.348+0000 7f45c2000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f45bc0cf890 0x7f45bc06bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.348+0000 7f45c2000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45bc0cdfe0 0x7f45bc06d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.348+0000 7f45c2000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc0cac20 con 0x7f45bc0cf890 2024-02-19T17:14:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.348+0000 7f45c2000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc06b590 con 0x7f45bc0cdfe0 2024-02-19T17:14:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.348+0000 7f45c2000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0ca410 con 0x7f45bc0cdc00 2024-02-19T17:14:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.348+0000 7f45bbe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f45bc0cf890 0x7f45bc06bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.348+0000 7f45bbe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f45bc0cf890 0x7f45bc06bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57304/0 (socket says 172.21.15.46:57304) 2024-02-19T17:14:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.348+0000 7f45bbe00640 1 -- 172.21.15.46:0/183611534 learned_addr learned my addr 172.21.15.46:0/183611534 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.349+0000 7f45c0c00640 1 --2- 172.21.15.46:0/183611534 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45bc0cdc00 0x7f45bc0cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.349+0000 7f45c1600640 1 --2- 172.21.15.46:0/183611534 >> v2:172.21.15.142:3300/0 conn(0x7f45bc0cdfe0 0x7f45bc06d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.349+0000 7f45bbe00640 1 -- 172.21.15.46:0/183611534 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45bc0cdc00 msgr2=0x7f45bc0cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.349+0000 7f45bbe00640 1 --2- 172.21.15.46:0/183611534 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45bc0cdc00 0x7f45bc0cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.349+0000 7f45bbe00640 1 -- 172.21.15.46:0/183611534 >> v2:172.21.15.142:3300/0 conn(0x7f45bc0cdfe0 msgr2=0x7f45bc06d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.349+0000 7f45bbe00640 1 --2- 172.21.15.46:0/183611534 >> v2:172.21.15.142:3300/0 conn(0x7f45bc0cdfe0 0x7f45bc06d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.349+0000 7f45bbe00640 1 -- 172.21.15.46:0/183611534 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc06bb10 con 0x7f45bc0cf890 2024-02-19T17:14:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.349+0000 7f45c1600640 1 --2- 172.21.15.46:0/183611534 >> v2:172.21.15.142:3300/0 conn(0x7f45bc0cdfe0 0x7f45bc06d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:39.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.350+0000 7f45bbe00640 1 --2- 172.21.15.46:0/183611534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc0cf890 0x7f45bc06bfa0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0cd8c0 tx=0x7f45ac02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edde51ab0611e28f server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:39.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.350+0000 7f45bb400640 1 -- 172.21.15.46:0/183611534 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac02ca80 con 0x7f45bc0cf890 2024-02-19T17:14:39.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.350+0000 7f45bb400640 1 -- 172.21.15.46:0/183611534 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac02cbe0 con 0x7f45bc0cf890 2024-02-19T17:14:39.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.350+0000 7f45bb400640 1 -- 172.21.15.46:0/183611534 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0343f0 con 0x7f45bc0cf890 2024-02-19T17:14:39.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.351+0000 7f45c2000640 1 -- 172.21.15.46:0/183611534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc0cf890 msgr2=0x7f45bc06bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:39.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.351+0000 7f45c2000640 1 --2- 172.21.15.46:0/183611534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc0cf890 0x7f45bc06bfa0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0cd8c0 tx=0x7f45ac02bee0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.351+0000 7f45c2000640 1 -- 172.21.15.46:0/183611534 shutdown_connections 2024-02-19T17:14:39.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.351+0000 7f45c2000640 1 --2- 172.21.15.46:0/183611534 >> v2:172.21.15.142:3300/0 conn(0x7f45bc0cdfe0 0x7f45bc06d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.351+0000 7f45c2000640 1 --2- 172.21.15.46:0/183611534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc0cf890 0x7f45bc06bfa0 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.351+0000 7f45c2000640 1 --2- 172.21.15.46:0/183611534 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45bc0cdc00 0x7f45bc0cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.351+0000 7f45c2000640 1 -- 172.21.15.46:0/183611534 >> 172.21.15.46:0/183611534 conn(0x7f45bc0cc840 msgr2=0x7f45bc0ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:39.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.351+0000 7f45c2000640 1 -- 172.21.15.46:0/183611534 shutdown_connections 2024-02-19T17:14:39.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.351+0000 7f45c2000640 1 -- 172.21.15.46:0/183611534 wait complete. 2024-02-19T17:14:39.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.353+0000 7f45c2000640 1 Processor -- start 2024-02-19T17:14:39.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.353+0000 7f45c2000640 1 -- start start 2024-02-19T17:14:39.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.354+0000 7f45c2000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc0cdc00 0x7f45bc1f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:39.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.354+0000 7f45c2000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45bc0cdfe0 0x7f45bc157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:39.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.354+0000 7f45c2000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc0cf890 0x7f45bc0a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:39.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.354+0000 7f45c2000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc15da40 con 0x7f45bc0cf890 2024-02-19T17:14:39.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.354+0000 7f45c2000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0c7ee0 con 0x7f45bc0cdc00 2024-02-19T17:14:39.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.354+0000 7f45c2000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0c81c0 con 0x7f45bc0cdfe0 2024-02-19T17:14:39.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.354+0000 7f45c1600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc0cf890 0x7f45bc0a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:39.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.354+0000 7f45c1600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc0cf890 0x7f45bc0a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57312/0 (socket says 172.21.15.46:57312) 2024-02-19T17:14:39.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.354+0000 7f45c1600640 1 -- 172.21.15.46:0/3234854264 learned_addr learned my addr 172.21.15.46:0/3234854264 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:39.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.355+0000 7f45bbe00640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45bc0cdfe0 0x7f45bc157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:39.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.355+0000 7f45c0c00640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc0cdc00 0x7f45bc1f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:39.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.355+0000 7f45c1600640 1 -- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45bc0cdfe0 msgr2=0x7f45bc157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:39.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.355+0000 7f45c1600640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45bc0cdfe0 0x7f45bc157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.355+0000 7f45c1600640 1 -- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc0cdc00 msgr2=0x7f45bc1f7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:39.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.355+0000 7f45c1600640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc0cdc00 0x7f45bc1f7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.355+0000 7f45c1600640 1 -- 172.21.15.46:0/3234854264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac009b30 con 0x7f45bc0cf890 2024-02-19T17:14:39.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.355+0000 7f45c0c00640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc0cdc00 0x7f45bc1f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:39.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.355+0000 7f45c1600640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc0cf890 0x7f45bc0a0310 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f45b400c7f0 tx=0x7f45b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:39.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.355+0000 7f45b8c00640 1 -- 172.21.15.46:0/3234854264 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4007820 con 0x7f45bc0cf890 2024-02-19T17:14:39.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.355+0000 7f45b8c00640 1 -- 172.21.15.46:0/3234854264 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4007980 con 0x7f45bc0cf890 2024-02-19T17:14:39.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.355+0000 7f45b8c00640 1 -- 172.21.15.46:0/3234854264 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4007d70 con 0x7f45bc0cf890 2024-02-19T17:14:39.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.355+0000 7f45c2000640 1 -- 172.21.15.46:0/3234854264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc0c84a0 con 0x7f45bc0cf890 2024-02-19T17:14:39.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.356+0000 7f45c2000640 1 -- 172.21.15.46:0/3234854264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc0c8a60 con 0x7f45bc0cf890 2024-02-19T17:14:39.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.357+0000 7f45c2000640 1 -- 172.21.15.46:0/3234854264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc0c8c50 con 0x7f45bc0cf890 2024-02-19T17:14:39.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.358+0000 7f45b8c00640 1 -- 172.21.15.46:0/3234854264 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f45b40113f0 con 0x7f45bc0cf890 2024-02-19T17:14:39.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.359+0000 7f45b8c00640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f459806b860 0x7f459806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:39.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.359+0000 7f45b8c00640 1 -- 172.21.15.46:0/3234854264 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f45b408a200 con 0x7f45bc0cf890 2024-02-19T17:14:39.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.359+0000 7f45c0c00640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f459806b860 0x7f459806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:39.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.360+0000 7f45c0c00640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f459806b860 0x7f459806dd20 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f45a4006fd0 tx=0x7f45a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:39.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.364+0000 7f45b8c00640 1 -- 172.21.15.46:0/3234854264 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f45b4054f90 con 0x7f45bc0cf890 2024-02-19T17:14:39.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.555+0000 7f45c2000640 1 -- 172.21.15.46:0/3234854264 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45bc0ca660 con 0x7f459806b860 2024-02-19T17:14:39.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.562+0000 7f45b8c00640 1 -- 172.21.15.46:0/3234854264 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48596 (secure 0 0 0) 0x7f45a4009d90 con 0x7f459806b860 2024-02-19T17:14:39.548 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:14:39.549 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-02-19T17:14:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.565+0000 7f45c2000640 1 -- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f459806b860 msgr2=0x7f459806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.565+0000 7f45c2000640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f459806b860 0x7f459806dd20 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f45a4006fd0 tx=0x7f45a4008040 comp rx=0 tx=0).stop 2024-02-19T17:14:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.565+0000 7f45c2000640 1 -- 172.21.15.46:0/3234854264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc0cf890 msgr2=0x7f45bc0a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.565+0000 7f45c2000640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc0cf890 0x7f45bc0a0310 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f45b400c7f0 tx=0x7f45b400ccb0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.565+0000 7f45c2000640 1 -- 172.21.15.46:0/3234854264 shutdown_connections 2024-02-19T17:14:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.565+0000 7f45c2000640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f459806b860 0x7f459806dd20 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.565+0000 7f45c2000640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc0cf890 0x7f45bc0a0310 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.565+0000 7f45c2000640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45bc0cdfe0 0x7f45bc157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.565+0000 7f45c2000640 1 --2- 172.21.15.46:0/3234854264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc0cdc00 0x7f45bc1f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:39.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.565+0000 7f45c2000640 1 -- 172.21.15.46:0/3234854264 >> 172.21.15.46:0/3234854264 conn(0x7f45bc0cc840 msgr2=0x7f45bc0ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:39.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.565+0000 7f45c2000640 1 -- 172.21.15.46:0/3234854264 shutdown_connections 2024-02-19T17:14:39.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:39.565+0000 7f45c2000640 1 -- 172.21.15.46:0/3234854264 wait complete. 2024-02-19T17:14:39.569 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":18532,"stamp":"2024-02-19T17:14:38.480199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12069276,"kb_used_data":4552,"kb_used_omap":2838,"kb_used_meta":12061801,"kb_avail":742905444,"statfs":{"total":773094113280,"available":760735174656,"internally_reserved":0,"allocated":4661248,"data_stored":2552456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2906559,"internal_metadata":12351284801},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":90,"apply_latency_ms":90,"commit_latency_ns":90000000,"apply_latency_ns":90000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.465446"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":508,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-02-19T17:14:28.297973+0000","last_change":"2024-02-19T06:57:45.353063+0000","last_active":"2024-02-19T17:14:28.297973+0000","last_peered":"2024-02-19T17:14:28.297973+0000","last_clean":"2024-02-19T17:14:28.297973+0000","last_became_active":"2024-02-19T06:57:45.350602+0000","last_became_peered":"2024-02-19T06:57:45.350602+0000","last_unstale":"2024-02-19T17:14:28.297973+0000","last_undegraded":"2024-02-19T17:14:28.297973+0000","last_fullsized":"2024-02-19T17:14:28.297973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T06:57:44.230095+0000","last_clean_scrub_stamp":"2024-02-19T06:57:44.230095+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T14:04:42.513180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424516846,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1804144,"kb_used_data":424,"kb_used_omap":46,"kb_used_meta":1803665,"kb_avail":92567696,"statfs":{"total":96636764160,"available":94789320704,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47262,"internal_metadata":1846953826},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":1.0229999999999999,"15min":0.99399999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.107,"5min":9.6859999999999999,"15min":9.6859999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":1.1080000000000001,"15min":1.036},"min":{"1min":0.46000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.4159999999999999,"5min":12.372,"15min":12.372},"last":1.03}]},{"osd":1,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.361,"15min":5.3079999999999998},"min":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.4660000000000002,"5min":29.341000000000001,"15min":1340.5419999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.3140000000000001,"15min":5.3019999999999996},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.992,"5min":25.664999999999999,"15min":1340.414},"last":0.89100000000000001}]},{"osd":2,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.1419999999999999,"15min":1.071},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38500000000000001},"max":{"1min":1.6799999999999999,"5min":4.0709999999999997,"15min":6.4770000000000003},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.292,"15min":1.2110000000000001},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.432},"max":{"1min":2.5059999999999998,"5min":11.471,"15min":11.471},"last":1.498}]},{"osd":3,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1739999999999999,"15min":1.242},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.2639999999999998,"5min":9.4450000000000003,"15min":9.4450000000000003},"last":1},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.331,"15min":1.266},"min":{"1min":0.55900000000000005,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":2.5449999999999999,"5min":11.388,"15min":11.388},"last":1.5920000000000001}]},{"osd":4,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.92500000000000004,"15min":0.95199999999999996},"min":{"1min":0.45900000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.121,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":1.4319999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.093,"15min":1.036},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":2.331,"5min":10.106999999999999,"15min":10.106999999999999},"last":1.3899999999999999}]},{"osd":5,"last update":"Mon Feb 19 17:14:31 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1890000000000001,"15min":1.091},"min":{"1min":0.45600000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.8119999999999998,"5min":11.430999999999999,"15min":11.430999999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.0820000000000001,"15min":1.04},"min":{"1min":0.49099999999999999,"5min":0.45600000000000002,"15min":0.441},"max":{"1min":2.718,"5min":5.391,"15min":5.391},"last":0.81399999999999995}]},{"osd":7,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.097,"15min":1.0760000000000001},"min":{"1min":0.55300000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.3700000000000001,"5min":9.9800000000000004,"15min":9.9800000000000004},"last":1.169},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.292,"15min":1.1910000000000001},"min":{"1min":0.66800000000000004,"5min":0.46400000000000002,"15min":0.46300000000000002},"max":{"1min":2.9079999999999999,"5min":12.414999999999999,"15min":12.414999999999999},"last":1.6499999999999999}]}]},{"osd":5,"up_from":15,"seq":64424516844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1426932,"kb_used_data":424,"kb_used_omap":473,"kb_used_meta":1426022,"kb_avail":92944908,"statfs":{"total":96636764160,"available":95175585792,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":484739,"internal_metadata":1460247165},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":1.0880000000000001,"15min":1.0640000000000001},"min":{"1min":0.34200000000000003,"5min":0.33000000000000002,"15min":0.27100000000000002},"max":{"1min":1.2330000000000001,"5min":9.8399999999999999,"15min":9.8399999999999999},"last":1.151},{"interface":"front","average":{"1min":1.083,"5min":1.2090000000000001,"15min":1.157},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.0919999999999996,"5min":5.1980000000000004,"15min":6.9539999999999997},"last":1.629}]},{"osd":1,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.3380000000000001,"15min":3.8090000000000002},"min":{"1min":0.45300000000000001,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":1.1060000000000001,"5min":16.93,"15min":560.22000000000003},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.345,"15min":3.8519999999999999},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.36199999999999999},"max":{"1min":3.7999999999999998,"5min":9.2360000000000007,"15min":559.36300000000006},"last":1.4039999999999999}]},{"osd":2,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4870000000000001,"15min":1.266},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":4.0129999999999999,"5min":23.012,"15min":23.012},"last":1.212},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.2809999999999999,"15min":1.2070000000000001},"min":{"1min":0.50800000000000001,"5min":0.432,"15min":0.41999999999999998},"max":{"1min":2.4380000000000002,"5min":5.4379999999999997,"15min":5.5529999999999999},"last":1.47}]},{"osd":3,"last update":"Mon Feb 19 17:14:14 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.448,"15min":1.5209999999999999},"min":{"1min":0.53200000000000003,"5min":0.43099999999999999,"15min":0.41099999999999998},"max":{"1min":3.8969999999999998,"5min":23.094000000000001,"15min":78.207999999999998},"last":1.681},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.75,"15min":1.667},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":4.0519999999999996,"5min":36.241999999999997,"15min":78.245000000000005},"last":1.738}]},{"osd":4,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":1.091,"15min":0.97099999999999997},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":1.423,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":2.0350000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.1919999999999999,"15min":1.0089999999999999},"min":{"1min":0.48099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.855,"5min":14.992000000000001,"15min":14.992000000000001},"last":1.786}]},{"osd":6,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1220000000000001,"15min":1.036},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":3.968,"5min":6.6989999999999998,"15min":6.6989999999999998},"last":1.8320000000000001},{"interface":"front","average":{"1min":0.997,"5min":1.3300000000000001,"15min":1.127},"min":{"1min":0.53200000000000003,"5min":0.47599999999999998,"15min":0.41399999999999998},"max":{"1min":3.3580000000000001,"5min":16.837,"15min":16.837},"last":1.9370000000000001}]},{"osd":7,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.173,"15min":1.0549999999999999},"min":{"1min":0.48699999999999999,"5min":0.46400000000000002,"15min":0.42899999999999999},"max":{"1min":3.9340000000000002,"5min":7.2969999999999997,"15min":7.2969999999999997},"last":2.149},{"interface":"front","average":{"1min":1.238,"5min":1.6459999999999999,"15min":1.2529999999999999},"min":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.39400000000000002},"max":{"1min":4.1289999999999996,"5min":35.945,"15min":35.945},"last":1.9890000000000001}]}]},{"osd":7,"up_from":14,"seq":60129549548,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1262584,"kb_used_data":1004,"kb_used_omap":237,"kb_used_meta":1261330,"kb_avail":93109256,"statfs":{"total":96636764160,"available":95343878144,"internally_reserved":0,"allocated":1028096,"data_stored":761833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":243426,"internal_metadata":1291602206},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":1.1639999999999999,"15min":1.5409999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":1.794,"5min":16.071999999999999,"15min":135.33099999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":1.736,"15min":1.75},"min":{"1min":0.39400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1,"5min":42.113,"15min":134.83000000000001},"last":1.2450000000000001}]},{"osd":1,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":1.109,"15min":2.823},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.806,"5min":14.302,"15min":440.32799999999997},"last":1.3049999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.8080000000000001,"15min":3.0619999999999998},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.35399999999999998},"max":{"1min":1.8169999999999999,"5min":45.880000000000003,"15min":442.47500000000002},"last":1.518}]},{"osd":2,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.7210000000000001,"15min":1.5609999999999999},"min":{"1min":0.443,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.863,"5min":45.709000000000003,"15min":77.938999999999993},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.5349999999999999,"15min":1.4870000000000001},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.38300000000000001},"max":{"1min":1.109,"5min":42.390999999999998,"15min":79.799000000000007},"last":1.0629999999999999}]},{"osd":3,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":2.5059999999999998,"15min":1.8260000000000001},"min":{"1min":0.46200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.915,"5min":126.935,"15min":126.935},"last":1.196},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.3520000000000001,"15min":1.4590000000000001},"min":{"1min":0.48099999999999998,"5min":0.44800000000000001,"15min":0.41499999999999998},"max":{"1min":2.8319999999999999,"5min":14.634,"15min":72.626000000000005},"last":1.659}]},{"osd":4,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":1.538,"15min":1.109},"min":{"1min":0.443,"5min":0.37,"15min":0.36399999999999999},"max":{"1min":1.4259999999999999,"5min":42.188000000000002,"15min":42.188000000000002},"last":1.345},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.121,"15min":0.98099999999999998},"min":{"1min":0.45000000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.8480000000000001,"5min":22.009,"15min":22.009},"last":1.554}]},{"osd":5,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":1.655,"15min":1.22},"min":{"1min":0.55000000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.5579999999999998,"5min":68.173000000000002,"15min":68.173000000000002},"last":1.708},{"interface":"front","average":{"1min":1.0249999999999999,"5min":2.1000000000000001,"15min":1.343},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.436},"max":{"1min":1.7849999999999999,"5min":45.917999999999999,"15min":45.917999999999999},"last":1.7869999999999999}]},{"osd":6,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.716,"15min":1.2569999999999999},"min":{"1min":0.53500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.8799999999999999,"5min":67.986999999999995,"15min":67.986999999999995},"last":1.9419999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.288,"15min":1.131},"min":{"1min":0.70599999999999996,"5min":0.48799999999999999,"15min":0.47999999999999998},"max":{"1min":2.1819999999999999,"5min":13.959,"15min":13.959},"last":1.9079999999999999}]}]},{"osd":4,"up_from":14,"seq":60129549546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1613748,"kb_used_data":424,"kb_used_omap":500,"kb_used_meta":1612811,"kb_avail":92758092,"statfs":{"total":96636764160,"available":94984286208,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":512202,"internal_metadata":1651519286},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.93999999999999995,"15min":1.0700000000000001},"min":{"1min":0.32800000000000001,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":2.6099999999999999,"5min":4.3840000000000003,"15min":28.562999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.95799999999999996,"15min":1.028},"min":{"1min":0.45000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.29,"5min":3.6429999999999998,"15min":13.212},"last":0.91700000000000004}]},{"osd":1,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.94899999999999995,"15min":6.7409999999999997},"min":{"1min":0.379,"5min":0.35999999999999999,"15min":0.34499999999999997},"max":{"1min":2.5099999999999998,"5min":4.3719999999999999,"15min":1591.5709999999999},"last":1.101},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.073,"15min":6.7709999999999999},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":3.4910000000000001,"5min":4.3109999999999999,"15min":1590.9179999999999},"last":1.0269999999999999}]},{"osd":2,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.173,"15min":1.149},"min":{"1min":0.47799999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.2090000000000001,"5min":9.077,"15min":16.189},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.999,"15min":1.125},"min":{"1min":0.45000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.5459999999999998,"5min":4.2999999999999998,"15min":6.0190000000000001},"last":1.2509999999999999}]},{"osd":3,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.175,"15min":1.1799999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":3.6429999999999998,"5min":4.9269999999999996,"15min":16.074999999999999},"last":1.4279999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.137,"15min":1.1819999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.7410000000000001,"5min":4.202,"15min":5.9390000000000001},"last":1.381}]},{"osd":5,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.89100000000000001,"15min":0.92300000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.4419999999999999,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":1.9430000000000001},{"interface":"front","average":{"1min":0.90800000000000003,"5min":1.018,"15min":1.012},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0409999999999999,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":2.2010000000000001}]},{"osd":6,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0249999999999999,"15min":0.998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.2879999999999998,"5min":7.6440000000000001,"15min":16.228999999999999},"last":1.5980000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.0249999999999999,"15min":0.98599999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.4670000000000001,"5min":4.8680000000000003,"15min":6.0549999999999997},"last":1.7190000000000001}]},{"osd":7,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.042,"15min":1.0669999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.738,"5min":4.556,"15min":5.415},"last":2.0499999999999998},{"interface":"front","average":{"1min":1.206,"5min":1.159,"15min":1.123},"min":{"1min":0.42799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.2559999999999998,"5min":8.5350000000000001,"15min":16.149999999999999},"last":1.6919999999999999}]}]},{"osd":3,"up_from":14,"seq":60129549518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1540848,"kb_used_data":424,"kb_used_omap":50,"kb_used_meta":1540365,"kb_avail":92830992,"statfs":{"total":96636764160,"available":95058935808,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51317,"internal_metadata":1577334667},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:28 2024","interfaces":[{"interface":"back","average":{"1min":2.1110000000000002,"5min":1.3540000000000001,"15min":1.371},"min":{"1min":0.36899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":14.741,"5min":14.741,"15min":14.741},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.8240000000000001,"5min":1.3220000000000001,"15min":1.3999999999999999},"min":{"1min":0.39000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.8019999999999996,"5min":8.8019999999999996,"15min":8.8019999999999996},"last":1.5}]},{"osd":1,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":1.5209999999999999,"15min":2.7069999999999999},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":2.6299999999999999,"5min":23.510000000000002,"15min":278.68099999999998},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.427,"15min":2.7519999999999998},"min":{"1min":0.41599999999999998,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":2.5910000000000002,"5min":8.0559999999999992,"15min":279.06599999999997},"last":1.3819999999999999}]},{"osd":2,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":2.7389999999999999,"15min":2.0760000000000001},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.351,"5min":121.10299999999999,"15min":121.10299999999999},"last":1.224},{"interface":"front","average":{"1min":0.91100000000000003,"5min":2.6320000000000001,"15min":1.986},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.33800000000000002},"max":{"1min":2.0470000000000002,"5min":118.05800000000001,"15min":118.05800000000001},"last":1.1890000000000001}]},{"osd":4,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.788,"15min":1.627},"min":{"1min":0.43099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.153,"5min":35.975999999999999,"15min":35.975999999999999},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.556,"15min":1.637},"min":{"1min":0.48799999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.2519999999999998,"5min":12.666,"15min":12.666},"last":1.536}]},{"osd":5,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.536,"15min":1.5720000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.9860000000000002,"5min":8.7669999999999995,"15min":8.7669999999999995},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.5600000000000001,"15min":1.667},"min":{"1min":0.79900000000000004,"5min":0.498,"15min":0.48699999999999999},"max":{"1min":2.1930000000000001,"5min":8.8819999999999997,"15min":8.8819999999999997},"last":1.6850000000000001}]},{"osd":6,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.546,"15min":1.6839999999999999},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.47099999999999997},"max":{"1min":2.8719999999999999,"5min":9.0860000000000003,"15min":9.0860000000000003},"last":1.327},{"interface":"front","average":{"1min":1.335,"5min":1.575,"15min":1.651},"min":{"1min":0.64100000000000001,"5min":0.59499999999999997,"15min":0.53800000000000003},"max":{"1min":3.7530000000000001,"5min":15.616,"15min":15.616},"last":1.0369999999999999}]},{"osd":7,"last update":"Mon Feb 19 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.516,"15min":1.7150000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48799999999999999},"max":{"1min":3.9009999999999998,"5min":10.589,"15min":10.589},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.5369999999999999,"15min":1.6990000000000001},"min":{"1min":0.71999999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":4.8109999999999999,"5min":7.3780000000000001,"15min":7.3780000000000001},"last":1.6120000000000001}]}]},{"osd":2,"up_from":14,"seq":60129549534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1784432,"kb_used_data":424,"kb_used_omap":768,"kb_used_meta":1783231,"kb_avail":92587408,"statfs":{"total":96636764160,"available":94809505792,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":786953,"internal_metadata":1826029047},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.99399999999999999,"15min":1.417},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.25900000000000001},"max":{"1min":2.8839999999999999,"5min":6.6719999999999997,"15min":65.132000000000005},"last":1.339},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.1599999999999999,"15min":1.591},"min":{"1min":0.39700000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.4510000000000001,"5min":11.308999999999999,"15min":70.902000000000001},"last":0.89700000000000002}]},{"osd":1,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.4990000000000001,"15min":5.6379999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.71,"5min":11.342000000000001,"15min":1038.0440000000001},"last":1.4590000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":1.419,"15min":5.5419999999999998},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.33600000000000002},"max":{"1min":1.6899999999999999,"5min":8.0749999999999993,"15min":1037.0899999999999},"last":1.29}]},{"osd":3,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.218,"15min":1.427},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.29299999999999998},"max":{"1min":1.7410000000000001,"5min":5.0629999999999997,"15min":7.71},"last":1.504},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.573,"15min":1.6839999999999999},"min":{"1min":0.57999999999999996,"5min":0.44,"15min":0.318},"max":{"1min":2.6699999999999999,"5min":11.372,"15min":11.816000000000001},"last":1.2569999999999999}]},{"osd":4,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.794,"15min":2.2229999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.581,"5min":26.771000000000001,"15min":189.965},"last":1.617},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.716,"15min":2.1680000000000001},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.41199999999999998},"max":{"1min":2.46,"5min":27.465,"15min":193.35400000000001},"last":1.7050000000000001}]},{"osd":5,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.212,"15min":1.395},"min":{"1min":0.54000000000000004,"5min":0.44500000000000001,"15min":0.38500000000000001},"max":{"1min":2.8650000000000002,"5min":5.024,"15min":6.6159999999999997},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.556,"15min":1.5980000000000001},"min":{"1min":0.749,"5min":0.59899999999999998,"15min":0.52100000000000002},"max":{"1min":3.831,"5min":11.218999999999999,"15min":11.218999999999999},"last":1.7989999999999999}]},{"osd":6,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.5680000000000001,"15min":1.514},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9690000000000001,"5min":6.6319999999999997,"15min":6.6319999999999997},"last":1.429},{"interface":"front","average":{"1min":1.202,"5min":1.3460000000000001,"15min":1.5069999999999999},"min":{"1min":0.501,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.8180000000000001,"5min":7.9409999999999998,"15min":7.9409999999999998},"last":1.5669999999999999}]},{"osd":7,"last update":"Mon Feb 19 17:13:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.534,"15min":1.5669999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.46300000000000002},"max":{"1min":3.8090000000000002,"5min":5.5049999999999999,"15min":6.1680000000000001},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.556,"15min":1.589},"min":{"1min":0.68500000000000005,"5min":0.63,"15min":0.435},"max":{"1min":2.2290000000000001,"5min":23.437000000000001,"15min":23.437000000000001},"last":1.7629999999999999}]}]},{"osd":1,"up_from":14,"seq":60129549523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1739508,"kb_used_data":424,"kb_used_omap":490,"kb_used_meta":1738581,"kb_avail":92632332,"statfs":{"total":96636764160,"available":94855507968,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":502102,"internal_metadata":1780307626},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":1.3460000000000001,"15min":1.296},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":2.2149999999999999,"5min":14.206,"15min":14.206},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":1.5069999999999999,"15min":1.367},"min":{"1min":0.41199999999999998,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":2.056,"5min":14.311,"15min":14.311},"last":1.4610000000000001}]},{"osd":2,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.3109999999999999,"15min":1.663},"min":{"1min":0.41899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.4649999999999999,"5min":13.16,"15min":82.034999999999997},"last":1.079},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.6100000000000001,"15min":1.8580000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32000000000000001},"max":{"1min":3.407,"5min":13.068,"15min":83.215999999999994},"last":1.1879999999999999}]},{"osd":3,"last update":"Mon Feb 19 17:14:28 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.7270000000000001,"15min":1.6890000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":4.5800000000000001,"5min":9.5449999999999999,"15min":13.901},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.718,"15min":1.607},"min":{"1min":0.39600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.9620000000000002,"5min":18.905000000000001,"15min":18.905000000000001},"last":1.2729999999999999}]},{"osd":4,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.4830000000000001,"15min":1.4419999999999999},"min":{"1min":0.46700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.2010000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":1.385},{"interface":"front","average":{"1min":1.139,"5min":1.5209999999999999,"15min":1.472},"min":{"1min":0.55600000000000005,"5min":0.46400000000000002,"15min":0.39900000000000002},"max":{"1min":3.6640000000000001,"5min":13.253,"15min":13.253},"last":2.1059999999999999}]},{"osd":5,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.6799999999999999,"15min":1.651},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.47599999999999998},"max":{"1min":3.3519999999999999,"5min":13.005000000000001,"15min":13.760999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.6259999999999999,"15min":1.516},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":3.2429999999999999,"5min":9.8770000000000007,"15min":9.8770000000000007},"last":2.036}]},{"osd":6,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.5800000000000001,"15min":1.54},"min":{"1min":0.51000000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.6779999999999999,"5min":13.206,"15min":13.206},"last":1.8180000000000001},{"interface":"front","average":{"1min":1.377,"5min":1.609,"15min":1.6359999999999999},"min":{"1min":0.54600000000000004,"5min":0.496,"15min":0.496},"max":{"1min":3.4449999999999998,"5min":9.125,"15min":13.862},"last":1.4350000000000001}]},{"osd":7,"last update":"Mon Feb 19 17:13:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.6020000000000001,"15min":1.585},"min":{"1min":0.64200000000000002,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":2.7490000000000001,"5min":13.311999999999999,"15min":13.311999999999999},"last":1.921},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.7490000000000001,"15min":1.7569999999999999},"min":{"1min":0.59799999999999998,"5min":0.53300000000000003,"15min":0.52200000000000002},"max":{"1min":3.4940000000000002,"5min":13.115,"15min":13.819000000000001},"last":1.544}]}]},{"osd":0,"up_from":14,"seq":60129549543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":897080,"kb_used_data":1004,"kb_used_omap":272,"kb_used_meta":895791,"kb_avail":93474760,"statfs":{"total":96636764160,"available":95718154240,"internally_reserved":0,"allocated":1028096,"data_stored":761833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":278558,"internal_metadata":917290978},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":1.431,"15min":1.3240000000000001},"min":{"1min":0.29599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.0219999999999998,"5min":20.481999999999999,"15min":20.481999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":1.204,"15min":1.3899999999999999},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":1.613,"5min":5.6619999999999999,"15min":7.8680000000000003},"last":0.748}]},{"osd":2,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":1.331,"15min":1.2989999999999999},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.30599999999999999},"max":{"1min":2.0910000000000002,"5min":5.3289999999999997,"15min":5.8490000000000002},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.5820000000000001,"15min":1.452},"min":{"1min":0.36699999999999999,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":1.357,"5min":28.132999999999999,"15min":28.132999999999999},"last":1.1659999999999999}]},{"osd":3,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":1.635,"15min":1.411},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.309},"max":{"1min":1.466,"5min":12.734,"15min":12.734},"last":1.179},{"interface":"front","average":{"1min":0.96199999999999997,"5min":2.153,"15min":1.7509999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.34699999999999998},"max":{"1min":3.141,"5min":21.021999999999998,"15min":21.021999999999998},"last":1.6439999999999999}]},{"osd":4,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":1.732,"15min":1.504},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.516,"5min":13.388,"15min":13.388},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.5920000000000001,"15min":1.4570000000000001},"min":{"1min":0.55200000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.0579999999999998,"5min":10.034000000000001,"15min":10.034000000000001},"last":1.3859999999999999}]},{"osd":5,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.466,"15min":1.5229999999999999},"min":{"1min":0.53400000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.069,"5min":7.9370000000000003,"15min":7.9370000000000003},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.6379999999999999,"15min":1.498},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.496},"max":{"1min":2.9830000000000001,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":1.552}]},{"osd":6,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.494,"15min":1.5309999999999999},"min":{"1min":0.61899999999999999,"5min":0.49099999999999999,"15min":0.46200000000000002},"max":{"1min":2.5760000000000001,"5min":10.573,"15min":10.573},"last":1.129},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.7290000000000001,"15min":1.5780000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":1.5529999999999999,"5min":15.301,"15min":15.301},"last":1.5069999999999999}]},{"osd":7,"last update":"Mon Feb 19 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.681,"15min":1.651},"min":{"1min":0.63100000000000001,"5min":0.50700000000000001,"15min":0.45700000000000002},"max":{"1min":1.994,"5min":17.152000000000001,"15min":17.152000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.6080000000000001,"15min":1.502},"min":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.52000000000000002},"max":{"1min":1.585,"5min":11.932,"15min":11.932},"last":1.899}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T17:14:39.573 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-19T06:57:44.230095+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=19, tm_hour=6, tm_min=57, tm_sec=44, tm_wday=0, tm_yday=50, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=19, tm_hour=17, tm_min=14, tm_sec=32, tm_wday=0, tm_yday=50, tm_isdst=0) 2024-02-19T17:14:39.574 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-19T17:14:59.575 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-19T17:14:59.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.827+0000 7fb91ca00640 1 Processor -- start 2024-02-19T17:14:59.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.827+0000 7fb91ca00640 1 -- start start 2024-02-19T17:14:59.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.828+0000 7fb91ca00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb9180ce9f0 0x7fb9180cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:59.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.829+0000 7fb91ca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9180cfe50 0x7fb9180b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:59.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.829+0000 7fb91ca00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9180ca820 con 0x7fb9180ca3b0 2024-02-19T17:14:59.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.829+0000 7fb91ca00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb918070eb0 con 0x7fb9180ce9f0 2024-02-19T17:14:59.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.829+0000 7fb91ca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180b2700 con 0x7fb9180cfe50 2024-02-19T17:14:59.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.829+0000 7fb916800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb9180ce9f0 0x7fb9180cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:59.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.829+0000 7fb916800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb9180ce9f0 0x7fb9180cedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46864/0 (socket says 172.21.15.46:46864) 2024-02-19T17:14:59.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.829+0000 7fb916800640 1 -- 172.21.15.46:0/2067796129 learned_addr learned my addr 172.21.15.46:0/2067796129 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:59.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.830+0000 7fb917200640 1 --2- 172.21.15.46:0/2067796129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9180cfe50 0x7fb9180b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:59.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.830+0000 7fb916800640 1 -- 172.21.15.46:0/2067796129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9180cfe50 msgr2=0x7fb9180b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:59.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.830+0000 7fb916800640 1 --2- 172.21.15.46:0/2067796129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9180cfe50 0x7fb9180b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:59.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.830+0000 7fb916800640 1 -- 172.21.15.46:0/2067796129 >> v1:172.21.15.142:6789/0 conn(0x7fb9180ca3b0 legacy=0x7fb9180cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:14:59.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.830+0000 7fb916800640 1 -- 172.21.15.46:0/2067796129 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9180710c0 con 0x7fb9180ce9f0 2024-02-19T17:14:59.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.831+0000 7fb916800640 1 --2- 172.21.15.46:0/2067796129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9180ce9f0 0x7fb9180cedd0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fb908009870 tx=0x7fb90802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cc13abb911afc server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:59.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.831+0000 7fb915400640 1 -- 172.21.15.46:0/2067796129 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908030840 con 0x7fb9180ce9f0 2024-02-19T17:14:59.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.831+0000 7fb915400640 1 -- 172.21.15.46:0/2067796129 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9080309a0 con 0x7fb9180ce9f0 2024-02-19T17:14:59.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.831+0000 7fb915400640 1 -- 172.21.15.46:0/2067796129 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908030d30 con 0x7fb9180ce9f0 2024-02-19T17:14:59.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.832+0000 7fb91ca00640 1 -- 172.21.15.46:0/2067796129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9180ce9f0 msgr2=0x7fb9180cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:59.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.832+0000 7fb91ca00640 1 --2- 172.21.15.46:0/2067796129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9180ce9f0 0x7fb9180cedd0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fb908009870 tx=0x7fb90802b980 comp rx=0 tx=0).stop 2024-02-19T17:14:59.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.832+0000 7fb91ca00640 1 -- 172.21.15.46:0/2067796129 shutdown_connections 2024-02-19T17:14:59.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.832+0000 7fb91ca00640 1 --2- 172.21.15.46:0/2067796129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9180cfe50 0x7fb9180b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:59.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.832+0000 7fb91ca00640 1 --2- 172.21.15.46:0/2067796129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9180ce9f0 0x7fb9180cedd0 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:59.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.832+0000 7fb91ca00640 1 -- 172.21.15.46:0/2067796129 >> 172.21.15.46:0/2067796129 conn(0x7fb91806afa0 msgr2=0x7fb91806b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:14:59.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.832+0000 7fb91ca00640 1 -- 172.21.15.46:0/2067796129 shutdown_connections 2024-02-19T17:14:59.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.832+0000 7fb91ca00640 1 -- 172.21.15.46:0/2067796129 wait complete. 2024-02-19T17:14:59.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.834+0000 7fb91ca00640 1 Processor -- start 2024-02-19T17:14:59.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.834+0000 7fb91ca00640 1 -- start start 2024-02-19T17:14:59.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.835+0000 7fb91ca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9180ca3b0 0x7fb918072760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:59.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.835+0000 7fb91ca00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9180ce9f0 0x7fb91815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:59.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.835+0000 7fb91ca00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9180cfe50 0x7fb9180c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:59.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.835+0000 7fb91ca00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb918072ca0 con 0x7fb9180ce9f0 2024-02-19T17:14:59.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.835+0000 7fb91ca00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180c52e0 con 0x7fb9180ca3b0 2024-02-19T17:14:59.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.835+0000 7fb91ca00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180c55c0 con 0x7fb9180cfe50 2024-02-19T17:14:59.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.835+0000 7fb915e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9180ce9f0 0x7fb91815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:59.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.835+0000 7fb915e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9180ce9f0 0x7fb91815d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46872/0 (socket says 172.21.15.46:46872) 2024-02-19T17:14:59.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.835+0000 7fb915e00640 1 -- 172.21.15.46:0/3812807507 learned_addr learned my addr 172.21.15.46:0/3812807507 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:14:59.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.836+0000 7fb917200640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9180cfe50 0x7fb9180c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:59.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.836+0000 7fb916800640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9180ca3b0 0x7fb918072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:59.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.836+0000 7fb915e00640 1 -- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9180cfe50 msgr2=0x7fb9180c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:59.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.836+0000 7fb915e00640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9180cfe50 0x7fb9180c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:59.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.836+0000 7fb915e00640 1 -- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9180ca3b0 msgr2=0x7fb918072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:14:59.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.836+0000 7fb915e00640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9180ca3b0 0x7fb918072760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:14:59.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.836+0000 7fb915e00640 1 -- 172.21.15.46:0/3812807507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9080094d0 con 0x7fb9180ce9f0 2024-02-19T17:14:59.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.836+0000 7fb916800640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9180ca3b0 0x7fb918072760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:14:59.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.836+0000 7fb915e00640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9180ce9f0 0x7fb91815d0b0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fb90400c3c0 tx=0x7fb90400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:59.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.836+0000 7fb90ea00640 1 -- 172.21.15.46:0/3812807507 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040052d0 con 0x7fb9180ce9f0 2024-02-19T17:14:59.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.836+0000 7fb90ea00640 1 -- 172.21.15.46:0/3812807507 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904005450 con 0x7fb9180ce9f0 2024-02-19T17:14:59.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.836+0000 7fb90ea00640 1 -- 172.21.15.46:0/3812807507 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904007260 con 0x7fb9180ce9f0 2024-02-19T17:14:59.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.837+0000 7fb91ca00640 1 -- 172.21.15.46:0/3812807507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91815c8b0 con 0x7fb9180ce9f0 2024-02-19T17:14:59.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.837+0000 7fb91ca00640 1 -- 172.21.15.46:0/3812807507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9180c58a0 con 0x7fb9180ce9f0 2024-02-19T17:14:59.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.838+0000 7fb91ca00640 1 -- 172.21.15.46:0/3812807507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91815cdd0 con 0x7fb9180ce9f0 2024-02-19T17:14:59.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.839+0000 7fb90ea00640 1 -- 172.21.15.46:0/3812807507 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb9040073c0 con 0x7fb9180ce9f0 2024-02-19T17:14:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.840+0000 7fb90ea00640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb8f806b810 0x7fb8f806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:14:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.840+0000 7fb90ea00640 1 -- 172.21.15.46:0/3812807507 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb9040892a0 con 0x7fb9180ce9f0 2024-02-19T17:14:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.840+0000 7fb916800640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb8f806b810 0x7fb8f806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:14:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.841+0000 7fb916800640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb8f806b810 0x7fb8f806dcd0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb908036000 tx=0x7fb90803b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:14:59.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:14:59.844+0000 7fb90ea00640 1 -- 172.21.15.46:0/3812807507 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb91815cdd0 con 0x7fb9180ce9f0 2024-02-19T17:15:00.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.042+0000 7fb91ca00640 1 -- 172.21.15.46:0/3812807507 --> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9180b2ed0 con 0x7fb8f806b810 2024-02-19T17:15:00.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.049+0000 7fb90ea00640 1 -- 172.21.15.46:0/3812807507 <== mgr.4105 v2:172.21.15.142:6832/1628765207 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48491 (secure 0 0 0) 0x7fb908030be0 con 0x7fb8f806b810 2024-02-19T17:15:00.035 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:15:00.036 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-02-19T17:15:00.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.052+0000 7fb91ca00640 1 -- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb8f806b810 msgr2=0x7fb8f806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:15:00.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.052+0000 7fb91ca00640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb8f806b810 0x7fb8f806dcd0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb908036000 tx=0x7fb90803b040 comp rx=0 tx=0).stop 2024-02-19T17:15:00.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.052+0000 7fb91ca00640 1 -- 172.21.15.46:0/3812807507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9180ce9f0 msgr2=0x7fb91815d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:15:00.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.052+0000 7fb91ca00640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9180ce9f0 0x7fb91815d0b0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fb90400c3c0 tx=0x7fb90400c880 comp rx=0 tx=0).stop 2024-02-19T17:15:00.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.052+0000 7fb91ca00640 1 -- 172.21.15.46:0/3812807507 shutdown_connections 2024-02-19T17:15:00.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.052+0000 7fb91ca00640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7fb8f806b810 0x7fb8f806dcd0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.052+0000 7fb91ca00640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9180cfe50 0x7fb9180c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.052+0000 7fb91ca00640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9180ce9f0 0x7fb91815d0b0 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.052+0000 7fb91ca00640 1 --2- 172.21.15.46:0/3812807507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9180ca3b0 0x7fb918072760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.052+0000 7fb91ca00640 1 -- 172.21.15.46:0/3812807507 >> 172.21.15.46:0/3812807507 conn(0x7fb91806afa0 msgr2=0x7fb9180cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:15:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.053+0000 7fb91ca00640 1 -- 172.21.15.46:0/3812807507 shutdown_connections 2024-02-19T17:15:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.053+0000 7fb91ca00640 1 -- 172.21.15.46:0/3812807507 wait complete. 2024-02-19T17:15:00.057 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":18542,"stamp":"2024-02-19T17:14:58.485846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12069268,"kb_used_data":4552,"kb_used_omap":2838,"kb_used_meta":12061801,"kb_avail":742905452,"statfs":{"total":773094113280,"available":760735182848,"internally_reserved":0,"allocated":4661248,"data_stored":2552456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2906559,"internal_metadata":12351284801},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003363"},"pg_stats":[{"pgid":"1.0","version":"38'119","reported_seq":519,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-02-19T17:14:39.835071+0000","last_change":"2024-02-19T17:14:39.835115+0000","last_active":"2024-02-19T17:14:39.835071+0000","last_peered":"2024-02-19T17:14:39.835071+0000","last_clean":"2024-02-19T17:14:39.835071+0000","last_became_active":"2024-02-19T06:57:45.350602+0000","last_became_peered":"2024-02-19T06:57:45.350602+0000","last_unstale":"2024-02-19T17:14:39.835071+0000","last_undegraded":"2024-02-19T17:14:39.835071+0000","last_fullsized":"2024-02-19T17:14:39.835071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'119","last_scrub_stamp":"2024-02-19T17:14:39.835012+0000","last_deep_scrub":"38'119","last_deep_scrub_stamp":"2024-02-19T17:14:39.835012+0000","last_clean_scrub_stamp":"2024-02-19T17:14:39.835012+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T22:30:12.694891+0000","scrub_duration":195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424516850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1804144,"kb_used_data":424,"kb_used_omap":46,"kb_used_meta":1803665,"kb_avail":92567696,"statfs":{"total":96636764160,"available":94789320704,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47262,"internal_metadata":1846953826},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":1.0229999999999999,"15min":0.99399999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.107,"5min":9.6859999999999999,"15min":9.6859999999999999},"last":1.6040000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":1.1080000000000001,"15min":1.036},"min":{"1min":0.46000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.4159999999999999,"5min":12.372,"15min":12.372},"last":1.1619999999999999}]},{"osd":1,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.361,"15min":5.3079999999999998},"min":{"1min":0.40400000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.4660000000000002,"5min":29.341000000000001,"15min":1340.5419999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.3140000000000001,"15min":5.3019999999999996},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.992,"5min":25.664999999999999,"15min":1340.414},"last":1.133}]},{"osd":2,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.1419999999999999,"15min":1.071},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38500000000000001},"max":{"1min":1.6799999999999999,"5min":4.0709999999999997,"15min":6.4770000000000003},"last":1.294},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.292,"15min":1.2110000000000001},"min":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.432},"max":{"1min":2.5059999999999998,"5min":11.471,"15min":11.471},"last":1.3340000000000001}]},{"osd":3,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1739999999999999,"15min":1.242},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.2639999999999998,"5min":9.4450000000000003,"15min":9.4450000000000003},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.331,"15min":1.266},"min":{"1min":0.55900000000000005,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":2.5449999999999999,"5min":11.388,"15min":11.388},"last":1.46}]},{"osd":4,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.92500000000000004,"15min":0.95199999999999996},"min":{"1min":0.45900000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.121,"5min":4.4470000000000001,"15min":4.4470000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.093,"15min":1.036},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":2.331,"5min":10.106999999999999,"15min":10.106999999999999},"last":1.4099999999999999}]},{"osd":5,"last update":"Mon Feb 19 17:14:31 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1890000000000001,"15min":1.091},"min":{"1min":0.45600000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.8119999999999998,"5min":11.430999999999999,"15min":11.430999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.0820000000000001,"15min":1.04},"min":{"1min":0.49099999999999999,"5min":0.45600000000000002,"15min":0.441},"max":{"1min":2.718,"5min":5.391,"15min":5.391},"last":0.75}]},{"osd":7,"last update":"Mon Feb 19 17:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.097,"15min":1.0760000000000001},"min":{"1min":0.55300000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.3700000000000001,"5min":9.9800000000000004,"15min":9.9800000000000004},"last":1.5149999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.292,"15min":1.1910000000000001},"min":{"1min":0.66800000000000004,"5min":0.46400000000000002,"15min":0.46300000000000002},"max":{"1min":2.9079999999999999,"5min":12.414999999999999,"15min":12.414999999999999},"last":1.385}]}]},{"osd":5,"up_from":15,"seq":64424516848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1426932,"kb_used_data":424,"kb_used_omap":473,"kb_used_meta":1426022,"kb_avail":92944908,"statfs":{"total":96636764160,"available":95175585792,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":484739,"internal_metadata":1460247165},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":1.0880000000000001,"15min":1.0640000000000001},"min":{"1min":0.34200000000000003,"5min":0.33000000000000002,"15min":0.27100000000000002},"max":{"1min":1.2330000000000001,"5min":9.8399999999999999,"15min":9.8399999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.2090000000000001,"15min":1.157},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.0919999999999996,"5min":5.1980000000000004,"15min":6.9539999999999997},"last":1.391}]},{"osd":1,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.3380000000000001,"15min":3.8090000000000002},"min":{"1min":0.45300000000000001,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":1.1060000000000001,"5min":16.93,"15min":560.22000000000003},"last":1.407},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.345,"15min":3.8519999999999999},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.36199999999999999},"max":{"1min":3.7999999999999998,"5min":9.2360000000000007,"15min":559.36300000000006},"last":0.92300000000000004}]},{"osd":2,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4870000000000001,"15min":1.266},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":4.0129999999999999,"5min":23.012,"15min":23.012},"last":1.246},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.2809999999999999,"15min":1.2070000000000001},"min":{"1min":0.50800000000000001,"5min":0.432,"15min":0.41999999999999998},"max":{"1min":2.4380000000000002,"5min":5.4379999999999997,"15min":5.5529999999999999},"last":1.4670000000000001}]},{"osd":3,"last update":"Mon Feb 19 17:14:14 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.448,"15min":1.5209999999999999},"min":{"1min":0.53200000000000003,"5min":0.43099999999999999,"15min":0.41099999999999998},"max":{"1min":3.8969999999999998,"5min":23.094000000000001,"15min":78.207999999999998},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.75,"15min":1.667},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":4.0519999999999996,"5min":36.241999999999997,"15min":78.245000000000005},"last":1.4990000000000001}]},{"osd":4,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":1.091,"15min":0.97099999999999997},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":1.423,"5min":8.1159999999999997,"15min":8.1159999999999997},"last":1.2789999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.1919999999999999,"15min":1.0089999999999999},"min":{"1min":0.48099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.855,"5min":14.992000000000001,"15min":14.992000000000001},"last":1.208}]},{"osd":6,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1220000000000001,"15min":1.036},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":3.968,"5min":6.6989999999999998,"15min":6.6989999999999998},"last":1.331},{"interface":"front","average":{"1min":0.997,"5min":1.3300000000000001,"15min":1.127},"min":{"1min":0.53200000000000003,"5min":0.47599999999999998,"15min":0.41399999999999998},"max":{"1min":3.3580000000000001,"5min":16.837,"15min":16.837},"last":1.165}]},{"osd":7,"last update":"Mon Feb 19 17:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.173,"15min":1.0549999999999999},"min":{"1min":0.48699999999999999,"5min":0.46400000000000002,"15min":0.42899999999999999},"max":{"1min":3.9340000000000002,"5min":7.2969999999999997,"15min":7.2969999999999997},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.238,"5min":1.6459999999999999,"15min":1.2529999999999999},"min":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.39400000000000002},"max":{"1min":4.1289999999999996,"5min":35.945,"15min":35.945},"last":1.4410000000000001}]}]},{"osd":7,"up_from":14,"seq":60129549552,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1262580,"kb_used_data":1004,"kb_used_omap":237,"kb_used_meta":1261330,"kb_avail":93109260,"statfs":{"total":96636764160,"available":95343882240,"internally_reserved":0,"allocated":1028096,"data_stored":761833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":243426,"internal_metadata":1291602206},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:51 2024","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.266,"15min":1.569},"min":{"1min":0.48199999999999998,"5min":0.34599999999999997,"15min":0.32400000000000001},"max":{"1min":10.677,"5min":16.071999999999999,"15min":135.33099999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.8300000000000001,"15min":1.788},"min":{"1min":0.496,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":9.8770000000000007,"5min":42.113,"15min":134.83000000000001},"last":1.0820000000000001}]},{"osd":1,"last update":"Mon Feb 19 17:14:51 2024","interfaces":[{"interface":"back","average":{"1min":2.6269999999999998,"5min":1.4550000000000001,"15min":2.6869999999999998},"min":{"1min":0.42199999999999999,"5min":0.375,"15min":0.35899999999999999},"max":{"1min":30.294,"5min":30.294,"15min":440.32799999999997},"last":1.3420000000000001},{"interface":"front","average":{"1min":2.1970000000000001,"5min":1.8799999999999999,"15min":2.899},"min":{"1min":0.55900000000000005,"5min":0.377,"15min":0.35399999999999998},"max":{"1min":17.402999999999999,"5min":45.880000000000003,"15min":442.47500000000002},"last":1.5429999999999999}]},{"osd":2,"last update":"Mon Feb 19 17:14:51 2024","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":1.895,"15min":1.359},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":15.278,"5min":45.709000000000003,"15min":45.709000000000003},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.6439999999999999,"5min":1.6359999999999999,"15min":1.2709999999999999},"min":{"1min":0.53500000000000003,"5min":0.44400000000000001,"15min":0.38300000000000001},"max":{"1min":9.9109999999999996,"5min":42.390999999999998,"15min":42.390999999999998},"last":1.369}]},{"osd":3,"last update":"Mon Feb 19 17:14:51 2024","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":2.6469999999999998,"15min":1.6319999999999999},"min":{"1min":0.58499999999999996,"5min":0.46200000000000002,"15min":0.374},"max":{"1min":13.266999999999999,"5min":126.935,"15min":126.935},"last":1.5129999999999999},{"interface":"front","average":{"1min":2.0329999999999999,"5min":1.5509999999999999,"15min":1.268},"min":{"1min":0.60599999999999998,"5min":0.44800000000000001,"15min":0.41499999999999998},"max":{"1min":15.407999999999999,"5min":15.407999999999999,"15min":15.407999999999999},"last":1.4019999999999999}]},{"osd":4,"last update":"Mon Feb 19 17:14:51 2024","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.675,"15min":1.155},"min":{"1min":0.48499999999999999,"5min":0.37,"15min":0.36399999999999999},"max":{"1min":9.8290000000000006,"5min":42.188000000000002,"15min":42.188000000000002},"last":1.222},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.2749999999999999,"15min":1.0329999999999999},"min":{"1min":0.47499999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":14.347,"5min":22.009,"15min":22.009},"last":1.4790000000000001}]},{"osd":5,"last update":"Mon Feb 19 17:14:51 2024","interfaces":[{"interface":"back","average":{"1min":2.2890000000000001,"5min":1.9079999999999999,"15min":1.294},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.41599999999999998},"max":{"1min":19.937000000000001,"5min":68.173000000000002,"15min":68.173000000000002},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.796,"5min":2.2010000000000001,"15min":1.391},"min":{"1min":0.45800000000000002,"5min":0.44500000000000001,"15min":0.437},"max":{"1min":11.403,"5min":45.917999999999999,"15min":45.917999999999999},"last":1.611}]},{"osd":6,"last update":"Mon Feb 19 17:14:51 2024","interfaces":[{"interface":"back","average":{"1min":2.3759999999999999,"5min":1.9670000000000001,"15min":1.3420000000000001},"min":{"1min":0.54600000000000004,"5min":0.52300000000000002,"15min":0.44800000000000001},"max":{"1min":19.983000000000001,"5min":67.986999999999995,"15min":67.986999999999995},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.903,"5min":1.46,"15min":1.1779999999999999},"min":{"1min":0.60399999999999998,"5min":0.48799999999999999,"15min":0.47999999999999998},"max":{"1min":11.365,"5min":13.959,"15min":13.959},"last":1.6679999999999999}]}]},{"osd":4,"up_from":14,"seq":60129549550,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1613748,"kb_used_data":424,"kb_used_omap":500,"kb_used_meta":1612811,"kb_avail":92758092,"statfs":{"total":96636764160,"available":94984286208,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":512202,"internal_metadata":1651519286},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.93999999999999995,"15min":1.0700000000000001},"min":{"1min":0.32800000000000001,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":2.6099999999999999,"5min":4.3840000000000003,"15min":28.562999999999999},"last":1.6299999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.95799999999999996,"15min":1.028},"min":{"1min":0.45000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.29,"5min":3.6429999999999998,"15min":13.212},"last":1.1519999999999999}]},{"osd":1,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.94899999999999995,"15min":6.7409999999999997},"min":{"1min":0.379,"5min":0.35999999999999999,"15min":0.34499999999999997},"max":{"1min":2.5099999999999998,"5min":4.3719999999999999,"15min":1591.5709999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.073,"15min":6.7709999999999999},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":3.4910000000000001,"5min":4.3109999999999999,"15min":1590.9179999999999},"last":1.0129999999999999}]},{"osd":2,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.173,"15min":1.149},"min":{"1min":0.47799999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.2090000000000001,"5min":9.077,"15min":16.189},"last":1.4850000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.999,"15min":1.125},"min":{"1min":0.45000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.5459999999999998,"5min":4.2999999999999998,"15min":6.0190000000000001},"last":1.292}]},{"osd":3,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.175,"15min":1.1799999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":3.6429999999999998,"5min":4.9269999999999996,"15min":16.074999999999999},"last":1.665},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.137,"15min":1.1819999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.7410000000000001,"5min":4.202,"15min":5.9390000000000001},"last":1.734}]},{"osd":5,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.89100000000000001,"15min":0.92300000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.4419999999999999,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":1.681},{"interface":"front","average":{"1min":0.90800000000000003,"5min":1.018,"15min":1.012},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0409999999999999,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":1.3540000000000001}]},{"osd":6,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0249999999999999,"15min":0.998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.2879999999999998,"5min":7.6440000000000001,"15min":16.228999999999999},"last":1.6000000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.0249999999999999,"15min":0.98599999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.4670000000000001,"5min":4.8680000000000003,"15min":6.0549999999999997},"last":1.8200000000000001}]},{"osd":7,"last update":"Mon Feb 19 17:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.042,"15min":1.0669999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.738,"5min":4.556,"15min":5.415},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.159,"15min":1.123},"min":{"1min":0.42799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.2559999999999998,"5min":8.5350000000000001,"15min":16.149999999999999},"last":1.7170000000000001}]}]},{"osd":3,"up_from":14,"seq":60129549522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1540848,"kb_used_data":424,"kb_used_omap":50,"kb_used_meta":1540365,"kb_avail":92830992,"statfs":{"total":96636764160,"available":95058935808,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51317,"internal_metadata":1577334667},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:28 2024","interfaces":[{"interface":"back","average":{"1min":2.1110000000000002,"5min":1.3540000000000001,"15min":1.371},"min":{"1min":0.36899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":14.741,"5min":14.741,"15min":14.741},"last":1.081},{"interface":"front","average":{"1min":1.8240000000000001,"5min":1.3220000000000001,"15min":1.3999999999999999},"min":{"1min":0.39000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.8019999999999996,"5min":8.8019999999999996,"15min":8.8019999999999996},"last":1.248}]},{"osd":1,"last update":"Mon Feb 19 17:14:34 2024","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.5760000000000001,"15min":2.7149999999999999},"min":{"1min":0.48999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":9.6980000000000004,"5min":23.510000000000002,"15min":278.68099999999998},"last":1.0009999999999999},{"interface":"front","average":{"1min":2.165,"5min":1.635,"15min":2.7949999999999999},"min":{"1min":0.48199999999999998,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":10.582000000000001,"5min":10.582000000000001,"15min":279.06599999999997},"last":1.9510000000000001}]},{"osd":2,"last update":"Mon Feb 19 17:14:34 2024","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":2.9510000000000001,"15min":2.0979999999999999},"min":{"1min":0.45100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":14.67,"5min":121.10299999999999,"15min":121.10299999999999},"last":1.21},{"interface":"front","average":{"1min":1.821,"5min":2.7170000000000001,"15min":1.952},"min":{"1min":0.43099999999999999,"5min":0.35299999999999998,"15min":0.33800000000000002},"max":{"1min":8.7639999999999993,"5min":118.05800000000001,"15min":118.05800000000001},"last":1.4399999999999999}]},{"osd":4,"last update":"Mon Feb 19 17:14:34 2024","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.9079999999999999,"15min":1.623},"min":{"1min":0.442,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.3109999999999999,"5min":35.975999999999999,"15min":35.975999999999999},"last":1.4790000000000001},{"interface":"front","average":{"1min":2.1539999999999999,"5min":1.776,"15min":1.6599999999999999},"min":{"1min":0.51600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":14.837,"5min":14.837,"15min":14.837},"last":1.772}]},{"osd":5,"last update":"Mon Feb 19 17:14:34 2024","interfaces":[{"interface":"back","average":{"1min":1.9590000000000001,"5min":1.6399999999999999,"15min":1.5860000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":9.7680000000000007,"5min":9.7680000000000007,"15min":9.7680000000000007},"last":1.3700000000000001},{"interface":"front","average":{"1min":2.1379999999999999,"5min":1.7410000000000001,"15min":1.6870000000000001},"min":{"1min":0.60099999999999998,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":14.794,"5min":14.794,"15min":14.794},"last":2.024}]},{"osd":6,"last update":"Mon Feb 19 17:14:34 2024","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.631,"15min":1.6200000000000001},"min":{"1min":0.70399999999999996,"5min":0.50800000000000001,"15min":0.47099999999999997},"max":{"1min":5.3579999999999997,"5min":9.0860000000000003,"15min":9.0860000000000003},"last":2.101},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.663,"15min":1.6499999999999999},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.53800000000000003},"max":{"1min":9.6310000000000002,"5min":15.616,"15min":15.616},"last":1.6140000000000001}]},{"osd":7,"last update":"Mon Feb 19 17:14:34 2024","interfaces":[{"interface":"back","average":{"1min":2.0779999999999998,"5min":1.611,"15min":1.6579999999999999},"min":{"1min":0.753,"5min":0.50700000000000001,"15min":0.48799999999999999},"max":{"1min":8.8369999999999997,"5min":10.589,"15min":10.589},"last":2.194},{"interface":"front","average":{"1min":1.7210000000000001,"5min":1.601,"15min":1.6950000000000001},"min":{"1min":0.63700000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.1989999999999998,"5min":7.3780000000000001,"15min":7.3780000000000001},"last":1.897}]}]},{"osd":2,"up_from":14,"seq":60129549538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1784432,"kb_used_data":424,"kb_used_omap":768,"kb_used_meta":1783231,"kb_avail":92587408,"statfs":{"total":96636764160,"available":94809505792,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":786953,"internal_metadata":1826029047},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:52 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.1379999999999999,"15min":1.4119999999999999},"min":{"1min":0.30599999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":11.561999999999999,"5min":11.561999999999999,"15min":65.132000000000005},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1519999999999999,"15min":1.5700000000000001},"min":{"1min":0.29799999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":3.6829999999999998,"5min":11.308999999999999,"15min":70.902000000000001},"last":1.1559999999999999}]},{"osd":1,"last update":"Mon Feb 19 17:14:52 2024","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.514,"15min":5.6470000000000002},"min":{"1min":0.39100000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":10.066000000000001,"5min":11.342000000000001,"15min":1038.0440000000001},"last":1.012},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3959999999999999,"15min":5.516},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.33600000000000002},"max":{"1min":6.0599999999999996,"5min":8.0749999999999993,"15min":1037.0899999999999},"last":1.5149999999999999}]},{"osd":3,"last update":"Mon Feb 19 17:14:52 2024","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.319,"15min":1.4339999999999999},"min":{"1min":0.48099999999999998,"5min":0.33800000000000002,"15min":0.29299999999999998},"max":{"1min":11.613,"5min":11.613,"15min":11.613},"last":1.393},{"interface":"front","average":{"1min":1.321,"5min":1.5589999999999999,"15min":1.667},"min":{"1min":0.443,"5min":0.44,"15min":0.318},"max":{"1min":6.1180000000000003,"5min":11.372,"15min":11.816000000000001},"last":1.3340000000000001}]},{"osd":4,"last update":"Mon Feb 19 17:14:52 2024","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":1.833,"15min":2.2490000000000001},"min":{"1min":0.70699999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":5.8650000000000002,"5min":26.771000000000001,"15min":189.965},"last":1.4410000000000001},{"interface":"front","average":{"1min":2.641,"5min":1.9330000000000001,"15min":2.246},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.41199999999999998},"max":{"1min":25.954000000000001,"5min":27.465,"15min":193.35400000000001},"last":1.272}]},{"osd":5,"last update":"Mon Feb 19 17:14:52 2024","interfaces":[{"interface":"back","average":{"1min":2.556,"5min":1.4870000000000001,"15min":1.4610000000000001},"min":{"1min":0.56200000000000006,"5min":0.44500000000000001,"15min":0.38500000000000001},"max":{"1min":25.704000000000001,"5min":25.704000000000001,"15min":25.704000000000001},"last":1.22},{"interface":"front","average":{"1min":1.591,"5min":1.5649999999999999,"15min":1.603},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.52100000000000002},"max":{"1min":3.7690000000000001,"5min":11.218999999999999,"15min":11.218999999999999},"last":1.577}]},{"osd":6,"last update":"Mon Feb 19 17:14:52 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.526,"15min":1.518},"min":{"1min":0.53400000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":6.0140000000000002,"5min":6.6319999999999997,"15min":6.6319999999999997},"last":2.0409999999999999},{"interface":"front","average":{"1min":1.8089999999999999,"5min":1.4690000000000001,"15min":1.514},"min":{"1min":0.66800000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":7.0880000000000001,"5min":7.9409999999999998,"15min":7.9409999999999998},"last":1.702}]},{"osd":7,"last update":"Mon Feb 19 17:14:52 2024","interfaces":[{"interface":"back","average":{"1min":2.1349999999999998,"5min":1.5920000000000001,"15min":1.6100000000000001},"min":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.46300000000000002},"max":{"1min":15.042,"5min":15.042,"15min":15.042},"last":1.9450000000000001},{"interface":"front","average":{"1min":2.383,"5min":1.776,"15min":1.625},"min":{"1min":0.749,"5min":0.63,"15min":0.435},"max":{"1min":18.908999999999999,"5min":23.437000000000001,"15min":23.437000000000001},"last":1.6279999999999999}]}]},{"osd":1,"up_from":14,"seq":60129549527,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1739508,"kb_used_data":424,"kb_used_omap":490,"kb_used_meta":1738581,"kb_avail":92632332,"statfs":{"total":96636764160,"available":94855507968,"internally_reserved":0,"allocated":434176,"data_stored":171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":502102,"internal_metadata":1780307626},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 17:14:54 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.373,"15min":1.248},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":3.0459999999999998,"5min":14.206,"15min":14.206},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.45,"15min":1.3660000000000001},"min":{"1min":0.57699999999999996,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":4.0890000000000004,"5min":14.311,"15min":14.311},"last":0.98299999999999998}]},{"osd":2,"last update":"Mon Feb 19 17:14:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.3340000000000001,"15min":1.3640000000000001},"min":{"1min":0.34000000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.617,"5min":13.16,"15min":13.16},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.5940000000000001,"15min":1.573},"min":{"1min":0.57499999999999996,"5min":0.33600000000000002,"15min":0.32000000000000001},"max":{"1min":5.3150000000000004,"5min":13.068,"15min":14.051},"last":1.1259999999999999}]},{"osd":3,"last update":"Mon Feb 19 17:14:28 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.7270000000000001,"15min":1.6890000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":4.5800000000000001,"5min":9.5449999999999999,"15min":13.901},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.718,"15min":1.607},"min":{"1min":0.39600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.9620000000000002,"5min":18.905000000000001,"15min":18.905000000000001},"last":1.3919999999999999}]},{"osd":4,"last update":"Mon Feb 19 17:14:54 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4339999999999999,"15min":1.4299999999999999},"min":{"1min":0.65400000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.1349999999999998,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.528,"15min":1.4470000000000001},"min":{"1min":0.56100000000000005,"5min":0.46400000000000002,"15min":0.39900000000000002},"max":{"1min":2.508,"5min":13.253,"15min":13.253},"last":1.599}]},{"osd":5,"last update":"Mon Feb 19 17:14:54 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.694,"15min":1.655},"min":{"1min":0.628,"5min":0.504,"15min":0.47599999999999998},"max":{"1min":5.2320000000000002,"5min":13.005000000000001,"15min":13.760999999999999},"last":1.6519999999999999},{"interface":"front","average":{"1min":3.8799999999999999,"5min":2.044,"15min":1.6639999999999999},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.46899999999999997},"max":{"1min":55.863,"5min":55.863,"15min":55.863},"last":1.6830000000000001}]},{"osd":6,"last update":"Mon Feb 19 17:14:54 2024","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.591,"15min":1.516},"min":{"1min":0.63100000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.5859999999999999,"5min":13.206,"15min":13.206},"last":1.74},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.6120000000000001,"15min":1.6439999999999999},"min":{"1min":0.86599999999999999,"5min":0.496,"15min":0.496},"max":{"1min":4.3959999999999999,"5min":9.125,"15min":13.862},"last":1.361}]},{"osd":7,"last update":"Mon Feb 19 17:14:54 2024","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.625,"15min":1.5620000000000001},"min":{"1min":0.80700000000000005,"5min":0.64200000000000002,"15min":0.47499999999999998},"max":{"1min":2.552,"5min":13.311999999999999,"15min":13.311999999999999},"last":1.821},{"interface":"front","average":{"1min":1.7470000000000001,"5min":1.79,"15min":1.778},"min":{"1min":0.76100000000000001,"5min":0.53300000000000003,"15min":0.52200000000000002},"max":{"1min":5.2729999999999997,"5min":13.115,"15min":13.819000000000001},"last":1.7869999999999999}]}]},{"osd":0,"up_from":14,"seq":60129549547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":897076,"kb_used_data":1004,"kb_used_omap":272,"kb_used_meta":895791,"kb_avail":93474764,"statfs":{"total":96636764160,"available":95718158336,"internally_reserved":0,"allocated":1028096,"data_stored":761833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":278558,"internal_metadata":917290978},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 17:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.464,"15min":1.329},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":3.8639999999999999,"5min":20.481999999999999,"15min":20.481999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.2509999999999999,"15min":1.3680000000000001},"min":{"1min":0.48299999999999998,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":3.0840000000000001,"5min":5.6619999999999999,"15min":7.8680000000000003},"last":1.6739999999999999}]},{"osd":2,"last update":"Mon Feb 19 17:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.407,"15min":1.3120000000000001},"min":{"1min":0.46999999999999997,"5min":0.33300000000000002,"15min":0.30599999999999999},"max":{"1min":5.9459999999999997,"5min":5.9459999999999997,"15min":5.9459999999999997},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.6220000000000001,"15min":1.4399999999999999},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":3.004,"5min":28.132999999999999,"15min":28.132999999999999},"last":1.4299999999999999}]},{"osd":3,"last update":"Mon Feb 19 17:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.6020000000000001,"15min":1.4139999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.309},"max":{"1min":4.0209999999999999,"5min":12.734,"15min":12.734},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.464,"5min":2.1960000000000002,"15min":1.7549999999999999},"min":{"1min":0.49399999999999999,"5min":0.42099999999999999,"15min":0.34699999999999998},"max":{"1min":3.7970000000000002,"5min":21.021999999999998,"15min":21.021999999999998},"last":1.7090000000000001}]},{"osd":4,"last update":"Mon Feb 19 17:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.696,"15min":1.5049999999999999},"min":{"1min":0.47399999999999998,"5min":0.437,"15min":0.41299999999999998},"max":{"1min":3.9140000000000001,"5min":13.388,"15min":13.388},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.591,"15min":1.4430000000000001},"min":{"1min":0.51100000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":3.782,"5min":10.034000000000001,"15min":10.034000000000001},"last":2.2789999999999999}]},{"osd":5,"last update":"Mon Feb 19 17:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.5349999999999999,"15min":1.5309999999999999},"min":{"1min":0.63800000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.4569999999999999,"5min":7.9370000000000003,"15min":7.9370000000000003},"last":2.306},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.6120000000000001,"15min":1.494},"min":{"1min":0.58799999999999997,"5min":0.55000000000000004,"15min":0.496},"max":{"1min":3.8239999999999998,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":2.3610000000000002}]},{"osd":6,"last update":"Mon Feb 19 17:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.5209999999999999,"15min":1.5049999999999999},"min":{"1min":0.66700000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.3170000000000002,"5min":10.573,"15min":10.573},"last":2.1909999999999998},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.694,"15min":1.5780000000000001},"min":{"1min":0.69299999999999995,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":3.9569999999999999,"5min":15.301,"15min":15.301},"last":2.234}]},{"osd":7,"last update":"Mon Feb 19 17:14:46 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.696,"15min":1.6279999999999999},"min":{"1min":0.71099999999999997,"5min":0.50700000000000001,"15min":0.45700000000000002},"max":{"1min":2.2410000000000001,"5min":17.152000000000001,"15min":17.152000000000001},"last":2.4249999999999998},{"interface":"front","average":{"1min":1.54,"5min":1.617,"15min":1.5069999999999999},"min":{"1min":0.73099999999999998,"5min":0.53500000000000003,"15min":0.52000000000000002},"max":{"1min":3.9900000000000002,"5min":11.932,"15min":11.932},"last":2.3969999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T17:15:00.059 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-19T17:15:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.284+0000 7f871b000640 1 Processor -- start 2024-02-19T17:15:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.284+0000 7f871b000640 1 -- start start 2024-02-19T17:15:00.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.286+0000 7f871b000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8714161600 0x7f87140b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:15:00.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.286+0000 7f871b000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871415dcb0 0x7f87140b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:15:00.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.286+0000 7f871b000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87140b3bd0 con 0x7f87140d4120 2024-02-19T17:15:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.286+0000 7f871b000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87140b3eb0 con 0x7f8714161600 2024-02-19T17:15:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.286+0000 7f871b000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87140b4190 con 0x7f871415dcb0 2024-02-19T17:15:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.286+0000 7f8719c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8714161600 0x7f87140b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:15:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.286+0000 7f8719c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8714161600 0x7f87140b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46888/0 (socket says 172.21.15.46:46888) 2024-02-19T17:15:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.286+0000 7f8719c00640 1 -- 172.21.15.46:0/302262153 learned_addr learned my addr 172.21.15.46:0/302262153 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:15:00.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.286+0000 7f8719c00640 1 -- 172.21.15.46:0/302262153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871415dcb0 msgr2=0x7f87140b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:15:00.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.286+0000 7f8719200640 1 --2- 172.21.15.46:0/302262153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871415dcb0 0x7f87140b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:15:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.287+0000 7f8719c00640 1 --2- 172.21.15.46:0/302262153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871415dcb0 0x7f87140b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.287+0000 7f8719c00640 1 -- 172.21.15.46:0/302262153 >> v1:172.21.15.142:6789/0 conn(0x7f87140d4120 legacy=0x7f87141619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:15:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.287+0000 7f8719c00640 1 -- 172.21.15.46:0/302262153 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87140b4470 con 0x7f8714161600 2024-02-19T17:15:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.287+0000 7f8719200640 1 --2- 172.21.15.46:0/302262153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871415dcb0 0x7f87140b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T17:15:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.288+0000 7f8719c00640 1 --2- 172.21.15.46:0/302262153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8714161600 0x7f87140b4c70 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f8708009850 tx=0x7f870802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a2214dcfec548a server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:15:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.288+0000 7f8713e00640 1 -- 172.21.15.46:0/302262153 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708004230 con 0x7f8714161600 2024-02-19T17:15:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.288+0000 7f8713e00640 1 -- 172.21.15.46:0/302262153 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8708004390 con 0x7f8714161600 2024-02-19T17:15:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.288+0000 7f8713e00640 1 -- 172.21.15.46:0/302262153 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708031830 con 0x7f8714161600 2024-02-19T17:15:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.289+0000 7f871b000640 1 -- 172.21.15.46:0/302262153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8714161600 msgr2=0x7f87140b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:15:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.289+0000 7f871b000640 1 --2- 172.21.15.46:0/302262153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8714161600 0x7f87140b4c70 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f8708009850 tx=0x7f870802b8d0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.289+0000 7f871b000640 1 -- 172.21.15.46:0/302262153 shutdown_connections 2024-02-19T17:15:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.289+0000 7f871b000640 1 --2- 172.21.15.46:0/302262153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871415dcb0 0x7f87140b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.289+0000 7f871b000640 1 --2- 172.21.15.46:0/302262153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8714161600 0x7f87140b4c70 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.289+0000 7f871b000640 1 -- 172.21.15.46:0/302262153 >> 172.21.15.46:0/302262153 conn(0x7f871408afc0 msgr2=0x7f87140d36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:15:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.289+0000 7f871b000640 1 -- 172.21.15.46:0/302262153 shutdown_connections 2024-02-19T17:15:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.289+0000 7f871b000640 1 -- 172.21.15.46:0/302262153 wait complete. 2024-02-19T17:15:00.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.291+0000 7f871b000640 1 Processor -- start 2024-02-19T17:15:00.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.291+0000 7f871b000640 1 -- start start 2024-02-19T17:15:00.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.292+0000 7f871b000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87140d4120 0x7f87141f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:15:00.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.292+0000 7f871b000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871415dcb0 0x7f871415e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:15:00.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.292+0000 7f871b000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8714161600 0x7f871415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:15:00.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.292+0000 7f871b000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871415aa30 con 0x7f87140d4120 2024-02-19T17:15:00.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.292+0000 7f871b000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8714159eb0 con 0x7f8714161600 2024-02-19T17:15:00.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.292+0000 7f871b000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871415a190 con 0x7f871415dcb0 2024-02-19T17:15:00.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.292+0000 7f8719c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87140d4120 0x7f87141f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:15:00.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.292+0000 7f8719c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87140d4120 0x7f87141f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46902/0 (socket says 172.21.15.46:46902) 2024-02-19T17:15:00.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.292+0000 7f8719c00640 1 -- 172.21.15.46:0/2085845499 learned_addr learned my addr 172.21.15.46:0/2085845499 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:15:00.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.293+0000 7f871a600640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8714161600 0x7f871415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:15:00.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.293+0000 7f8719200640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871415dcb0 0x7f871415e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:15:00.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.293+0000 7f8719c00640 1 -- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871415dcb0 msgr2=0x7f871415e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:15:00.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.293+0000 7f8719c00640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871415dcb0 0x7f871415e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.293+0000 7f8719c00640 1 -- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8714161600 msgr2=0x7f871415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:15:00.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.293+0000 7f8719c00640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8714161600 0x7f871415e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.293+0000 7f8719c00640 1 -- 172.21.15.46:0/2085845499 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8708009460 con 0x7f87140d4120 2024-02-19T17:15:00.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.293+0000 7f871a600640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8714161600 0x7f871415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T17:15:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.293+0000 7f8719c00640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87140d4120 0x7f87141f42a0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f870802b910 tx=0x7f87080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:15:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.294+0000 7f8711600640 1 -- 172.21.15.46:0/2085845499 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708031a40 con 0x7f87140d4120 2024-02-19T17:15:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.294+0000 7f8711600640 1 -- 172.21.15.46:0/2085845499 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8708031ba0 con 0x7f87140d4120 2024-02-19T17:15:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.294+0000 7f8711600640 1 -- 172.21.15.46:0/2085845499 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708005e10 con 0x7f87140d4120 2024-02-19T17:15:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.294+0000 7f871b000640 1 -- 172.21.15.46:0/2085845499 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871415a470 con 0x7f87140d4120 2024-02-19T17:15:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.294+0000 7f871b000640 1 -- 172.21.15.46:0/2085845499 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8714159180 con 0x7f87140d4120 2024-02-19T17:15:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.295+0000 7f871b000640 1 -- 172.21.15.46:0/2085845499 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871408b8e0 con 0x7f87140d4120 2024-02-19T17:15:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.297+0000 7f8711600640 1 -- 172.21.15.46:0/2085845499 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8708003610 con 0x7f87140d4120 2024-02-19T17:15:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.297+0000 7f8711600640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f86f806b810 0x7f86f806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:15:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.298+0000 7f8711600640 1 -- 172.21.15.46:0/2085845499 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f87080ac3c0 con 0x7f87140d4120 2024-02-19T17:15:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.298+0000 7f8719200640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f86f806b810 0x7f86f806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:15:00.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.299+0000 7f8719200640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f86f806b810 0x7f86f806dcd0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f8704006fd0 tx=0x7f8704008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:15:00.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.302+0000 7f8711600640 1 -- 172.21.15.46:0/2085845499 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8708077220 con 0x7f87140d4120 2024-02-19T17:15:00.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.502+0000 7f871b000640 1 -- 172.21.15.46:0/2085845499 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f871404eee0 con 0x7f87140d4120 2024-02-19T17:15:00.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.507+0000 7f8711600640 1 -- 172.21.15.46:0/2085845499 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f870807a8e0 con 0x7f87140d4120 2024-02-19T17:15:00.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.508+0000 7f8711600640 1 -- 172.21.15.46:0/2085845499 <== mon.0 v2:172.21.15.46:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8708077220 con 0x7f87140d4120 2024-02-19T17:15:00.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.510+0000 7f871b000640 1 -- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f86f806b810 msgr2=0x7f86f806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:15:00.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.510+0000 7f871b000640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f86f806b810 0x7f86f806dcd0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f8704006fd0 tx=0x7f8704008040 comp rx=0 tx=0).stop 2024-02-19T17:15:00.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.510+0000 7f871b000640 1 -- 172.21.15.46:0/2085845499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87140d4120 msgr2=0x7f87141f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:15:00.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.510+0000 7f871b000640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87140d4120 0x7f87141f42a0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f870802b910 tx=0x7f87080046c0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.510+0000 7f871b000640 1 -- 172.21.15.46:0/2085845499 shutdown_connections 2024-02-19T17:15:00.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.510+0000 7f871b000640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f86f806b810 0x7f86f806dcd0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.510+0000 7f871b000640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8714161600 0x7f871415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.511+0000 7f871b000640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871415dcb0 0x7f871415e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.511+0000 7f871b000640 1 --2- 172.21.15.46:0/2085845499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87140d4120 0x7f87141f42a0 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.511+0000 7f871b000640 1 -- 172.21.15.46:0/2085845499 >> 172.21.15.46:0/2085845499 conn(0x7f871408afc0 msgr2=0x7f87140d36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:15:00.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.511+0000 7f871b000640 1 -- 172.21.15.46:0/2085845499 shutdown_connections 2024-02-19T17:15:00.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.511+0000 7f871b000640 1 -- 172.21.15.46:0/2085845499 wait complete. 2024-02-19T17:15:00.516 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-19T17:15:00.517 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T17:15:00.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.757+0000 7f574a800640 1 Processor -- start 2024-02-19T17:15:00.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.758+0000 7f574a800640 1 -- start start 2024-02-19T17:15:00.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.759+0000 7f574a800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5744145260 0x7f574415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:15:00.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.759+0000 7f574a800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5744071000 0x7f57440714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:15:00.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.759+0000 7f574a800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574415ce10 con 0x7f574415f440 2024-02-19T17:15:00.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.759+0000 7f574a800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57440719f0 con 0x7f5744071000 2024-02-19T17:15:00.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.759+0000 7f574a800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57440cbde0 con 0x7f5744145260 2024-02-19T17:15:00.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.760+0000 7f573be00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5744071000 0x7f57440714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:15:00.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.760+0000 7f573be00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5744071000 0x7f57440714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46908/0 (socket says 172.21.15.46:46908) 2024-02-19T17:15:00.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.760+0000 7f573be00640 1 -- 172.21.15.46:0/3656527313 learned_addr learned my addr 172.21.15.46:0/3656527313 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:15:00.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.760+0000 7f5743400640 1 --2- 172.21.15.46:0/3656527313 >> v2:172.21.15.142:3300/0 conn(0x7f5744145260 0x7f574415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:15:00.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.761+0000 7f573be00640 1 -- 172.21.15.46:0/3656527313 >> v2:172.21.15.142:3300/0 conn(0x7f5744145260 msgr2=0x7f574415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-19T17:15:00.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.761+0000 7f573be00640 1 --2- 172.21.15.46:0/3656527313 >> v2:172.21.15.142:3300/0 conn(0x7f5744145260 0x7f574415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.761+0000 7f573be00640 1 -- 172.21.15.46:0/3656527313 >> v1:172.21.15.142:6789/0 conn(0x7f574415f440 legacy=0x7f574415f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:15:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.761+0000 7f573be00640 1 -- 172.21.15.46:0/3656527313 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57440cc080 con 0x7f5744071000 2024-02-19T17:15:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.762+0000 7f573be00640 1 --2- 172.21.15.46:0/3656527313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5744071000 0x7f57440714b0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f574406f510 tx=0x7f572c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9d8b24afc1465f server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:15:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.762+0000 7f5742a00640 1 -- 172.21.15.46:0/3656527313 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c031870 con 0x7f5744071000 2024-02-19T17:15:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.762+0000 7f5742a00640 1 -- 172.21.15.46:0/3656527313 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f572c0319d0 con 0x7f5744071000 2024-02-19T17:15:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.762+0000 7f5742a00640 1 -- 172.21.15.46:0/3656527313 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c031d80 con 0x7f5744071000 2024-02-19T17:15:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.763+0000 7f574a800640 1 -- 172.21.15.46:0/3656527313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5744071000 msgr2=0x7f57440714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:15:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.763+0000 7f574a800640 1 --2- 172.21.15.46:0/3656527313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5744071000 0x7f57440714b0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f574406f510 tx=0x7f572c02b910 comp rx=0 tx=0).stop 2024-02-19T17:15:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.763+0000 7f574a800640 1 -- 172.21.15.46:0/3656527313 shutdown_connections 2024-02-19T17:15:00.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.763+0000 7f574a800640 1 --2- 172.21.15.46:0/3656527313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5744071000 0x7f57440714b0 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.763+0000 7f574a800640 1 --2- 172.21.15.46:0/3656527313 >> v2:172.21.15.142:3300/0 conn(0x7f5744145260 0x7f574415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.763+0000 7f574a800640 1 -- 172.21.15.46:0/3656527313 >> 172.21.15.46:0/3656527313 conn(0x7f5744066f70 msgr2=0x7f574406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:15:00.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.763+0000 7f574a800640 1 -- 172.21.15.46:0/3656527313 shutdown_connections 2024-02-19T17:15:00.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.763+0000 7f574a800640 1 -- 172.21.15.46:0/3656527313 wait complete. 2024-02-19T17:15:00.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.765+0000 7f574a800640 1 Processor -- start 2024-02-19T17:15:00.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.765+0000 7f574a800640 1 -- start start 2024-02-19T17:15:00.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.766+0000 7f574a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5744071000 0x7f5744138ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:15:00.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.766+0000 7f574a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5744145260 0x7f574413abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:15:00.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.766+0000 7f574a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f574415f440 0x7f57441400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:15:00.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.766+0000 7f574a800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5744139220 con 0x7f574415f440 2024-02-19T17:15:00.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.766+0000 7f574a800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57440aefd0 con 0x7f5744145260 2024-02-19T17:15:00.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.766+0000 7f574a800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57440afb50 con 0x7f5744071000 2024-02-19T17:15:00.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.766+0000 7f5743e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f574415f440 0x7f57441400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:15:00.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.766+0000 7f5743e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f574415f440 0x7f57441400c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46918/0 (socket says 172.21.15.46:46918) 2024-02-19T17:15:00.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.766+0000 7f5743e00640 1 -- 172.21.15.46:0/1733050014 learned_addr learned my addr 172.21.15.46:0/1733050014 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T17:15:00.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.766+0000 7f573be00640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5744145260 0x7f574413abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:15:00.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.766+0000 7f5743400640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5744071000 0x7f5744138ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:15:00.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.767+0000 7f5743e00640 1 -- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5744071000 msgr2=0x7f5744138ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:15:00.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.767+0000 7f5743e00640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5744071000 0x7f5744138ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.767+0000 7f5743e00640 1 -- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5744145260 msgr2=0x7f574413abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:15:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.767+0000 7f5743e00640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5744145260 0x7f574413abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.767+0000 7f5743e00640 1 -- 172.21.15.46:0/1733050014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0094d0 con 0x7f574415f440 2024-02-19T17:15:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.767+0000 7f5743e00640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f574415f440 0x7f57441400c0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f573c00c710 tx=0x7f573c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:15:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.767+0000 7f573b400640 1 -- 172.21.15.46:0/1733050014 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c006d50 con 0x7f574415f440 2024-02-19T17:15:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.767+0000 7f573b400640 1 -- 172.21.15.46:0/1733050014 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f573c00ce20 con 0x7f574415f440 2024-02-19T17:15:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.767+0000 7f574a800640 1 -- 172.21.15.46:0/1733050014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57440af220 con 0x7f574415f440 2024-02-19T17:15:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.767+0000 7f573b400640 1 -- 172.21.15.46:0/1733050014 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c003bd0 con 0x7f574415f440 2024-02-19T17:15:00.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.767+0000 7f574a800640 1 -- 172.21.15.46:0/1733050014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57440af7e0 con 0x7f574415f440 2024-02-19T17:15:00.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.768+0000 7f574a800640 1 -- 172.21.15.46:0/1733050014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57440afcc0 con 0x7f574415f440 2024-02-19T17:15:00.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.769+0000 7f573b400640 1 -- 172.21.15.46:0/1733050014 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f573c003d30 con 0x7f574415f440 2024-02-19T17:15:00.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.770+0000 7f573b400640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f572006b810 0x7f572006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T17:15:00.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.771+0000 7f573b400640 1 -- 172.21.15.46:0/1733050014 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f573c089a90 con 0x7f574415f440 2024-02-19T17:15:00.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.771+0000 7f5743400640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f572006b810 0x7f572006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T17:15:00.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.772+0000 7f5743400640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f572006b810 0x7f572006dcd0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f5734009ad0 tx=0x7f5734008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T17:15:00.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:00.775+0000 7f573b400640 1 -- 172.21.15.46:0/1733050014 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f573c058240 con 0x7f574415f440 2024-02-19T17:15:01.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.014+0000 7f574a800640 1 -- 172.21.15.46:0/1733050014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5744067ba0 con 0x7f574415f440 2024-02-19T17:15:01.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.015+0000 7f573b400640 1 -- 172.21.15.46:0/1733050014 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3703 (secure 0 0 0) 0x7f573c057dd0 con 0x7f574415f440 2024-02-19T17:15:01.001 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T17:15:01.001 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2121507890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2121507890},{"type":"v1","addr":"172.21.15.142:6835","nonce":2121507890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3952092655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6833","nonce":3952092655},{"type":"v1","addr":"172.21.15.46:6835","nonce":3952092655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1741774776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1741774776},{"type":"v1","addr":"172.21.15.142:6837","nonce":1741774776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":10308,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6834/527023025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":527023025},{"type":"v1","addr":"172.21.15.46:6834","nonce":527023025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2024-02-19T17:15:01.001 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-02-19T17:15:01.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.018+0000 7f574a800640 1 -- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f572006b810 msgr2=0x7f572006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:15:01.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.018+0000 7f574a800640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f572006b810 0x7f572006dcd0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f5734009ad0 tx=0x7f5734008040 comp rx=0 tx=0).stop 2024-02-19T17:15:01.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.018+0000 7f574a800640 1 -- 172.21.15.46:0/1733050014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f574415f440 msgr2=0x7f57441400c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T17:15:01.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.018+0000 7f574a800640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f574415f440 0x7f57441400c0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f573c00c710 tx=0x7f573c00cbd0 comp rx=0 tx=0).stop 2024-02-19T17:15:01.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.018+0000 7f574a800640 1 -- 172.21.15.46:0/1733050014 shutdown_connections 2024-02-19T17:15:01.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.018+0000 7f574a800640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:6832/1628765207,v1:172.21.15.142:6833/1628765207] conn(0x7f572006b810 0x7f572006dcd0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:01.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.018+0000 7f574a800640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f574415f440 0x7f57441400c0 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:01.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.018+0000 7f574a800640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5744145260 0x7f574413abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:01.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.018+0000 7f574a800640 1 --2- 172.21.15.46:0/1733050014 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5744071000 0x7f5744138ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T17:15:01.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.019+0000 7f574a800640 1 -- 172.21.15.46:0/1733050014 >> 172.21.15.46:0/1733050014 conn(0x7f5744066f70 msgr2=0x7f57440cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T17:15:01.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.019+0000 7f574a800640 1 -- 172.21.15.46:0/1733050014 shutdown_connections 2024-02-19T17:15:01.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T17:15:01.019+0000 7f574a800640 1 -- 172.21.15.46:0/1733050014 wait complete. 2024-02-19T17:15:01.026 DEBUG:tasks.cephfs.filesystem:already dead... 2024-02-19T17:15:01.026 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-19T17:15:01.026 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-19T17:15:01.026 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:01.047 INFO:tasks.ceph.mds.a:Stopped 2024-02-19T17:15:01.048 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-19T17:15:01.048 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:01.123 INFO:tasks.ceph.mds.c:Stopped 2024-02-19T17:15:01.124 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-19T17:15:01.124 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:01.146 INFO:tasks.ceph.mds.b:Stopped 2024-02-19T17:15:01.146 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-19T17:15:01.146 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:01.208 INFO:tasks.ceph.mds.d:Stopped 2024-02-19T17:15:01.209 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-19T17:15:01.209 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-19T17:15:01.209 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:05.143 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-02-19T17:15:07.310 INFO:tasks.ceph.osd.0:Stopped 2024-02-19T17:15:07.311 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-19T17:15:07.311 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:11.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-02-19T17:15:11.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-02-19T17:15:13.413 INFO:tasks.ceph.osd.1:Stopped 2024-02-19T17:15:13.413 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-19T17:15:13.413 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:17.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-02-19T17:15:17.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-02-19T17:15:19.514 INFO:tasks.ceph.osd.2:Stopped 2024-02-19T17:15:19.515 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-19T17:15:19.515 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:23.167 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-02-19T17:15:23.167 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-02-19T17:15:25.617 INFO:tasks.ceph.osd.3:Stopped 2024-02-19T17:15:25.617 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-02-19T17:15:25.617 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:28.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-02-19T17:15:28.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-02-19T17:15:31.720 INFO:tasks.ceph.osd.4:Stopped 2024-02-19T17:15:31.721 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-02-19T17:15:31.721 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:34.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-02-19T17:15:34.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-02-19T17:15:37.822 INFO:tasks.ceph.osd.5:Stopped 2024-02-19T17:15:37.823 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-02-19T17:15:37.823 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:40.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-02-19T17:15:40.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-02-19T17:15:43.925 INFO:tasks.ceph.osd.6:Stopped 2024-02-19T17:15:43.925 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-02-19T17:15:43.925 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:45.790 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-02-19T17:15:45.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-02-19T17:15:50.027 INFO:tasks.ceph.osd.7:Stopped 2024-02-19T17:15:50.027 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-19T17:15:50.028 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-19T17:15:50.028 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:51.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-02-19T17:15:51.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-02-19T17:15:56.131 INFO:tasks.ceph.mgr.y:Stopped 2024-02-19T17:15:56.132 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-19T17:15:56.132 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:56.223 INFO:tasks.ceph.mgr.x:Stopped 2024-02-19T17:15:56.223 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-19T17:15:56.223 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-19T17:15:56.223 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:15:56.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-02-19T17:16:01.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-02-19T17:16:02.325 INFO:tasks.ceph.mon.a:Stopped 2024-02-19T17:16:02.326 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-19T17:16:02.326 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:16:02.377 INFO:tasks.ceph.mon.b:Stopped 2024-02-19T17:16:02.378 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-19T17:16:02.378 INFO:teuthology.orchestra.run:waiting for 300 2024-02-19T17:16:02.476 INFO:tasks.ceph.mon.c:Stopped 2024-02-19T17:16:02.477 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-19T17:16:02.477 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-19T17:16:02.699 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T17:16:02.700 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-19T17:16:03.018 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T17:16:03.019 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-19T17:16:03.295 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T17:16:03.295 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-19T17:16:03.557 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T17:16:03.557 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-19T17:16:03.826 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T17:16:03.827 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-02-19T17:16:04.572 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T17:16:04.572 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-02-19T17:16:04.893 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T17:16:04.894 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-02-19T17:16:05.171 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T17:16:05.171 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-02-19T17:16:05.453 INFO:tasks.ceph:Archiving mon data... 2024-02-19T17:16:05.455 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566145/data/mon.a.tgz 2024-02-19T17:16:05.455 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-02-19T17:16:05.519 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.CcYkTF4xlf 2024-02-19T17:16:05.519 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.CcYkTF4xlf 2024-02-19T17:16:05.761 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.CcYkTF4xlf 2024-02-19T17:16:05.987 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.CcYkTF4xlf is 588KB 2024-02-19T17:16:06.108 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.CcYkTF4xlf 2024-02-19T17:16:06.168 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566145/data/mon.b.tgz 2024-02-19T17:16:06.168 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-02-19T17:16:06.217 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.4ghjp3Grvk 2024-02-19T17:16:06.218 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.4ghjp3Grvk 2024-02-19T17:16:06.454 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.4ghjp3Grvk 2024-02-19T17:16:06.591 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.4ghjp3Grvk is 593KB 2024-02-19T17:16:06.693 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.4ghjp3Grvk 2024-02-19T17:16:06.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-02-19T17:16:06.742 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566145/data/mon.c.tgz 2024-02-19T17:16:06.742 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-02-19T17:16:06.788 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.QdupTAenX1 2024-02-19T17:16:06.789 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.QdupTAenX1 2024-02-19T17:16:07.023 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.QdupTAenX1 2024-02-19T17:16:07.164 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.QdupTAenX1 is 593KB 2024-02-19T17:16:07.265 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.QdupTAenX1 2024-02-19T17:16:07.316 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-19T17:16:07.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-19T17:16:07.324 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-19T17:16:07.543 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-19T17:16:07.594 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-19T17:16:07.594 INFO:tasks.ceph:Archiving crash dumps... 2024-02-19T17:16:07.596 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566145/remote/smithi046/crash 2024-02-19T17:16:07.597 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-19T17:16:07.699 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566145/remote/smithi142/crash 2024-02-19T17:16:07.700 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-19T17:16:07.783 INFO:tasks.ceph:Shutting down logrotate 2024-02-19T17:16:19.718 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-19T17:16:19.835 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-19T17:16:19.933 INFO:tasks.ceph:Compressing logs... 2024-02-19T17:16:19.933 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-19T17:16:19.941 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-19T17:16:20.051 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-02-19T17:16:20.052 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68272.log 2024-02-19T17:16:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47543.log 2024-02-19T17:16:20.054 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68432.log 2024-02-19T17:16:20.055 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.68272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68512.log 2024-02-19T17:16:20.056 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539944.log 2024-02-19T17:16:20.057 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.68432.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-19T17:16:20.057 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42589.log 2024-02-19T17:16:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.68512.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-02-19T17:16:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481811.log 2024-02-19T17:16:20.059 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.539944.log.gz 2024-02-19T17:16:20.059 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.73405.log 2024-02-19T17:16:20.060 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-02-19T17:16:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258487.log 2024-02-19T17:16:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37867.log 2024-02-19T17:16:20.061 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.1.73405.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-02-19T17:16:20.062 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442401.log 2024-02-19T17:16:20.062 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-02-19T17:16:20.062 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68472.log 2024-02-19T17:16:20.063 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458850.log 2024-02-19T17:16:20.064 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68232.log 2024-02-19T17:16:20.064 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483756.log 2024-02-19T17:16:20.065 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.68472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.73857.log 2024-02-19T17:16:20.065 INFO:teuthology.orchestra.run.smithi142.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68272.log.gz 2024-02-19T17:16:20.065 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.68232.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-19T17:16:20.066 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404343.log 2024-02-19T17:16:20.066 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250558.log 2024-02-19T17:16:20.067 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.3.73857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68392.log 2024-02-19T17:16:20.067 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181965.log 2024-02-19T17:16:20.068 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68312.log 2024-02-19T17:16:20.068 INFO:teuthology.orchestra.run.smithi142.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68232.log.gz 2024-02-19T17:16:20.068 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.68392.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-19T17:16:20.069 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.68312.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-02-19T17:16:20.070 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.481811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260162.log 2024-02-19T17:16:20.070 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428356.log 2024-02-19T17:16:20.070 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46100.log 2024-02-19T17:16:20.071 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68352.log 2024-02-19T17:16:20.071 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-02-19T17:16:20.072 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145743.log 2024-02-19T17:16:20.072 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236824.log 2024-02-19T17:16:20.073 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.68352.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-02-19T17:16:20.073 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261015.log 2024-02-19T17:16:20.074 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.442401.log: /var/log/ceph/ceph-client.admin.258487.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.458850.log: -- /var/log/ceph/ceph-client.admin.516456.log 2024-02-19T17:16:20.074 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47543.log.gz 2024-02-19T17:16:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.483756.log: /var/log/ceph/ceph-client.admin.404343.log: /var/log/ceph/ceph-client.admin.42589.log: /var/log/ceph/ceph-client.admin.37867.log: /var/log/ceph/ceph-client.admin.145743.log: /var/log/ceph/ceph-client.admin.236824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308439.log 2024-02-19T17:16:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46100.log: /var/log/ceph/ceph-client.admin.428356.log: /var/log/ceph/ceph-client.admin.250558.log: /var/log/ceph/ceph-client.admin.181965.log: /var/log/ceph/ceph-client.admin.260162.log: /var/log/ceph/ceph-client.admin.261015.log: /var/log/ceph/ceph-client.admin.516456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319186.log 2024-02-19T17:16:20.077 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.308439.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.516456.log.gz 2024-02-19T17:16:20.077 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269193.log 2024-02-19T17:16:20.078 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.319186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379262.log 2024-02-19T17:16:20.079 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.269193.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.145743.log.gz 2024-02-19T17:16:20.079 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421774.log 2024-02-19T17:16:20.080 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.379262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239805.log 2024-02-19T17:16:20.081 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42589.log.gz 2024-02-19T17:16:20.081 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.421774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44114.log 2024-02-19T17:16:20.082 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.239805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319195.log 2024-02-19T17:16:20.082 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.308439.log.gz 2024-02-19T17:16:20.083 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187810.log 2024-02-19T17:16:20.083 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44114.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.379262.log.gz 2024-02-19T17:16:20.084 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.319195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135007.log 2024-02-19T17:16:20.085 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.187810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403497.log 2024-02-19T17:16:20.086 INFO:teuthology.orchestra.run.smithi046.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.319186.log.gz 2024-02-19T17:16:20.086 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244637.log 2024-02-19T17:16:20.086 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.135007.log: /var/log/ceph/ceph-client.admin.403497.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.319195.log.gz 2024-02-19T17:16:20.087 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223209.log 2024-02-19T17:16:20.087 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.244637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380136.log 2024-02-19T17:16:20.088 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.223209.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.421774.log.gz 2024-02-19T17:16:20.089 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201578.log 2024-02-19T17:16:20.089 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.403497.log.gz 2024-02-19T17:16:20.090 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.380136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225777.log 2024-02-19T17:16:20.090 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.201578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132907.log 2024-02-19T17:16:20.091 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.225777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333136.log 2024-02-19T17:16:20.092 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.135007.log.gz 2024-02-19T17:16:20.092 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.132907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386214.log 2024-02-19T17:16:20.093 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.333136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506761.log 2024-02-19T17:16:20.094 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.386214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124418.log 2024-02-19T17:16:20.095 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.506761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474972.log 2024-02-19T17:16:20.096 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.124418.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.261015.log.gz 2024-02-19T17:16:20.096 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43269.log 2024-02-19T17:16:20.096 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.474972.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.223209.log.gz 2024-02-19T17:16:20.097 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355073.log 2024-02-19T17:16:20.097 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396702.log 2024-02-19T17:16:20.098 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.355073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144848.log 2024-02-19T17:16:20.099 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.225777.log.gz 2024-02-19T17:16:20.100 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.396702.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.239805.log.gz 2024-02-19T17:16:20.100 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449953.log 2024-02-19T17:16:20.100 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43269.log.gz 2024-02-19T17:16:20.101 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314336.log 2024-02-19T17:16:20.101 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.449953.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37867.log.gz 2024-02-19T17:16:20.102 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238559.log 2024-02-19T17:16:20.102 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.314336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47999.log 2024-02-19T17:16:20.103 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.238559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538410.log 2024-02-19T17:16:20.104 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200687.log 2024-02-19T17:16:20.105 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47999.log: /var/log/ceph/ceph-client.admin.538410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203364.log 2024-02-19T17:16:20.106 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.200687.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.538410.log.gz 2024-02-19T17:16:20.106 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470682.log 2024-02-19T17:16:20.107 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.404343.log.gz 2024-02-19T17:16:20.107 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.203364.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-19T17:16:20.107 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.470682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505499.log 2024-02-19T17:16:20.108 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47999.log.gz 2024-02-19T17:16:20.108 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538960.log 2024-02-19T17:16:20.109 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.505499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531747.log 2024-02-19T17:16:20.110 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.538960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242424.log 2024-02-19T17:16:20.110 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.538960.log.gz 2024-02-19T17:16:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.531747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126932.log 2024-02-19T17:16:20.112 INFO:teuthology.orchestra.run.smithi046.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.531747.log.gz 2024-02-19T17:16:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.242424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480107.log 2024-02-19T17:16:20.113 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.126932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119124.log 2024-02-19T17:16:20.114 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.144848.log.gz 2024-02-19T17:16:20.114 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.480107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194968.log 2024-02-19T17:16:20.115 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.119124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530436.log 2024-02-19T17:16:20.115 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.194968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401405.log 2024-02-19T17:16:20.116 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.530436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137936.log 2024-02-19T17:16:20.116 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.530436.log.gz 2024-02-19T17:16:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.401405.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46100.log.gz 2024-02-19T17:16:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322142.log 2024-02-19T17:16:20.118 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.137936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110698.log 2024-02-19T17:16:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.322142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511125.log 2024-02-19T17:16:20.120 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.110698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213234.log 2024-02-19T17:16:20.120 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.511125.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.483756.log.gz 2024-02-19T17:16:20.121 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.401405.log.gz 2024-02-19T17:16:20.121 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384530.log 2024-02-19T17:16:20.121 INFO:teuthology.orchestra.run.smithi046.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.511125.log.gz 2024-02-19T17:16:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.213234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450368.log 2024-02-19T17:16:20.123 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.384530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237293.log 2024-02-19T17:16:20.124 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.450368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322983.log 2024-02-19T17:16:20.124 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.386214.log.gz 2024-02-19T17:16:20.124 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.237293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257224.log 2024-02-19T17:16:20.125 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.322983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539139.log 2024-02-19T17:16:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.257224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225768.log 2024-02-19T17:16:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539139.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.333136.log.gz 2024-02-19T17:16:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527794.log 2024-02-19T17:16:20.127 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.539139.log.gz 2024-02-19T17:16:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.225768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540406.log 2024-02-19T17:16:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.527794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42597.log 2024-02-19T17:16:20.129 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.527794.log.gz 2024-02-19T17:16:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.540406.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.380136.log.gz 2024-02-19T17:16:20.130 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347104.log 2024-02-19T17:16:20.130 INFO:teuthology.orchestra.run.smithi046.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.540406.log.gz 2024-02-19T17:16:20.131 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.396702.log.gz 2024-02-19T17:16:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529125.log 2024-02-19T17:16:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42597.log: /var/log/ceph/ceph-client.admin.347104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384113.log 2024-02-19T17:16:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.529125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131654.log 2024-02-19T17:16:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.384113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457884.log 2024-02-19T17:16:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.131654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263586.log 2024-02-19T17:16:20.135 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.238559.log.gz 2024-02-19T17:16:20.135 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.457884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336574.log 2024-02-19T17:16:20.135 INFO:teuthology.orchestra.run.smithi046.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.529125.log.gz 2024-02-19T17:16:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.263586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471547.log 2024-02-19T17:16:20.137 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.336574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456900.log 2024-02-19T17:16:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143997.log 2024-02-19T17:16:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.471547.log: /var/log/ceph/ceph-client.admin.456900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400988.log 2024-02-19T17:16:20.139 INFO:teuthology.orchestra.run.smithi046.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.244637.log.gz 2024-02-19T17:16:20.139 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.126932.log.gz 2024-02-19T17:16:20.140 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315619.log 2024-02-19T17:16:20.140 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-19T17:16:20.141 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.400988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151622.log 2024-02-19T17:16:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.315619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460769.log 2024-02-19T17:16:20.142 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.132907.log.gz 2024-02-19T17:16:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.151622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49313.log 2024-02-19T17:16:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.460769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131226.log 2024-02-19T17:16:20.144 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238977.log 2024-02-19T17:16:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.131226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341982.log 2024-02-19T17:16:20.145 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.355073.log.gz 2024-02-19T17:16:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.238977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472862.log 2024-02-19T17:16:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.341982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155510.log 2024-02-19T17:16:20.148 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.472862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311404.log 2024-02-19T17:16:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.155510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138775.log 2024-02-19T17:16:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.311404.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.314336.log.gz 2024-02-19T17:16:20.150 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42931.log 2024-02-19T17:16:20.151 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.138775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518140.log 2024-02-19T17:16:20.151 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331867.log 2024-02-19T17:16:20.152 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.518140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45848.log 2024-02-19T17:16:20.152 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.518140.log.gz 2024-02-19T17:16:20.153 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.331867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248823.log 2024-02-19T17:16:20.154 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227948.log 2024-02-19T17:16:20.154 INFO:teuthology.orchestra.run.smithi046.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.322142.log.gz 2024-02-19T17:16:20.155 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.248823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231797.log 2024-02-19T17:16:20.155 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.227948.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.322983.log.gz 2024-02-19T17:16:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355554.log 2024-02-19T17:16:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.231797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248405.log 2024-02-19T17:16:20.157 INFO:teuthology.orchestra.run.smithi142.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.68432.log.gz 2024-02-19T17:16:20.158 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.355554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48755.log 2024-02-19T17:16:20.158 INFO:teuthology.orchestra.run.smithi142.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68472.log.gz 2024-02-19T17:16:20.159 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.248405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113099.log 2024-02-19T17:16:20.159 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.213234.log.gz 2024-02-19T17:16:20.160 INFO:teuthology.orchestra.run.smithi142.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68512.log.gz 2024-02-19T17:16:20.160 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404756.log 2024-02-19T17:16:20.161 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113099.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.237293.log.gz 2024-02-19T17:16:20.161 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.236824.log.gz 2024-02-19T17:16:20.161 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111204.log 2024-02-19T17:16:20.161 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.404756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213644.log 2024-02-19T17:16:20.162 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202470.log 2024-02-19T17:16:20.162 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.481811.log.gz 2024-02-19T17:16:20.163 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.213644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212806.log 2024-02-19T17:16:20.164 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.202470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318351.log 2024-02-19T17:16:20.164 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.505499.log.gz 2024-02-19T17:16:20.165 INFO:teuthology.orchestra.run.smithi142.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.3.73857.log.gz 2024-02-19T17:16:20.165 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.212806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477552.log 2024-02-19T17:16:20.166 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.318351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442893.log 2024-02-19T17:16:20.166 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42931.log.gz 2024-02-19T17:16:20.166 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.470682.log.gz 2024-02-19T17:16:20.167 INFO:teuthology.orchestra.run.smithi142.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68312.log.gz 2024-02-19T17:16:20.167 INFO:teuthology.orchestra.run.smithi142.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68392.log.gz 2024-02-19T17:16:20.168 INFO:teuthology.orchestra.run.smithi142.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.68352.log.gz 2024-02-19T17:16:20.168 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.477552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511116.log 2024-02-19T17:16:20.169 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.442893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524701.log 2024-02-19T17:16:20.169 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.225768.log.gz 2024-02-19T17:16:20.169 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.238977.log.gz 2024-02-19T17:16:20.169 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.474972.log.gz 2024-02-19T17:16:20.169 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250089.log 2024-02-19T17:16:20.169 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.511116.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.400988.log.gz 2024-02-19T17:16:20.170 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.511116.log.gz 2024-02-19T17:16:20.170 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.524701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217142.log 2024-02-19T17:16:20.171 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.524701.log.gz 2024-02-19T17:16:20.171 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.250089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454655.log 2024-02-19T17:16:20.171 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.258487.log.gz 2024-02-19T17:16:20.171 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.217142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252899.log 2024-02-19T17:16:20.172 INFO:teuthology.orchestra.run.smithi046.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.260162.log.gz 2024-02-19T17:16:20.172 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.454655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216248.log 2024-02-19T17:16:20.173 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.252899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502584.log 2024-02-19T17:16:20.174 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.216248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320900.log 2024-02-19T17:16:20.174 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0%/var/log/ceph/ceph-client.admin.502584.log: -- replaced with /var/log/ceph/ceph-client.admin.187810.log.gz 2024-02-19T17:16:20.175 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.131654.log.gz 2024-02-19T17:16:20.175 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525593.log 2024-02-19T17:16:20.175 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.320900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341092.log 2024-02-19T17:16:20.177 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.525593.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.269193.log.gz 2024-02-19T17:16:20.177 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134590.log 2024-02-19T17:16:20.177 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.525593.log.gz 2024-02-19T17:16:20.177 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.341092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254701.log 2024-02-19T17:16:20.178 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.134590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220942.log 2024-02-19T17:16:20.179 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.254701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214911.log 2024-02-19T17:16:20.180 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.220942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44740.log 2024-02-19T17:16:20.181 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.214911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313503.log 2024-02-19T17:16:20.181 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44740.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.181965.log.gz 2024-02-19T17:16:20.182 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535763.log 2024-02-19T17:16:20.182 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.201578.log.gz 2024-02-19T17:16:20.183 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.313503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455991.log 2024-02-19T17:16:20.183 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.535763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505926.log 2024-02-19T17:16:20.184 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.455991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319603.log 2024-02-19T17:16:20.185 INFO:teuthology.orchestra.run.smithi046.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.535763.log.gz 2024-02-19T17:16:20.185 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.505926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423879.log 2024-02-19T17:16:20.186 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.319603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480571.log 2024-02-19T17:16:20.186 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.137936.log.gz 2024-02-19T17:16:20.187 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.423879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47669.log 2024-02-19T17:16:20.188 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.480571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533566.log 2024-02-19T17:16:20.189 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526483.log 2024-02-19T17:16:20.190 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.533566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454229.log 2024-02-19T17:16:20.190 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.533566.log.gz 2024-02-19T17:16:20.191 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.526483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464935.log 2024-02-19T17:16:20.192 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.454229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306352.log 2024-02-19T17:16:20.193 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.464935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320480.log 2024-02-19T17:16:20.194 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.306352.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.526483.log.gz 2024-02-19T17:16:20.194 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271314.log 2024-02-19T17:16:20.195 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.320480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43508.log 2024-02-19T17:16:20.195 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.271314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267532.log 2024-02-19T17:16:20.196 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.138775.log.gz 2024-02-19T17:16:20.197 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46991.log 2024-02-19T17:16:20.197 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.257224.log.gz 2024-02-19T17:16:20.197 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.267532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263111.log 2024-02-19T17:16:20.198 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505508.log 2024-02-19T17:16:20.199 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.131226.log.gz 2024-02-19T17:16:20.199 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.263111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530875.log 2024-02-19T17:16:20.200 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.505508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322974.log 2024-02-19T17:16:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.530875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397546.log 2024-02-19T17:16:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.322974.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.341982.log.gz 2024-02-19T17:16:20.202 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202024.log 2024-02-19T17:16:20.203 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.397546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313920.log 2024-02-19T17:16:20.204 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.202024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205146.log 2024-02-19T17:16:20.204 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.530875.log.gz 2024-02-19T17:16:20.205 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.313920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234320.log 2024-02-19T17:16:20.206 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.205146.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42597.log.gz 2024-02-19T17:16:20.206 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508851.log 2024-02-19T17:16:20.207 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.234320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48167.log 2024-02-19T17:16:20.207 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45848.log.gz 2024-02-19T17:16:20.208 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.508851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41397.log 2024-02-19T17:16:20.209 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48167.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.111204.log.gz 2024-02-19T17:16:20.209 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332724.log 2024-02-19T17:16:20.209 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137515.log 2024-02-19T17:16:20.210 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48755.log.gz 2024-02-19T17:16:20.210 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.332724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378845.log 2024-02-19T17:16:20.211 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49313.log.gz 2024-02-19T17:16:20.211 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.137515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347531.log 2024-02-19T17:16:20.212 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.378845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411976.log 2024-02-19T17:16:20.213 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.347531.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.143997.log.gz 2024-02-19T17:16:20.213 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204264.log 2024-02-19T17:16:20.214 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.411976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510575.log 2024-02-19T17:16:20.215 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.204264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45638.log 2024-02-19T17:16:20.216 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.510575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408576.log 2024-02-19T17:16:20.216 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45638.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.306352.log.gz 2024-02-19T17:16:20.217 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344160.log 2024-02-19T17:16:20.217 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.408576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220090.log 2024-02-19T17:16:20.217 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.331867.log.gz 2024-02-19T17:16:20.218 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108745.log 2024-02-19T17:16:20.219 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.344160.log: /var/log/ceph/ceph-client.admin.220090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515995.log 2024-02-19T17:16:20.220 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538401.log 2024-02-19T17:16:20.221 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.515995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186911.log 2024-02-19T17:16:20.221 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.538401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384122.log 2024-02-19T17:16:20.222 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.538401.log.gz 2024-02-19T17:16:20.223 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.186911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257655.log 2024-02-19T17:16:20.223 INFO:teuthology.orchestra.run.smithi046.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.515995.log.gz 2024-02-19T17:16:20.224 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.384122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476717.log 2024-02-19T17:16:20.224 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.257655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411559.log 2024-02-19T17:16:20.225 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.476717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47359.log 2024-02-19T17:16:20.226 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.411559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470229.log 2024-02-19T17:16:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47243.log 2024-02-19T17:16:20.228 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.470229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254710.log 2024-02-19T17:16:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264169.log 2024-02-19T17:16:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.254710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144436.log 2024-02-19T17:16:20.230 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.264169.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.119124.log.gz 2024-02-19T17:16:20.230 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519541.log 2024-02-19T17:16:20.231 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144436.log: gzip 81.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.213644.log.gz 2024-02-19T17:16:20.232 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.136252.log 2024-02-19T17:16:20.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.519541.log: gzip -5 79.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.519541.log.gz 2024-02-19T17:16:20.232 INFO:teuthology.orchestra.run.smithi046.stderr: /var/log/ceph/ceph-client.admin.227448.log 2024-02-19T17:16:20.233 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.136252.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.231797.log.gz 2024-02-19T17:16:20.233 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282597.log 2024-02-19T17:16:20.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.227448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43844.log 2024-02-19T17:16:20.235 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.200687.log.gz 2024-02-19T17:16:20.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.282597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309301.log 2024-02-19T17:16:20.236 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518149.log 2024-02-19T17:16:20.237 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.309301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332285.log 2024-02-19T17:16:20.238 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.518149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281762.log 2024-02-19T17:16:20.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.332285.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.518149.log.gz 2024-02-19T17:16:20.239 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46702.log 2024-02-19T17:16:20.239 INFO:teuthology.orchestra.run.smithi046.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.456900.log.gz 2024-02-19T17:16:20.240 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.281762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210726.log 2024-02-19T17:16:20.240 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.460769.log.gz 2024-02-19T17:16:20.241 INFO:teuthology.orchestra.run.smithi046.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.471547.log.gz 2024-02-19T17:16:20.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506752.log 2024-02-19T17:16:20.241 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.472862.log.gz 2024-02-19T17:16:20.242 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.210726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520396.log 2024-02-19T17:16:20.242 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.506752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206494.log 2024-02-19T17:16:20.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.520396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272609.log 2024-02-19T17:16:20.244 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.520396.log.gz 2024-02-19T17:16:20.244 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.206494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312242.log 2024-02-19T17:16:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.272609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377503.log 2024-02-19T17:16:20.246 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.312242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324222.log 2024-02-19T17:16:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352096.log 2024-02-19T17:16:20.247 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.502584.log.gz 2024-02-19T17:16:20.248 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.324222.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.505508.log.gz 2024-02-19T17:16:20.248 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189144.log 2024-02-19T17:16:20.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.352096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241119.log 2024-02-19T17:16:20.249 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.212806.log.gz 2024-02-19T17:16:20.250 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.189144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426316.log 2024-02-19T17:16:20.251 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.205146.log.gz 2024-02-19T17:16:20.251 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.241119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163821.log 2024-02-19T17:16:20.252 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.426316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446027.log 2024-02-19T17:16:20.253 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324647.log 2024-02-19T17:16:20.254 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.446027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242923.log 2024-02-19T17:16:20.255 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.324647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391490.log 2024-02-19T17:16:20.255 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.242923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180282.log 2024-02-19T17:16:20.256 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.391490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345437.log 2024-02-19T17:16:20.257 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.180282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232623.log 2024-02-19T17:16:20.258 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.345437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43264.log 2024-02-19T17:16:20.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.232623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49494.log 2024-02-19T17:16:20.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341973.log 2024-02-19T17:16:20.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408585.log 2024-02-19T17:16:20.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.341973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378364.log 2024-02-19T17:16:20.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.408585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439861.log 2024-02-19T17:16:20.263 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.378364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456000.log 2024-02-19T17:16:20.264 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.439861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417949.log 2024-02-19T17:16:20.264 INFO:teuthology.orchestra.run.smithi046.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.404756.log.gz 2024-02-19T17:16:20.265 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.456000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316603.log 2024-02-19T17:16:20.266 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.417949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222375.log 2024-02-19T17:16:20.266 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.316603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182392.log 2024-02-19T17:16:20.267 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.315619.log.gz 2024-02-19T17:16:20.268 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.222375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45596.log 2024-02-19T17:16:20.268 INFO:teuthology.orchestra.run.smithi046.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.318351.log.gz 2024-02-19T17:16:20.268 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.182392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270034.log 2024-02-19T17:16:20.269 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48125.log 2024-02-19T17:16:20.269 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43508.log.gz 2024-02-19T17:16:20.270 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.270034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44216.log 2024-02-19T17:16:20.271 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539307.log 2024-02-19T17:16:20.272 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224933.log 2024-02-19T17:16:20.273 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323390.log 2024-02-19T17:16:20.273 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.347104.log.gz 2024-02-19T17:16:20.273 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.539307.log.gz 2024-02-19T17:16:20.274 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.224933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43550.log 2024-02-19T17:16:20.275 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.323390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46590.log 2024-02-19T17:16:20.275 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.241119.log.gz 2024-02-19T17:16:20.275 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47669.log.gz 2024-02-19T17:16:20.276 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438561.log 2024-02-19T17:16:20.276 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220507.log 2024-02-19T17:16:20.277 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.438561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522552.log 2024-02-19T17:16:20.278 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.220507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49169.log 2024-02-19T17:16:20.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.522552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427092.log 2024-02-19T17:16:20.279 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.522552.log.gz 2024-02-19T17:16:20.280 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140929.log 2024-02-19T17:16:20.281 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.427092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181543.log 2024-02-19T17:16:20.282 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.140929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46865.log 2024-02-19T17:16:20.283 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.181543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305086.log 2024-02-19T17:16:20.284 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37751.log 2024-02-19T17:16:20.284 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.305086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331457.log 2024-02-19T17:16:20.285 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458376.log 2024-02-19T17:16:20.286 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.331457.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.151622.log.gz 2024-02-19T17:16:20.286 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126058.log 2024-02-19T17:16:20.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.458376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131235.log 2024-02-19T17:16:20.288 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.126058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392738.log 2024-02-19T17:16:20.289 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.131235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427523.log 2024-02-19T17:16:20.289 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.392738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450794.log 2024-02-19T17:16:20.290 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.427523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112636.log 2024-02-19T17:16:20.291 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.450794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142734.log 2024-02-19T17:16:20.292 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190053.log 2024-02-19T17:16:20.293 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.142734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487569.log 2024-02-19T17:16:20.294 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.190053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248414.log 2024-02-19T17:16:20.294 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.136252.log.gz 2024-02-19T17:16:20.294 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.487569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486261.log 2024-02-19T17:16:20.295 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.248414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310987.log 2024-02-19T17:16:20.296 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.486261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112190.log 2024-02-19T17:16:20.297 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.310987.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.281762.log.gz 2024-02-19T17:16:20.297 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485417.log 2024-02-19T17:16:20.298 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264178.log 2024-02-19T17:16:20.299 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.485417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313512.log 2024-02-19T17:16:20.300 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.264178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49580.log 2024-02-19T17:16:20.301 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.313512.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.316603.log.gz 2024-02-19T17:16:20.301 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189639.log 2024-02-19T17:16:20.302 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317437.log 2024-02-19T17:16:20.302 INFO:teuthology.orchestra.run.smithi142.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.1.73405.log.gz 2024-02-19T17:16:20.303 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.189639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482819.log 2024-02-19T17:16:20.303 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.317437.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.320480.log.gz 2024-02-19T17:16:20.304 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144857.log 2024-02-19T17:16:20.305 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.322974.log.gz 2024-02-19T17:16:20.305 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.482819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509269.log 2024-02-19T17:16:20.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143151.log 2024-02-19T17:16:20.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.509269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521236.log 2024-02-19T17:16:20.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155973.log 2024-02-19T17:16:20.308 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.521236.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.216248.log.gz 2024-02-19T17:16:20.308 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423016.log 2024-02-19T17:16:20.309 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.521236.log.gz 2024-02-19T17:16:20.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.155973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439852.log 2024-02-19T17:16:20.310 INFO:teuthology.orchestra.run.smithi046.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.377503.log.gz 2024-02-19T17:16:20.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.423016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532189.log 2024-02-19T17:16:20.311 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.439852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220081.log 2024-02-19T17:16:20.312 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.532189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216239.log 2024-02-19T17:16:20.312 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.532189.log.gz 2024-02-19T17:16:20.313 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.220081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407741.log 2024-02-19T17:16:20.314 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.216239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252491.log 2024-02-19T17:16:20.315 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.407741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484998.log 2024-02-19T17:16:20.316 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.252491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503828.log 2024-02-19T17:16:20.317 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.484998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441543.log 2024-02-19T17:16:20.318 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.503828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323815.log 2024-02-19T17:16:20.318 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.441543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531307.log 2024-02-19T17:16:20.319 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.323815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152921.log 2024-02-19T17:16:20.320 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.531307.log: gzip 83.3% -- replaced with /var/log/ceph/ceph-client.admin.531307.log.gz 2024-02-19T17:16:20.321 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48916.log 2024-02-19T17:16:20.321 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.152921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526034.log 2024-02-19T17:16:20.322 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.344160.log.gz 2024-02-19T17:16:20.322 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375745.log 2024-02-19T17:16:20.323 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.526034.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.347531.log.gz 2024-02-19T17:16:20.323 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.526034.log.gz 2024-02-19T17:16:20.323 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.112199.log 2024-02-19T17:16:20.324 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.375745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261006.log 2024-02-19T17:16:20.325 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392321.log 2024-02-19T17:16:20.325 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.408576.log.gz 2024-02-19T17:16:20.326 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.408585.log.gz 2024-02-19T17:16:20.326 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.261006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391027.log 2024-02-19T17:16:20.327 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.392321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266281.log 2024-02-19T17:16:20.327 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.391027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215794.log 2024-02-19T17:16:20.328 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.266281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457893.log 2024-02-19T17:16:20.329 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.215794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515535.log 2024-02-19T17:16:20.330 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.457893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352577.log 2024-02-19T17:16:20.331 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.515535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398844.log 2024-02-19T17:16:20.332 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.352577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337984.log 2024-02-19T17:16:20.333 INFO:teuthology.orchestra.run.smithi046.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.203364.log.gz 2024-02-19T17:16:20.333 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391481.log 2024-02-19T17:16:20.333 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.398844.log: /var/log/ceph/ceph-client.admin.337984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195818.log 2024-02-19T17:16:20.335 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.391481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529556.log 2024-02-19T17:16:20.335 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.195818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205601.log 2024-02-19T17:16:20.336 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.529556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326306.log 2024-02-19T17:16:20.336 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.529556.log.gz 2024-02-19T17:16:20.337 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.205601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342853.log 2024-02-19T17:16:20.338 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.326306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452978.log 2024-02-19T17:16:20.339 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.342853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47401.log 2024-02-19T17:16:20.340 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.452978.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.509269.log.gz 2024-02-19T17:16:20.340 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267523.log 2024-02-19T17:16:20.341 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47401.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.487569.log.gz 2024-02-19T17:16:20.341 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48671.log 2024-02-19T17:16:20.341 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.267523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312673.log 2024-02-19T17:16:20.342 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272600.log 2024-02-19T17:16:20.344 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.505926.log.gz 2024-02-19T17:16:20.344 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213653.log 2024-02-19T17:16:20.344 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.312673.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.510575.log.gz 2024-02-19T17:16:20.344 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.272600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252482.log 2024-02-19T17:16:20.345 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.213653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129464.log 2024-02-19T17:16:20.347 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.252482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247991.log 2024-02-19T17:16:20.347 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.267532.log.gz 2024-02-19T17:16:20.348 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.129464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138355.log 2024-02-19T17:16:20.348 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.305086.log.gz 2024-02-19T17:16:20.348 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.247991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153354.log 2024-02-19T17:16:20.349 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.138355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226605.log 2024-02-19T17:16:20.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.153354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448153.log 2024-02-19T17:16:20.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.226605.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.375745.log.gz 2024-02-19T17:16:20.352 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.217142.log.gz 2024-02-19T17:16:20.352 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233878.log 2024-02-19T17:16:20.353 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.448153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159982.log 2024-02-19T17:16:20.353 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.233878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47915.log 2024-02-19T17:16:20.354 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.264169.log.gz 2024-02-19T17:16:20.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.159982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400150.log 2024-02-19T17:16:20.355 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.264178.log.gz 2024-02-19T17:16:20.356 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47915.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.144436.log.gz 2024-02-19T17:16:20.356 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395420.log 2024-02-19T17:16:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.400150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485007.log 2024-02-19T17:16:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.395420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399684.log 2024-02-19T17:16:20.358 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.485007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411967.log 2024-02-19T17:16:20.359 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.399684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151190.log 2024-02-19T17:16:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.411967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113090.log 2024-02-19T17:16:20.360 INFO:teuthology.orchestra.run.smithi046.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.470229.log.gz 2024-02-19T17:16:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.151190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427101.log 2024-02-19T17:16:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343726.log 2024-02-19T17:16:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.427101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183689.log 2024-02-19T17:16:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.343726.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.323390.log.gz 2024-02-19T17:16:20.363 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211143.log 2024-02-19T17:16:20.364 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.183689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380127.log 2024-02-19T17:16:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.211143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439444.log 2024-02-19T17:16:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.380127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528685.log 2024-02-19T17:16:20.366 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.439444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427514.log 2024-02-19T17:16:20.367 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.528685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455127.log 2024-02-19T17:16:20.368 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.427514.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.450368.log.gz 2024-02-19T17:16:20.368 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283023.log 2024-02-19T17:16:20.369 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.449953.log.gz 2024-02-19T17:16:20.369 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.455127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180704.log 2024-02-19T17:16:20.370 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.528685.log.gz 2024-02-19T17:16:20.370 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.283023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243767.log 2024-02-19T17:16:20.371 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.180704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327186.log 2024-02-19T17:16:20.372 INFO:teuthology.orchestra.run.smithi142.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-02-19T17:16:20.373 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.243767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438552.log 2024-02-19T17:16:20.373 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.327186.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.182392.log.gz 2024-02-19T17:16:20.373 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221967.log 2024-02-19T17:16:20.373 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.186911.log.gz 2024-02-19T17:16:20.374 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.438552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234738.log 2024-02-19T17:16:20.375 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.221967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304669.log 2024-02-19T17:16:20.375 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.234738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539181.log 2024-02-19T17:16:20.376 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.304669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182383.log 2024-02-19T17:16:20.377 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534481.log 2024-02-19T17:16:20.377 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.539181.log.gz 2024-02-19T17:16:20.378 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.182383.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.210726.log.gz 2024-02-19T17:16:20.378 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145752.log 2024-02-19T17:16:20.379 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.534481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352586.log 2024-02-19T17:16:20.380 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.145752.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.534481.log.gz 2024-02-19T17:16:20.380 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.456000.log.gz 2024-02-19T17:16:20.380 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229869.log 2024-02-19T17:16:20.381 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477134.log 2024-02-19T17:16:20.382 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.352586.log: /var/log/ceph/ceph-client.admin.229869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377935.log 2024-02-19T17:16:20.383 INFO:teuthology.orchestra.run.smithi046.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44114.log.gz 2024-02-19T17:16:20.383 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.477134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443376.log 2024-02-19T17:16:20.384 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307609.log 2024-02-19T17:16:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.443376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426437.log 2024-02-19T17:16:20.386 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.307609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209892.log 2024-02-19T17:16:20.386 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.426437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205155.log 2024-02-19T17:16:20.387 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.209892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49127.log 2024-02-19T17:16:20.388 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.506761.log.gz 2024-02-19T17:16:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.205155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189630.log 2024-02-19T17:16:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477967.log 2024-02-19T17:16:20.390 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.189630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130772.log 2024-02-19T17:16:20.391 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.477967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452987.log 2024-02-19T17:16:20.392 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.130772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539054.log 2024-02-19T17:16:20.393 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.452987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381978.log 2024-02-19T17:16:20.393 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305925.log 2024-02-19T17:16:20.394 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.539054.log.gz 2024-02-19T17:16:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.381978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475463.log 2024-02-19T17:16:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.305925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150772.log 2024-02-19T17:16:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.475463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269626.log 2024-02-19T17:16:20.398 INFO:teuthology.orchestra.run.smithi046.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.341092.log.gz 2024-02-19T17:16:20.398 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.384113.log.gz 2024-02-19T17:16:20.398 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.150772.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.384530.log.gz 2024-02-19T17:16:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260584.log 2024-02-19T17:16:20.399 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.384122.log.gz 2024-02-19T17:16:20.399 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.313503.log.gz 85.7% 2024-02-19T17:16:20.399 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.355554.log.gz 2024-02-19T17:16:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.269626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229878.log 2024-02-19T17:16:20.401 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45638.log.gz 2024-02-19T17:16:20.401 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.313512.log.gz 2024-02-19T17:16:20.401 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43550.log.gz 2024-02-19T17:16:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.260584.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.224933.log.gz 2024-02-19T17:16:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507589.log 2024-02-19T17:16:20.401 INFO:teuthology.orchestra.run.smithi046.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.215794.log.gz 2024-02-19T17:16:20.403 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8%/var/log/ceph/ceph-client.admin.229878.log: -- replaced with /var/log/ceph/ceph-client.admin.47401.log.gz 2024-02-19T17:16:20.403 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47915.log.gz 2024-02-19T17:16:20.403 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515084.log 2024-02-19T17:16:20.403 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.507589.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.448153.log.gz 2024-02-19T17:16:20.403 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221373.log 2024-02-19T17:16:20.404 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.515084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152912.log 2024-02-19T17:16:20.405 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.221373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42206.log 2024-02-19T17:16:20.405 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339840.log 2024-02-19T17:16:20.406 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.152912.log: /var/log/ceph/ceph-client.admin.42206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202033.log 2024-02-19T17:16:20.408 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501330.log 2024-02-19T17:16:20.408 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.339840.log: /var/log/ceph/ceph-client.admin.202033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273027.log 2024-02-19T17:16:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.501330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444689.log 2024-02-19T17:16:20.411 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.273027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452527.log 2024-02-19T17:16:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.444689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508433.log 2024-02-19T17:16:20.413 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.452527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163262.log 2024-02-19T17:16:20.414 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.508433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48209.log 2024-02-19T17:16:20.415 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305516.log 2024-02-19T17:16:20.416 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519975.log 2024-02-19T17:16:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.305516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41910.log 2024-02-19T17:16:20.418 INFO:teuthology.orchestra.run.smithi046.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.480107.log.gz 2024-02-19T17:16:20.418 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.519975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219256.log 2024-02-19T17:16:20.420 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41910.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.317437.log.gz 2024-02-19T17:16:20.420 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132494.log 2024-02-19T17:16:20.421 INFO:teuthology.orchestra.run.smithi046.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.438552.log.gz 2024-02-19T17:16:20.421 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.219256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422192.log 2024-02-19T17:16:20.421 INFO:teuthology.orchestra.run.smithi046.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.519975.log.gz 2024-02-19T17:16:20.422 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.132494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487122.log 2024-02-19T17:16:20.423 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.422192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422183.log 2024-02-19T17:16:20.424 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.487122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332715.log 2024-02-19T17:16:20.426 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.422183.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.345437.log.gz 2024-02-19T17:16:20.426 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216684.log 2024-02-19T17:16:20.426 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.477552.log.gz 78.2% 2024-02-19T17:16:20.427 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.343726.log.gz 2024-02-19T17:16:20.427 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.476717.log.gz 2024-02-19T17:16:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.332715.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.422183.log.gz 2024-02-19T17:16:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498635.log 2024-02-19T17:16:20.428 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.216684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110195.log 2024-02-19T17:16:20.429 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.498635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347540.log 2024-02-19T17:16:20.431 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.110195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409423.log 2024-02-19T17:16:20.431 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.347540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224515.log 2024-02-19T17:16:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.409423.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.194968.log.gz 2024-02-19T17:16:20.433 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482375.log 2024-02-19T17:16:20.434 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.252482.log.gz 2024-02-19T17:16:20.434 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.224515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342844.log 2024-02-19T17:16:20.435 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.482375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197577.log 2024-02-19T17:16:20.436 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.342844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250987.log 2024-02-19T17:16:20.437 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.197577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451214.log 2024-02-19T17:16:20.439 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.250987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151613.log 2024-02-19T17:16:20.440 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.451214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186056.log 2024-02-19T17:16:20.440 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.151613.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.506752.log.gz 2024-02-19T17:16:20.441 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.186056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328103.log 2024-02-19T17:16:20.441 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.134590.log.gz 2024-02-19T17:16:20.442 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325055.log 2024-02-19T17:16:20.443 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48671.log.gz 2024-02-19T17:16:20.443 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.328103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150781.log 2024-02-19T17:16:20.445 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135843.log 2024-02-19T17:16:20.445 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.305516.log.gz 2024-02-19T17:16:20.446 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.150781.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.220507.log.gz 2024-02-19T17:16:20.446 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127358.log 2024-02-19T17:16:20.447 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.135843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409414.log 2024-02-19T17:16:20.447 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.209892.log.gz 2024-02-19T17:16:20.448 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.127358.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.257655.log.gz 2024-02-19T17:16:20.448 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263120.log 2024-02-19T17:16:20.449 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325472.log 2024-02-19T17:16:20.450 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.409414.log: /var/log/ceph/ceph-client.admin.263120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315196.log 2024-02-19T17:16:20.451 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.233878.log.gz 2024-02-19T17:16:20.451 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422608.log 2024-02-19T17:16:20.452 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.315196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45806.log 2024-02-19T17:16:20.453 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.269626.log.gz 2024-02-19T17:16:20.453 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.422608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49874.log 2024-02-19T17:16:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309733.log 2024-02-19T17:16:20.456 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537068.log 2024-02-19T17:16:20.457 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.309733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381045.log 2024-02-19T17:16:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.537068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440278.log 2024-02-19T17:16:20.458 INFO:teuthology.orchestra.run.smithi046.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.537068.log.gz 2024-02-19T17:16:20.460 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.381045.log: /var/log/ceph/ceph-client.admin.440278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451666.log 2024-02-19T17:16:20.460 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.398844.log.gz 2024-02-19T17:16:20.461 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.452987.log.gz 2024-02-19T17:16:20.461 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483747.log 2024-02-19T17:16:20.462 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238968.log 2024-02-19T17:16:20.463 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.451666.log: /var/log/ceph/ceph-client.admin.483747.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.145752.log.gz 2024-02-19T17:16:20.464 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128638.log 2024-02-19T17:16:20.464 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.324222.log.gz 2024-02-19T17:16:20.465 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.238968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241536.log 2024-02-19T17:16:20.466 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.128638.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.326306.log.gz 2024-02-19T17:16:20.466 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268366.log 2024-02-19T17:16:20.467 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.241536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502575.log 2024-02-19T17:16:20.467 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.477134.log.gz 2024-02-19T17:16:20.467 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.268366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279448.log 2024-02-19T17:16:20.468 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46702.log.gz 2024-02-19T17:16:20.469 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.502575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48377.log 2024-02-19T17:16:20.470 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.279448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523823.log 2024-02-19T17:16:20.471 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179017.log 2024-02-19T17:16:20.471 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.523823.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.523823.log.gz 2024-02-19T17:16:20.472 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317853.log 2024-02-19T17:16:20.473 INFO:teuthology.orchestra.run.smithi046.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.482819.log.gz 2024-02-19T17:16:20.473 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311829.log 2024-02-19T17:16:20.473 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.427514.log.gz 2024-02-19T17:16:20.474 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.317853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491405.log 2024-02-19T17:16:20.475 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.311829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383682.log 2024-02-19T17:16:20.476 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.491405.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.332285.log.gz 2024-02-19T17:16:20.477 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202919.log 2024-02-19T17:16:20.477 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.332715.log.gz 2024-02-19T17:16:20.478 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.383682.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45806.log.gz 2024-02-19T17:16:20.478 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.332724.log.gz 2024-02-19T17:16:20.478 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403066.log 2024-02-19T17:16:20.479 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.202919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132072.log 2024-02-19T17:16:20.480 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.403066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281753.log 2024-02-19T17:16:20.481 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.132072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304678.log 2024-02-19T17:16:20.482 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.281753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232205.log 2024-02-19T17:16:20.483 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.304678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43676.log 2024-02-19T17:16:20.490 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.232205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387816.log 2024-02-19T17:16:20.490 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43676.log: gzip -5 --verbose 84.1% -- replaced with /var/log/ceph/ceph-client.admin.411967.log.gz 2024-02-19T17:16:20.490 INFO:teuthology.orchestra.run.smithi046.stderr: -- /var/log/ceph/ceph-client.admin.388758.log 2024-02-19T17:16:20.490 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.411559.log.gz 2024-02-19T17:16:20.490 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.216684.log.gz 2024-02-19T17:16:20.490 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.411976.log.gz 2024-02-19T17:16:20.491 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.387816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238131.log 2024-02-19T17:16:20.491 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.388758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273923.log 2024-02-19T17:16:20.491 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.238131.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.311404.log.gz 2024-02-19T17:16:20.491 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526043.log 2024-02-19T17:16:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.273923.log: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.224515.log.gz 2024-02-19T17:16:20.492 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.312673.log.gz 2024-02-19T17:16:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.526043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472028.log 2024-02-19T17:16:20.494 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose 80.7% -- replaced with /var/log/ceph/ceph-client.admin.451666.log.gz 2024-02-19T17:16:20.494 INFO:teuthology.orchestra.run.smithi046.stderr: -- /var/log/ceph/ceph-client.admin.407320.log 2024-02-19T17:16:20.494 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.472028.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.526043.log.gz 2024-02-19T17:16:20.495 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229431.log 2024-02-19T17:16:20.496 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.407320.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.281753.log.gz 2024-02-19T17:16:20.496 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42915.log 2024-02-19T17:16:20.498 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.229431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340257.log 2024-02-19T17:16:20.499 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348021.log 2024-02-19T17:16:20.499 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340257.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45596.log.gz 2024-02-19T17:16:20.499 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.126058.log.gz 2024-02-19T17:16:20.500 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427939.log 2024-02-19T17:16:20.500 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.348021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466779.log 2024-02-19T17:16:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.427939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457410.log 2024-02-19T17:16:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.466779.log: 78.1% 80.7% -- replaced with /var/log/ceph/ceph-client.admin.248405.log.gz 2024-02-19T17:16:20.503 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.248823.log.gz 2024-02-19T17:16:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267115.log 2024-02-19T17:16:20.504 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.248414.log.gz 2024-02-19T17:16:20.504 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.247991.log.gz 2024-02-19T17:16:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.457410.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.271314.log.gz 2024-02-19T17:16:20.505 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47033.log 2024-02-19T17:16:20.505 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.272600.log.gz 2024-02-19T17:16:20.505 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.267115.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.272609.log.gz 2024-02-19T17:16:20.506 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395842.log 2024-02-19T17:16:20.507 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183253.log 2024-02-19T17:16:20.508 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.395842.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.352096.log.gz 2024-02-19T17:16:20.508 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502165.log 2024-02-19T17:16:20.509 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.183253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519550.log 2024-02-19T17:16:20.510 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.502165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43214.log 2024-02-19T17:16:20.511 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.519550.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.135843.log.gz 2024-02-19T17:16:20.512 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43634.log 2024-02-19T17:16:20.513 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43214.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.222375.log.gz 2024-02-19T17:16:20.513 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.519550.log.gz 2024-02-19T17:16:20.513 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229422.log 2024-02-19T17:16:20.514 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179865.log 2024-02-19T17:16:20.515 INFO:teuthology.orchestra.run.smithi046.stderr: 77.5%/var/log/ceph/ceph-client.admin.229422.log: -- replaced with /var/log/ceph/ceph-client.admin.150772.log.gz 2024-02-19T17:16:20.515 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394989.log 2024-02-19T17:16:20.516 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540659.log 2024-02-19T17:16:20.517 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271773.log 2024-02-19T17:16:20.518 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.540659.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.540659.log.gz 2024-02-19T17:16:20.519 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134164.log 2024-02-19T17:16:20.519 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.271773.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.325055.log.gz 2024-02-19T17:16:20.520 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.134164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392330.log 2024-02-19T17:16:20.521 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.325472.log.gz 2024-02-19T17:16:20.521 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220498.log 2024-02-19T17:16:20.522 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.392330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197568.log 2024-02-19T17:16:20.524 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.220498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124889.log 2024-02-19T17:16:20.525 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.197568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471094.log 2024-02-19T17:16:20.526 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.124889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459276.log 2024-02-19T17:16:20.527 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.204264.log.gz 2024-02-19T17:16:20.527 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.471094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472454.log 2024-02-19T17:16:20.528 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.459276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328515.log 2024-02-19T17:16:20.529 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.254710.log.gz 2024-02-19T17:16:20.530 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.472454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522134.log 2024-02-19T17:16:20.531 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.328515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397115.log 2024-02-19T17:16:20.532 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.522134.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.522134.log.gz 2024-02-19T17:16:20.532 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346270.log 2024-02-19T17:16:20.532 INFO:teuthology.orchestra.run.smithi046.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.515535.log.gz 2024-02-19T17:16:20.533 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9%/var/log/ceph/ceph-client.admin.397115.log: -- replaced with /var/log/ceph/ceph-client.admin.112190.log.gz 2024-02-19T17:16:20.533 INFO:teuthology.orchestra.run.smithi046.stderr:gzip 92.9% -- replaced with /var/log/ceph/ceph-client.admin.189144.log.gz 2024-02-19T17:16:20.534 INFO:teuthology.orchestra.run.smithi046.stderr: 80.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.197568.log.gz -- 2024-02-19T17:16:20.534 INFO:teuthology.orchestra.run.smithi046.stderr: /var/log/ceph/ceph-client.admin.42586.log 2024-02-19T17:16:20.534 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.150781.log.gz 2024-02-19T17:16:20.535 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.346270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453404.log 2024-02-19T17:16:20.536 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337494.log 2024-02-19T17:16:20.536 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.242923.log.gz 2024-02-19T17:16:20.537 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.453404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389166.log 2024-02-19T17:16:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.337494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119542.log 2024-02-19T17:16:20.538 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.263111.log.gz 2024-02-19T17:16:20.539 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.389166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482366.log 2024-02-19T17:16:20.540 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.119542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231321.log 2024-02-19T17:16:20.540 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.482366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129900.log 2024-02-19T17:16:20.541 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.231321.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.131235.log.gz 2024-02-19T17:16:20.542 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47317.log 2024-02-19T17:16:20.542 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.331457.log.gz 2024-02-19T17:16:20.542 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.457410.log.gz 2024-02-19T17:16:20.543 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.472028.log.gz 2024-02-19T17:16:20.543 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453395.log 2024-02-19T17:16:20.544 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.129900.log: /var/log/ceph/ceph-client.admin.47317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406475.log 2024-02-19T17:16:20.544 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.128638.log.gz 2024-02-19T17:16:20.545 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.453395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528676.log 2024-02-19T17:16:20.546 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.406475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426040.log 2024-02-19T17:16:20.546 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.267523.log.gz 2024-02-19T17:16:20.547 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.528676.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.528676.log.gz 2024-02-19T17:16:20.547 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133329.log 2024-02-19T17:16:20.548 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.426040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43261.log 2024-02-19T17:16:20.549 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.133329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411133.log 2024-02-19T17:16:20.550 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539097.log 2024-02-19T17:16:20.551 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.411133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469765.log 2024-02-19T17:16:20.552 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322567.log 2024-02-19T17:16:20.553 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.469765.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.539097.log.gz 2024-02-19T17:16:20.554 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539769.log 2024-02-19T17:16:20.554 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.322567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209883.log 2024-02-19T17:16:20.555 INFO:teuthology.orchestra.run.smithi046.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.268366.log.gz 2024-02-19T17:16:20.556 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398835.log 2024-02-19T17:16:20.556 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.539769.log.gz 2024-02-19T17:16:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.209883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456410.log 2024-02-19T17:16:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.398835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212396.log 2024-02-19T17:16:20.559 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377494.log 2024-02-19T17:16:20.559 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.456410.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.387816.log.gz 2024-02-19T17:16:20.560 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.212396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255123.log 2024-02-19T17:16:20.561 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46531.log 2024-02-19T17:16:20.563 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.255123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212815.log 2024-02-19T17:16:20.563 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.151613.log.gz 2024-02-19T17:16:20.563 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188685.log 2024-02-19T17:16:20.564 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.212815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220933.log 2024-02-19T17:16:20.565 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.188685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536628.log 2024-02-19T17:16:20.566 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.220933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540028.log 2024-02-19T17:16:20.567 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.536628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45680.log 2024-02-19T17:16:20.568 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.540028.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.395842.log.gz 2024-02-19T17:16:20.568 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.540028.log.gz 2024-02-19T17:16:20.568 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227939.log 2024-02-19T17:16:20.569 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540616.log 2024-02-19T17:16:20.570 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.227939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475883.log 2024-02-19T17:16:20.571 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.540616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202928.log 2024-02-19T17:16:20.571 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.540616.log.gz 2024-02-19T17:16:20.572 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.475883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348961.log 2024-02-19T17:16:20.572 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.180282.log.gz 2024-02-19T17:16:20.573 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.202928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181112.log 2024-02-19T17:16:20.574 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.348961.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.202024.log.gz 2024-02-19T17:16:20.574 INFO:teuthology.orchestra.run.smithi046.stderr: 84.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424746.log 2024-02-19T17:16:20.575 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.202470.log.gz 2024-02-19T17:16:20.575 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.475883.log.gz 2024-02-19T17:16:20.575 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.181112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126486.log 2024-02-19T17:16:20.576 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.424746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186502.log 2024-02-19T17:16:20.577 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.126486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329778.log 2024-02-19T17:16:20.579 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.186502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327605.log 2024-02-19T17:16:20.579 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.480571.log.gz 2024-02-19T17:16:20.580 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.329778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390616.log 2024-02-19T17:16:20.581 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.260584.log.gz 2024-02-19T17:16:20.581 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.327605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534908.log 2024-02-19T17:16:20.582 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.390616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503002.log 2024-02-19T17:16:20.582 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.534908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185601.log 2024-02-19T17:16:20.583 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.503002.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.534908.log.gz 2024-02-19T17:16:20.584 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474140.log 2024-02-19T17:16:20.585 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.185601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388749.log 2024-02-19T17:16:20.586 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.474140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123946.log 2024-02-19T17:16:20.586 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.388749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219664.log 2024-02-19T17:16:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.123946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46184.log 2024-02-19T17:16:20.588 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.219664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423438.log 2024-02-19T17:16:20.589 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46184.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.155973.log.gz 2024-02-19T17:16:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133747.log 2024-02-19T17:16:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.423438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405602.log 2024-02-19T17:16:20.592 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.133747.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.238131.log.gz 2024-02-19T17:16:20.592 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524291.log 2024-02-19T17:16:20.593 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.405602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2024-02-19T17:16:20.593 INFO:teuthology.orchestra.run.smithi046.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.241536.log.gz 2024-02-19T17:16:20.594 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.524291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379689.log 2024-02-19T17:16:20.594 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.524291.log.gz 2024-02-19T17:16:20.595 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.243767.log.gz 2024-02-19T17:16:20.596 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46226.log 2024-02-19T17:16:20.596 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.271773.log.gz 2024-02-19T17:16:20.596 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.383682.log.gz/var/log/ceph/ceph-client.admin.379689.log: 2024-02-19T17:16:20.597 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113595.log 2024-02-19T17:16:20.598 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402230.log 2024-02-19T17:16:20.599 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160404.log 2024-02-19T17:16:20.599 INFO:teuthology.orchestra.run.smithi046.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.336574.log.gz 2024-02-19T17:16:20.599 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45680.log.gz 2024-02-19T17:16:20.601 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.402230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447309.log 2024-02-19T17:16:20.601 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46226.log.gz 2024-02-19T17:16:20.601 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179026.log 2024-02-19T17:16:20.602 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.447309.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.310987.log.gz 2024-02-19T17:16:20.603 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43261.log.gz 2024-02-19T17:16:20.603 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43214.log.gz 2024-02-19T17:16:20.603 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400562.log 2024-02-19T17:16:20.604 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.179026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504672.log 2024-02-19T17:16:20.604 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43634.log.gz 2024-02-19T17:16:20.605 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.400562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43193.log 2024-02-19T17:16:20.605 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2024-02-19T17:16:20.607 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.504672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317844.log 2024-02-19T17:16:20.608 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320020.log 2024-02-19T17:16:20.608 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.317844.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.226605.log.gz 2024-02-19T17:16:20.609 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118245.log 2024-02-19T17:16:20.609 INFO:teuthology.orchestra.run.smithi046.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.515084.log.gz 2024-02-19T17:16:20.610 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.320020.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.229422.log.gz 2024-02-19T17:16:20.610 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240232.log 2024-02-19T17:16:20.611 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.118245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518624.log 2024-02-19T17:16:20.612 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.240232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270451.log 2024-02-19T17:16:20.613 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.518624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409841.log 2024-02-19T17:16:20.613 INFO:teuthology.orchestra.run.smithi046.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.518624.log.gz 2024-02-19T17:16:20.614 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.270451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308874.log 2024-02-19T17:16:20.615 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.409841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469357.log 2024-02-19T17:16:20.616 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.308874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492617.log 2024-02-19T17:16:20.617 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.469357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426446.log 2024-02-19T17:16:20.618 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.492617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315187.log 2024-02-19T17:16:20.618 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.426446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307192.log 2024-02-19T17:16:20.619 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.315187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509717.log 2024-02-19T17:16:20.621 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.307192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118236.log 2024-02-19T17:16:20.621 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.266281.log.gz 2024-02-19T17:16:20.622 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.509717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423888.log 2024-02-19T17:16:20.622 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.402230.log.gz 2024-02-19T17:16:20.623 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47317.log.gz 2024-02-19T17:16:20.623 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48167.log.gz 2024-02-19T17:16:20.623 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.118236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523406.log 2024-02-19T17:16:20.624 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.423888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345446.log 2024-02-19T17:16:20.624 INFO:teuthology.orchestra.run.smithi046.stderr: 83.4%/var/log/ceph/ceph-client.admin.523406.log: -- replaced with /var/log/ceph/ceph-client.admin.391027.log.gz 2024-02-19T17:16:20.625 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.523406.log.gz 2024-02-19T17:16:20.625 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133338.log 2024-02-19T17:16:20.625 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.390616.log.gz 2024-02-19T17:16:20.626 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.345446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519117.log 2024-02-19T17:16:20.627 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.133338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180273.log 2024-02-19T17:16:20.627 INFO:teuthology.orchestra.run.smithi046.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.219664.log.gz 2024-02-19T17:16:20.628 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.519117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256815.log 2024-02-19T17:16:20.628 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.219256.log.gz 2024-02-19T17:16:20.629 INFO:teuthology.orchestra.run.smithi046.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.320020.log.gz 2024-02-19T17:16:20.629 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.519117.log.gz 2024-02-19T17:16:20.629 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.180273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273463.log 2024-02-19T17:16:20.630 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.256815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445569.log 2024-02-19T17:16:20.631 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.328515.log.gz 2024-02-19T17:16:20.631 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.273463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235991.log 2024-02-19T17:16:20.632 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.445569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307183.log 2024-02-19T17:16:20.633 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.345446.log.gz 2024-02-19T17:16:20.633 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.235991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460337.log 2024-02-19T17:16:20.633 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.348961.log.gz 2024-02-19T17:16:20.634 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.307183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357477.log 2024-02-19T17:16:20.635 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.460337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397989.log 2024-02-19T17:16:20.636 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.357477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329351.log 2024-02-19T17:16:20.636 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.255123.log.gz 2024-02-19T17:16:20.637 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.397989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194105.log 2024-02-19T17:16:20.637 INFO:teuthology.orchestra.run.smithi046.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.411133.log.gz 2024-02-19T17:16:20.638 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.427092.log.gz 2024-02-19T17:16:20.638 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.329351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135425.log 2024-02-19T17:16:20.639 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.194105.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-19T17:16:20.640 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.135425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474557.log 2024-02-19T17:16:20.641 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.audit.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.406475.log.gz 2024-02-19T17:16:20.641 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395411.log 2024-02-19T17:16:20.642 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.474557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314765.log 2024-02-19T17:16:20.643 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.395411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48713.log 2024-02-19T17:16:20.643 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.409841.log.gz 2024-02-19T17:16:20.644 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.314765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44636.log 2024-02-19T17:16:20.645 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48713.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.451214.log.gz 2024-02-19T17:16:20.645 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337975.log 2024-02-19T17:16:20.646 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.118245.log.gz 2024-02-19T17:16:20.646 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.44636.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.113595.log.gz 2024-02-19T17:16:20.646 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156424.log 2024-02-19T17:16:20.647 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.337975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403488.log 2024-02-19T17:16:20.648 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41397.log.gz 2024-02-19T17:16:20.648 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156424.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.234320.log.gz 2024-02-19T17:16:20.648 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250996.log 2024-02-19T17:16:20.650 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.403488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198022.log 2024-02-19T17:16:20.651 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.250996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513303.log 2024-02-19T17:16:20.652 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.198022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181956.log 2024-02-19T17:16:20.652 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46865.log.gz 2024-02-19T17:16:20.652 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.513303.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.304669.log.gz 2024-02-19T17:16:20.653 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188227.log 2024-02-19T17:16:20.653 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.181956.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.513303.log.gz 2024-02-19T17:16:20.654 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268784.log 2024-02-19T17:16:20.655 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.188227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41954.log 2024-02-19T17:16:20.655 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.268784.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.129900.log.gz 2024-02-19T17:16:20.656 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109340.log 2024-02-19T17:16:20.656 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154197.log 2024-02-19T17:16:20.657 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.389166.log.gz 2024-02-19T17:16:20.657 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485426.log 2024-02-19T17:16:20.658 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.395411.log.gz 2024-02-19T17:16:20.659 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.154197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153779.log 2024-02-19T17:16:20.660 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.485426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463018.log 2024-02-19T17:16:20.660 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.153779.log: 89.9% 80.6% -- replaced with /var/log/ceph/ceph-client.admin.397989.log.gz 2024-02-19T17:16:20.661 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.395420.log.gz 2024-02-19T17:16:20.661 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.456410.log.gz 2024-02-19T17:16:20.661 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.235991.log.gz 2024-02-19T17:16:20.661 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132063.log 2024-02-19T17:16:20.662 INFO:teuthology.orchestra.run.smithi046.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.183689.log.gz 2024-02-19T17:16:20.662 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.463018.log: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.185601.log.gz 2024-02-19T17:16:20.662 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206048.log 2024-02-19T17:16:20.663 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.186502.log.gz 2024-02-19T17:16:20.663 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.132063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440695.log 2024-02-19T17:16:20.664 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.206048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382820.log 2024-02-19T17:16:20.665 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.440695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264613.log 2024-02-19T17:16:20.666 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.382820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198458.log 2024-02-19T17:16:20.667 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.152921.log.gz 2024-02-19T17:16:20.667 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.264613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249663.log 2024-02-19T17:16:20.668 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.198458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271764.log 2024-02-19T17:16:20.668 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47831.log 2024-02-19T17:16:20.669 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.249663.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.181956.log.gz 2024-02-19T17:16:20.669 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.159982.log.gz 2024-02-19T17:16:20.670 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.271764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510147.log 2024-02-19T17:16:20.670 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49085.log 2024-02-19T17:16:20.671 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.510147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118653.log 2024-02-19T17:16:20.672 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233887.log 2024-02-19T17:16:20.673 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.118653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477125.log 2024-02-19T17:16:20.673 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.233887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161035.log 2024-02-19T17:16:20.674 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.477125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467253.log 2024-02-19T17:16:20.675 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528244.log 2024-02-19T17:16:20.676 INFO:teuthology.orchestra.run.smithi046.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.423888.log.gz 2024-02-19T17:16:20.676 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.467253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484590.log 2024-02-19T17:16:20.677 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.528244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42122.log 2024-02-19T17:16:20.678 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.179017.log.gz 2024-02-19T17:16:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161494.log 2024-02-19T17:16:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.484590.log: 90.0% 84.1% -- replaced with /var/log/ceph/ceph-client.admin.179026.log.gz 2024-02-19T17:16:20.679 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.447309.log.gz 2024-02-19T17:16:20.680 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399252.log 2024-02-19T17:16:20.681 INFO:teuthology.orchestra.run.smithi046.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.528244.log.gz 2024-02-19T17:16:20.681 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404334.log 2024-02-19T17:16:20.681 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.161494.log: /var/log/ceph/ceph-client.admin.399252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341552.log 2024-02-19T17:16:20.682 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.404334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513721.log 2024-02-19T17:16:20.683 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.341552.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.307183.log.gz 2024-02-19T17:16:20.684 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308031.log 2024-02-19T17:16:20.684 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.307192.log.gz 2024-02-19T17:16:20.685 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.513721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244176.log 2024-02-19T17:16:20.686 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.308031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141859.log 2024-02-19T17:16:20.687 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.244176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252073.log 2024-02-19T17:16:20.687 INFO:teuthology.orchestra.run.smithi046.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.513721.log.gz 2024-02-19T17:16:20.688 INFO:teuthology.orchestra.run.smithi046.stderr: 83.4%/var/log/ceph/ceph-client.admin.141859.log: -- replaced with /var/log/ceph/ceph-client.admin.327605.log.gz 2024-02-19T17:16:20.688 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228499.log 2024-02-19T17:16:20.689 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.252073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326736.log 2024-02-19T17:16:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.228499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188218.log 2024-02-19T17:16:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.326736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446464.log 2024-02-19T17:16:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.188218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283856.log 2024-02-19T17:16:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.446464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47485.log 2024-02-19T17:16:20.693 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.283856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46016.log 2024-02-19T17:16:20.694 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310565.log 2024-02-19T17:16:20.695 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42374.log 2024-02-19T17:16:20.695 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.310565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245081.log 2024-02-19T17:16:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255545.log 2024-02-19T17:16:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.245081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500912.log 2024-02-19T17:16:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.255545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182799.log 2024-02-19T17:16:20.698 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.500912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446018.log 2024-02-19T17:16:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.182799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445161.log 2024-02-19T17:16:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.446018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218007.log 2024-02-19T17:16:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.445161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532646.log 2024-02-19T17:16:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.218007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211968.log 2024-02-19T17:16:20.702 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.532646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426031.log 2024-02-19T17:16:20.703 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.211968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328524.log 2024-02-19T17:16:20.704 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.426031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210300.log 2024-02-19T17:16:20.705 INFO:teuthology.orchestra.run.smithi046.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.532646.log.gz 2024-02-19T17:16:20.705 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.328524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251618.log 2024-02-19T17:16:20.706 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.210300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335740.log 2024-02-19T17:16:20.707 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.251618.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.426316.log.gz 2024-02-19T17:16:20.708 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384539.log 2024-02-19T17:16:20.709 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.335740.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.426446.log.gz 2024-02-19T17:16:20.709 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.463018.log.gz 2024-02-19T17:16:20.709 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356045.log 2024-02-19T17:16:20.709 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441104.log 2024-02-19T17:16:20.711 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.384539.log: /var/log/ceph/ceph-client.admin.356045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233050.log 2024-02-19T17:16:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.441104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405611.log 2024-02-19T17:16:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.233050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318768.log 2024-02-19T17:16:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.405611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331876.log 2024-02-19T17:16:20.714 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.318768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228974.log 2024-02-19T17:16:20.715 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.331876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271323.log 2024-02-19T17:16:20.716 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.228974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423447.log 2024-02-19T17:16:20.717 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.271323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348970.log 2024-02-19T17:16:20.717 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.381978.log.gz 2024-02-19T17:16:20.718 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.423447.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.445569.log.gz 2024-02-19T17:16:20.718 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279882.log 2024-02-19T17:16:20.718 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.446018.log.gz 2024-02-19T17:16:20.719 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.382820.log.gz 2024-02-19T17:16:20.719 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.348970.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.446464.log.gz 2024-02-19T17:16:20.719 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150230.log 2024-02-19T17:16:20.720 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.279882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479656.log 2024-02-19T17:16:20.721 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.150230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449944.log 2024-02-19T17:16:20.722 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425171.log 2024-02-19T17:16:20.723 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.479656.log: /var/log/ceph/ceph-client.admin.449944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272182.log 2024-02-19T17:16:20.724 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43218.log 2024-02-19T17:16:20.725 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.425171.log: /var/log/ceph/ceph-client.admin.272182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143574.log 2024-02-19T17:16:20.726 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539010.log 2024-02-19T17:16:20.728 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522561.log 2024-02-19T17:16:20.728 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539010.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.539010.log.gz 2024-02-19T17:16:20.728 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399675.log 2024-02-19T17:16:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.522561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251627.log 2024-02-19T17:16:20.730 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.399675.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.522561.log.gz 2024-02-19T17:16:20.730 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402239.log 2024-02-19T17:16:20.731 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.251627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187365.log 2024-02-19T17:16:20.732 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.402239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140041.log 2024-02-19T17:16:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.187365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406466.log 2024-02-19T17:16:20.734 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.443376.log.gz 2024-02-19T17:16:20.734 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.140041.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.221967.log.gz 2024-02-19T17:16:20.734 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346279.log 2024-02-19T17:16:20.735 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.406466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333145.log 2024-02-19T17:16:20.736 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.346279.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.453395.log.gz 2024-02-19T17:16:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253325.log 2024-02-19T17:16:20.737 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.453404.log.gz 2024-02-19T17:16:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.333145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163565.log 2024-02-19T17:16:20.738 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.253325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145266.log 2024-02-19T17:16:20.739 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442884.log 2024-02-19T17:16:20.740 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.145266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259331.log 2024-02-19T17:16:20.740 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.442884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46268.log 2024-02-19T17:16:20.741 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.259331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442410.log 2024-02-19T17:16:20.742 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266689.log 2024-02-19T17:16:20.743 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.403488.log.gz 2024-02-19T17:16:20.743 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.442410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379680.log 2024-02-19T17:16:20.744 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.266689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43928.log 2024-02-19T17:16:20.745 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.379680.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.130314.log 2024-02-19T17:16:20.746 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186047.log 2024-02-19T17:16:20.747 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49085.log.gz 2024-02-19T17:16:20.747 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49127.log.gz 2024-02-19T17:16:20.748 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.130314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141385.log 2024-02-19T17:16:20.748 INFO:teuthology.orchestra.run.smithi046.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.118236.log.gz 2024-02-19T17:16:20.749 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.186047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224943.log 2024-02-19T17:16:20.750 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.141385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463445.log 2024-02-19T17:16:20.751 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.224943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481403.log 2024-02-19T17:16:20.753 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.463445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252908.log 2024-02-19T17:16:20.753 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.481403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196254.log 2024-02-19T17:16:20.754 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.252908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383673.log 2024-02-19T17:16:20.755 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.196254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350288.log 2024-02-19T17:16:20.756 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.383673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217133.log 2024-02-19T17:16:20.757 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118662.log 2024-02-19T17:16:20.757 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.350288.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.466779.log.gz 2024-02-19T17:16:20.758 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.217133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49443.log 2024-02-19T17:16:20.759 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.118662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270877.log 2024-02-19T17:16:20.759 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223626.log 2024-02-19T17:16:20.760 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.270877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262272.log 2024-02-19T17:16:20.761 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.223626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393152.log 2024-02-19T17:16:20.761 INFO:teuthology.orchestra.run.smithi046.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.454229.log.gz 2024-02-19T17:16:20.762 INFO:teuthology.orchestra.run.smithi046.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.455127.log.gz 2024-02-19T17:16:20.762 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.262272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45722.log 2024-02-19T17:16:20.763 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.454655.log.gz 2024-02-19T17:16:20.763 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.393152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145275.log 2024-02-19T17:16:20.764 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448571.log 2024-02-19T17:16:20.765 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.145275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530866.log 2024-02-19T17:16:20.766 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.448571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224098.log 2024-02-19T17:16:20.767 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.530866.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.530866.log.gz 2024-02-19T17:16:20.767 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46907.log 2024-02-19T17:16:20.767 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.224098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532198.log 2024-02-19T17:16:20.768 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462546.log 2024-02-19T17:16:20.770 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.532198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235574.log 2024-02-19T17:16:20.771 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.462546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495046.log 2024-02-19T17:16:20.771 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.235574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355563.log 2024-02-19T17:16:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.495046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306343.log 2024-02-19T17:16:20.773 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.532198.log.gz 2024-02-19T17:16:20.774 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.355563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463927.log 2024-02-19T17:16:20.775 INFO:teuthology.orchestra.run.smithi046.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.268784.log.gz 2024-02-19T17:16:20.775 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.306343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207780.log 2024-02-19T17:16:20.775 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.463927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211134.log 2024-02-19T17:16:20.777 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.207780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511977.log 2024-02-19T17:16:20.777 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.346279.log.gz 2024-02-19T17:16:20.778 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.211134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396255.log 2024-02-19T17:16:20.779 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.511977.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.220942.log.gz 2024-02-19T17:16:20.779 INFO:teuthology.orchestra.run.smithi046.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.342853.log.gz 2024-02-19T17:16:20.780 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.396255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319612.log 2024-02-19T17:16:20.780 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.348970.log.gz 2024-02-19T17:16:20.780 INFO:teuthology.orchestra.run.smithi046.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.511977.log.gz 2024-02-19T17:16:20.781 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305934.log 2024-02-19T17:16:20.781 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.427523.log.gz 2024-02-19T17:16:20.782 INFO:teuthology.orchestra.run.smithi046.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.536628.log.gz 2024-02-19T17:16:20.782 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.319612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455136.log 2024-02-19T17:16:20.783 INFO:teuthology.orchestra.run.smithi046.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.487122.log.gz 2024-02-19T17:16:20.783 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.152912.log.gz 2024-02-19T17:16:20.783 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.305934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218415.log 2024-02-19T17:16:20.784 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.455136.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.153779.log.gz 2024-02-19T17:16:20.784 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.154197.log.gz 2024-02-19T17:16:20.785 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262281.log 2024-02-19T17:16:20.785 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.341552.log.gz 2024-02-19T17:16:20.785 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.218415.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.305934.log.gz 2024-02-19T17:16:20.786 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142743.log 2024-02-19T17:16:20.786 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.262281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486708.log 2024-02-19T17:16:20.788 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.142743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398422.log 2024-02-19T17:16:20.788 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48293.log 2024-02-19T17:16:20.789 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.486708.log: /var/log/ceph/ceph-client.admin.398422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480116.log 2024-02-19T17:16:20.790 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233041.log 2024-02-19T17:16:20.791 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.480116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465517.log 2024-02-19T17:16:20.792 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.233041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215803.log 2024-02-19T17:16:20.793 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.465517.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.396255.log.gz 2024-02-19T17:16:20.793 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131645.log 2024-02-19T17:16:20.794 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.186047.log.gz 2024-02-19T17:16:20.795 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.215803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134581.log 2024-02-19T17:16:20.795 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.130314.log.gz 2024-02-19T17:16:20.795 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.131645.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.211134.log.gz 2024-02-19T17:16:20.799 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259753.log 2024-02-19T17:16:20.801 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.134581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500903.log 2024-02-19T17:16:20.801 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.335740.log.gz 2024-02-19T17:16:20.801 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.259753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536173.log 2024-02-19T17:16:20.802 INFO:teuthology.orchestra.run.smithi046.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.161035.log.gz 2024-02-19T17:16:20.802 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.500903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142279.log 2024-02-19T17:16:20.802 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.536173.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.536173.log.gz 2024-02-19T17:16:20.802 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243349.log 2024-02-19T17:16:20.802 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.307609.log.gz 2024-02-19T17:16:20.803 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.142279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377944.log 2024-02-19T17:16:20.803 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.243349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318360.log 2024-02-19T17:16:20.804 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.377944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160395.log 2024-02-19T17:16:20.804 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.318360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48461.log 2024-02-19T17:16:20.805 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.160395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357486.log 2024-02-19T17:16:20.806 INFO:teuthology.orchestra.run.smithi046.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.329351.log.gz 2024-02-19T17:16:20.807 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45974.log 2024-02-19T17:16:20.807 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.357486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235156.log 2024-02-19T17:16:20.808 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109757.log 2024-02-19T17:16:20.809 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.235156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484581.log 2024-02-19T17:16:20.810 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465526.log 2024-02-19T17:16:20.811 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.484581.log: gzip -5 --verbose 89.9% -- /var/log/ceph/ceph-client.admin.311413.log -- replaced with /var/log/ceph/ceph-client.admin.400150.log.gz 2024-02-19T17:16:20.811 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:20.812 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.465526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463436.log 2024-02-19T17:16:20.812 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.384539.log.gz 2024-02-19T17:16:20.813 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.311413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505917.log 2024-02-19T17:16:20.813 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.143574.log.gz 2024-02-19T17:16:20.813 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.463436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477543.log 2024-02-19T17:16:20.815 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.505917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449403.log 2024-02-19T17:16:20.816 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.477543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48335.log 2024-02-19T17:16:20.817 INFO:teuthology.orchestra.run.smithi142.stderr: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-19T17:16:20.817 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41954.log.gz 2024-02-19T17:16:20.818 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41910.log.gz 2024-02-19T17:16:20.818 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42122.log.gz 2024-02-19T17:16:20.818 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.449403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243340.log 2024-02-19T17:16:20.818 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262703.log 2024-02-19T17:16:20.819 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.455136.log.gz 2024-02-19T17:16:20.819 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.243340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147019.log 2024-02-19T17:16:20.820 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.262703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327614.log 2024-02-19T17:16:20.821 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.147019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309724.log 2024-02-19T17:16:20.822 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.327614.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.256815.log.gz 2024-02-19T17:16:20.822 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478399.log 2024-02-19T17:16:20.823 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.309724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525161.log 2024-02-19T17:16:20.824 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.478399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202479.log 2024-02-19T17:16:20.825 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.525161.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.314765.log.gz 2024-02-19T17:16:20.826 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231788.log 2024-02-19T17:16:20.826 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.202479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45276.log 2024-02-19T17:16:20.827 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.231788.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.525161.log.gz 2024-02-19T17:16:20.828 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468090.log 2024-02-19T17:16:20.829 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424334.log 2024-02-19T17:16:20.829 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.468090.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.484590.log.gz 2024-02-19T17:16:20.830 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526923.log 2024-02-19T17:16:20.831 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459872.log 2024-02-19T17:16:20.832 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.424334.log: /var/log/ceph/ceph-client.admin.526923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450377.log 2024-02-19T17:16:20.833 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.459872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50267.log 2024-02-19T17:16:20.834 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.450377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378854.log 2024-02-19T17:16:20.835 INFO:teuthology.orchestra.run.smithi046.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.441104.log.gz 2024-02-19T17:16:20.835 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.526923.log.gz 2024-02-19T17:16:20.835 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.442401.log.gz 2024-02-19T17:16:20.835 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.50267.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.440278.log.gz 2024-02-19T17:16:20.835 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250549.log 2024-02-19T17:16:20.836 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.457884.log.gz 2024-02-19T17:16:20.836 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.442410.log.gz 2024-02-19T17:16:20.837 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.378854.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.442893.log.gz 2024-02-19T17:16:20.837 INFO:teuthology.orchestra.run.smithi046.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.458850.log.gz 2024-02-19T17:16:20.837 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486699.log 2024-02-19T17:16:20.838 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.465517.log.gz 2024-02-19T17:16:20.838 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.250549.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.224098.log.gz 2024-02-19T17:16:20.838 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.223626.log.gz 2024-02-19T17:16:20.838 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.238968.log.gz 2024-02-19T17:16:20.838 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475874.log 2024-02-19T17:16:20.838 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.266689.log.gz 2024-02-19T17:16:20.839 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.486699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331040.log 2024-02-19T17:16:20.840 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48125.log.gz 2024-02-19T17:16:20.840 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48293.log.gz 88.5% 2024-02-19T17:16:20.840 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48335.log.gz 2024-02-19T17:16:20.841 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.131645.log.gz 2024-02-19T17:16:20.841 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48461.log.gz 2024-02-19T17:16:20.841 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48916.log.gz 2024-02-19T17:16:20.841 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.475874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344151.log 2024-02-19T17:16:20.842 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.331040.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.319612.log.gz 2024-02-19T17:16:20.842 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386667.log 2024-02-19T17:16:20.843 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.344151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47075.log 2024-02-19T17:16:20.843 INFO:teuthology.orchestra.run.smithi046.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.342844.log.gz 2024-02-19T17:16:20.843 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.323815.log.gz 2024-02-19T17:16:20.844 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.386667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391036.log 2024-02-19T17:16:20.845 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45512.log 2024-02-19T17:16:20.846 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.391036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398413.log 2024-02-19T17:16:20.847 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228508.log 2024-02-19T17:16:20.848 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.398413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342391.log 2024-02-19T17:16:20.848 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.228508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129055.log 2024-02-19T17:16:20.849 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.342391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534033.log 2024-02-19T17:16:20.850 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.129055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464926.log 2024-02-19T17:16:20.851 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.534033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253743.log 2024-02-19T17:16:20.852 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.464926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381987.log 2024-02-19T17:16:20.853 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.253743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237302.log 2024-02-19T17:16:20.853 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.500903.log.gz 2024-02-19T17:16:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.381987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382394.log 2024-02-19T17:16:20.854 INFO:teuthology.orchestra.run.smithi046.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.134581.log.gz 2024-02-19T17:16:20.854 INFO:teuthology.orchestra.run.smithi046.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.112636.log.gz 2024-02-19T17:16:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.237302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250080.log 2024-02-19T17:16:20.855 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.142734.log.gz 2024-02-19T17:16:20.856 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.382394.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.142743.log.gz 2024-02-19T17:16:20.856 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408163.log 2024-02-19T17:16:20.857 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.486699.log.gz 2024-02-19T17:16:20.858 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.250080.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.534033.log.gz 2024-02-19T17:16:20.858 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146597.log 2024-02-19T17:16:20.858 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.408163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41866.log 2024-02-19T17:16:20.859 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.146597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45428.log 2024-02-19T17:16:20.860 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476300.log 2024-02-19T17:16:20.861 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.233041.log.gz 2024-02-19T17:16:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45428.log: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.243340.log.gz 2024-02-19T17:16:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111213.log 2024-02-19T17:16:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.476300.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.262272.log.gz 2024-02-19T17:16:20.863 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410258.log 2024-02-19T17:16:20.863 INFO:teuthology.orchestra.run.smithi046.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.188227.log.gz 2024-02-19T17:16:20.863 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111213.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.262281.log.gz 2024-02-19T17:16:20.864 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308022.log 2024-02-19T17:16:20.864 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.388758.log.gz 2024-02-19T17:16:20.865 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.410258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539818.log 2024-02-19T17:16:20.865 INFO:teuthology.orchestra.run.smithi046.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.250549.log.gz 2024-02-19T17:16:20.866 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.308022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227022.log 2024-02-19T17:16:20.867 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535337.log 2024-02-19T17:16:20.868 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.539818.log.gz 2024-02-19T17:16:20.868 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.458376.log.gz 2024-02-19T17:16:20.868 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.227022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393005.log 2024-02-19T17:16:20.869 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.464926.log.gz 2024-02-19T17:16:20.870 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.535337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493753.log 2024-02-19T17:16:20.871 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.535337.log.gz 2024-02-19T17:16:20.871 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.393005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504254.log 2024-02-19T17:16:20.871 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.465526.log.gz 2024-02-19T17:16:20.872 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.493753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252064.log 2024-02-19T17:16:20.873 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.504254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41478.log 2024-02-19T17:16:20.874 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.252064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42598.log 2024-02-19T17:16:20.875 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450785.log 2024-02-19T17:16:20.876 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.132072.log.gz 2024-02-19T17:16:20.876 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325064.log 2024-02-19T17:16:20.877 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.450785.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46991.log.gz 2024-02-19T17:16:20.877 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465934.log 2024-02-19T17:16:20.878 INFO:teuthology.orchestra.run.smithi046.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.475874.log.gz 2024-02-19T17:16:20.879 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441534.log 2024-02-19T17:16:20.879 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.476300.log.gz 2024-02-19T17:16:20.880 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.465934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540532.log 2024-02-19T17:16:20.880 INFO:teuthology.orchestra.run.smithi046.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.356045.log.gz 2024-02-19T17:16:20.880 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.383673.log.gz 2024-02-19T17:16:20.880 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.449403.log.gz 2024-02-19T17:16:20.881 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.441534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49748.log 2024-02-19T17:16:20.881 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.450785.log.gz 2024-02-19T17:16:20.882 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.450377.log.gz 2024-02-19T17:16:20.882 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.540532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533107.log 2024-02-19T17:16:20.883 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.540532.log.gz 2024-02-19T17:16:20.883 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49748.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.232205.log.gz 2024-02-19T17:16:20.883 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-19T17:16:20.884 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.533107.log: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.533107.log.gz 2024-02-19T17:16:20.884 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535754.log 2024-02-19T17:16:20.885 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266272.log 2024-02-19T17:16:20.886 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.535754.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.535754.log.gz 2024-02-19T17:16:20.886 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109766.log 2024-02-19T17:16:20.887 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.266272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219247.log 2024-02-19T17:16:20.888 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540280.log 2024-02-19T17:16:20.889 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.219247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49229.log 2024-02-19T17:16:20.890 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.540280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281344.log 2024-02-19T17:16:20.890 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.540280.log.gz 2024-02-19T17:16:20.891 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245072.log 2024-02-19T17:16:20.892 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.281344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511968.log 2024-02-19T17:16:20.893 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.245072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406893.log 2024-02-19T17:16:20.894 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.511968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534899.log 2024-02-19T17:16:20.894 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.511968.log.gz 2024-02-19T17:16:20.895 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.406893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383251.log 2024-02-19T17:16:20.896 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.534899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279439.log 2024-02-19T17:16:20.896 INFO:teuthology.orchestra.run.smithi046.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.534899.log.gz 2024-02-19T17:16:20.897 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.383251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352105.log 2024-02-19T17:16:20.898 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.279439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478822.log 2024-02-19T17:16:20.898 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.352105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326315.log 2024-02-19T17:16:20.899 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.478822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49355.log 2024-02-19T17:16:20.900 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.439852.log.gz 2024-02-19T17:16:20.900 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.326315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377081.log 2024-02-19T17:16:20.901 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427930.log 2024-02-19T17:16:20.902 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49355.log: /var/log/ceph/ceph-client.admin.377081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46787.log 2024-02-19T17:16:20.903 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.427930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343735.log 2024-02-19T17:16:20.903 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483333.log 2024-02-19T17:16:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224107.log 2024-02-19T17:16:20.905 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.343735.log: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.109757.log.gz 2024-02-19T17:16:20.906 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.483333.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.537564.log 2024-02-19T17:16:20.906 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43676.log.gz 2024-02-19T17:16:20.907 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.224107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257646.log 2024-02-19T17:16:20.907 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.537564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500484.log 2024-02-19T17:16:20.908 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.537564.log.gz 2024-02-19T17:16:20.908 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.257646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510138.log 2024-02-19T17:16:20.909 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.500484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472037.log 2024-02-19T17:16:20.910 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.510138.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.219247.log.gz 2024-02-19T17:16:20.911 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164238.log 2024-02-19T17:16:20.912 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.472037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444698.log 2024-02-19T17:16:20.913 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41478.log.gz 2024-02-19T17:16:20.913 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.164238.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.220081.log.gz 2024-02-19T17:16:20.913 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466352.log 2024-02-19T17:16:20.914 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.444698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513294.log 2024-02-19T17:16:20.915 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.237302.log.gz 2024-02-19T17:16:20.916 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.466352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120386.log 2024-02-19T17:16:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.513294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184259.log 2024-02-19T17:16:20.918 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.254701.log.gz 2024-02-19T17:16:20.918 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.513294.log.gz 2024-02-19T17:16:20.918 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48377.log.gz 2024-02-19T17:16:20.918 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49229.log.gz 2024-02-19T17:16:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.120386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45554.log 2024-02-19T17:16:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.184259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205592.log 2024-02-19T17:16:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495037.log 2024-02-19T17:16:20.922 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.205592.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.423016.log.gz 2024-02-19T17:16:20.922 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517724.log 2024-02-19T17:16:20.923 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.495037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236000.log 2024-02-19T17:16:20.924 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.517724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505090.log 2024-02-19T17:16:20.924 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.517724.log.gz 2024-02-19T17:16:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.236000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448144.log 2024-02-19T17:16:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.505090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256806.log 2024-02-19T17:16:20.927 INFO:teuthology.orchestra.run.smithi046.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.164238.log.gz 2024-02-19T17:16:20.927 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.325064.log.gz 2024-02-19T17:16:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.448144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478390.log 2024-02-19T17:16:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.256806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151199.log 2024-02-19T17:16:20.929 INFO:teuthology.orchestra.run.smithi046.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.344151.log.gz 2024-02-19T17:16:20.929 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.377944.log.gz 2024-02-19T17:16:20.930 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.343735.log.gz 2024-02-19T17:16:20.930 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.478390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529996.log 2024-02-19T17:16:20.931 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.408163.log.gz 2024-02-19T17:16:20.931 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.151199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227031.log 2024-02-19T17:16:20.931 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45276.log.gz 2024-02-19T17:16:20.932 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.529996.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45428.log.gz 2024-02-19T17:16:20.932 INFO:teuthology.orchestra.run.smithi046.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.529996.log.gz 2024-02-19T17:16:20.933 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325889.log 2024-02-19T17:16:20.933 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45974.log.gz 2024-02-19T17:16:20.933 INFO:teuthology.orchestra.run.smithi046.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.500484.log.gz 2024-02-19T17:16:20.934 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.410258.log.gz/var/log/ceph/ceph-client.admin.227031.log: 2024-02-19T17:16:20.934 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136261.log 2024-02-19T17:16:20.934 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325889.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.143151.log.gz 2024-02-19T17:16:20.935 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152462.log 2024-02-19T17:16:20.936 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.136261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488909.log 2024-02-19T17:16:20.937 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.152462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208197.log 2024-02-19T17:16:20.938 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.488909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345011.log 2024-02-19T17:16:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.208197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190062.log 2024-02-19T17:16:20.940 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.345011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42921.log 2024-02-19T17:16:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.190062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249255.log 2024-02-19T17:16:20.942 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.236000.log.gz 2024-02-19T17:16:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42921.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.327614.log.gz 2024-02-19T17:16:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346696.log 2024-02-19T17:16:20.943 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48713.log.gz 2024-02-19T17:16:20.943 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.304678.log.gz 2024-02-19T17:16:20.944 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.249255.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.472037.log.gz 2024-02-19T17:16:20.944 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539265.log 2024-02-19T17:16:20.944 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43844.log.gz 2024-02-19T17:16:20.945 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.270034.log.gz 2024-02-19T17:16:20.945 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.441534.log.gz 2024-02-19T17:16:20.946 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.474140.log.gz 2024-02-19T17:16:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.346696.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.465934.log.gz 2024-02-19T17:16:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387807.log 2024-02-19T17:16:20.946 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.181543.log.gz 2024-02-19T17:16:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212387.log 2024-02-19T17:16:20.947 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.539265.log.gz 2024-02-19T17:16:20.948 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.261006.log.gz 2024-02-19T17:16:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.387807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238140.log 2024-02-19T17:16:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.212387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521662.log 2024-02-19T17:16:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.238140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516873.log 2024-02-19T17:16:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.521662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324638.log 2024-02-19T17:16:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.516873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540490.log 2024-02-19T17:16:20.951 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.516873.log.gz 2024-02-19T17:16:20.952 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.324638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487578.log 2024-02-19T17:16:20.952 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.190053.log.gz 2024-02-19T17:16:20.953 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.540490.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.540490.log.gz -5 2024-02-19T17:16:20.953 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.306770.log 2024-02-19T17:16:20.953 INFO:teuthology.orchestra.run.smithi046.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.521662.log.gz 2024-02-19T17:16:20.954 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.487578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186920.log 2024-02-19T17:16:20.954 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.306770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140032.log 2024-02-19T17:16:20.955 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.186920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46363.log 2024-02-19T17:16:20.956 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.140032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445578.log 2024-02-19T17:16:20.957 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490092.log 2024-02-19T17:16:20.958 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232632.log 2024-02-19T17:16:20.959 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.445578.log: /var/log/ceph/ceph-client.admin.490092.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.482366.log.gz 2024-02-19T17:16:20.959 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527803.log 2024-02-19T17:16:20.960 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.232632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444276.log 2024-02-19T17:16:20.960 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.227022.log.gz 2024-02-19T17:16:20.961 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.527803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240682.log 2024-02-19T17:16:20.962 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.444276.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.227031.log.gz 2024-02-19T17:16:20.962 INFO:teuthology.orchestra.run.smithi046.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.250080.log.gz 2024-02-19T17:16:20.962 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.504254.log.gz 2024-02-19T17:16:20.962 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42594.log 2024-02-19T17:16:20.964 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.240682.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.311413.log.gz 2024-02-19T17:16:20.964 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.311829.log.gz 2024-02-19T17:16:20.964 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305507.log 2024-02-19T17:16:20.965 INFO:teuthology.orchestra.run.smithi046.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.313920.log.gz 2024-02-19T17:16:20.965 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% 92.3% -- replaced with /var/log/ceph/ceph-client.admin.527803.log.gz -- replaced with /var/log/ceph/ceph-client.admin.383251.log.gz 2024-02-19T17:16:20.965 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:20.965 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47117.log 2024-02-19T17:16:20.965 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.381987.log.gz 2024-02-19T17:16:20.965 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.382394.log.gz 2024-02-19T17:16:20.966 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.305507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409832.log 2024-02-19T17:16:20.967 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187356.log 2024-02-19T17:16:20.968 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.409832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540112.log 2024-02-19T17:16:20.969 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.187356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496216.log 2024-02-19T17:16:20.970 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.540112.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.540112.log.gz 2024-02-19T17:16:20.970 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386223.log 2024-02-19T17:16:20.971 INFO:teuthology.orchestra.run.smithi046.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.339840.log.gz 2024-02-19T17:16:20.971 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.340257.log.gz 2024-02-19T17:16:20.972 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.496216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153363.log 2024-02-19T17:16:20.972 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.386223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239814.log 2024-02-19T17:16:20.973 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.153363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239395.log 2024-02-19T17:16:20.974 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.239814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41697.log 2024-02-19T17:16:20.975 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.239395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460346.log 2024-02-19T17:16:20.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439435.log 2024-02-19T17:16:20.977 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45554.log.gz 2024-02-19T17:16:20.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.460346.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46184.log.gz 2024-02-19T17:16:20.978 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45130.log 2024-02-19T17:16:20.978 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46531.log.gz 2024-02-19T17:16:20.978 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42594.log.gz 2024-02-19T17:16:20.978 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42921.log.gz 2024-02-19T17:16:20.979 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43193.log.gz 2024-02-19T17:16:20.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.439435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258905.log 2024-02-19T17:16:20.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.2.45130.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.423447.log.gz 2024-02-19T17:16:20.980 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330612.log 2024-02-19T17:16:20.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.258905.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.186056.log.gz 2024-02-19T17:16:20.981 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156415.log 2024-02-19T17:16:20.981 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.239395.log.gz 2024-02-19T17:16:20.982 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.330612.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.187365.log.gz 2024-02-19T17:16:20.982 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48251.log 2024-02-19T17:16:20.983 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.156415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340266.log 2024-02-19T17:16:20.985 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142270.log 2024-02-19T17:16:20.986 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207368.log 2024-02-19T17:16:20.986 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.142270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345863.log 2024-02-19T17:16:20.987 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.207368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474131.log 2024-02-19T17:16:20.989 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.345863.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47359.log.gz 2024-02-19T17:16:20.989 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49916.log 2024-02-19T17:16:20.990 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.474131.log: 89.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.135425.log.gz 2024-02-19T17:16:20.990 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.313086.log 2024-02-19T17:16:20.990 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.138355.log.gz 2024-02-19T17:16:20.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196263.log 2024-02-19T17:16:20.991 INFO:teuthology.orchestra.run.smithi046.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.151199.log.gz 2024-02-19T17:16:20.992 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.313086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540238.log 2024-02-19T17:16:20.993 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.196263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42332.log 2024-02-19T17:16:20.994 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.540238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325898.log 2024-02-19T17:16:20.994 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.540238.log.gz 2024-02-19T17:16:20.995 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247100.log 2024-02-19T17:16:20.996 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.325898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444267.log 2024-02-19T17:16:20.997 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.247100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201141.log 2024-02-19T17:16:20.998 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.444267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464359.log 2024-02-19T17:16:20.999 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.201141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410684.log 2024-02-19T17:16:21.000 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.464359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412806.log 2024-02-19T17:16:21.001 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.410684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198934.log 2024-02-19T17:16:21.002 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.412806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411550.log 2024-02-19T17:16:21.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.198934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308883.log 2024-02-19T17:16:21.004 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.411550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393143.log 2024-02-19T17:16:21.005 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.308883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441972.log 2024-02-19T17:16:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.393143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269617.log 2024-02-19T17:16:21.007 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.441972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390067.log 2024-02-19T17:16:21.008 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.269617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217550.log 2024-02-19T17:16:21.009 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.390067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481394.log 2024-02-19T17:16:21.010 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.217550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512397.log 2024-02-19T17:16:21.010 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.481394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155964.log 2024-02-19T17:16:21.011 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.512397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311820.log 2024-02-19T17:16:21.013 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.155964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155036.log 2024-02-19T17:16:21.014 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.311820.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.308874.log.gz 2024-02-19T17:16:21.014 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280882.log 2024-02-19T17:16:21.015 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.308883.log.gz 2024-02-19T17:16:21.015 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.317844.log.gz 2024-02-19T17:16:21.015 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.326315.log.gz 2024-02-19T17:16:21.016 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.155036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469774.log 2024-02-19T17:16:21.016 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.324638.log.gz 2024-02-19T17:16:21.016 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.345011.log.gz 2024-02-19T17:16:21.016 INFO:teuthology.orchestra.run.smithi046.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.512397.log.gz 2024-02-19T17:16:21.017 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.280882.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.345863.log.gz 2024-02-19T17:16:21.017 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351654.log 2024-02-19T17:16:21.017 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.469774.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.352577.log.gz 2024-02-19T17:16:21.018 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162428.log 2024-02-19T17:16:21.018 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.387807.log.gz 2024-02-19T17:16:21.019 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.411550.log.gz 2024-02-19T17:16:21.019 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.351654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394998.log 2024-02-19T17:16:21.020 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.162428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129473.log 2024-02-19T17:16:21.022 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.394998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208623.log 2024-02-19T17:16:21.023 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.129473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492608.log 2024-02-19T17:16:21.024 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.208623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163556.log 2024-02-19T17:16:21.025 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.492608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461194.log 2024-02-19T17:16:21.027 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.163556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207789.log 2024-02-19T17:16:21.027 INFO:teuthology.orchestra.run.smithi046.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.155036.log.gz 2024-02-19T17:16:21.028 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.461194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498626.log 2024-02-19T17:16:21.029 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.207789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514175.log 2024-02-19T17:16:21.030 INFO:teuthology.orchestra.run.smithi046.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.256806.log.gz 2024-02-19T17:16:21.031 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.498626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198467.log 2024-02-19T17:16:21.032 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.514175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270043.log 2024-02-19T17:16:21.032 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.485417.log.gz 2024-02-19T17:16:21.033 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.198467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69904.log 2024-02-19T17:16:21.033 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.378845.log.gz 2024-02-19T17:16:21.034 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.305507.log.gz 2024-02-19T17:16:21.034 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.270043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130781.log 2024-02-19T17:16:21.036 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382811.log 2024-02-19T17:16:21.037 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43592.log 2024-02-19T17:16:21.038 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43270.log 2024-02-19T17:16:21.039 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306761.log 2024-02-19T17:16:21.040 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239386.log 2024-02-19T17:16:21.041 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322558.log 2024-02-19T17:16:21.042 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351237.log 2024-02-19T17:16:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466770.log 2024-02-19T17:16:21.044 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114064.log 2024-02-19T17:16:21.045 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128211.log 2024-02-19T17:16:21.046 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135416.log 2024-02-19T17:16:21.047 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540448.log 2024-02-19T17:16:21.048 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47711.log 2024-02-19T17:16:21.049 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385371.log 2024-02-19T17:16:21.050 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462054.log 2024-02-19T17:16:21.052 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479229.log 2024-02-19T17:16:21.052 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235165.log 2024-02-19T17:16:21.053 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211977.log 2024-02-19T17:16:21.055 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348012.log 2024-02-19T17:16:21.056 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31423.log 2024-02-19T17:16:21.057 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162419.log 2024-02-19T17:16:21.058 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385380.log 2024-02-19T17:16:21.059 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265855.log 2024-02-19T17:16:21.060 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208206.log 2024-02-19T17:16:21.061 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410249.log 2024-02-19T17:16:21.062 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497382.log 2024-02-19T17:16:21.063 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278584.log 2024-02-19T17:16:21.064 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261850.log 2024-02-19T17:16:21.065 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218840.log 2024-02-19T17:16:21.066 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376659.log 2024-02-19T17:16:21.068 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182808.log 2024-02-19T17:16:21.069 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283435.log 2024-02-19T17:16:21.070 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162009.log 2024-02-19T17:16:21.071 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512886.log 2024-02-19T17:16:21.072 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353085.log 2024-02-19T17:16:21.073 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487131.log 2024-02-19T17:16:21.074 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133756.log 2024-02-19T17:16:21.075 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339849.log 2024-02-19T17:16:21.076 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412384.log 2024-02-19T17:16:21.076 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523832.log 2024-02-19T17:16:21.077 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123937.log 2024-02-19T17:16:21.079 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261859.log 2024-02-19T17:16:21.080 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314345.log 2024-02-19T17:16:21.081 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44072.log 2024-02-19T17:16:21.082 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206039.log 2024-02-19T17:16:21.083 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327177.log 2024-02-19T17:16:21.084 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400979.log 2024-02-19T17:16:21.085 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537573.log 2024-02-19T17:16:21.086 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213225.log 2024-02-19T17:16:21.087 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344603.log 2024-02-19T17:16:21.088 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341101.log 2024-02-19T17:16:21.089 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110689.log 2024-02-19T17:16:21.090 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152041.log 2024-02-19T17:16:21.091 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258496.log 2024-02-19T17:16:21.092 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41996.log 2024-02-19T17:16:21.093 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49536.log 2024-02-19T17:16:21.093 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185610.log 2024-02-19T17:16:21.094 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283444.log 2024-02-19T17:16:21.095 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453821.log 2024-02-19T17:16:21.096 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-19T17:16:21.100 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214071.log 2024-02-19T17:16:21.100 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119968.log 2024-02-19T17:16:21.100 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234329.log 2024-02-19T17:16:21.100 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511549.log 2024-02-19T17:16:21.101 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412393.log 2024-02-19T17:16:21.102 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468938.log 2024-02-19T17:16:21.102 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46058.log 2024-02-19T17:16:21.103 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536619.log 2024-02-19T17:16:21.104 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200251.log 2024-02-19T17:16:21.105 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452109.log 2024-02-19T17:16:21.105 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45386.log 2024-02-19T17:16:21.106 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111773.log 2024-02-19T17:16:21.108 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230316.log 2024-02-19T17:16:21.108 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446886.log 2024-02-19T17:16:21.109 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490082.log 2024-02-19T17:16:21.110 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221958.log 2024-02-19T17:16:21.111 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49001.log 2024-02-19T17:16:21.112 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496225.log 2024-02-19T17:16:21.114 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310996.log 2024-02-19T17:16:21.114 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155501.log 2024-02-19T17:16:21.115 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467682.log 2024-02-19T17:16:21.116 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134173.log 2024-02-19T17:16:21.117 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45764.log 2024-02-19T17:16:21.118 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42248.log 2024-02-19T17:16:21.119 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515075.log 2024-02-19T17:16:21.120 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340684.log 2024-02-19T17:16:21.121 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261437.log 2024-02-19T17:16:21.122 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47159.log 2024-02-19T17:16:21.123 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143160.log 2024-02-19T17:16:21.124 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141394.log 2024-02-19T17:16:21.125 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109349.log 2024-02-19T17:16:21.126 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211551.log 2024-02-19T17:16:21.127 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428347.log 2024-02-19T17:16:21.128 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265864.log 2024-02-19T17:16:21.129 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46949.log 2024-02-19T17:16:21.130 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516447.log 2024-02-19T17:16:21.130 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152050.log 2024-02-19T17:16:21.131 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472871.log 2024-02-19T17:16:21.132 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199796.log 2024-02-19T17:16:21.133 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279891.log 2024-02-19T17:16:21.134 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461603.log 2024-02-19T17:16:21.135 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258077.log 2024-02-19T17:16:21.136 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443859.log 2024-02-19T17:16:21.136 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390058.log 2024-02-19T17:16:21.137 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46405.log 2024-02-19T17:16:21.138 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470673.log 2024-02-19T17:16:21.139 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330187.log 2024-02-19T17:16:21.139 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141850.log 2024-02-19T17:16:21.140 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351246.log 2024-02-19T17:16:21.141 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226614.log 2024-02-19T17:16:21.142 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537077.log 2024-02-19T17:16:21.143 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203819.log 2024-02-19T17:16:21.144 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402648.log 2024-02-19T17:16:21.144 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511540.log 2024-02-19T17:16:21.145 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312664.log 2024-02-19T17:16:21.146 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389646.log 2024-02-19T17:16:21.147 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426670.log 2024-02-19T17:16:21.147 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209040.log 2024-02-19T17:16:21.148 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387094.log 2024-02-19T17:16:21.149 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353585.log 2024-02-19T17:16:21.150 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314774.log 2024-02-19T17:16:21.150 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343301.log 2024-02-19T17:16:21.151 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146161.log 2024-02-19T17:16:21.152 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338470.log 2024-02-19T17:16:21.153 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502993.log 2024-02-19T17:16:21.154 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483072.log 2024-02-19T17:16:21.155 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328942.log 2024-02-19T17:16:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139619.log 2024-02-19T17:16:21.157 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325481.log 2024-02-19T17:16:21.158 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138346.log 2024-02-19T17:16:21.159 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483063.log 2024-02-19T17:16:21.160 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49982.log 2024-02-19T17:16:21.162 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179448.log 2024-02-19T17:16:21.162 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259322.log 2024-02-19T17:16:21.164 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124880.log 2024-02-19T17:16:21.165 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247982.log 2024-02-19T17:16:21.166 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426325.log 2024-02-19T17:16:21.167 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521245.log 2024-02-19T17:16:21.168 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146170.log 2024-02-19T17:16:21.169 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210309.log 2024-02-19T17:16:21.170 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49706.log 2024-02-19T17:16:21.171 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255132.log 2024-02-19T17:16:21.172 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137506.log 2024-02-19T17:16:21.173 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216693.log 2024-02-19T17:16:21.174 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386676.log 2024-02-19T17:16:21.175 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217559.log 2024-02-19T17:16:21.177 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456419.log 2024-02-19T17:16:21.177 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488900.log 2024-02-19T17:16:21.178 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42934.log 2024-02-19T17:16:21.179 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539860.log 2024-02-19T17:16:21.180 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267949.log 2024-02-19T17:16:21.182 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321307.log 2024-02-19T17:16:21.183 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260171.log 2024-02-19T17:16:21.184 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393382.log 2024-02-19T17:16:21.185 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504245.log 2024-02-19T17:16:21.186 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353594.log 2024-02-19T17:16:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126941.log 2024-02-19T17:16:21.188 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193679.log 2024-02-19T17:16:21.189 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443367.log 2024-02-19T17:16:21.190 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400571.log 2024-02-19T17:16:21.191 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484173.log 2024-02-19T17:16:21.192 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45932.log 2024-02-19T17:16:21.193 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192836.log 2024-02-19T17:16:21.194 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341543.log 2024-02-19T17:16:21.195 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401822.log 2024-02-19T17:16:21.196 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48083.log 2024-02-19T17:16:21.197 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340675.log 2024-02-19T17:16:21.198 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443850.log 2024-02-19T17:16:21.200 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539349.log 2024-02-19T17:16:21.201 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241545.log 2024-02-19T17:16:21.202 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509260.log 2024-02-19T17:16:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203373.log 2024-02-19T17:16:21.203 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517296.log 2024-02-19T17:16:21.204 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259744.log 2024-02-19T17:16:21.205 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198925.log 2024-02-19T17:16:21.207 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222792.log 2024-02-19T17:16:21.208 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137088.log 2024-02-19T17:16:21.209 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468510.log 2024-02-19T17:16:21.209 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193688.log 2024-02-19T17:16:21.210 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393055.log 2024-02-19T17:16:21.211 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349853.log 2024-02-19T17:16:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204255.log 2024-02-19T17:16:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407732.log 2024-02-19T17:16:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209466.log 2024-02-19T17:16:21.214 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49664.log 2024-02-19T17:16:21.215 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47957.log 2024-02-19T17:16:21.216 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42290.log 2024-02-19T17:16:21.217 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482810.log 2024-02-19T17:16:21.218 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183698.log 2024-02-19T17:16:21.218 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187801.log 2024-02-19T17:16:21.220 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460760.log 2024-02-19T17:16:21.220 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108736.log 2024-02-19T17:16:21.221 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307600.log 2024-02-19T17:16:21.222 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119959.log 2024-02-19T17:16:21.223 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46658.log 2024-02-19T17:16:21.224 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519126.log 2024-02-19T17:16:21.224 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42592.log 2024-02-19T17:16:21.225 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129891.log 2024-02-19T17:16:21.226 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476708.log 2024-02-19T17:16:21.227 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247542.log 2024-02-19T17:16:21.228 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520824.log 2024-02-19T17:16:21.229 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283014.log 2024-02-19T17:16:21.230 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463918.log 2024-02-19T17:16:21.231 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265438.log 2024-02-19T17:16:21.232 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539620.log 2024-02-19T17:16:21.233 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520405.log 2024-02-19T17:16:21.234 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209031.log 2024-02-19T17:16:21.235 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206947.log 2024-02-19T17:16:21.236 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539391.log 2024-02-19T17:16:21.237 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162845.log 2024-02-19T17:16:21.238 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265030.log 2024-02-19T17:16:21.239 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523415.log 2024-02-19T17:16:21.240 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506344.log 2024-02-19T17:16:21.240 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500493.log 2024-02-19T17:16:21.241 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507180.log 2024-02-19T17:16:21.242 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465943.log 2024-02-19T17:16:21.243 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225351.log 2024-02-19T17:16:21.244 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120377.log 2024-02-19T17:16:21.244 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191080.log 2024-02-19T17:16:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385789.log 2024-02-19T17:16:21.246 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525602.log 2024-02-19T17:16:21.247 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162836.log 2024-02-19T17:16:21.247 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132485.log 2024-02-19T17:16:21.248 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140497.log 2024-02-19T17:16:21.249 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391907.log 2024-02-19T17:16:21.250 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144006.log 2024-02-19T17:16:21.251 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235583.log 2024-02-19T17:16:21.251 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337022.log 2024-02-19T17:16:21.252 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47873.log 2024-02-19T17:16:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237712.log 2024-02-19T17:16:21.254 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195809.log 2024-02-19T17:16:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150221.log 2024-02-19T17:16:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214902.log 2024-02-19T17:16:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515526.log 2024-02-19T17:16:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46745.log 2024-02-19T17:16:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180695.log 2024-02-19T17:16:21.259 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48958.log 2024-02-19T17:16:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196683.log 2024-02-19T17:16:21.261 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330196.log 2024-02-19T17:16:21.262 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48835.log 2024-02-19T17:16:21.263 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45890.log 2024-02-19T17:16:21.264 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134998.log 2024-02-19T17:16:21.265 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264604.log 2024-02-19T17:16:21.265 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384954.log 2024-02-19T17:16:21.267 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393094.log 2024-02-19T17:16:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258914.log 2024-02-19T17:16:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381569.log 2024-02-19T17:16:21.269 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480987.log 2024-02-19T17:16:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153788.log 2024-02-19T17:16:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343310.log 2024-02-19T17:16:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513712.log 2024-02-19T17:16:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403904.log 2024-02-19T17:16:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441981.log 2024-02-19T17:16:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272191.log 2024-02-19T17:16:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240673.log 2024-02-19T17:16:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329769.log 2024-02-19T17:16:21.277 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508015.log 2024-02-19T17:16:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401813.log 2024-02-19T17:16:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452518.log 2024-02-19T17:16:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508842.log 2024-02-19T17:16:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253316.log 2024-02-19T17:16:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49832.log 2024-02-19T17:16:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409001.log 2024-02-19T17:16:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249246.log 2024-02-19T17:16:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47789.log 2024-02-19T17:16:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181534.log 2024-02-19T17:16:21.286 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240223.log 2024-02-19T17:16:21.287 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190585.log 2024-02-19T17:16:21.288 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-02-19T17:16:21.289 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135834.log 2024-02-19T17:16:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378373.log 2024-02-19T17:16:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402657.log 2024-02-19T17:16:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526474.log 2024-02-19T17:16:21.292 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241994.log 2024-02-19T17:16:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233469.log 2024-02-19T17:16:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266698.log 2024-02-19T17:16:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457401.log 2024-02-19T17:16:21.296 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397537.log 2024-02-19T17:16:21.296 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154206.log 2024-02-19T17:16:21.297 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48419.log 2024-02-19T17:16:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397998.log 2024-02-19T17:16:21.300 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406884.log 2024-02-19T17:16:21.301 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163830.log 2024-02-19T17:16:21.301 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45234.log 2024-02-19T17:16:21.302 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219673.log 2024-02-19T17:16:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42596.log 2024-02-19T17:16:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354587.log 2024-02-19T17:16:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475454.log 2024-02-19T17:16:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491396.log 2024-02-19T17:16:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462537.log 2024-02-19T17:16:21.307 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194560.log 2024-02-19T17:16:21.308 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440269.log 2024-02-19T17:16:21.309 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48503.log 2024-02-19T17:16:21.309 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381036.log 2024-02-19T17:16:21.310 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471556.log 2024-02-19T17:16:21.311 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136670.log 2024-02-19T17:16:21.312 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185178.log 2024-02-19T17:16:21.313 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515986.log 2024-02-19T17:16:21.313 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48629.log 2024-02-19T17:16:21.314 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265021.log 2024-02-19T17:16:21.315 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268775.log 2024-02-19T17:16:21.316 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247533.log 2024-02-19T17:16:21.317 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376178.log 2024-02-19T17:16:21.318 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278593.log 2024-02-19T17:16:21.319 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376169.log 2024-02-19T17:16:21.320 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335731.log 2024-02-19T17:16:21.321 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201587.log 2024-02-19T17:16:21.322 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448562.log 2024-02-19T17:16:21.323 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391898.log 2024-02-19T17:16:21.324 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49271.log 2024-02-19T17:16:21.325 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425578.log 2024-02-19T17:16:21.326 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237721.log 2024-02-19T17:16:21.327 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113604.log 2024-02-19T17:16:21.328 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350706.log 2024-02-19T17:16:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522983.log 2024-02-19T17:16:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236833.log 2024-02-19T17:16:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514626.log 2024-02-19T17:16:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254275.log 2024-02-19T17:16:21.333 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323399.log 2024-02-19T17:16:21.334 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194096.log 2024-02-19T17:16:21.334 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468099.log 2024-02-19T17:16:21.335 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322151.log 2024-02-19T17:16:21.336 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540154.log 2024-02-19T17:16:21.337 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454238.log 2024-02-19T17:16:21.338 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330621.log 2024-02-19T17:16:21.339 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412815.log 2024-02-19T17:16:21.340 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42416.log 2024-02-19T17:16:21.341 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519966.log 2024-02-19T17:16:21.341 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525152.log 2024-02-19T17:16:21.342 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447318.log 2024-02-19T17:16:21.343 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282606.log 2024-02-19T17:16:21.344 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472445.log 2024-02-19T17:16:21.345 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502156.log 2024-02-19T17:16:21.346 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356036.log 2024-02-19T17:16:21.346 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70251.log 2024-02-19T17:16:21.347 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328094.log 2024-02-19T17:16:21.348 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317428.log 2024-02-19T17:16:21.349 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454646.log 2024-02-19T17:16:21.350 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247091.log 2024-02-19T17:16:21.351 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486252.log 2024-02-19T17:16:21.352 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193260.log 2024-02-19T17:16:21.353 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279015.log 2024-02-19T17:16:21.354 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535328.log 2024-02-19T17:16:21.355 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185169.log 2024-02-19T17:16:21.355 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152471.log 2024-02-19T17:16:21.356 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514635.log 2024-02-19T17:16:21.357 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339423.log 2024-02-19T17:16:21.358 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344594.log 2024-02-19T17:16:21.359 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403913.log 2024-02-19T17:16:21.360 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321316.log 2024-02-19T17:16:21.361 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446455.log 2024-02-19T17:16:21.361 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389637.log 2024-02-19T17:16:21.362 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506335.log 2024-02-19T17:16:21.363 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42038.log 2024-02-19T17:16:21.364 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512877.log 2024-02-19T17:16:21.364 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468929.log 2024-02-19T17:16:21.365 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326745.log 2024-02-19T17:16:21.366 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315628.log 2024-02-19T17:16:21.367 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320891.log 2024-02-19T17:16:21.368 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49043.log 2024-02-19T17:16:21.369 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45470.log 2024-02-19T17:16:21.370 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47443.log 2024-02-19T17:16:21.370 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534472.log 2024-02-19T17:16:21.371 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281335.log 2024-02-19T17:16:21.372 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154623.log 2024-02-19T17:16:21.373 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467673.log 2024-02-19T17:16:21.374 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236416.log 2024-02-19T17:16:21.375 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310574.log 2024-02-19T17:16:21.375 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210717.log 2024-02-19T17:16:21.376 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424325.log 2024-02-19T17:16:21.377 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517715.log 2024-02-19T17:16:21.378 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214062.log 2024-02-19T17:16:21.379 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161044.log 2024-02-19T17:16:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269202.log 2024-02-19T17:16:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425587.log 2024-02-19T17:16:21.381 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540196.log 2024-02-19T17:16:21.382 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480562.log 2024-02-19T17:16:21.383 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521653.log 2024-02-19T17:16:21.384 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451675.log 2024-02-19T17:16:21.385 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504663.log 2024-02-19T17:16:21.385 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458367.log 2024-02-19T17:16:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43886.log 2024-02-19T17:16:21.387 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481820.log 2024-02-19T17:16:21.388 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540322.log 2024-02-19T17:16:21.389 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196674.log 2024-02-19T17:16:21.389 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524710.log 2024-02-19T17:16:21.390 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354596.log 2024-02-19T17:16:21.391 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262694.log 2024-02-19T17:16:21.392 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459267.log 2024-02-19T17:16:21.393 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249672.log 2024-02-19T17:16:21.394 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-19T17:16:21.395 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377072.log 2024-02-19T17:16:21.396 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474548.log 2024-02-19T17:16:21.397 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199805.log 2024-02-19T17:16:21.398 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137927.log 2024-02-19T17:16:21.399 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404765.log 2024-02-19T17:16:21.400 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328933.log 2024-02-19T17:16:21.401 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426679.log 2024-02-19T17:16:21.402 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469348.log 2024-02-19T17:16:21.403 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479238.log 2024-02-19T17:16:21.404 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155045.log 2024-02-19T17:16:21.405 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353094.log 2024-02-19T17:16:21.406 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536182.log 2024-02-19T17:16:21.408 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534024.log 2024-02-19T17:16:21.409 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387085.log 2024-02-19T17:16:21.410 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230799.log 2024-02-19T17:16:21.411 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345854.log 2024-02-19T17:16:21.412 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112645.log 2024-02-19T17:16:21.412 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503411.log 2024-02-19T17:16:21.413 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313095.log 2024-02-19T17:16:21.415 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241985.log 2024-02-19T17:16:21.415 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350715.log 2024-02-19T17:16:21.416 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388224.log 2024-02-19T17:16:21.417 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453812.log 2024-02-19T17:16:21.418 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48545.log 2024-02-19T17:16:21.419 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331031.log 2024-02-19T17:16:21.419 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405178.log 2024-02-19T17:16:21.420 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451205.log 2024-02-19T17:16:21.421 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42933.log 2024-02-19T17:16:21.422 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147028.log 2024-02-19T17:16:21.423 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46447.log 2024-02-19T17:16:21.424 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337503.log 2024-02-19T17:16:21.425 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233460.log 2024-02-19T17:16:21.425 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503420.log 2024-02-19T17:16:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49399.log 2024-02-19T17:16:21.427 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500067.log 2024-02-19T17:16:21.428 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471103.log 2024-02-19T17:16:21.428 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42932.log 2024-02-19T17:16:21.429 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484164.log 2024-02-19T17:16:21.430 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191089.log 2024-02-19T17:16:21.431 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127802.log 2024-02-19T17:16:21.432 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230790.log 2024-02-19T17:16:21.433 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43466.log 2024-02-19T17:16:21.435 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256398.log 2024-02-19T17:16:21.436 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164692.log 2024-02-19T17:16:21.436 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140506.log 2024-02-19T17:16:21.437 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197123.log 2024-02-19T17:16:21.438 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125640.log 2024-02-19T17:16:21.439 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476291.log 2024-02-19T17:16:21.440 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483324.log 2024-02-19T17:16:21.441 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119551.log 2024-02-19T17:16:21.442 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473713.log 2024-02-19T17:16:21.443 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540574.log 2024-02-19T17:16:21.444 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255967.log 2024-02-19T17:16:21.445 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527363.log 2024-02-19T17:16:21.446 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238550.log 2024-02-19T17:16:21.447 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452100.log 2024-02-19T17:16:21.448 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527354.log 2024-02-19T17:16:21.449 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526914.log 2024-02-19T17:16:21.451 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47585.log 2024-02-19T17:16:21.451 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140920.log 2024-02-19T17:16:21.452 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261428.log 2024-02-19T17:16:21.453 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193271.log 2024-02-19T17:16:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403075.log 2024-02-19T17:16:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42164.log 2024-02-19T17:16:21.456 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273472.log 2024-02-19T17:16:21.458 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230325.log 2024-02-19T17:16:21.458 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485845.log 2024-02-19T17:16:21.459 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206938.log 2024-02-19T17:16:21.461 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181121.log 2024-02-19T17:16:21.462 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317020.log 2024-02-19T17:16:21.463 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268357.log 2024-02-19T17:16:21.463 INFO:teuthology.orchestra.run.smithi142.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-02-19T17:16:21.464 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501738.log 2024-02-19T17:16:21.465 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139187.log 2024-02-19T17:16:21.466 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260593.log 2024-02-19T17:16:21.466 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-19T17:16:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227439.log 2024-02-19T17:16:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48041.log 2024-02-19T17:16:21.469 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41824.log 2024-02-19T17:16:21.470 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47627.log 2024-02-19T17:16:21.471 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308448.log 2024-02-19T17:16:21.472 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267106.log 2024-02-19T17:16:21.473 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478813.log 2024-02-19T17:16:21.473 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206485.log 2024-02-19T17:16:21.474 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540699.log 2024-02-19T17:16:21.475 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320029.log 2024-02-19T17:16:21.476 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393391.log 2024-02-19T17:16:21.477 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222801.log 2024-02-19T17:16:21.478 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493763.log 2024-02-19T17:16:21.479 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463027.log 2024-02-19T17:16:21.480 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183244.log 2024-02-19T17:16:21.481 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421765.log 2024-02-19T17:16:21.481 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257233.log 2024-02-19T17:16:21.482 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505081.log 2024-02-19T17:16:21.483 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512388.log 2024-02-19T17:16:21.484 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164683.log 2024-02-19T17:16:21.485 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497391.log 2024-02-19T17:16:21.485 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119133.log 2024-02-19T17:16:21.486 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533116.log 2024-02-19T17:16:21.487 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-19T17:16:21.488 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439018.log 2024-02-19T17:16:21.489 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422599.log 2024-02-19T17:16:21.490 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128629.log 2024-02-19T17:16:21.491 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248832.log 2024-02-19T17:16:21.491 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200696.log 2024-02-19T17:16:21.492 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139196.log 2024-02-19T17:16:21.493 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401396.log 2024-02-19T17:16:21.494 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338461.log 2024-02-19T17:16:21.495 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517305.log 2024-02-19T17:16:21.496 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439027.log 2024-02-19T17:16:21.496 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540070.log 2024-02-19T17:16:21.497 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243758.log 2024-02-19T17:16:21.498 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380546.log 2024-02-19T17:16:21.499 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305095.log 2024-02-19T17:16:21.500 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222384.log 2024-02-19T17:16:21.501 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270868.log 2024-02-19T17:16:21.502 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533575.log 2024-02-19T17:16:21.503 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270460.log 2024-02-19T17:16:21.504 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318777.log 2024-02-19T17:16:21.504 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349394.log 2024-02-19T17:16:21.505 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42583.log 2024-02-19T17:16:21.506 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446877.log 2024-02-19T17:16:21.507 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256389.log 2024-02-19T17:16:21.508 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-02-19T17:16:21.509 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375754.log 2024-02-19T17:16:21.510 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464350.log 2024-02-19T17:16:21.511 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381560.log 2024-02-19T17:16:21.512 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226194.log 2024-02-19T17:16:21.513 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273914.log 2024-02-19T17:16:21.514 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389175.log 2024-02-19T17:16:21.515 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190576.log 2024-02-19T17:16:21.516 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199350.log 2024-02-19T17:16:21.517 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263577.log 2024-02-19T17:16:21.518 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139610.log 2024-02-19T17:16:21.519 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424755.log 2024-02-19T17:16:21.520 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242932.log 2024-02-19T17:16:21.521 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380555.log 2024-02-19T17:16:21.522 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470238.log 2024-02-19T17:16:21.523 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473722.log 2024-02-19T17:16:21.524 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310156.log 2024-02-19T17:16:21.524 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316594.log 2024-02-19T17:16:21.525 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501321.log 2024-02-19T17:16:21.526 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46489.log 2024-02-19T17:16:21.527 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253734.log 2024-02-19T17:16:21.528 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423025.log 2024-02-19T17:16:21.528 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43802.log 2024-02-19T17:16:21.530 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406049.log 2024-02-19T17:16:21.531 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215357.log 2024-02-19T17:16:21.531 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48587.log 2024-02-19T17:16:21.532 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41782.log 2024-02-19T17:16:21.533 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161485.log 2024-02-19T17:16:21.534 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351663.log 2024-02-19T17:16:21.534 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232214.log 2024-02-19T17:16:21.535 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184250.log 2024-02-19T17:16:21.536 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186493.log 2024-02-19T17:16:21.538 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114073.log 2024-02-19T17:16:21.538 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455571.log 2024-02-19T17:16:21.539 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440686.log 2024-02-19T17:16:21.540 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507598.log 2024-02-19T17:16:21.541 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467262.log 2024-02-19T17:16:21.542 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43718.log 2024-02-19T17:16:21.543 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42919.log 2024-02-19T17:16:21.544 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346687.log 2024-02-19T17:16:21.545 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529565.log 2024-02-19T17:16:21.546 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137097.log 2024-02-19T17:16:21.547 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255554.log 2024-02-19T17:16:21.548 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126067.log 2024-02-19T17:16:21.549 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537989.log 2024-02-19T17:16:21.550 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273018.log 2024-02-19T17:16:21.551 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42925.log 2024-02-19T17:16:21.551 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144427.log 2024-02-19T17:16:21.552 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348480.log 2024-02-19T17:16:21.553 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474981.log 2024-02-19T17:16:21.554 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217998.log 2024-02-19T17:16:21.556 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382403.log 2024-02-19T17:16:21.556 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242415.log 2024-02-19T17:16:21.557 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49790.log 2024-02-19T17:16:21.558 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396264.log 2024-02-19T17:16:21.559 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280387.log 2024-02-19T17:16:21.560 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282184.log 2024-02-19T17:16:21.561 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214489.log 2024-02-19T17:16:21.562 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508424.log 2024-02-19T17:16:21.563 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532637.log 2024-02-19T17:16:21.564 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501747.log 2024-02-19T17:16:21.565 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528235.log 2024-02-19T17:16:21.566 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223635.log 2024-02-19T17:16:21.567 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162000.log 2024-02-19T17:16:21.568 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41740.log 2024-02-19T17:16:21.569 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310147.log 2024-02-19T17:16:21.570 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200242.log 2024-02-19T17:16:21.571 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400141.log 2024-02-19T17:16:21.571 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192827.log 2024-02-19T17:16:21.573 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316136.log 2024-02-19T17:16:21.574 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126495.log 2024-02-19T17:16:21.575 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154614.log 2024-02-19T17:16:21.576 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223218.log 2024-02-19T17:16:21.577 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518895.log 2024-02-19T17:16:21.578 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110186.log 2024-02-19T17:16:21.579 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41574.log 2024-02-19T17:16:21.580 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221364.log 2024-02-19T17:16:21.581 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456891.log 2024-02-19T17:16:21.581 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146606.log 2024-02-19T17:16:21.582 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448980.log 2024-02-19T17:16:21.583 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209475.log 2024-02-19T17:16:21.584 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383260.log 2024-02-19T17:16:21.585 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159973.log 2024-02-19T17:16:21.586 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280891.log 2024-02-19T17:16:21.586 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393103.log 2024-02-19T17:16:21.587 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500076.log 2024-02-19T17:16:21.588 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336157.log 2024-02-19T17:16:21.589 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336148.log 2024-02-19T17:16:21.590 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280396.log 2024-02-19T17:16:21.591 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129046.log 2024-02-19T17:16:21.592 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241128.log 2024-02-19T17:16:21.592 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355082.log 2024-02-19T17:16:21.593 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127793.log 2024-02-19T17:16:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321723.log 2024-02-19T17:16:21.595 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43268.log 2024-02-19T17:16:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499807.log 2024-02-19T17:16:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336565.log 2024-02-19T17:16:21.598 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136679.log 2024-02-19T17:16:21.598 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265447.log 2024-02-19T17:16:21.599 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179856.log 2024-02-19T17:16:21.600 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283865.log 2024-02-19T17:16:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282175.log 2024-02-19T17:16:21.602 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49622.log 2024-02-19T17:16:21.603 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485836.log 2024-02-19T17:16:21.603 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503837.log 2024-02-19T17:16:21.604 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405187.log 2024-02-19T17:16:21.605 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348489.log 2024-02-19T17:16:21.606 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204710.log 2024-02-19T17:16:21.607 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406058.log 2024-02-19T17:16:21.607 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392995.log 2024-02-19T17:16:21.608 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179439.log 2024-02-19T17:16:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396693.log 2024-02-19T17:16:21.610 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507171.log 2024-02-19T17:16:21.611 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411142.log 2024-02-19T17:16:21.612 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317011.log 2024-02-19T17:16:21.613 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244628.log 2024-02-19T17:16:21.613 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379271.log 2024-02-19T17:16:21.614 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447727.log 2024-02-19T17:16:21.615 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408154.log 2024-02-19T17:16:21.616 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462063.log 2024-02-19T17:16:21.617 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447736.log 2024-02-19T17:16:21.617 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520815.log 2024-02-19T17:16:21.618 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207359.log 2024-02-19T17:16:21.619 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338951.log 2024-02-19T17:16:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390607.log 2024-02-19T17:16:21.621 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199359.log 2024-02-19T17:16:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194977.log 2024-02-19T17:16:21.622 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448989.log 2024-02-19T17:16:21.623 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539578.log 2024-02-19T17:16:21.624 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393046.log 2024-02-19T17:16:21.626 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324231.log 2024-02-19T17:16:21.627 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203810.log 2024-02-19T17:16:21.628 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468519.log 2024-02-19T17:16:21.628 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43760.log 2024-02-19T17:16:21.629 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529116.log 2024-02-19T17:16:21.630 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164247.log 2024-02-19T17:16:21.631 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337013.log 2024-02-19T17:16:21.632 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540741.log 2024-02-19T17:16:21.632 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312251.log 2024-02-19T17:16:21.633 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510584.log 2024-02-19T17:16:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111764.log 2024-02-19T17:16:21.635 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321732.log 2024-02-19T17:16:21.636 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477976.log 2024-02-19T17:16:21.637 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244185.log 2024-02-19T17:16:21.638 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473286.log 2024-02-19T17:16:21.639 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339432.log 2024-02-19T17:16:21.641 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41655.log 2024-02-19T17:16:21.641 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189135.log 2024-02-19T17:16:21.642 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441113.log 2024-02-19T17:16:21.643 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128220.log 2024-02-19T17:16:21.644 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410693.log 2024-02-19T17:16:21.645 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518886.log 2024-02-19T17:16:21.646 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43975.log 2024-02-19T17:16:21.646 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376650.log 2024-02-19T17:16:21.647 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124409.log 2024-02-19T17:16:21.648 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163253.log 2024-02-19T17:16:21.649 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509708.log 2024-02-19T17:16:21.650 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516882.log 2024-02-19T17:16:21.651 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188694.log 2024-02-19T17:16:21.652 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320471.log 2024-02-19T17:16:21.652 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425162.log 2024-02-19T17:16:21.653 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117814.log 2024-02-19T17:16:21.654 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332294.log 2024-02-19T17:16:21.655 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354103.log 2024-02-19T17:16:21.656 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267940.log 2024-02-19T17:16:21.656 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198013.log 2024-02-19T17:16:21.657 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392747.log 2024-02-19T17:16:21.659 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127349.log 2024-02-19T17:16:21.659 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499816.log 2024-02-19T17:16:21.660 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138766.log 2024-02-19T17:16:21.661 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215348.log 2024-02-19T17:16:21.662 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349385.log 2024-02-19T17:16:21.663 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218424.log 2024-02-19T17:16:21.664 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522143.log 2024-02-19T17:16:21.664 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342400.log 2024-02-19T17:16:21.665 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445152.log 2024-02-19T17:16:21.666 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225360.log 2024-02-19T17:16:21.667 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197132.log 2024-02-19T17:16:21.668 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539223.log 2024-02-19T17:16:21.669 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338942.log 2024-02-19T17:16:21.669 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461185.log 2024-02-19T17:16:21.670 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309292.log 2024-02-19T17:16:21.671 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466361.log 2024-02-19T17:16:21.672 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46142.log 2024-02-19T17:16:21.673 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480978.log 2024-02-19T17:16:21.674 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417940.log 2024-02-19T17:16:21.675 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539902.log 2024-02-19T17:16:21.676 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234747.log 2024-02-19T17:16:21.676 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539536.log 2024-02-19T17:16:21.677 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539494.log 2024-02-19T17:16:21.678 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461612.log 2024-02-19T17:16:21.679 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194551.log 2024-02-19T17:16:21.680 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407311.log 2024-02-19T17:16:21.681 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395833.log 2024-02-19T17:16:21.681 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397124.log 2024-02-19T17:16:21.682 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449412.log 2024-02-19T17:16:21.683 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47201.log 2024-02-19T17:16:21.684 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531756.log 2024-02-19T17:16:21.685 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228983.log 2024-02-19T17:16:21.686 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537980.log 2024-02-19T17:16:21.687 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514166.log 2024-02-19T17:16:21.688 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201132.log 2024-02-19T17:16:21.689 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231312.log 2024-02-19T17:16:21.690 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354094.log 2024-02-19T17:16:21.691 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255976.log 2024-02-19T17:16:21.692 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117805.log 2024-02-19T17:16:21.692 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384963.log 2024-02-19T17:16:21.693 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313929.log 2024-02-19T17:16:21.694 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130323.log 2024-02-19T17:16:21.695 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42080.log 2024-02-19T17:16:21.696 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258068.log 2024-02-19T17:16:21.697 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479647.log 2024-02-19T17:16:21.698 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316127.log 2024-02-19T17:16:21.699 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350297.log 2024-02-19T17:16:21.700 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117554.log 2024-02-19T17:16:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347113.log 2024-02-19T17:16:21.702 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125631.log 2024-02-19T17:16:21.703 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-02-19T17:16:21.704 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208614.log 2024-02-19T17:16:21.704 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117564.log 2024-02-19T17:16:21.705 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254266.log 2024-02-19T17:16:21.707 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218831.log 2024-02-19T17:16:21.708 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531316.log 2024-02-19T17:16:21.712 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473295.log 2024-02-19T17:16:21.712 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143583.log 2024-02-19T17:16:21.712 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224524.log 2024-02-19T17:16:21.712 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518633.log 2024-02-19T17:16:21.713 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204701.log 2024-02-19T17:16:21.713 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331448.log 2024-02-19T17:16:21.714 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539986.log 2024-02-19T17:16:21.715 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323806.log 2024-02-19T17:16:21.716 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279006.log 2024-02-19T17:16:21.717 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388233.log 2024-02-19T17:16:21.718 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44030.log 2024-02-19T17:16:21.718 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455562.log 2024-02-19T17:16:21.719 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236407.log 2024-02-19T17:16:21.720 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458859.log 2024-02-19T17:16:21.721 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329360.log 2024-02-19T17:16:21.722 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385798.log 2024-02-19T17:16:21.723 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214480.log 2024-02-19T17:16:21.724 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459863.log 2024-02-19T17:16:21.725 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132916.log 2024-02-19T17:16:21.725 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508006.log 2024-02-19T17:16:21.726 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530445.log 2024-02-19T17:16:21.727 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211560.log 2024-02-19T17:16:21.728 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408992.log 2024-02-19T17:16:21.729 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399261.log 2024-02-19T17:16:21.730 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524281.log 2024-02-19T17:16:21.731 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522974.log 2024-02-19T17:16:21.731 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540364.log 2024-02-19T17:16:21.732 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539433.log 2024-02-19T17:16:21.733 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349862.log 2024-02-19T17:16:21.734 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345020.log 2024-02-19T17:16:21.735 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226185.log 2024-02-19T17:16:21.736 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530005.log 2024-02-19T17:16:21.761 INFO:teuthology.orchestra.run.smithi142.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-02-19T17:16:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.130781.log: /var/log/ceph/ceph-client.admin.69904.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.305925.log.gz 2024-02-19T17:16:22.054 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49982.log: /var/log/ceph/ceph-client.admin.45470.log: /var/log/ceph/ceph-client.admin.320891.log: /var/log/ceph/ceph-client.admin.210717.log: /var/log/ceph/ceph-client.admin.161044.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.398835.log.gz 2024-02-19T17:16:22.055 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.404334.log.gz 2024-02-19T17:16:22.055 INFO:teuthology.orchestra.run.smithi046.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.380127.log.gz 2024-02-19T17:16:22.055 INFO:teuthology.orchestra.run.smithi046.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.195818.log.gz 2024-02-19T17:16:22.055 INFO:teuthology.orchestra.run.smithi046.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.471094.log.gz 2024-02-19T17:16:22.055 INFO:teuthology.orchestra.run.smithi046.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.270451.log.gz 2024-02-19T17:16:22.055 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% 80.5% -- replaced with /var/log/ceph/ceph-client.admin.280882.log.gz 2024-02-19T17:16:22.059 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.270043.log.gz 2024-02-19T17:16:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.466770.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.119542.log.gz 2024-02-19T17:16:22.060 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.133747.log.gz 2024-02-19T17:16:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.540448.log: 89.9% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.460346.log.gz 2024-02-19T17:16:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.462054.log: -- replaced with /var/log/ceph/ceph-client.admin.232632.log.gz 2024-02-19T17:16:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.479229.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.540448.log.gz 2024-02-19T17:16:22.060 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.510138.log.gz 2024-02-19T17:16:22.060 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.249663.log.gz 2024-02-19T17:16:22.061 INFO:teuthology.orchestra.run.smithi046.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.207780.log.gz 2024-02-19T17:16:22.061 INFO:teuthology.orchestra.run.smithi046.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.311820.log.gz 2024-02-19T17:16:22.061 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.207789.log.gz 80.4% 2024-02-19T17:16:22.061 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.313086.log.gz 2024-02-19T17:16:22.061 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.391481.log.gz 2024-02-19T17:16:22.061 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46016.log.gz 2024-02-19T17:16:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.410249.log: -- replaced with /var/log/ceph/ceph-client.admin.483333.log.gz 2024-02-19T17:16:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.497382.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43264.log.gz 2024-02-19T17:16:22.062 INFO:teuthology.orchestra.run.smithi046.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.247100.log.gz 2024-02-19T17:16:22.062 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.327186.log.gz 2024-02-19T17:16:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.512886.log: /var/log/ceph/ceph-client.admin.487131.log: /var/log/ceph/ceph-client.admin.412384.log: /var/log/ceph/ceph-client.admin.523832.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47831.log.gz 2024-02-19T17:16:22.062 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42374.log.gz 2024-02-19T17:16:22.062 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.318768.log.gz 2024-02-19T17:16:22.063 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.151190.log.gz 2024-02-19T17:16:22.063 INFO:teuthology.orchestra.run.smithi046.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.2.45130.log.gz 2024-02-19T17:16:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.400979.log: /var/log/ceph/ceph-client.admin.537573.log: /var/log/ceph/ceph-client.admin.453821.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.320900.log.gz 2024-02-19T17:16:22.069 INFO:teuthology.orchestra.run.smithi046.stderr: 89.7% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.144857.log.gz 2024-02-19T17:16:22.070 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.512886.log.gz 2024-02-19T17:16:22.070 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.3.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.145266.log.gz 2024-02-19T17:16:22.070 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.252073.log.gz 2024-02-19T17:16:22.070 INFO:teuthology.orchestra.run.smithi046.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.308031.log.gz 2024-02-19T17:16:22.070 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.511549.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.537573.log.gz 2024-02-19T17:16:22.071 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.439435.log.gz 2024-02-19T17:16:22.071 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.412393.log: /var/log/ceph/ceph-client.admin.468938.log: /var/log/ceph/ceph-client.admin.536619.log: /var/log/ceph/ceph-client.admin.452109.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.503002.log.gz 2024-02-19T17:16:22.071 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.446886.log: /var/log/ceph/ceph-client.admin.490082.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.210300.log.gz 2024-02-19T17:16:22.071 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.496225.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.536619.log.gz 2024-02-19T17:16:22.071 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.467682.log: 84.6%/var/log/ceph/ceph-client.admin.515075.log: -- replaced with /var/log/ceph/ceph-client.admin.251618.log.gz 2024-02-19T17:16:22.071 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.259331.log.gz 2024-02-19T17:16:22.071 INFO:teuthology.orchestra.run.smithi046.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.273463.log.gz 2024-02-19T17:16:22.071 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.457893.log.gz 2024-02-19T17:16:22.072 INFO:teuthology.orchestra.run.smithi046.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.211968.log.gz 2024-02-19T17:16:22.072 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.515075.log.gz 2024-02-19T17:16:22.072 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.428347.log: /var/log/ceph/ceph-client.admin.516447.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.509717.log.gz 2024-02-19T17:16:22.072 INFO:teuthology.orchestra.run.smithi046.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.452978.log.gz 2024-02-19T17:16:22.072 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.472871.log: /var/log/ceph/ceph-client.admin.461603.log: /var/log/ceph/ceph-client.admin.443859.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.516447.log.gz 2024-02-19T17:16:22.072 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.504672.log.gz 2024-02-19T17:16:22.072 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.470673.log: /var/log/ceph/ceph-client.admin.537077.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.511549.log.gz 2024-02-19T17:16:22.072 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.402648.log: /var/log/ceph/ceph-client.admin.511540.log: /var/log/ceph/ceph-client.admin.426670.log: /var/log/ceph/ceph-client.admin.502993.log: /var/log/ceph/ceph-client.admin.483072.log: 84.6%/var/log/ceph/ceph-client.admin.483063.log: -- replaced with /var/log/ceph/ceph-client.admin.460337.log.gz 2024-02-19T17:16:22.073 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.477125.log.gz 2024-02-19T17:16:22.073 INFO:teuthology.orchestra.run.smithi046.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.511540.log.gz 2024-02-19T17:16:22.073 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.155964.log.gz 2024-02-19T17:16:22.073 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.156415.log.gz 2024-02-19T17:16:22.073 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.377935.log.gz 2024-02-19T17:16:22.073 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.162428.log.gz 2024-02-19T17:16:22.073 INFO:teuthology.orchestra.run.smithi046.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.449944.log.gz 2024-02-19T17:16:22.074 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.426325.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.331040.log.gz 2024-02-19T17:16:22.074 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45722.log.gz 2024-02-19T17:16:22.074 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.450794.log.gz 2024-02-19T17:16:22.074 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.521245.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43218.log.gz 2024-02-19T17:16:22.074 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.264613.log.gz 2024-02-19T17:16:22.074 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.141859.log.gz 2024-02-19T17:16:22.074 INFO:teuthology.orchestra.run.smithi046.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.330612.log.gz 2024-02-19T17:16:22.074 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.198022.log.gz 2024-02-19T17:16:22.075 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.521245.log.gz 2024-02-19T17:16:22.075 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.402239.log.gz 2024-02-19T17:16:22.075 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.456419.log: /var/log/ceph/ceph-client.admin.488900.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.188218.log.gz 2024-02-19T17:16:22.075 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539860.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.198467.log.gz 2024-02-19T17:16:22.075 INFO:teuthology.orchestra.run.smithi046.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.206494.log.gz 2024-02-19T17:16:22.075 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.393382.log: 88.4% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.441543.log.gz -- replaced with /var/log/ceph/ceph-client.admin.539860.log.gz 2024-02-19T17:16:22.075 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:22.075 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.326736.log.gz 2024-02-19T17:16:22.076 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.504245.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.422192.log.gz 2024-02-19T17:16:22.076 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.202928.log.gz 2024-02-19T17:16:22.076 INFO:teuthology.orchestra.run.smithi046.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.283856.log.gz 2024-02-19T17:16:22.076 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.337975.log.gz 2024-02-19T17:16:22.076 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.443367.log: /var/log/ceph/ceph-client.admin.400571.log: 89.8%/var/log/ceph/ceph-client.admin.484173.log: -- replaced with /var/log/ceph/ceph-client.admin.508433.log.gz 2024-02-19T17:16:22.076 INFO:teuthology.orchestra.run.smithi046.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.130772.log.gz 2024-02-19T17:16:22.076 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.409423.log.gz 2024-02-19T17:16:22.077 INFO:teuthology.orchestra.run.smithi046.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.109340.log.gz 2024-02-19T17:16:22.082 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.401822.log: 84.7% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.243349.log.gz 2024-02-19T17:16:22.082 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.502575.log.gz 2024-02-19T17:16:22.082 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.443850.log: -- replaced with /var/log/ceph/ceph-client.admin.163556.log.gz 2024-02-19T17:16:22.082 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.239814.log.gz 2024-02-19T17:16:22.082 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.475463.log.gz 2024-02-19T17:16:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539349.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.477967.log.gz 2024-02-19T17:16:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.509260.log: /var/log/ceph/ceph-client.admin.517296.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.208623.log.gz 2024-02-19T17:16:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.468510.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.539349.log.gz 2024-02-19T17:16:22.083 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.481403.log.gz 2024-02-19T17:16:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.407732.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.517296.log.gz 2024-02-19T17:16:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.482810.log: /var/log/ceph/ceph-client.admin.460760.log: /var/log/ceph/ceph-client.admin.519126.log: /var/log/ceph/ceph-client.admin.476708.log: /var/log/ceph/ceph-client.admin.520824.log: /var/log/ceph/ceph-client.admin.463918.log: /var/log/ceph/ceph-client.admin.539620.log: /var/log/ceph/ceph-client.admin.520405.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.539620.log.gz 2024-02-19T17:16:22.083 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.519126.log.gz 2024-02-19T17:16:22.083 INFO:teuthology.orchestra.run.smithi046.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.520824.log.gz 2024-02-19T17:16:22.084 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.520405.log.gz 2024-02-19T17:16:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539391.log: /var/log/ceph/ceph-client.admin.523415.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.129055.log.gz 2024-02-19T17:16:22.084 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.444689.log.gz 2024-02-19T17:16:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.506344.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.445161.log.gz 2024-02-19T17:16:22.084 INFO:teuthology.orchestra.run.smithi046.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.539391.log.gz 2024-02-19T17:16:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.500493.log: /var/log/ceph/ceph-client.admin.507180.log: /var/log/ceph/ceph-client.admin.465943.log: /var/log/ceph/ceph-client.admin.525602.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.523415.log.gz 2024-02-19T17:16:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.515526.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44740.log.gz 2024-02-19T17:16:22.084 INFO:teuthology.orchestra.run.smithi046.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.515526.log.gz 2024-02-19T17:16:22.085 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.505090.log.gz 2024-02-19T17:16:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.480987.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.217133.log.gz 2024-02-19T17:16:22.085 INFO:teuthology.orchestra.run.smithi046.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46907.log.gz/var/log/ceph/ceph-client.admin.513712.log: 2024-02-19T17:16:22.085 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.224943.log.gz 2024-02-19T17:16:22.085 INFO:teuthology.orchestra.run.smithi046.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.513712.log.gz 2024-02-19T17:16:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.403904.log: /var/log/ceph/ceph-client.admin.441981.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.267115.log.gz 2024-02-19T17:16:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.508015.log: /var/log/ceph/ceph-client.admin.401813.log: /var/log/ceph/ceph-client.admin.452518.log: /var/log/ceph/ceph-client.admin.508842.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.132063.log.gz 2024-02-19T17:16:22.086 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.525602.log.gz 2024-02-19T17:16:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.409001.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.251627.log.gz 2024-02-19T17:16:22.086 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.424746.log.gz 2024-02-19T17:16:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mgr.y.log: 89.9%/var/log/ceph/ceph-client.admin.402657.log: -- replaced with /var/log/ceph/ceph-client.admin.328524.log.gz/var/log/ceph/ceph-client.admin.526474.log: 2024-02-19T17:16:22.100 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.457401.log: /var/log/ceph/ceph-client.admin.397537.log: 89.2% 81.6% -- replaced with /var/log/ceph/ceph-client.admin.350288.log.gz 2024-02-19T17:16:22.100 INFO:teuthology.orchestra.run.smithi046.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.526474.log.gz 2024-02-19T17:16:22.101 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69904.log.gz 2024-02-19T17:16:22.101 INFO:teuthology.orchestra.run.smithi046.stderr: 91.8% 81.4% -- replaced with /var/log/ceph/ceph-client.admin.406466.log.gz 2024-02-19T17:16:22.101 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.397998.log: -- replaced with /var/log/ceph/ceph-client.admin.405611.log.gz 2024-02-19T17:16:22.101 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.325889.log.gz 2024-02-19T17:16:22.102 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.427101.log.gz 2024-02-19T17:16:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.406884.log: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.507589.log.gz 2024-02-19T17:16:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.475454.log: /var/log/ceph/ceph-client.admin.491396.log: /var/log/ceph/ceph-client.admin.462537.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.252899.log.gz 2024-02-19T17:16:22.102 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.440269.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.306343.log.gz 2024-02-19T17:16:22.103 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9%/var/log/ceph/ceph-client.admin.471556.log: -- replaced with /var/log/ceph/ceph-client.admin.233050.log.gz 2024-02-19T17:16:22.103 INFO:teuthology.orchestra.run.smithi046.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.233887.log.gz 2024-02-19T17:16:22.103 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.515986.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.318360.log.gz 2024-02-19T17:16:22.103 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.515986.log.gz 2024-02-19T17:16:22.104 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43928.log.gz 2024-02-19T17:16:22.104 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.325898.log.gz 2024-02-19T17:16:22.104 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.189639.log.gz 2024-02-19T17:16:22.104 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.205155.log.gz 2024-02-19T17:16:22.105 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4%/var/log/ceph/ceph-client.admin.448562.log: -- replaced with /var/log/ceph/ceph-client.admin.442884.log.gz/var/log/ceph/ceph-client.admin.425578.log: 2024-02-19T17:16:22.105 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.160395.log.gz 2024-02-19T17:16:22.105 INFO:teuthology.orchestra.run.smithi046.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.147019.log.gz 2024-02-19T17:16:22.105 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.522983.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49748.log.gz 2024-02-19T17:16:22.106 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.514626.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49916.log.gz 2024-02-19T17:16:22.106 INFO:teuthology.orchestra.run.smithi046.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.310565.log.gz 2024-02-19T17:16:22.106 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.514626.log.gz 2024-02-19T17:16:22.106 INFO:teuthology.orchestra.run.smithi046.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.514175.log.gz 2024-02-19T17:16:22.106 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.522983.log.gz 2024-02-19T17:16:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.468099.log: /var/log/ceph/ceph-client.admin.540154.log: 92.2%/var/log/ceph/ceph-client.admin.454238.log: /var/log/ceph/ceph-client.admin.412815.log: -- replaced with /var/log/ceph/ceph-client.admin.337984.log.gz 2024-02-19T17:16:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.519966.log: /var/log/ceph/ceph-client.admin.525152.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.540154.log.gz 2024-02-19T17:16:22.107 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.447318.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.519966.log.gz 2024-02-19T17:16:22.107 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.462546.log.gz 2024-02-19T17:16:22.108 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.525152.log.gz 2024-02-19T17:16:22.108 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.472445.log: /var/log/ceph/ceph-client.admin.502156.log: /var/log/ceph/ceph-client.admin.454646.log: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.523832.log.gz 2024-02-19T17:16:22.108 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47243.log.gz 2024-02-19T17:16:22.109 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.486252.log: /var/log/ceph/ceph-client.admin.535328.log: /var/log/ceph/ceph-client.admin.514635.log: 93.1%/var/log/ceph/ceph-client.admin.403913.log: -- replaced with /var/log/ceph/ceph-client.admin.202033.log.gz 2024-02-19T17:16:22.109 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.446455.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.535328.log.gz 2024-02-19T17:16:22.109 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.506335.log: /var/log/ceph/ceph-client.admin.512877.log: /var/log/ceph/ceph-client.admin.468929.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.244176.log.gz 2024-02-19T17:16:22.109 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.534472.log: /var/log/ceph/ceph-client.admin.467673.log: 84.3%/var/log/ceph/ceph-client.admin.424325.log: -- replaced with /var/log/ceph/ceph-client.admin.512877.log.gz 2024-02-19T17:16:22.109 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.517715.log: 84.1% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.534472.log.gz -- replaced with /var/log/ceph/ceph-client.admin.502165.log.gz 2024-02-19T17:16:22.110 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:22.110 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.517715.log.gz 2024-02-19T17:16:22.110 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.540196.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.469774.log.gz 2024-02-19T17:16:22.111 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.508015.log.gz 2024-02-19T17:16:22.111 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.425587.log: 89.2%/var/log/ceph/ceph-client.admin.480562.log: -- replaced with /var/log/ceph/ceph-client.admin.540196.log.gz 2024-02-19T17:16:22.111 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.521653.log: /var/log/ceph/ceph-client.admin.451675.log: /var/log/ceph/ceph-client.admin.504663.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.153354.log.gz 2024-02-19T17:16:22.147 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.458367.log: /var/log/ceph/ceph-client.admin.481820.log: /var/log/ceph/ceph-client.admin.139196.log: /var/log/ceph/ceph-client.admin.310156.log: /var/log/ceph/ceph-client.admin.218831.log: /var/log/ceph/ceph-client.admin.540322.log: /var/log/ceph/ceph-client.admin.524710.log: 81.9%/var/log/ceph/ceph-client.admin.459267.log: -- replaced with /var/log/ceph/ceph-client.admin.483747.log.gz 2024-02-19T17:16:22.147 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.0.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42586.log.gz 2024-02-19T17:16:22.148 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.540322.log.gz 2024-02-19T17:16:22.148 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9%/var/log/ceph/ceph-client.admin.474548.log: -- replaced with /var/log/ceph/ceph-client.admin.49874.log.gz 2024-02-19T17:16:22.148 INFO:teuthology.orchestra.run.smithi046.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.218415.log.gz 2024-02-19T17:16:22.148 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.404765.log: /var/log/ceph/ceph-client.admin.426679.log: /var/log/ceph/ceph-client.admin.469348.log: /var/log/ceph/ceph-client.admin.479238.log: /var/log/ceph/ceph-client.admin.536182.log: /var/log/ceph/ceph-client.admin.534024.log: /var/log/ceph/ceph-client.admin.503411.log: /var/log/ceph/ceph-client.admin.453812.log: /var/log/ceph/ceph-client.admin.405178.log: /var/log/ceph/ceph-client.admin.451205.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.534024.log.gz 2024-02-19T17:16:22.149 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.469765.log.gz 2024-02-19T17:16:22.149 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.469357.log.gz/var/log/ceph/ceph-client.admin.503420.log: 2024-02-19T17:16:22.149 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.500067.log: /var/log/ceph/ceph-client.admin.471103.log: /var/log/ceph/ceph-client.admin.484164.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.319603.log.gz 2024-02-19T17:16:22.149 INFO:teuthology.orchestra.run.smithi046.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.341973.log.gz 2024-02-19T17:16:22.150 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.322567.log.gz 2024-02-19T17:16:22.150 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.476291.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.422608.log.gz 2024-02-19T17:16:22.150 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.483324.log: /var/log/ceph/ceph-client.admin.473713.log: /var/log/ceph/ceph-client.admin.540574.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.457401.log.gz 2024-02-19T17:16:22.150 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.474131.log.gz 2024-02-19T17:16:22.150 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.540574.log.gz 2024-02-19T17:16:22.151 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.527363.log: /var/log/ceph/ceph-client.admin.452100.log: /var/log/ceph/ceph-client.admin.527354.log: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.527354.log.gz 2024-02-19T17:16:22.151 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.526914.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.505917.log.gz 2024-02-19T17:16:22.151 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.526914.log.gz 2024-02-19T17:16:22.151 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.536182.log.gz 2024-02-19T17:16:22.152 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.282597.log.gz 2024-02-19T17:16:22.152 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.403075.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.231788.log.gz 2024-02-19T17:16:22.152 INFO:teuthology.orchestra.run.smithi046.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.235156.log.gz 2024-02-19T17:16:22.152 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.347540.log.gz 2024-02-19T17:16:22.152 INFO:teuthology.orchestra.run.smithi046.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.212387.log.gz 2024-02-19T17:16:22.152 INFO:teuthology.orchestra.run.smithi046.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.196254.log.gz 2024-02-19T17:16:22.152 INFO:teuthology.orchestra.run.smithi046.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.486261.log.gz 2024-02-19T17:16:22.153 INFO:teuthology.orchestra.run.smithi046.stderr: 92.3%/var/log/ceph/ceph-client.admin.485845.log: -- replaced with /var/log/ceph/ceph-client.admin.527363.log.gz 2024-02-19T17:16:22.153 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.163821.log.gz 2024-02-19T17:16:22.153 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% 84.5% -- replaced with /var/log/ceph/ceph-client.admin.141385.log.gz 2024-02-19T17:16:22.153 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.388749.log.gz 2024-02-19T17:16:22.154 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.253325.log.gz 2024-02-19T17:16:22.154 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.398422.log.gz 2024-02-19T17:16:22.154 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.484998.log.gz 2024-02-19T17:16:22.154 INFO:teuthology.orchestra.run.smithi046.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37751.log.gz 2024-02-19T17:16:22.154 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.501738.log: /var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.478813.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.463927.log.gz 2024-02-19T17:16:22.155 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.540699.log: /var/log/ceph/ceph-client.admin.393391.log: /var/log/ceph/ceph-client.admin.493763.log: /var/log/ceph/ceph-client.admin.463027.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.540699.log.gz 2024-02-19T17:16:22.155 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.421765.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.215803.log.gz 2024-02-19T17:16:22.155 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.505081.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.240682.log.gz 2024-02-19T17:16:22.155 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.512388.log: /var/log/ceph/ceph-client.admin.533116.log: /var/log/ceph/ceph-osd.2.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.512388.log.gz 2024-02-19T17:16:22.155 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.439018.log: /var/log/ceph/ceph-client.admin.422599.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.213653.log.gz 2024-02-19T17:16:22.155 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.497391.log: 89.9%/var/log/ceph/ceph-client.admin.401396.log: -- replaced with /var/log/ceph/ceph-client.admin.211143.log.gz 2024-02-19T17:16:22.155 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.517305.log: /var/log/ceph/ceph-client.admin.439027.log: 85.0% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.391490.log.gz 2024-02-19T17:16:22.156 INFO:teuthology.orchestra.run.smithi046.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.250987.log.gz 2024-02-19T17:16:22.156 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.386667.log.gz 2024-02-19T17:16:22.156 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.540070.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.517305.log.gz 2024-02-19T17:16:22.156 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.540070.log.gz 2024-02-19T17:16:22.156 INFO:teuthology.orchestra.run.smithi046.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.481394.log.gz 2024-02-19T17:16:22.156 INFO:teuthology.orchestra.run.smithi046.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.309724.log.gz 2024-02-19T17:16:22.156 INFO:teuthology.orchestra.run.smithi046.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.533116.log.gz 2024-02-19T17:16:22.157 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.443367.log.gz 2024-02-19T17:16:22.157 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.533575.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.477543.log.gz 2024-02-19T17:16:22.157 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.446877.log: /var/log/ceph/ceph-mds.c.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.273027.log.gz 2024-02-19T17:16:22.157 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1%/var/log/ceph/ceph-client.admin.464350.log: -- replaced with /var/log/ceph/ceph-client.admin.480987.log.gz 2024-02-19T17:16:22.158 INFO:teuthology.orchestra.run.smithi046.stderr: 78.9% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.309733.log.gz 2024-02-19T17:16:22.158 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.424755.log: -- replaced with /var/log/ceph/ceph-client.admin.245072.log.gz/var/log/ceph/ceph-client.admin.470238.log: 2024-02-19T17:16:22.158 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.198458.log.gz 2024-02-19T17:16:22.158 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.473722.log: /var/log/ceph/ceph-client.admin.501321.log: /var/log/ceph/ceph-client.admin.423025.log: /var/log/ceph/ceph-client.admin.406049.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.423438.log.gz 2024-02-19T17:16:22.158 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45512.log.gz 2024-02-19T17:16:22.158 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46787.log.gz 2024-02-19T17:16:22.159 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.455571.log: /var/log/ceph/ceph-client.admin.440686.log: /var/log/ceph/ceph-client.admin.507598.log: /var/log/ceph/ceph-client.admin.467262.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.533575.log.gz 2024-02-19T17:16:22.159 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.529565.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.224107.log.gz 2024-02-19T17:16:22.159 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.537989.log: /var/log/ceph/ceph-client.admin.474981.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.425171.log.gz 2024-02-19T17:16:22.159 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.257646.log.gz 2024-02-19T17:16:22.159 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.537989.log.gz 2024-02-19T17:16:22.159 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48209.log.gz 2024-02-19T17:16:22.160 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49169.log.gz 2024-02-19T17:16:22.160 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.396264.log: 94.4% 93.4% -- replaced with /var/log/ceph/ceph-client.admin.317853.log.gz/var/log/ceph/ceph-client.admin.508424.log: 2024-02-19T17:16:22.160 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.163565.log.gz 2024-02-19T17:16:22.160 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.532637.log: /var/log/ceph/ceph-client.admin.501747.log: /var/log/ceph/ceph-client.admin.528235.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.532637.log.gz 2024-02-19T17:16:22.160 INFO:teuthology.orchestra.run.smithi046.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.529565.log.gz 2024-02-19T17:16:22.160 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.400141.log: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.528235.log.gz 2024-02-19T17:16:22.161 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.342391.log.gz 2024-02-19T17:16:22.161 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.202479.log.gz 2024-02-19T17:16:22.161 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.346270.log.gz 2024-02-19T17:16:22.161 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.518895.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.407741.log.gz 2024-02-19T17:16:22.162 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.456891.log: /var/log/ceph/ceph-client.admin.448980.log: /var/log/ceph/ceph-client.admin.500076.log: 81.5%/var/log/ceph/ceph-client.admin.499807.log: -- replaced with /var/log/ceph/ceph-client.admin.427930.log.gz 2024-02-19T17:16:22.162 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.496216.log.gz 2024-02-19T17:16:22.162 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.485836.log: /var/log/ceph/ceph-client.admin.503837.log: /var/log/ceph/ceph-client.admin.405187.log: /var/log/ceph/ceph-client.admin.406058.log: /var/log/ceph/ceph-client.admin.396693.log: /var/log/ceph/ceph-client.admin.507171.log: /var/log/ceph/ceph-client.admin.411142.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.113090.log.gz 2024-02-19T17:16:22.162 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.447727.log: /var/log/ceph/ceph-client.admin.408154.log: /var/log/ceph/ceph-client.admin.462063.log: /var/log/ceph/ceph-client.admin.447736.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.229878.log.gz 2024-02-19T17:16:22.162 INFO:teuthology.orchestra.run.smithi046.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.109766.log.gz 2024-02-19T17:16:22.162 INFO:teuthology.orchestra.run.smithi046.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.524710.log.gz 2024-02-19T17:16:22.163 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.520815.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.152462.log.gz 2024-02-19T17:16:22.163 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.235574.log.gz 2024-02-19T17:16:22.163 INFO:teuthology.orchestra.run.smithi046.stderr: 78.1%/var/log/ceph/ceph-client.admin.448989.log: -- replaced with /var/log/ceph/ceph-client.admin.520815.log.gz 2024-02-19T17:16:22.163 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% 78.6% -- replaced with /var/log/ceph/ceph-client.admin.279439.log.gz 2024-02-19T17:16:22.163 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.252064.log.gz 2024-02-19T17:16:22.164 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.398413.log.gz 2024-02-19T17:16:22.164 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539578.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.472454.log.gz 2024-02-19T17:16:22.164 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9%/var/log/ceph/ceph-client.admin.468519.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49443.log.gz 2024-02-19T17:16:22.164 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.539578.log.gz 2024-02-19T17:16:22.164 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.478399.log.gz 2024-02-19T17:16:22.164 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.529116.log: 77.4%/var/log/ceph/ceph-client.admin.540741.log: -- replaced with /var/log/ceph/ceph-client.admin.448144.log.gz 2024-02-19T17:16:22.165 INFO:teuthology.orchestra.run.smithi046.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.529116.log.gz 2024-02-19T17:16:22.165 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.510584.log: /var/log/ceph/ceph-client.admin.477976.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.540741.log.gz 2024-02-19T17:16:22.165 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.473286.log: 90.0%/var/log/ceph/ceph-client.admin.441113.log: -- replaced with /var/log/ceph/ceph-client.admin.427939.log.gz 2024-02-19T17:16:22.165 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.410693.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.478822.log.gz 2024-02-19T17:16:22.165 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.518886.log: /var/log/ceph/ceph-client.admin.509708.log: /var/log/ceph/ceph-client.admin.516882.log: /var/log/ceph/ceph-client.admin.425162.log: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.503828.log.gz 90.1% -- replaced with /var/log/ceph/ceph-client.admin.486708.log.gz 2024-02-19T17:16:22.166 INFO:teuthology.orchestra.run.smithi046.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.205601.log.gz 2024-02-19T17:16:22.166 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% 2024-02-19T17:16:22.166 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7%/var/log/ceph/ceph-client.admin.499816.log: /var/log/ceph/ceph-client.admin.522143.log: /var/log/ceph/ceph-client.admin.445152.log: -- replaced with /var/log/ceph/ceph-client.admin.459872.log.gz 2024-02-19T17:16:22.166 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.516882.log.gz 2024-02-19T17:16:22.166 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.463436.log.gz 2024-02-19T17:16:22.166 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539223.log: /var/log/ceph/ceph-client.admin.461185.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.179865.log.gz 2024-02-19T17:16:22.166 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.522143.log.gz 2024-02-19T17:16:22.167 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.539223.log.gz 2024-02-19T17:16:22.167 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.466361.log: 84.7%/var/log/ceph/ceph-client.admin.480978.log: -- replaced with /var/log/ceph/ceph-client.admin.227939.log.gz 90.0% -- replaced with /var/log/ceph/ceph-client.admin.377081.log.gz 2024-02-19T17:16:22.167 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:22.237 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.417940.log: /var/log/ceph/ceph-client.admin.539902.log: /var/log/ceph/ceph-client.admin.539536.log: /var/log/ceph/ceph-client.admin.461612.log: /var/log/ceph/ceph-client.admin.407311.log: /var/log/ceph/ceph-client.admin.395833.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.539536.log.gz 2024-02-19T17:16:22.238 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.539902.log.gz 2024-02-19T17:16:22.238 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539494.log: /var/log/ceph/ceph-client.admin.397124.log: /var/log/ceph/ceph-client.admin.449412.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47033.log.gz 2024-02-19T17:16:22.238 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.539494.log.gz 2024-02-19T17:16:22.239 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47117.log.gz 2024-02-19T17:16:22.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.531756.log: -- replaced with /var/log/ceph/ceph-client.admin.47075.log.gz/var/log/ceph/ceph-client.admin.537980.log: 2024-02-19T17:16:22.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.514166.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42598.log.gz 2024-02-19T17:16:22.239 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.537980.log.gz 2024-02-19T17:16:22.240 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.514166.log.gz 2024-02-19T17:16:22.240 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% 91.9% -- replaced with /var/log/ceph/ceph-client.admin.229431.log.gz -- replaced with /var/log/ceph/ceph-client.admin.351654.log.gz 2024-02-19T17:16:22.240 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:22.240 INFO:teuthology.orchestra.run.smithi046.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.379680.log.gz 2024-02-19T17:16:22.240 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.337494.log.gz 2024-02-19T17:16:22.241 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.352105.log.gz 2024-02-19T17:16:22.241 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.266272.log.gz 2024-02-19T17:16:22.241 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.281344.log.gz 2024-02-19T17:16:22.241 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% 84.0% -- replaced with /var/log/ceph/ceph-client.admin.146597.log.gz 2024-02-19T17:16:22.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.479647.log: -- replaced with /var/log/ceph/ceph-client.admin.403066.log.gz 2024-02-19T17:16:22.242 INFO:teuthology.orchestra.run.smithi046.stderr: 92.9% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.346696.log.gz 2024-02-19T17:16:22.242 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.183253.log.gz 2024-02-19T17:16:22.242 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.466361.log.gz 2024-02-19T17:16:22.242 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.155510.log.gz 92.3% -- replaced with /var/log/ceph/ceph-client.admin.531756.log.gz 2024-02-19T17:16:22.242 INFO:teuthology.orchestra.run.smithi046.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.161494.log.gz 2024-02-19T17:16:22.243 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:22.243 INFO:teuthology.orchestra.run.smithi046.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.466770.log.gz 2024-02-19T17:16:22.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.a.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.357477.log.gz 2024-02-19T17:16:22.244 INFO:teuthology.orchestra.run.smithi046.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.133329.log.gz 92.4% 2024-02-19T17:16:22.244 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.424334.log.gz 2024-02-19T17:16:22.244 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.531316.log: /var/log/ceph/ceph-client.admin.473295.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.129464.log.gz 2024-02-19T17:16:22.245 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.153363.log.gz 2024-02-19T17:16:22.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.518633.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.234738.log.gz 2024-02-19T17:16:22.245 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539986.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.392738.log.gz 2024-02-19T17:16:22.245 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.539986.log.gz 2024-02-19T17:16:22.246 INFO:teuthology.orchestra.run.smithi046.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.394989.log.gz 2024-02-19T17:16:22.246 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.198934.log.gz 2024-02-19T17:16:22.246 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.455562.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.518633.log.gz 2024-02-19T17:16:22.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.508006.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.118653.log.gz 2024-02-19T17:16:22.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.459863.log: /var/log/ceph/ceph-client.admin.458859.log: /var/log/ceph/ceph-client.admin.530445.log: /var/log/ceph/ceph-client.admin.408992.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.531316.log.gz 2024-02-19T17:16:22.247 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.479647.log.gz 2024-02-19T17:16:22.247 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.399261.log: /var/log/ceph/ceph-client.admin.524281.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.485007.log.gz 2024-02-19T17:16:22.247 INFO:teuthology.orchestra.run.smithi046.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.524281.log.gz 2024-02-19T17:16:22.248 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.522974.log: /var/log/ceph/ceph-client.admin.540364.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.189630.log.gz 2024-02-19T17:16:22.248 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.258905.log.gz 2024-02-19T17:16:22.248 INFO:teuthology.orchestra.run.smithi046.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.522974.log.gz 2024-02-19T17:16:22.248 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.539433.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.423879.log.gz 2024-02-19T17:16:22.248 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.540364.log.gz 2024-02-19T17:16:22.249 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.539433.log.gz 2024-02-19T17:16:22.249 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2%/var/log/ceph/ceph-client.admin.530005.log: -- replaced with /var/log/ceph/ceph-client.admin.140032.log.gz 2024-02-19T17:16:22.249 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.269617.log.gz 2024-02-19T17:16:22.249 INFO:teuthology.orchestra.run.smithi046.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.493753.log.gz 2024-02-19T17:16:22.250 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.187356.log.gz 2024-02-19T17:16:22.250 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.252491.log.gz 2024-02-19T17:16:22.250 INFO:teuthology.orchestra.run.smithi046.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.180273.log.gz 2024-02-19T17:16:22.250 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.180704.log.gz 2024-02-19T17:16:22.250 INFO:teuthology.orchestra.run.smithi046.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.530445.log.gz 2024-02-19T17:16:22.251 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.212396.log.gz 2024-02-19T17:16:22.251 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.439444.log.gz 2024-02-19T17:16:22.251 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.217550.log.gz 2024-02-19T17:16:22.251 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47485.log.gz 2024-02-19T17:16:22.251 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% 91.8% -- replaced with /var/log/ceph/ceph-client.admin.196263.log.gz 2024-02-19T17:16:22.251 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.216239.log.gz 2024-02-19T17:16:22.251 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49355.log.gz 2024-02-19T17:16:22.252 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.439861.log.gz 2024-02-19T17:16:22.252 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.132494.log.gz 2024-02-19T17:16:22.252 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.220498.log.gz 2024-02-19T17:16:22.252 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.324647.log.gz 2024-02-19T17:16:22.252 INFO:teuthology.orchestra.run.smithi046.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.279448.log.gz 2024-02-19T17:16:22.252 INFO:teuthology.orchestra.run.smithi046.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.444698.log.gz 2024-02-19T17:16:22.253 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.238140.log.gz 2024-02-19T17:16:22.253 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.133338.log.gz 2024-02-19T17:16:22.253 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.394998.log.gz 2024-02-19T17:16:22.253 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.214911.log.gz 2024-02-19T17:16:22.253 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.485426.log.gz 2024-02-19T17:16:22.254 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.252908.log.gz 2024-02-19T17:16:22.254 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.228499.log.gz 2024-02-19T17:16:22.254 INFO:teuthology.orchestra.run.smithi046.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.134164.log.gz 2024-02-19T17:16:22.254 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% 78.3% -- replaced with /var/log/ceph/ceph-client.admin.426031.log.gz 2024-02-19T17:16:22.254 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.444267.log.gz 2024-02-19T17:16:22.255 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.444276.log.gz 2024-02-19T17:16:22.255 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.410684.log.gz 2024-02-19T17:16:22.255 INFO:teuthology.orchestra.run.smithi046.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.220933.log.gz 2024-02-19T17:16:22.255 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.218007.log.gz 2024-02-19T17:16:22.255 INFO:teuthology.orchestra.run.smithi046.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.409832.log.gz 2024-02-19T17:16:22.256 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.426437.log.gz 2024-02-19T17:16:22.256 INFO:teuthology.orchestra.run.smithi046.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.232623.log.gz 2024-02-19T17:16:22.256 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% 84.7% -- replaced with /var/log/ceph/ceph-client.admin.466352.log.gz 2024-02-19T17:16:22.256 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.467253.log.gz 2024-02-19T17:16:22.256 INFO:teuthology.orchestra.run.smithi046.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.441972.log.gz 2024-02-19T17:16:22.256 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.279882.log.gz 2024-02-19T17:16:22.257 INFO:teuthology.orchestra.run.smithi046.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.501330.log.gz 2024-02-19T17:16:22.257 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41866.log.gz 2024-02-19T17:16:22.257 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.455991.log.gz 2024-02-19T17:16:22.257 INFO:teuthology.orchestra.run.smithi046.stderr: 90.3% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42332.log.gz 2024-02-19T17:16:22.257 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.309301.log.gz 2024-02-19T17:16:22.257 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.306770.log.gz 93.3% -- replaced with /var/log/ceph/ceph-client.admin.201141.log.gz 2024-02-19T17:16:22.257 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:22.258 INFO:teuthology.orchestra.run.smithi046.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.492608.log.gz 2024-02-19T17:16:22.258 INFO:teuthology.orchestra.run.smithi046.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.377494.log.gz 2024-02-19T17:16:22.258 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.378364.log.gz 2024-02-19T17:16:22.258 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.399252.log.gz 2024-02-19T17:16:22.259 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.495037.log.gz 2024-02-19T17:16:22.259 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.461194.log.gz 2024-02-19T17:16:22.259 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.181112.log.gz 2024-02-19T17:16:22.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.382811.log: /var/log/ceph/ceph-client.admin.43592.log: /var/log/ceph/ceph-client.admin.211977.log: /var/log/ceph/ceph-client.admin.128211.log: /var/log/ceph/ceph-client.admin.43270.log: /var/log/ceph/ceph-client.admin.239386.log: /var/log/ceph/ceph-client.admin.306761.log: /var/log/ceph/ceph-client.admin.119968.log: /var/log/ceph/ceph-client.admin.322558.log: /var/log/ceph/ceph-client.admin.235165.log: /var/log/ceph/ceph-client.admin.351237.log: /var/log/ceph/ceph-client.admin.49001.log: /var/log/ceph/ceph-client.admin.213225.log: /var/log/ceph/ceph-client.admin.44072.log: /var/log/ceph/ceph-client.admin.376659.log: /var/log/ceph/ceph-client.admin.310996.log: /var/log/ceph/ceph-client.admin.114064.log: /var/log/ceph/ceph-client.admin.341101.log: /var/log/ceph/ceph-client.admin.344603.log: /var/log/ceph/ceph-client.admin.41996.log: /var/log/ceph/ceph-client.admin.135416.log: /var/log/ceph/ceph-client.admin.185610.log: /var/log/ceph/ceph-client.admin.42248.log: /var/log/ceph/ceph-client.admin.385371.log: /var/log/ceph/ceph-client.admin.214071.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.310156.log.gz 2024-02-19T17:16:22.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.340684.log: /var/log/ceph/ceph-client.admin.211551.log: /var/log/ceph/ceph-client.admin.45386.log: /var/log/ceph/ceph-client.admin.265864.log: /var/log/ceph/ceph-client.admin.110689.log: /var/log/ceph/ceph-client.admin.111773.log: /var/log/ceph/ceph-client.admin.143160.log: /var/log/ceph/ceph-client.admin.265855.log: /var/log/ceph/ceph-client.admin.315628.log: /var/log/ceph/ceph-client.admin.230316.log: /var/log/ceph/ceph-client.admin.47711.log: /var/log/ceph/ceph-client.admin.141394.log: /var/log/ceph/ceph-client.admin.261850.log: /var/log/ceph/ceph-client.admin.247542.log: /var/log/ceph/ceph-client.admin.261437.log: /var/log/ceph/ceph-client.admin.179448.log: /var/log/ceph/ceph-client.admin.348012.log: /var/log/ceph/ceph-client.admin.217559.log: /var/log/ceph/ceph-client.admin.283014.log: /var/log/ceph/ceph-client.admin.162845.log: /var/log/ceph/ceph-client.admin.258496.log: /var/log/ceph/ceph-client.admin.385789.log: /var/log/ceph/ceph.tmp-client.admin.31423.log: /var/log/ceph/ceph-client.admin.120377.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31423.log.gz 2024-02-19T17:16:22.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.391907.log: /var/log/ceph/ceph-client.admin.47159.log: /var/log/ceph/ceph-client.admin.218840.log: /var/log/ceph/ceph-client.admin.124880.log: /var/log/ceph/ceph-client.admin.162419.log: /var/log/ceph/ceph-client.admin.45764.log: /var/log/ceph/ceph-client.admin.235583.log: /var/log/ceph/ceph-client.admin.47873.log: /var/log/ceph/ceph-client.admin.162836.log: /var/log/ceph/ceph-client.admin.199796.log: /var/log/ceph/ceph-client.admin.132485.log: /var/log/ceph/ceph-client.admin.385380.log: /var/log/ceph/ceph-client.admin.109349.log: /var/log/ceph/ceph-client.admin.46745.log: /var/log/ceph/ceph-client.admin.195809.log: /var/log/ceph/ceph-client.admin.150221.log: /var/log/ceph/ceph-client.admin.162009.log: /var/log/ceph/ceph-client.admin.210309.log: /var/log/ceph/ceph-client.admin.208206.log: /var/log/ceph/ceph-client.admin.48958.log: /var/log/ceph/ceph-client.admin.330196.log: /var/log/ceph/ceph-client.admin.152050.log: /var/log/ceph/ceph-client.admin.46949.log: /var/log/ceph/ceph-client.admin.247982.log: /var/log/ceph/ceph-client.admin.278584.log: /var/log/ceph/ceph-client.admin.49706.log: /var/log/ceph/ceph-client.admin.214902.log: /var/log/ceph/ceph-client.admin.259322.log: /var/log/ceph/ceph-client.admin.341543.log: /var/log/ceph/ceph-client.admin.45890.log: /var/log/ceph/ceph-client.admin.264604.log: /var/log/ceph/ceph-client.admin.196683.log: /var/log/ceph/ceph-client.admin.182808.log: /var/log/ceph/ceph-client.admin.46405.log: /var/log/ceph/ceph-client.admin.180695.log: /var/log/ceph/ceph-client.admin.48835.log: /var/log/ceph/ceph-client.admin.216693.log: /var/log/ceph/ceph-client.admin.381569.log: /var/log/ceph/ceph-client.admin.393094.log: /var/log/ceph/ceph-client.admin.241994.log: /var/log/ceph/ceph-client.admin.283435.log: /var/log/ceph/ceph-client.admin.265438.log: /var/log/ceph/ceph-client.admin.353085.log: /var/log/ceph/ceph-client.admin.330187.log: /var/log/ceph/ceph-client.admin.47789.log: /var/log/ceph/ceph-client.admin.240673.log: /var/log/ceph/ceph-client.admin.266698.log: /var/log/ceph/ceph-client.admin.133756.log: /var/log/ceph/ceph-client.admin.339849.log: /var/log/ceph/ceph-client.admin.209031.log: /var/log/ceph/ceph-client.admin.351246.log: /var/log/ceph/ceph-client.admin.378373.log: /var/log/ceph/ceph-client.admin.240223.log: /var/log/ceph/ceph-client.admin.123937.log: /var/log/ceph/ceph-client.admin.48419.log: /var/log/ceph/ceph-client.admin.203819.log: /var/log/ceph/ceph-client.admin.265030.log: /var/log/ceph/ceph-client.admin.278593.log: /var/log/ceph/ceph-client.admin.233469.log: /var/log/ceph/ceph-client.admin.154206.log: /var/log/ceph/ceph-client.admin.389646.log: /var/log/ceph/ceph-client.admin.314345.log: /var/log/ceph/ceph-client.admin.163830.log: /var/log/ceph/ceph-client.admin.225351.log: /var/log/ceph/ceph-client.admin.261859.log: /var/log/ceph/ceph-client.admin.209040.log: /var/log/ceph/ceph-client.admin.219673.log: /var/log/ceph/ceph-client.admin.42596.log: /var/log/ceph/ceph-client.admin.153788.log: /var/log/ceph/ceph-client.admin.206039.log: /var/log/ceph/ceph-client.admin.191080.log: /var/log/ceph/ceph-client.admin.222792.log: /var/log/ceph/ceph-client.admin.353585.log: /var/log/ceph/ceph-client.admin.381036.log: /var/log/ceph/ceph-client.admin.136670.log: /var/log/ceph/ceph-client.admin.152041.log: /var/log/ceph/ceph-client.admin.194560.log: /var/log/ceph/ceph-client.admin.253316.log: /var/log/ceph/ceph-client.admin.144006.log: /var/log/ceph/ceph-client.admin.376178.log: /var/log/ceph/ceph-client.admin.265021.log: /var/log/ceph/ceph-client.admin.185178.log: /var/log/ceph/ceph-client.admin.49536.log: /var/log/ceph/ceph-client.admin.113604.log: /var/log/ceph/ceph-client.admin.237712.log: /var/log/ceph/ceph-client.admin.335731.log: /var/log/ceph/ceph-client.admin.201587.log: /var/log/ceph/ceph-client.admin.317428.log: /var/log/ceph/ceph-client.admin.283444.log: /var/log/ceph/ceph-client.admin.267949.log: /var/log/ceph/ceph-client.admin.327177.log: /var/log/ceph/ceph-client.admin.49271.log: /var/log/ceph/ceph-client.admin.237721.log: /var/log/ceph/ceph-client.admin.234329.log: /var/log/ceph/ceph-client.admin.49832.log: /var/log/ceph/ceph-client.admin.42290.log: /var/log/ceph/ceph-client.admin.260171.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46363.log.gz 2024-02-19T17:16:22.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.236833.log: /var/log/ceph/ceph-client.admin.350706.log: /var/log/ceph/ceph-client.admin.46058.log: /var/log/ceph/ceph-client.admin.376169.log: /var/log/ceph/ceph-client.admin.268775.log: /var/log/ceph/ceph-client.admin.200251.log: /var/log/ceph/ceph-client.admin.194096.log: /var/log/ceph/ceph-client.admin.322151.log: /var/log/ceph/ceph-client.admin.391898.log: /var/log/ceph/ceph-client.admin.221958.log: /var/log/ceph/ceph-client.admin.247533.log: /var/log/ceph/ceph-client.admin.155501.log: /var/log/ceph/ceph-client.admin.282606.log: /var/log/ceph/ceph-client.admin.70251.log: /var/log/ceph/ceph-client.admin.134173.log: /var/log/ceph/ceph-client.admin.181534.log: /var/log/ceph/ceph-client.admin.126941.log: /var/log/ceph/ceph-client.admin.193260.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46590.log.gz 2024-02-19T17:16:22.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.247091.log: /var/log/ceph/ceph-client.admin.279891.log: /var/log/ceph/ceph-client.admin.389637.log: /var/log/ceph/ceph-client.admin.258077.log: /var/log/ceph/ceph-client.admin.255132.log: /var/log/ceph/ceph-client.admin.45932.log: /var/log/ceph/ceph-client.admin.339423.log: /var/log/ceph/ceph-client.admin.152471.log: /var/log/ceph/ceph-client.admin.141850.log: /var/log/ceph/ceph-client.admin.42038.log: /var/log/ceph/ceph-client.admin.390058.log: /var/log/ceph/ceph-client.admin.192836.log: /var/log/ceph/ceph-client.admin.137506.log: /var/log/ceph/ceph-client.admin.326745.log: /var/log/ceph/ceph-client.admin.321316.log: /var/log/ceph/ceph-client.admin.154623.log: /var/log/ceph/ceph-client.admin.226614.log: /var/log/ceph/ceph-client.admin.312664.log: /var/log/ceph/ceph-client.admin.386676.log: /var/log/ceph/ceph-client.admin.47443.log: /var/log/ceph/ceph-client.admin.49043.log: /var/log/ceph/ceph-client.admin.387094.log: /var/log/ceph/ceph-client.admin.236416.log: /var/log/ceph/ceph-client.admin.314774.log: /var/log/ceph/ceph-client.admin.241545.log: /var/log/ceph/ceph-client.admin.281335.log: /var/log/ceph/ceph-client.admin.310574.log: /var/log/ceph/ceph-client.admin.206947.log: /var/log/ceph/ceph-client.admin.146161.log: /var/log/ceph/ceph-client.admin.338470.log: /var/log/ceph/ceph-client.admin.343301.log: /var/log/ceph/ceph-client.admin.214062.log: /var/log/ceph/ceph-client.admin.269202.log: /var/log/ceph/ceph-client.admin.328942.log: /var/log/ceph/ceph-client.admin.139619.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41697.log.gz/var/log/ceph/ceph-client.admin.198925.log: 2024-02-19T17:16:22.260 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.138346.log: /var/log/ceph/ceph-client.admin.325481.log: /var/log/ceph/ceph-client.admin.146170.log: /var/log/ceph/ceph-client.admin.46658.log: /var/log/ceph/ceph-client.admin.119959.log: /var/log/ceph/ceph-client.admin.42934.log: /var/log/ceph/ceph-client.admin.353594.log: /var/log/ceph/ceph-client.admin.321307.log: /var/log/ceph/ceph-client.admin.193679.log: /var/log/ceph/ceph-client.admin.48083.log: /var/log/ceph/ceph-client.admin.340675.log: /var/log/ceph/ceph-client.admin.203373.log: /var/log/ceph/ceph-client.admin.259744.log: /var/log/ceph/ceph-client.admin.137088.log: /var/log/ceph/ceph-client.admin.193688.log: /var/log/ceph/ceph-client.admin.204255.log: /var/log/ceph/ceph-client.admin.393055.log: /var/log/ceph/ceph-client.admin.349853.log: /var/log/ceph/ceph-client.admin.209466.log: /var/log/ceph/ceph-client.admin.49664.log: /var/log/ceph/ceph-client.admin.47957.log: /var/log/ceph/ceph-client.admin.183698.log: /var/log/ceph/ceph-client.admin.108736.log: /var/log/ceph/ceph-client.admin.187801.log: /var/log/ceph/ceph-client.admin.307600.log: /var/log/ceph/ceph-client.admin.42592.log: /var/log/ceph/ceph-client.admin.129891.log: /var/log/ceph/ceph-client.admin.140497.log: /var/log/ceph/ceph-client.admin.337022.log: /var/log/ceph/ceph-client.admin.134998.log: /var/log/ceph/ceph-client.admin.384954.log: /var/log/ceph/ceph-client.admin.258914.log: /var/log/ceph/ceph-client.admin.343310.log: /var/log/ceph/ceph-client.admin.249246.log: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.381045.log.gz 2024-02-19T17:16:22.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.329769.log: /var/log/ceph/ceph-client.admin.272191.log: /var/log/ceph/ceph-client.admin.190585.log: /var/log/ceph/ceph-client.admin.135834.log: /var/log/ceph/ceph-client.admin.45234.log: /var/log/ceph/ceph-client.admin.354587.log: /var/log/ceph/ceph-client.admin.48629.log: /var/log/ceph/ceph-client.admin.48503.log: /var/log/ceph/ceph-client.admin.254275.log: /var/log/ceph/ceph-client.admin.323399.log: /var/log/ceph/ceph-client.admin.42416.log: /var/log/ceph/ceph-client.admin.330621.log: /var/log/ceph/ceph-client.admin.356036.log: /var/log/ceph/ceph-client.admin.328094.log: /var/log/ceph/ceph-client.admin.279015.log: /var/log/ceph/ceph-client.admin.185169.log: /var/log/ceph/ceph-client.admin.344594.log: 81.3%/var/log/ceph/ceph-client.admin.328933.log: -- replaced with /var/log/ceph/ceph-client.admin.521653.log.gz 2024-02-19T17:16:22.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112645.log: /var/log/ceph/ceph-client.admin.43886.log: /var/log/ceph/ceph-client.admin.313095.log: /var/log/ceph/ceph-client.admin.206938.log: /var/log/ceph/ceph-client.admin.43466.log: /var/log/ceph/ceph-client.admin.377072.log: /var/log/ceph/ceph-client.admin.127802.log: /var/log/ceph/ceph-client.admin.331031.log: /var/log/ceph/ceph-client.admin.181121.log: /var/log/ceph/ceph-client.admin.137927.log: /var/log/ceph/ceph-client.admin.318777.log: /var/log/ceph/ceph-client.admin.338461.log: /var/log/ceph/ceph-client.admin.164692.log: /var/log/ceph/ceph-client.admin.268357.log: /var/log/ceph/ceph-client.admin.197123.log: /var/log/ceph/ceph-client.admin.227439.log: /var/log/ceph/ceph-client.admin.388224.log: /var/log/ceph/ceph-client.admin.222384.log: /var/log/ceph/ceph-client.admin.41574.log: /var/log/ceph/ceph-client.admin.139187.log: /var/log/ceph/ceph-client.admin.47627.log: /var/log/ceph/ceph-client.admin.48545.log: /var/log/ceph/ceph-client.admin.305095.log: /var/log/ceph/ceph-client.admin.273914.log: /var/log/ceph/ceph-client.admin.383260.log: /var/log/ceph/ceph-client.admin.41824.log: /var/log/ceph/ceph-client.admin.140920.log: /var/log/ceph/ceph-client.admin.382403.log: /var/log/ceph/ceph-client.admin.46447.log: /var/log/ceph/ceph-client.admin.190576.log: /var/log/ceph/ceph-client.admin.280891.log: /var/log/ceph/ceph-client.admin.380546.log: /var/log/ceph/ceph-client.admin.233460.log: /var/log/ceph/ceph-client.admin.43802.log: /var/log/ceph/ceph-client.admin.270868.log: /var/log/ceph/ceph-client.admin.215357.log: /var/log/ceph/ceph-client.admin.336148.log: /var/log/ceph/ceph-client.admin.267106.log: /var/log/ceph/ceph-client.admin.49399.log: /var/log/ceph/ceph-client.admin.41740.log: /var/log/ceph/ceph-client.admin.351663.log: /var/log/ceph/ceph-client.admin.196674.log: /var/log/ceph/ceph-client.admin.129046.log: /var/log/ceph/ceph-client.admin.270460.log: /var/log/ceph/ceph-client.admin.206485.log: /var/log/ceph/ceph-client.admin.42583.log: /var/log/ceph/ceph-client.admin.214480.log: /var/log/ceph/ceph-client.admin.184250.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.464350.log.gz 2024-02-19T17:16:22.261 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.463918.log.gz 2024-02-19T17:16:22.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.137097.log: /var/log/ceph/ceph-client.admin.354596.log: /var/log/ceph/ceph-client.admin.355082.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.463445.log.gz 2024-02-19T17:16:22.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.193271.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.467673.log.gz 2024-02-19T17:16:22.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.256389.log: /var/log/ceph/ceph-client.admin.243758.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.467262.log.gz 2024-02-19T17:16:22.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.132916.log: /var/log/ceph/ceph-client.admin.320029.log: /var/log/ceph/ceph-client.admin.262694.log: /var/log/ceph/ceph-client.admin.126067.log: /var/log/ceph/ceph-client.admin.349394.log: /var/log/ceph/ceph-client.admin.321723.log: /var/log/ceph/ceph-client.admin.126495.log: /var/log/ceph/ceph-client.admin.222801.log: /var/log/ceph/ceph-client.admin.223635.log: /var/log/ceph/ceph-client.admin.217998.log: /var/log/ceph/ceph-client.admin.249672.log: /var/log/ceph/ceph-client.admin.375754.log: /var/log/ceph/ceph-client.admin.179856.log: /var/log/ceph/ceph-client.admin.144427.log: /var/log/ceph/ceph-client.admin.136679.log: /var/log/ceph/ceph-client.admin.392747.log: /var/log/ceph/ceph-client.admin.49790.log: /var/log/ceph/ceph-client.admin.199805.log: /var/log/ceph/ceph-client.admin.282175.log: /var/log/ceph/ceph-client.admin.230325.log: /var/log/ceph/ceph-client.admin.242932.log: /var/log/ceph/ceph-client.admin.46142.log: /var/log/ceph/ceph-client.admin.348480.log: /var/log/ceph/ceph-client.admin.155045.log: /var/log/ceph/ceph-client.admin.280387.log: /var/log/ceph/ceph-client.admin.329360.log: /var/log/ceph/ceph-client.admin.381560.log: /var/log/ceph/ceph-client.admin.44030.log: /var/log/ceph/ceph-client.admin.348489.log: /var/log/ceph/ceph-client.admin.332294.log: /var/log/ceph/ceph-client.admin.353094.log: /var/log/ceph/ceph-client.admin.214489.log: /var/log/ceph/ceph-client.admin.179439.log: /var/log/ceph/ceph-client.admin.226194.log: /var/log/ceph/ceph-client.admin.194551.log: /var/log/ceph/ceph-client.admin.117814.log: /var/log/ceph/ceph-client.admin.198013.log: /var/log/ceph/ceph-client.admin.162000.log: /var/log/ceph/ceph-client.admin.387085.log: /var/log/ceph/ceph-client.admin.317011.log: /var/log/ceph/ceph-client.admin.282184.log: /var/log/ceph/ceph-client.admin.354103.log: /var/log/ceph/ceph-client.admin.143583.log: /var/log/ceph/ceph-client.admin.230799.log: /var/log/ceph/ceph-client.admin.200242.log: /var/log/ceph/ceph-client.admin.379271.log: /var/log/ceph/ceph-client.admin.199350.log: /var/log/ceph/ceph-client.admin.376650.log: /var/log/ceph/ceph-client.admin.253734.log: /var/log/ceph/ceph-client.admin.215348.log: /var/log/ceph/ceph-client.admin.223218.log: /var/log/ceph/ceph-client.admin.345854.log: /var/log/ceph/ceph-client.admin.127349.log: /var/log/ceph/ceph-client.admin.263577.log: /var/log/ceph/ceph-client.admin.188694.log: /var/log/ceph/ceph-client.admin.208614.log: /var/log/ceph/ceph-client.admin.218424.log: /var/log/ceph/ceph-client.admin.267940.log: /var/log/ceph/ceph-client.admin.241985.log: /var/log/ceph/ceph-client.admin.138766.log: /var/log/ceph/ceph-client.admin.139610.log: /var/log/ceph/ceph-client.admin.347113.log: /var/log/ceph/ceph-client.admin.244628.log: /var/log/ceph/ceph-client.admin.186493.log: /var/log/ceph/ceph-client.admin.350715.log: /var/log/ceph/ceph-client.admin.224524.log: /var/log/ceph/ceph-client.admin.231312.log: /var/log/ceph/ceph-client.admin.380555.log: /var/log/ceph/ceph-client.admin.204701.log: /var/log/ceph/ceph-client.admin.221364.log: /var/log/ceph/ceph-client.admin.43718.log: /var/log/ceph/ceph-client.admin.42933.log: /var/log/ceph/ceph-client.admin.203810.log: /var/log/ceph/ceph-client.admin.47585.log: /var/log/ceph/ceph-client.admin.316594.log: /var/log/ceph/ceph-client.admin.279006.log: /var/log/ceph/ceph-client.admin.42919.log: /var/log/ceph/ceph-client.admin.338951.log: /var/log/ceph/ceph-client.admin.309292.log: /var/log/ceph/ceph-client.admin.147028.log: /var/log/ceph/ceph-client.admin.261428.log: /var/log/ceph/ceph-client.admin.48587.log: /var/log/ceph/ceph-client.admin.388233.log: /var/log/ceph/ceph-client.admin.345020.log: /var/log/ceph/ceph-client.admin.146606.log: /var/log/ceph/ceph-client.admin.339432.log: /var/log/ceph/ceph-client.admin.337503.log: /var/log/ceph/ceph-client.admin.41782.log: /var/log/ceph/ceph-client.admin.128629.log: /var/log/ceph/ceph-client.admin.161485.log: /var/log/ceph/ceph-client.admin.346687.log: /var/log/ceph/ceph-client.admin.42932.log: /var/log/ceph/ceph-client.admin.189135.log: /var/log/ceph/ceph-client.admin.323806.log: /var/log/ceph/ceph-client.admin.114073.log: /var/log/ceph/ceph-client.admin.200696.log: /var/log/ceph/ceph-client.admin.337013.log: /var/log/ceph/ceph-client.admin.191089.log: /var/log/ceph/ceph-client.admin.128220.log: /var/log/ceph/ceph-client.admin.199359.log: /var/log/ceph/ceph-client.admin.280396.log: /var/log/ceph/ceph-client.admin.232214.log: /var/log/ceph/ceph-client.admin.312251.log: /var/log/ceph/ceph-client.admin.393046.log: /var/log/ceph/ceph-client.admin.43975.log: /var/log/ceph/ceph-client.admin.230790.log: /var/log/ceph/ceph-client.admin.197132.log: /var/log/ceph/ceph-client.admin.43760.log: /var/log/ceph/ceph-client.admin.163253.log: /var/log/ceph/ceph-client.admin.256398.log: /var/log/ceph/ceph-client.admin.338942.log: /var/log/ceph/ceph-client.admin.255554.log: /var/log/ceph/ceph-client.admin.385798.log: /var/log/ceph/ceph-client.admin.164247.log: /var/log/ceph/ceph-client.admin.320471.log: /var/log/ceph/ceph-client.admin.140506.log: /var/log/ceph/ceph-client.admin.273018.log: /var/log/ceph/ceph-client.admin.236407.log: /var/log/ceph/ceph-client.admin.211560.log: /var/log/ceph/ceph-client.admin.321732.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.393143.log.gz 2024-02-19T17:16:22.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.125640.log: /var/log/ceph/ceph-client.admin.42925.log: /var/log/ceph/ceph-client.admin.234747.log: /var/log/ceph/ceph-client.admin.349862.log: /var/log/ceph/ceph-client.admin.242415.log: /var/log/ceph/ceph-client.admin.244185.log: /var/log/ceph/ceph-client.admin.119551.log: /var/log/ceph/ceph-client.admin.124409.log: /var/log/ceph/ceph-client.admin.130323.log: /var/log/ceph/ceph-client.admin.201132.log: /var/log/ceph/ceph-client.admin.255976.log: /var/log/ceph/ceph-client.admin.255967.log: /var/log/ceph/ceph-client.admin.41655.log: /var/log/ceph/ceph-client.admin.350297.log: /var/log/ceph/ceph-client.admin.389175.log: /var/log/ceph/ceph-client.admin.238550.log: /var/log/ceph/ceph-client.admin.384963.log: /var/log/ceph/ceph-client.admin.42164.log: /var/log/ceph/ceph-client.admin.313929.log: /var/log/ceph/ceph-client.admin.273472.log: /var/log/ceph/ceph-client.admin.42080.log: /var/log/ceph/ceph-client.admin.125631.log: /var/log/ceph/ceph-client.admin.349385.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.509260.log.gz 2024-02-19T17:16:22.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.265447.log: /var/log/ceph/ceph-client.admin.336565.log: /var/log/ceph/ceph-client.admin.43268.log: /var/log/ceph/ceph-client.admin.127793.log: /var/log/ceph/ceph-client.admin.260593.log: /var/log/ceph/ceph-client.admin.283865.log: /var/log/ceph/ceph-client.admin.49622.log: /var/log/ceph/ceph-client.admin.392995.log: /var/log/ceph/ceph-client.admin.204710.log: /var/log/ceph/ceph-client.admin.48041.log: /var/log/ceph/ceph-client.admin.241128.log: /var/log/ceph/ceph-client.admin.207359.log: /var/log/ceph/ceph-client.admin.390607.log: /var/log/ceph/ceph-client.admin.324231.log: /var/log/ceph/ceph-client.admin.194977.log: /var/log/ceph/ceph-client.admin.308448.log: /var/log/ceph/ceph-client.admin.336157.log: /var/log/ceph/ceph-client.admin.111764.log: /var/log/ceph/ceph-client.admin.342400.log: /var/log/ceph/ceph-client.admin.225360.log: /var/log/ceph/ceph-client.admin.47201.log: /var/log/ceph/ceph-client.admin.183244.log: /var/log/ceph/ceph-client.admin.228983.log: /var/log/ceph/ceph-client.admin.393103.log: /var/log/ceph/ceph-client.admin.354094.log: /var/log/ceph/ceph-client.admin.117805.log: /var/log/ceph/ceph-client.admin.258068.log: /var/log/ceph/ceph-client.admin.159973.log: /var/log/ceph/ceph-client.admin.257233.log: /var/log/ceph/ceph-client.admin.316127.log: /var/log/ceph/ceph-client.admin.164683.log: /var/log/ceph/ceph-client.admin.110186.log: /var/log/ceph/ceph-client.admin.209475.log: /var/log/ceph/ceph-client.admin.154614.log: /var/log/ceph/ceph-client.admin.117554.log: /var/log/ceph/ceph-client.admin.119133.log: /var/log/ceph/ceph-client.admin.310147.log: /var/log/ceph/ceph-client.admin.192827.log: /var/log/ceph/ceph-client.admin.317020.log: /var/log/ceph/ceph-client.admin.117564.log: /var/log/ceph/ceph-client.admin.248832.log: /var/log/ceph/ceph-client.admin.46489.log: /var/log/ceph/ceph-client.admin.316136.log: /var/log/ceph/ceph-client.admin.331448.log: /var/log/ceph/ceph-client.admin.226185.log: /var/log/ceph/ceph-client.admin.254266.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.530005.log.gz 2024-02-19T17:16:22.262 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.402648.log.gz 2024-02-19T17:16:22.262 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.402657.log.gz 2024-02-19T17:16:22.263 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.403075.log.gz 2024-02-19T17:16:22.265 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.129046.log.gz 2024-02-19T17:16:22.265 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.128220.log.gz 2024-02-19T17:16:22.265 INFO:teuthology.orchestra.run.smithi046.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.197577.log.gz 2024-02-19T17:16:22.265 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.254275.log.gz 2024-02-19T17:16:22.266 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49494.log.gz 2024-02-19T17:16:22.266 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49536.log.gz 2024-02-19T17:16:22.266 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.161485.log.gz 2024-02-19T17:16:22.266 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.325481.log.gz 2024-02-19T17:16:22.266 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.137097.log.gz 2024-02-19T17:16:22.266 INFO:teuthology.orchestra.run.smithi046.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.397998.log.gz 2024-02-19T17:16:22.266 INFO:teuthology.orchestra.run.smithi046.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.485836.log.gz 2024-02-19T17:16:22.267 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.485845.log.gz 2024-02-19T17:16:22.267 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.125631.log.gz 2024-02-19T17:16:22.267 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.498626.log.gz 2024-02-19T17:16:22.268 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.350706.log.gz 2024-02-19T17:16:22.268 INFO:teuthology.orchestra.run.smithi046.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.508006.log.gz 2024-02-19T17:16:22.269 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.119959.log.gz 2024-02-19T17:16:22.269 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.120377.log.gz 2024-02-19T17:16:22.269 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.350297.log.gz 2024-02-19T17:16:22.269 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.119968.log.gz -- replaced with /var/log/ceph/ceph-client.admin.119551.log.gz 2024-02-19T17:16:22.269 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:22.270 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.139610.log.gz 2024-02-19T17:16:22.270 INFO:teuthology.orchestra.run.smithi046.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.139187.log.gz 2024-02-19T17:16:22.271 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.139196.log.gz 2024-02-19T17:16:22.271 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.129891.log.gz 2024-02-19T17:16:22.272 INFO:teuthology.orchestra.run.smithi046.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.129473.log.gz 2024-02-19T17:16:22.275 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.393152.log.gz 2024-02-19T17:16:22.279 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.470238.log.gz 2024-02-19T17:16:22.280 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.474981.log.gz 2024-02-19T17:16:22.280 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.182799.log.gz 2024-02-19T17:16:22.281 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42915.log.gz 2024-02-19T17:16:22.284 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.315187.log.gz 2024-02-19T17:16:22.301 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.446877.log.gz 2024-02-19T17:16:22.301 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.446027.log.gz 2024-02-19T17:16:22.302 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.483324.log.gz 2024-02-19T17:16:22.303 INFO:teuthology.orchestra.run.smithi046.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.491396.log.gz 2024-02-19T17:16:22.312 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.137515.log.gz 2024-02-19T17:16:22.314 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.162000.log.gz 2024-02-19T17:16:22.352 INFO:teuthology.orchestra.run.smithi046.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.514635.log.gz 2024-02-19T17:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.454646.log.gz 2024-02-19T17:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.439027.log.gz 2024-02-19T17:16:22.355 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.468090.log.gz 2024-02-19T17:16:22.356 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.399675.log.gz 2024-02-19T17:16:22.357 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.468099.log.gz 2024-02-19T17:16:22.401 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.401822.log.gz 2024-02-19T17:16:22.418 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48251.log.gz 2024-02-19T17:16:22.427 INFO:teuthology.orchestra.run.smithi046.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.391036.log.gz 2024-02-19T17:16:22.429 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.518895.log.gz 2024-02-19T17:16:22.432 INFO:teuthology.orchestra.run.smithi046.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.226185.log.gz 2024-02-19T17:16:22.433 INFO:teuthology.orchestra.run.smithi046.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.208197.log.gz 2024-02-19T17:16:22.440 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.470673.log.gz 2024-02-19T17:16:22.442 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.472871.log.gz 2024-02-19T17:16:22.447 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.508851.log.gz 2024-02-19T17:16:22.454 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.320891.log.gz 2024-02-19T17:16:22.462 INFO:teuthology.orchestra.run.smithi046.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.261428.log.gz 2024-02-19T17:16:22.465 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.261437.log.gz 2024-02-19T17:16:22.466 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.262703.log.gz 2024-02-19T17:16:22.472 INFO:teuthology.orchestra.run.smithi046.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.502993.log.gz 2024-02-19T17:16:22.476 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.443850.log.gz 2024-02-19T17:16:22.477 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.426670.log.gz 2024-02-19T17:16:22.479 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.331876.log.gz 2024-02-19T17:16:22.485 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.228974.log.gz 2024-02-19T17:16:22.488 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.248832.log.gz 2024-02-19T17:16:22.488 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.272182.log.gz 2024-02-19T17:16:22.490 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.272191.log.gz 2024-02-19T17:16:22.512 INFO:teuthology.orchestra.run.smithi046.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.479229.log.gz 2024-02-19T17:16:22.528 INFO:teuthology.orchestra.run.smithi046.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.504245.log.gz 2024-02-19T17:16:22.530 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.507180.log.gz 2024-02-19T17:16:22.530 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.500912.log.gz 2024-02-19T17:16:22.540 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.340266.log.gz 2024-02-19T17:16:22.540 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.403913.log.gz 2024-02-19T17:16:22.568 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.409001.log.gz 2024-02-19T17:16:22.572 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.468938.log.gz 2024-02-19T17:16:22.573 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.490082.log.gz 2024-02-19T17:16:22.574 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.497382.log.gz 2024-02-19T17:16:22.576 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.506335.log.gz 2024-02-19T17:16:22.619 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.475454.log.gz 2024-02-19T17:16:22.620 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.474557.log.gz 2024-02-19T17:16:22.626 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.329778.log.gz 2024-02-19T17:16:22.628 INFO:teuthology.orchestra.run.smithi046.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.459267.log.gz 2024-02-19T17:16:22.628 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.426040.log.gz 2024-02-19T17:16:22.629 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.441981.log.gz 2024-02-19T17:16:22.630 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.500493.log.gz 2024-02-19T17:16:22.636 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.462537.log.gz 2024-02-19T17:16:22.636 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.505081.log.gz 2024-02-19T17:16:22.637 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.255545.log.gz 2024-02-19T17:16:22.644 INFO:teuthology.orchestra.run.smithi046.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.412384.log.gz 2024-02-19T17:16:22.650 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.271323.log.gz 2024-02-19T17:16:22.662 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.142270.log.gz 2024-02-19T17:16:22.673 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.454238.log.gz 2024-02-19T17:16:22.677 INFO:teuthology.orchestra.run.smithi046.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.210717.log.gz 2024-02-19T17:16:22.678 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.483063.log.gz 2024-02-19T17:16:22.679 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.501321.log.gz 2024-02-19T17:16:22.680 INFO:teuthology.orchestra.run.smithi046.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.488900.log.gz 2024-02-19T17:16:22.696 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.465943.log.gz 2024-02-19T17:16:22.699 INFO:teuthology.orchestra.run.smithi046.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.393382.log.gz 2024-02-19T17:16:22.700 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.452100.log.gz 2024-02-19T17:16:22.703 INFO:teuthology.orchestra.run.smithi046.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.446886.log.gz 2024-02-19T17:16:22.724 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.400571.log.gz 2024-02-19T17:16:22.739 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.283023.log.gz 2024-02-19T17:16:22.745 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.405187.log.gz 2024-02-19T17:16:22.746 INFO:teuthology.orchestra.run.smithi046.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.407320.log.gz 2024-02-19T17:16:22.747 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.486252.log.gz 2024-02-19T17:16:22.747 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.501738.log.gz 2024-02-19T17:16:22.748 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.422599.log.gz 2024-02-19T17:16:22.748 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.502156.log.gz 2024-02-19T17:16:22.749 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.500067.log.gz 2024-02-19T17:16:22.750 INFO:teuthology.orchestra.run.smithi046.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.501747.log.gz 2024-02-19T17:16:22.755 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.396693.log.gz 2024-02-19T17:16:22.759 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.392321.log.gz 2024-02-19T17:16:22.763 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.456891.log.gz 2024-02-19T17:16:22.764 INFO:teuthology.orchestra.run.smithi046.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.460760.log.gz 2024-02-19T17:16:22.765 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.473713.log.gz 2024-02-19T17:16:22.765 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.456419.log.gz 2024-02-19T17:16:22.766 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.474548.log.gz 2024-02-19T17:16:22.767 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.478813.log.gz 2024-02-19T17:16:22.767 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.440686.log.gz 2024-02-19T17:16:22.768 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.473722.log.gz 2024-02-19T17:16:22.769 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.458859.log.gz 2024-02-19T17:16:22.784 INFO:teuthology.orchestra.run.smithi046.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.240232.log.gz 2024-02-19T17:16:22.794 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.426679.log.gz 2024-02-19T17:16:22.797 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.439018.log.gz 2024-02-19T17:16:22.799 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.468519.log.gz 2024-02-19T17:16:22.800 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.476291.log.gz 2024-02-19T17:16:22.801 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.463027.log.gz 2024-02-19T17:16:22.815 INFO:teuthology.orchestra.run.smithi046.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.126486.log.gz 2024-02-19T17:16:22.815 INFO:teuthology.orchestra.run.smithi046.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.271764.log.gz 2024-02-19T17:16:22.816 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.446455.log.gz 2024-02-19T17:16:22.817 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.451205.log.gz 2024-02-19T17:16:22.826 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.440269.log.gz 2024-02-19T17:16:22.848 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.401396.log.gz 2024-02-19T17:16:22.849 INFO:teuthology.orchestra.run.smithi046.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.400979.log.gz 2024-02-19T17:16:22.850 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.403904.log.gz 2024-02-19T17:16:22.862 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.421765.log.gz 2024-02-19T17:16:22.862 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.404765.log.gz 2024-02-19T17:16:22.864 INFO:teuthology.orchestra.run.smithi046.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.408154.log.gz 2024-02-19T17:16:22.869 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.448980.log.gz 2024-02-19T17:16:22.869 INFO:teuthology.orchestra.run.smithi046.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.448562.log.gz 2024-02-19T17:16:22.870 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.452518.log.gz 2024-02-19T17:16:22.870 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.453812.log.gz 2024-02-19T17:16:22.870 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.447318.log.gz 2024-02-19T17:16:22.871 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.453821.log.gz 2024-02-19T17:16:22.872 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.482375.log.gz 2024-02-19T17:16:22.872 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.448571.log.gz 2024-02-19T17:16:22.872 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.425578.log.gz 2024-02-19T17:16:22.872 INFO:teuthology.orchestra.run.smithi046.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.508424.log.gz 2024-02-19T17:16:22.873 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.500076.log.gz 2024-02-19T17:16:22.874 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.503837.log.gz 2024-02-19T17:16:22.879 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.472445.log.gz 2024-02-19T17:16:22.882 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.477976.log.gz 2024-02-19T17:16:22.884 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.205592.log.gz 2024-02-19T17:16:22.889 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.258496.log.gz 2024-02-19T17:16:22.902 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.396264.log.gz 2024-02-19T17:16:22.907 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.440695.log.gz 2024-02-19T17:16:22.921 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.484581.log.gz 2024-02-19T17:16:22.927 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.507171.log.gz 2024-02-19T17:16:22.932 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.397124.log.gz 2024-02-19T17:16:22.938 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49580.log.gz 2024-02-19T17:16:22.990 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.385371.log.gz 2024-02-19T17:16:23.024 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.351237.log.gz 2024-02-19T17:16:23.028 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.110689.log.gz 2024-02-19T17:16:23.028 INFO:teuthology.orchestra.run.smithi046.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.128211.log.gz 2024-02-19T17:16:23.031 INFO:teuthology.orchestra.run.smithi046.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.445578.log.gz 2024-02-19T17:16:23.031 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.312242.log.gz 2024-02-19T17:16:23.032 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.423025.log.gz 2024-02-19T17:16:23.033 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.407311.log.gz 2024-02-19T17:16:23.033 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.310996.log.gz 2024-02-19T17:16:23.034 INFO:teuthology.orchestra.run.smithi046.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.455571.log.gz 2024-02-19T17:16:23.034 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.406058.log.gz 2024-02-19T17:16:23.052 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.464935.log.gz 2024-02-19T17:16:23.055 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.464359.log.gz 2024-02-19T17:16:23.057 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.306761.log.gz 2024-02-19T17:16:23.060 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.235165.log.gz 2024-02-19T17:16:23.061 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.235583.log.gz 2024-02-19T17:16:23.061 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-19T17:16:23.067 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.395833.log.gz 2024-02-19T17:16:23.076 INFO:teuthology.orchestra.run.smithi046.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.480978.log.gz 2024-02-19T17:16:23.079 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.264604.log.gz 2024-02-19T17:16:23.084 INFO:teuthology.orchestra.run.smithi046.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.195809.log.gz 2024-02-19T17:16:23.093 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.214071.log.gz 2024-02-19T17:16:23.101 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.400141.log.gz 2024-02-19T17:16:23.103 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.471103.log.gz 2024-02-19T17:16:23.107 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44072.log.gz 2024-02-19T17:16:23.108 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.447736.log.gz 2024-02-19T17:16:23.130 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.339849.log.gz 2024-02-19T17:16:23.174 INFO:teuthology.orchestra.run.smithi046.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.239386.log.gz 2024-02-19T17:16:23.177 INFO:teuthology.orchestra.run.smithi046.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.218831.log.gz 2024-02-19T17:16:23.183 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.240673.log.gz 2024-02-19T17:16:23.184 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.283014.log.gz 2024-02-19T17:16:23.196 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.462063.log.gz 2024-02-19T17:16:23.197 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.185610.log.gz 2024-02-19T17:16:23.204 INFO:teuthology.orchestra.run.smithi046.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.261850.log.gz 2024-02-19T17:16:23.209 INFO:teuthology.orchestra.run.smithi046.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.461612.log.gz 2024-02-19T17:16:23.209 INFO:teuthology.orchestra.run.smithi046.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.386223.log.gz 2024-02-19T17:16:23.213 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.162845.log.gz 2024-02-19T17:16:23.214 INFO:teuthology.orchestra.run.smithi046.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.278584.log.gz 2024-02-19T17:16:23.215 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.376659.log.gz 2024-02-19T17:16:23.216 INFO:teuthology.orchestra.run.smithi046.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.162419.log.gz 2024-02-19T17:16:23.218 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.199796.log.gz 2024-02-19T17:16:23.225 INFO:teuthology.orchestra.run.smithi046.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.410693.log.gz 2024-02-19T17:16:23.225 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47873.log.gz 2024-02-19T17:16:23.229 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.265864.log.gz 2024-02-19T17:16:23.229 INFO:teuthology.orchestra.run.smithi046.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.209883.log.gz 2024-02-19T17:16:23.242 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.330196.log.gz 2024-02-19T17:16:23.246 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.376178.log.gz 2024-02-19T17:16:23.250 INFO:teuthology.orchestra.run.smithi046.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.132485.log.gz 2024-02-19T17:16:23.261 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.210309.log.gz 2024-02-19T17:16:23.263 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.480116.log.gz 2024-02-19T17:16:23.264 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.179448.log.gz 2024-02-19T17:16:23.274 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.247982.log.gz 2024-02-19T17:16:23.275 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.327177.log.gz 2024-02-19T17:16:23.347 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.208206.log.gz 2024-02-19T17:16:23.355 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.222792.log.gz 2024-02-19T17:16:23.355 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.225351.log.gz 2024-02-19T17:16:23.355 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.240223.log.gz 2024-02-19T17:16:23.362 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.283444.log.gz 2024-02-19T17:16:23.367 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.209040.log.gz 2024-02-19T17:16:23.368 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47711.log.gz 2024-02-19T17:16:23.373 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.114064.log.gz 2024-02-19T17:16:23.374 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45890.log.gz 2024-02-19T17:16:23.375 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45764.log.gz 2024-02-19T17:16:23.376 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46745.log.gz 2024-02-19T17:16:23.377 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46405.log.gz 2024-02-19T17:16:23.378 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46949.log.gz 2024-02-19T17:16:23.382 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43270.log.gz 2024-02-19T17:16:23.383 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43592.log.gz 2024-02-19T17:16:23.385 INFO:teuthology.orchestra.run.smithi046.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.136670.log.gz 2024-02-19T17:16:23.392 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.351246.log.gz 2024-02-19T17:16:23.396 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.163830.log.gz 2024-02-19T17:16:23.399 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.143160.log.gz 2024-02-19T17:16:23.400 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.133756.log.gz 2024-02-19T17:16:23.403 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.233469.log.gz 2024-02-19T17:16:23.404 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.236416.log.gz 2024-02-19T17:16:23.404 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.124880.log.gz 2024-02-19T17:16:23.413 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.322558.log.gz 2024-02-19T17:16:23.415 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49706.log.gz 2024-02-19T17:16:23.418 INFO:teuthology.orchestra.run.smithi046.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.241994.log.gz 2024-02-19T17:16:23.419 INFO:teuthology.orchestra.run.smithi046.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.0.50267.log.gz 2024-02-19T17:16:23.424 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.381569.log.gz 2024-02-19T17:16:23.425 INFO:teuthology.orchestra.run.smithi046.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.237712.log.gz 2024-02-19T17:16:23.429 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.150221.log.gz 2024-02-19T17:16:23.441 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.353085.log.gz 2024-02-19T17:16:23.448 INFO:teuthology.orchestra.run.smithi046.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.194105.log.gz 2024-02-19T17:16:23.452 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.499807.log.gz 2024-02-19T17:16:23.499 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.206039.log.gz 2024-02-19T17:16:23.501 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.226614.log.gz 2024-02-19T17:16:23.501 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46058.log.gz 2024-02-19T17:16:23.506 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42248.log.gz 2024-02-19T17:16:23.506 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42596.log.gz 2024-02-19T17:16:23.509 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.391898.log.gz 2024-02-19T17:16:23.526 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.282606.log.gz 2024-02-19T17:16:23.544 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.314774.log.gz 2024-02-19T17:16:23.544 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.314345.log.gz 2024-02-19T17:16:23.547 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.266698.log.gz 2024-02-19T17:16:23.555 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47789.log.gz 2024-02-19T17:16:23.557 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.193260.log.gz 2024-02-19T17:16:23.561 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48958.log.gz 2024-02-19T17:16:23.563 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.152041.log.gz 2024-02-19T17:16:23.565 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.322151.log.gz 2024-02-19T17:16:23.568 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.326745.log.gz 2024-02-19T17:16:23.568 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.317428.log.gz 2024-02-19T17:16:23.569 INFO:teuthology.orchestra.run.smithi046.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.247533.log.gz 2024-02-19T17:16:23.570 INFO:teuthology.orchestra.run.smithi046.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.247091.log.gz 2024-02-19T17:16:23.571 INFO:teuthology.orchestra.run.smithi046.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.162836.log.gz 2024-02-19T17:16:23.573 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.255132.log.gz 2024-02-19T17:16:23.573 INFO:teuthology.orchestra.run.smithi046.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.155501.log.gz 2024-02-19T17:16:23.576 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.134173.log.gz 2024-02-19T17:16:23.581 INFO:teuthology.orchestra.run.smithi046.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.330187.log.gz 2024-02-19T17:16:23.582 INFO:teuthology.orchestra.run.smithi046.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.376169.log.gz 2024-02-19T17:16:23.583 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.203819.log.gz 2024-02-19T17:16:23.587 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.140497.log.gz 2024-02-19T17:16:23.589 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.267949.log.gz 2024-02-19T17:16:23.589 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.268775.log.gz 2024-02-19T17:16:23.591 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.278593.log.gz 2024-02-19T17:16:23.595 INFO:teuthology.orchestra.run.smithi046.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.265021.log.gz 2024-02-19T17:16:23.598 INFO:teuthology.orchestra.run.smithi046.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.141850.log.gz 2024-02-19T17:16:23.601 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.253316.log.gz 2024-02-19T17:16:23.603 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.269202.log.gz 2024-02-19T17:16:23.605 INFO:teuthology.orchestra.run.smithi046.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.259744.log.gz 2024-02-19T17:16:23.609 INFO:teuthology.orchestra.run.smithi046.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.214062.log.gz 2024-02-19T17:16:23.638 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.425162.log.gz 2024-02-19T17:16:23.646 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.194096.log.gz 2024-02-19T17:16:23.647 INFO:teuthology.orchestra.run.smithi046.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.209031.log.gz 2024-02-19T17:16:23.648 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.193688.log.gz 2024-02-19T17:16:23.667 INFO:teuthology.orchestra.run.smithi046.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.152050.log.gz 2024-02-19T17:16:23.678 INFO:teuthology.orchestra.run.smithi046.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.137088.log.gz 2024-02-19T17:16:23.678 INFO:teuthology.orchestra.run.smithi046.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.138346.log.gz 2024-02-19T17:16:23.681 INFO:teuthology.orchestra.run.smithi046.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.261859.log.gz 2024-02-19T17:16:23.686 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49043.log.gz 2024-02-19T17:16:23.687 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.321307.log.gz 2024-02-19T17:16:23.687 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.134998.log.gz 2024-02-19T17:16:23.693 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.200251.log.gz 2024-02-19T17:16:23.694 INFO:teuthology.orchestra.run.smithi046.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.137927.log.gz 2024-02-19T17:16:23.696 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.108736.log.gz 2024-02-19T17:16:23.697 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.234329.log.gz 2024-02-19T17:16:23.700 INFO:teuthology.orchestra.run.smithi046.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.353585.log.gz 2024-02-19T17:16:23.708 INFO:teuthology.orchestra.run.smithi046.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.196683.log.gz 2024-02-19T17:16:23.718 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.153788.log.gz 2024-02-19T17:16:23.722 INFO:teuthology.orchestra.run.smithi046.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.335731.log.gz 2024-02-19T17:16:23.724 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.389637.log.gz 2024-02-19T17:16:23.726 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.144006.log.gz 2024-02-19T17:16:23.755 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.340684.log.gz 2024-02-19T17:16:23.756 INFO:teuthology.orchestra.run.smithi046.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.384954.log.gz 2024-02-19T17:16:23.774 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45932.log.gz 2024-02-19T17:16:23.774 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46447.log.gz 2024-02-19T17:16:23.775 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41574.log.gz 2024-02-19T17:16:23.775 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46658.log.gz 2024-02-19T17:16:23.775 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41824.log.gz 2024-02-19T17:16:23.780 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.221958.log.gz 2024-02-19T17:16:23.780 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43466.log.gz 2024-02-19T17:16:23.807 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.127802.log.gz 2024-02-19T17:16:23.840 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.388224.log.gz 2024-02-19T17:16:23.841 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.321316.log.gz 81.2% 2024-02-19T17:16:23.841 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.307600.log.gz 2024-02-19T17:16:23.842 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.331031.log.gz 2024-02-19T17:16:23.870 INFO:teuthology.orchestra.run.smithi046.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.339423.log.gz 2024-02-19T17:16:23.871 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.340675.log.gz 2024-02-19T17:16:23.878 INFO:teuthology.orchestra.run.smithi046.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.227439.log.gz 2024-02-19T17:16:23.880 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.258914.log.gz 2024-02-19T17:16:23.881 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.185169.log.gz 2024-02-19T17:16:23.888 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.318777.log.gz 2024-02-19T17:16:23.891 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.126941.log.gz 2024-02-19T17:16:23.900 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70251.log.gz 2024-02-19T17:16:23.901 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48629.log.gz 2024-02-19T17:16:23.905 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.181534.log.gz 2024-02-19T17:16:23.907 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.191080.log.gz 2024-02-19T17:16:23.913 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.328094.log.gz 2024-02-19T17:16:23.916 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43886.log.gz 2024-02-19T17:16:23.916 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43802.log.gz 2024-02-19T17:16:23.934 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46142.log.gz 2024-02-19T17:16:23.935 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42583.log.gz 2024-02-19T17:16:23.939 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.193679.log.gz 2024-02-19T17:16:23.941 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.193271.log.gz 2024-02-19T17:16:23.942 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.222801.log.gz 2024-02-19T17:16:23.948 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47957.log.gz 2024-02-19T17:16:23.974 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.262694.log.gz 2024-02-19T17:16:23.975 INFO:teuthology.orchestra.run.smithi046.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.279015.log.gz 2024-02-19T17:16:23.989 INFO:teuthology.orchestra.run.smithi046.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.349853.log.gz 2024-02-19T17:16:24.009 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.280387.log.gz 2024-02-19T17:16:24.015 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.196674.log.gz 2024-02-19T17:16:24.023 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.375754.log.gz 2024-02-19T17:16:24.024 INFO:teuthology.orchestra.run.smithi046.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.380546.log.gz 2024-02-19T17:16:24.033 INFO:teuthology.orchestra.run.smithi046.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.179439.log.gz 2024-02-19T17:16:24.034 INFO:teuthology.orchestra.run.smithi046.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.206947.log.gz 2024-02-19T17:16:24.037 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.242932.log.gz 2024-02-19T17:16:24.038 INFO:teuthology.orchestra.run.smithi046.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.144427.log.gz 2024-02-19T17:16:24.041 INFO:teuthology.orchestra.run.smithi046.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.356036.log.gz 2024-02-19T17:16:24.042 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.305095.log.gz 2024-02-19T17:16:24.043 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.270460.log.gz 2024-02-19T17:16:24.043 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48545.log.gz 2024-02-19T17:16:24.043 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48503.log.gz 2024-02-19T17:16:24.048 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.328933.log.gz 2024-02-19T17:16:24.051 INFO:teuthology.orchestra.run.smithi046.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.132916.log.gz 2024-02-19T17:16:24.055 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.343310.log.gz 2024-02-19T17:16:24.056 INFO:teuthology.orchestra.run.smithi046.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.241545.log.gz 2024-02-19T17:16:24.059 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49664.log.gz 2024-02-19T17:16:24.066 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.181121.log.gz 2024-02-19T17:16:24.066 INFO:teuthology.orchestra.run.smithi046.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.187801.log.gz 2024-02-19T17:16:24.067 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.214480.log.gz 2024-02-19T17:16:24.075 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.343301.log.gz 2024-02-19T17:16:24.082 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45234.log.gz 2024-02-19T17:16:24.085 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.222384.log.gz 2024-02-19T17:16:24.086 INFO:teuthology.orchestra.run.smithi046.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.44636.log.gz 2024-02-19T17:16:24.086 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.220090.log.gz 2024-02-19T17:16:24.088 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.223218.log.gz 2024-02-19T17:16:24.094 INFO:teuthology.orchestra.run.smithi046.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.253734.log.gz 2024-02-19T17:16:24.095 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.263577.log.gz 2024-02-19T17:16:24.096 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.282175.log.gz 2024-02-19T17:16:24.107 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42934.log.gz 2024-02-19T17:16:24.110 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.241985.log.gz 2024-02-19T17:16:24.120 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.354587.log.gz 2024-02-19T17:16:24.122 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.206938.log.gz 2024-02-19T17:16:24.123 INFO:teuthology.orchestra.run.smithi046.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.231312.log.gz 2024-02-19T17:16:24.123 INFO:teuthology.orchestra.run.smithi046.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.243758.log.gz 2024-02-19T17:16:24.123 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.355082.log.gz 2024-02-19T17:16:24.124 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49832.log.gz 2024-02-19T17:16:24.126 INFO:teuthology.orchestra.run.smithi046.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.207368.log.gz 2024-02-19T17:16:24.129 INFO:teuthology.orchestra.run.smithi046.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.255967.log.gz 2024-02-19T17:16:24.133 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.317011.log.gz 2024-02-19T17:16:24.135 INFO:teuthology.orchestra.run.smithi046.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.321723.log.gz 2024-02-19T17:16:24.137 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.215357.log.gz 2024-02-19T17:16:24.142 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.313095.log.gz 2024-02-19T17:16:24.146 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.310574.log.gz 2024-02-19T17:16:24.147 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.345854.log.gz 2024-02-19T17:16:24.148 INFO:teuthology.orchestra.run.smithi046.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.346687.log.gz 2024-02-19T17:16:24.148 INFO:teuthology.orchestra.run.smithi046.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.348480.log.gz 2024-02-19T17:16:24.151 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.143583.log.gz 2024-02-19T17:16:24.151 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.267940.log.gz 2024-02-19T17:16:24.152 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.279006.log.gz 2024-02-19T17:16:24.152 INFO:teuthology.orchestra.run.smithi046.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.268357.log.gz 2024-02-19T17:16:24.152 INFO:teuthology.orchestra.run.smithi046.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.200242.log.gz 2024-02-19T17:16:24.153 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.376650.log.gz 2024-02-19T17:16:24.154 INFO:teuthology.orchestra.run.smithi046.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.140506.log.gz 2024-02-19T17:16:24.157 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43760.log.gz 2024-02-19T17:16:24.166 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.198013.log.gz 2024-02-19T17:16:24.167 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.232214.log.gz 2024-02-19T17:16:24.169 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.214489.log.gz 2024-02-19T17:16:24.176 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.273914.log.gz 2024-02-19T17:16:24.176 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.279891.log.gz 2024-02-19T17:16:24.182 INFO:teuthology.orchestra.run.smithi046.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.186493.log.gz 2024-02-19T17:16:24.184 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.339432.log.gz 2024-02-19T17:16:24.185 INFO:teuthology.orchestra.run.smithi046.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.189135.log.gz 2024-02-19T17:16:24.190 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44030.log.gz 2024-02-19T17:16:24.207 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49790.log.gz 2024-02-19T17:16:24.232 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.127349.log.gz 2024-02-19T17:16:24.240 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.164247.log.gz 2024-02-19T17:16:24.292 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.128629.log.gz 2024-02-19T17:16:24.293 INFO:teuthology.orchestra.run.smithi046.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.236407.log.gz 2024-02-19T17:16:24.297 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43975.log.gz 2024-02-19T17:16:24.305 INFO:teuthology.orchestra.run.smithi046.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.215348.log.gz 2024-02-19T17:16:24.322 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.323806.log.gz 2024-02-19T17:16:24.323 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.324231.log.gz 2024-02-19T17:16:24.329 INFO:teuthology.orchestra.run.smithi046.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.138766.log.gz 2024-02-19T17:16:24.330 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.136679.log.gz 2024-02-19T17:16:24.332 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.146606.log.gz 2024-02-19T17:16:24.338 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.256398.log.gz 2024-02-19T17:16:24.339 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.256389.log.gz 2024-02-19T17:16:24.363 INFO:teuthology.orchestra.run.smithi046.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.163253.log.gz 2024-02-19T17:16:24.367 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.282184.log.gz 2024-02-19T17:16:24.374 INFO:teuthology.orchestra.run.smithi046.stderr: 85.3% 81.0% -- replaced with /var/log/ceph/ceph-client.admin.244628.log.gz -- replaced with /var/log/ceph/ceph-client.admin.206485.log.gz 2024-02-19T17:16:24.374 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:24.376 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.249672.log.gz 2024-02-19T17:16:24.409 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42919.log.gz 2024-02-19T17:16:24.410 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42925.log.gz 2024-02-19T17:16:24.410 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41782.log.gz 2024-02-19T17:16:24.410 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.192827.log.gz 2024-02-19T17:16:24.429 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.255976.log.gz 2024-02-19T17:16:24.430 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48041.log.gz 2024-02-19T17:16:24.438 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.136261.log.gz 2024-02-19T17:16:24.446 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.381560.log.gz 2024-02-19T17:16:24.450 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.386676.log.gz 2024-02-19T17:16:24.456 INFO:teuthology.orchestra.run.smithi046.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.320029.log.gz 2024-02-19T17:16:24.457 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.337503.log.gz 2024-02-19T17:16:24.459 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.338951.log.gz 2024-02-19T17:16:24.459 INFO:teuthology.orchestra.run.smithi046.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.238550.log.gz 2024-02-19T17:16:24.466 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.354596.log.gz 2024-02-19T17:16:24.469 INFO:teuthology.orchestra.run.smithi046.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.336565.log.gz 2024-02-19T17:16:24.470 INFO:teuthology.orchestra.run.smithi046.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.397115.log.gz 2024-02-19T17:16:24.471 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.124409.log.gz 2024-02-19T17:16:24.474 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.188685.log.gz 2024-02-19T17:16:24.474 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.390058.log.gz 2024-02-19T17:16:24.477 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.508842.log.gz 2024-02-19T17:16:24.482 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.345020.log.gz 2024-02-19T17:16:24.517 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.384963.log.gz 2024-02-19T17:16:24.529 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.424325.log.gz 2024-02-19T17:16:24.610 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49622.log.gz 2024-02-19T17:16:24.611 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46489.log.gz 2024-02-19T17:16:24.614 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42932.log.gz 2024-02-19T17:16:24.614 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.225360.log.gz 2024-02-19T17:16:24.614 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41655.log.gz 2024-02-19T17:16:24.617 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.242415.log.gz 2024-02-19T17:16:24.619 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.255554.log.gz 2024-02-19T17:16:24.625 INFO:teuthology.orchestra.run.smithi046.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.135416.log.gz 2024-02-19T17:16:24.628 INFO:teuthology.orchestra.run.smithi046.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.401813.log.gz 2024-02-19T17:16:24.647 INFO:teuthology.orchestra.run.smithi046.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.117805.log.gz 2024-02-19T17:16:24.650 INFO:teuthology.orchestra.run.smithi046.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.349385.log.gz 2024-02-19T17:16:24.651 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.308448.log.gz 2024-02-19T17:16:24.651 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.159973.log.gz 2024-02-19T17:16:24.653 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.321732.log.gz 2024-02-19T17:16:24.653 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.337013.log.gz 2024-02-19T17:16:24.654 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.336157.log.gz 2024-02-19T17:16:24.655 INFO:teuthology.orchestra.run.smithi046.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.183244.log.gz 2024-02-19T17:16:24.655 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.211560.log.gz 2024-02-19T17:16:24.656 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.182383.log.gz 2024-02-19T17:16:24.657 INFO:teuthology.orchestra.run.smithi046.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.202919.log.gz 2024-02-19T17:16:24.657 INFO:teuthology.orchestra.run.smithi046.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.201132.log.gz 2024-02-19T17:16:24.660 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.478390.log.gz 2024-02-19T17:16:24.661 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.479238.log.gz 2024-02-19T17:16:24.664 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.484173.log.gz 2024-02-19T17:16:24.665 INFO:teuthology.orchestra.run.smithi046.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.194551.log.gz 2024-02-19T17:16:24.666 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.194560.log.gz 2024-02-19T17:16:24.667 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.204255.log.gz 2024-02-19T17:16:24.687 INFO:teuthology.orchestra.run.smithi046.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.353594.log.gz 2024-02-19T17:16:24.701 INFO:teuthology.orchestra.run.smithi046.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.447727.log.gz 2024-02-19T17:16:25.943 INFO:teuthology.orchestra.run.smithi046.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.354103.log.gz 2024-02-19T17:16:26.883 INFO:teuthology.orchestra.run.smithi046.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.123937.log.gz 2024-02-19T17:16:26.883 INFO:teuthology.orchestra.run.smithi046.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.126495.log.gz 2024-02-19T17:16:26.884 INFO:teuthology.orchestra.run.smithi046.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.152471.log.gz 2024-02-19T17:16:26.884 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42038.log.gz 2024-02-19T17:16:26.884 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 93.2% 2024-02-19T17:16:26.884 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.200696.log.gz 2024-02-19T17:16:26.884 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.487131.log.gz 2024-02-19T17:16:26.884 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.259753.log.gz 2024-02-19T17:16:26.886 INFO:teuthology.orchestra.run.smithi046.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.347113.log.gz 2024-02-19T17:16:26.887 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.270877.log.gz 2024-02-19T17:16:26.887 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.244185.log.gz 2024-02-19T17:16:26.887 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.236833.log.gz 2024-02-19T17:16:26.887 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.378854.log.gz 2024-02-19T17:16:26.887 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.467682.log.gz 2024-02-19T17:16:26.887 INFO:teuthology.orchestra.run.smithi046.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.518886.log.gz 2024-02-19T17:16:26.887 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.309292.log.gz 2024-02-19T17:16:26.887 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47627.log.gz 2024-02-19T17:16:26.888 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42933.log.gz 2024-02-19T17:16:26.888 INFO:teuthology.orchestra.run.smithi046.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.221364.log.gz 2024-02-19T17:16:26.888 INFO:teuthology.orchestra.run.smithi046.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.484164.log.gz 2024-02-19T17:16:26.888 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48083.log.gz 2024-02-19T17:16:26.888 INFO:teuthology.orchestra.run.smithi046.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.393094.log.gz 2024-02-19T17:16:26.888 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43718.log.gz 2024-02-19T17:16:26.888 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.180695.log.gz 2024-02-19T17:16:26.888 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.137506.log.gz 2024-02-19T17:16:26.889 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.377072.log.gz 2024-02-19T17:16:26.889 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.503411.log.gz 2024-02-19T17:16:26.889 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.379271.log.gz 2024-02-19T17:16:26.889 INFO:teuthology.orchestra.run.smithi046.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.483072.log.gz 2024-02-19T17:16:26.889 INFO:teuthology.orchestra.run.smithi046.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.316594.log.gz 2024-02-19T17:16:26.889 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.154623.log.gz 2024-02-19T17:16:26.889 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.117554.log.gz 2024-02-19T17:16:26.889 INFO:teuthology.orchestra.run.smithi046.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.226194.log.gz 2024-02-19T17:16:26.889 INFO:teuthology.orchestra.run.smithi046.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.406049.log.gz 2024-02-19T17:16:26.890 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.317020.log.gz 2024-02-19T17:16:26.890 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43268.log.gz 2024-02-19T17:16:26.890 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.119133.log.gz 2024-02-19T17:16:26.896 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.257233.log.gz 80.7% 2024-02-19T17:16:26.896 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.146161.log.gz 2024-02-19T17:16:26.897 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.461185.log.gz 2024-02-19T17:16:26.897 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.139619.log.gz 2024-02-19T17:16:26.897 INFO:teuthology.orchestra.run.smithi046.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.341543.log.gz 2024-02-19T17:16:26.897 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.458367.log.gz 2024-02-19T17:16:26.897 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.204701.log.gz 2024-02-19T17:16:26.897 INFO:teuthology.orchestra.run.smithi046.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.348012.log.gz 2024-02-19T17:16:26.897 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.424755.log.gz 2024-02-19T17:16:26.897 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.313929.log.gz 2024-02-19T17:16:26.898 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.400562.log.gz 2024-02-19T17:16:26.898 INFO:teuthology.orchestra.run.smithi046.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.265438.log.gz 2024-02-19T17:16:26.898 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.259322.log.gz 2024-02-19T17:16:26.898 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.406884.log.gz 2024-02-19T17:16:26.898 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48835.log.gz 2024-02-19T17:16:26.898 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.480562.log.gz 2024-02-19T17:16:26.898 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.338942.log.gz 2024-02-19T17:16:26.898 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.265447.log.gz 2024-02-19T17:16:26.899 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.221373.log.gz 2024-02-19T17:16:26.899 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% 85.3% -- replaced with /var/log/ceph/ceph-client.admin.332294.log.gz -- replaced with /var/log/ceph/ceph-client.admin.428347.log.gz 2024-02-19T17:16:26.899 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:26.899 INFO:teuthology.orchestra.run.smithi046.stderr: 85.0% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.320471.log.gz 2024-02-19T17:16:26.899 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.338470.log.gz 2024-02-19T17:16:26.899 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.234747.log.gz 2024-02-19T17:16:26.899 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.211551.log.gz 2024-02-19T17:16:26.899 INFO:teuthology.orchestra.run.smithi046.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.214902.log.gz 2024-02-19T17:16:26.899 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48587.log.gz 2024-02-19T17:16:26.900 INFO:teuthology.orchestra.run.smithi046.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.504663.log.gz 2024-02-19T17:16:26.900 INFO:teuthology.orchestra.run.smithi046.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.473286.log.gz 2024-02-19T17:16:26.900 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.260171.log.gz 84.6% 2024-02-19T17:16:26.900 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.270868.log.gz 2024-02-19T17:16:26.900 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.471556.log.gz 2024-02-19T17:16:26.900 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.338461.log.gz 2024-02-19T17:16:26.900 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.203810.log.gz 2024-02-19T17:16:26.900 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.154614.log.gz 2024-02-19T17:16:26.901 INFO:teuthology.orchestra.run.smithi046.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.381036.log.gz 2024-02-19T17:16:26.901 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45386.log.gz 2024-02-19T17:16:26.901 INFO:teuthology.orchestra.run.smithi046.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.399684.log.gz 2024-02-19T17:16:26.901 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.336148.log.gz 2024-02-19T17:16:26.901 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44216.log.gz 2024-02-19T17:16:26.901 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48419.log.gz 2024-02-19T17:16:26.901 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.448989.log.gz 2024-02-19T17:16:26.901 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.337022.log.gz 2024-02-19T17:16:26.902 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.461603.log.gz 2024-02-19T17:16:26.902 INFO:teuthology.orchestra.run.smithi046.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.408992.log.gz 2024-02-19T17:16:26.902 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49271.log.gz 2024-02-19T17:16:26.902 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49399.log.gz 2024-02-19T17:16:26.902 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.407732.log.gz 2024-02-19T17:16:26.902 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.267106.log.gz 2024-02-19T17:16:26.902 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.265855.log.gz 2024-02-19T17:16:26.902 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.348489.log.gz 2024-02-19T17:16:26.902 INFO:teuthology.orchestra.run.smithi046.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.469348.log.gz 2024-02-19T17:16:26.903 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41740.log.gz 2024-02-19T17:16:26.903 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.135834.log.gz 2024-02-19T17:16:26.903 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.459863.log.gz 2024-02-19T17:16:26.903 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.125640.log.gz 2024-02-19T17:16:26.903 INFO:teuthology.orchestra.run.smithi046.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.506344.log.gz 2024-02-19T17:16:26.903 INFO:teuthology.orchestra.run.smithi046.stderr: 85.6% 93.2% -- replaced with /var/log/ceph/ceph-client.admin.254266.log.gz -- replaced with /var/log/ceph/ceph-client.admin.204710.log.gz 2024-02-19T17:16:26.903 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:26.903 INFO:teuthology.orchestra.run.smithi046.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47585.log.gz 2024-02-19T17:16:26.903 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.385798.log.gz 2024-02-19T17:16:26.904 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.316127.log.gz 2024-02-19T17:16:26.904 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.344603.log.gz 2024-02-19T17:16:26.904 INFO:teuthology.orchestra.run.smithi046.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.410249.log.gz 2024-02-19T17:16:26.904 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.233460.log.gz 2024-02-19T17:16:26.904 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.154206.log.gz 2024-02-19T17:16:26.904 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.330621.log.gz 2024-02-19T17:16:26.904 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.455562.log.gz 2024-02-19T17:16:26.904 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.383260.log.gz 2024-02-19T17:16:26.905 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.281335.log.gz 2024-02-19T17:16:26.905 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49001.log.gz 2024-02-19T17:16:26.905 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.224524.log.gz 2024-02-19T17:16:26.905 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.213225.log.gz 2024-02-19T17:16:26.905 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.283435.log.gz 2024-02-19T17:16:26.905 INFO:teuthology.orchestra.run.smithi046.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.188694.log.gz 2024-02-19T17:16:26.905 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.155045.log.gz 2024-02-19T17:16:26.905 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.111764.log.gz 2024-02-19T17:16:26.905 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.507598.log.gz 2024-02-19T17:16:26.906 INFO:teuthology.orchestra.run.smithi046.stderr: 91.9% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.473295.log.gz -- replaced with /var/log/ceph/ceph-client.admin.265030.log.gz 2024-02-19T17:16:26.906 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:26.906 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.241128.log.gz 2024-02-19T17:16:26.906 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.211977.log.gz 2024-02-19T17:16:26.906 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47443.log.gz 2024-02-19T17:16:26.906 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47201.log.gz 2024-02-19T17:16:26.906 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47159.log.gz 2024-02-19T17:16:26.910 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.230316.log.gz 2024-02-19T17:16:26.910 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.476708.log.gz 2024-02-19T17:16:26.910 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.230790.log.gz 2024-02-19T17:16:26.910 INFO:teuthology.orchestra.run.smithi046.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.208614.log.gz 2024-02-19T17:16:26.910 INFO:teuthology.orchestra.run.smithi046.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.452527.log.gz 2024-02-19T17:16:26.911 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.218424.log.gz 2024-02-19T17:16:26.911 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.209466.log.gz 2024-02-19T17:16:26.911 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.209475.log.gz 2024-02-19T17:16:26.911 INFO:teuthology.orchestra.run.smithi046.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.199350.log.gz 2024-02-19T17:16:26.911 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.409414.log.gz 2024-02-19T17:16:26.911 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.207359.log.gz 2024-02-19T17:16:26.911 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42164.log.gz 2024-02-19T17:16:26.911 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.397537.log.gz 2024-02-19T17:16:26.912 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.312251.log.gz 2024-02-19T17:16:26.912 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.192836.log.gz 2024-02-19T17:16:26.912 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.389646.log.gz 2024-02-19T17:16:26.912 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.179856.log.gz 2024-02-19T17:16:26.912 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.452109.log.gz 2024-02-19T17:16:26.912 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.411142.log.gz 2024-02-19T17:16:26.912 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.109349.log.gz 2024-02-19T17:16:26.912 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.393046.log.gz 2024-02-19T17:16:26.913 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.219673.log.gz 2024-02-19T17:16:26.913 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.312664.log.gz 2024-02-19T17:16:26.913 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.249246.log.gz 2024-02-19T17:16:26.913 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.390607.log.gz 2024-02-19T17:16:26.913 INFO:teuthology.orchestra.run.smithi046.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.510147.log.gz 2024-02-19T17:16:26.913 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% 93.2% -- replaced with /var/log/ceph/ceph-client.admin.445152.log.gz 2024-02-19T17:16:26.913 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.206048.log.gz 2024-02-19T17:16:26.913 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.249255.log.gz 2024-02-19T17:16:26.914 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.328103.log.gz 2024-02-19T17:16:26.914 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42206.log.gz 2024-02-19T17:16:26.914 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.399261.log.gz 2024-02-19T17:16:26.914 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.412806.log.gz -- replaced with /var/log/ceph/ceph-client.admin.391907.log.gz 2024-02-19T17:16:26.914 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:26.914 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41996.log.gz 2024-02-19T17:16:26.914 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45470.log.gz 2024-02-19T17:16:26.914 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.382811.log.gz 2024-02-19T17:16:26.915 INFO:teuthology.orchestra.run.smithi046.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.110186.log.gz 2024-02-19T17:16:26.915 INFO:teuthology.orchestra.run.smithi046.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.392995.log.gz 2024-02-19T17:16:26.915 INFO:teuthology.orchestra.run.smithi046.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.197123.log.gz 2024-02-19T17:16:26.915 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.468929.log.gz 2024-02-19T17:16:26.915 INFO:teuthology.orchestra.run.smithi046.stderr: 93.6% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.393005.log.gz -- replaced with /var/log/ceph/ceph-client.admin.46268.log.gz 2024-02-19T17:16:26.915 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T17:16:26.915 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.443859.log.gz 2024-02-19T17:16:26.915 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42080.log.gz 2024-02-19T17:16:26.916 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.308022.log.gz 2024-02-19T17:16:26.916 INFO:teuthology.orchestra.run.smithi046.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.462054.log.gz 2024-02-19T17:16:26.916 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42416.log.gz 2024-02-19T17:16:26.916 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.405602.log.gz 2024-02-19T17:16:26.916 INFO:teuthology.orchestra.run.smithi046.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.406893.log.gz 2024-02-19T17:16:26.916 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42290.log.gz 2024-02-19T17:16:26.916 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.127793.log.gz 2024-02-19T17:16:26.917 INFO:teuthology.orchestra.run.smithi046.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.351663.log.gz 2024-02-19T17:16:26.917 INFO:teuthology.orchestra.run.smithi046.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.198925.log.gz 2024-02-19T17:16:26.979 INFO:teuthology.orchestra.run.smithi046.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.273018.log.gz 2024-02-19T17:16:27.022 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.509708.log.gz 2024-02-19T17:16:27.031 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.328942.log.gz 2024-02-19T17:16:27.135 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.468510.log.gz 2024-02-19T17:16:27.137 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42592.log.gz 2024-02-19T17:16:27.201 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.310147.log.gz 2024-02-19T17:16:27.208 INFO:teuthology.orchestra.run.smithi046.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.228983.log.gz 2024-02-19T17:16:27.211 INFO:teuthology.orchestra.run.smithi046.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.126067.log.gz 2024-02-19T17:16:27.215 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.503420.log.gz 2024-02-19T17:16:27.222 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.405178.log.gz 2024-02-19T17:16:27.233 INFO:teuthology.orchestra.run.smithi046.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.352586.log.gz 2024-02-19T17:16:27.239 INFO:teuthology.orchestra.run.smithi046.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.190576.log.gz 2024-02-19T17:16:27.294 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.425587.log.gz 2024-02-19T17:16:27.296 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.392330.log.gz 2024-02-19T17:16:27.332 INFO:teuthology.orchestra.run.smithi046.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.537077.log.gz 2024-02-19T17:16:27.345 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.412393.log.gz 2024-02-19T17:16:27.348 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.323399.log.gz 2024-02-19T17:16:27.350 INFO:teuthology.orchestra.run.smithi046.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.331448.log.gz 2024-02-19T17:16:27.566 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.385380.log.gz 2024-02-19T17:16:27.648 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.392747.log.gz 2024-02-19T17:16:27.696 INFO:teuthology.orchestra.run.smithi046.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.230799.log.gz 2024-02-19T17:16:27.707 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.342400.log.gz 2024-02-19T17:16:27.709 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.199359.log.gz 2024-02-19T17:16:27.711 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.199805.log.gz 2024-02-19T17:16:27.720 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.354094.log.gz 2024-02-19T17:16:27.723 INFO:teuthology.orchestra.run.smithi046.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.385789.log.gz 2024-02-19T17:16:27.734 INFO:teuthology.orchestra.run.smithi046.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.451675.log.gz 2024-02-19T17:16:27.790 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.260593.log.gz 2024-02-19T17:16:27.800 INFO:teuthology.orchestra.run.smithi046.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.349862.log.gz 2024-02-19T17:16:27.807 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.162009.log.gz 2024-02-19T17:16:27.876 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.449412.log.gz 2024-02-19T17:16:27.905 INFO:teuthology.orchestra.run.smithi046.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.258068.log.gz 2024-02-19T17:16:27.907 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.258077.log.gz 2024-02-19T17:16:27.912 INFO:teuthology.orchestra.run.smithi046.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.140920.log.gz 2024-02-19T17:16:27.924 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.349394.log.gz 2024-02-19T17:16:27.942 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.212815.log.gz 2024-02-19T17:16:27.954 INFO:teuthology.orchestra.run.smithi046.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.426325.log.gz 2024-02-19T17:16:28.105 INFO:teuthology.orchestra.run.smithi046.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.185178.log.gz 2024-02-19T17:16:28.107 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.329360.log.gz 2024-02-19T17:16:28.109 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.237721.log.gz 2024-02-19T17:16:28.117 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.117814.log.gz 2024-02-19T17:16:28.123 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.184250.log.gz 2024-02-19T17:16:28.149 INFO:teuthology.orchestra.run.smithi046.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.441113.log.gz 2024-02-19T17:16:28.178 INFO:teuthology.orchestra.run.smithi046.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.229869.log.gz 2024-02-19T17:16:28.301 INFO:teuthology.orchestra.run.smithi046.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.164683.log.gz 2024-02-19T17:16:28.306 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.329769.log.gz 2024-02-19T17:16:28.309 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.182808.log.gz 2024-02-19T17:16:28.561 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.482810.log.gz 2024-02-19T17:16:28.561 INFO:teuthology.orchestra.run.smithi046.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.230325.log.gz 2024-02-19T17:16:28.564 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.186920.log.gz 2024-02-19T17:16:28.574 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.190062.log.gz 2024-02-19T17:16:28.606 INFO:teuthology.orchestra.run.smithi046.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.379689.log.gz 2024-02-19T17:16:28.724 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.382403.log.gz 2024-02-19T17:16:28.724 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.387085.log.gz 2024-02-19T17:16:28.765 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49982.log.gz 2024-02-19T17:16:28.770 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.218840.log.gz 2024-02-19T17:16:28.789 INFO:teuthology.orchestra.run.smithi046.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.163262.log.gz 2024-02-19T17:16:28.793 INFO:teuthology.orchestra.run.smithi046.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.417940.log.gz 2024-02-19T17:16:28.944 INFO:teuthology.orchestra.run.smithi046.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.217559.log.gz 2024-02-19T17:16:28.962 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.197132.log.gz 2024-02-19T17:16:29.037 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.217998.log.gz 2024-02-19T17:16:29.100 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.201587.log.gz 2024-02-19T17:16:29.516 INFO:teuthology.orchestra.run.smithi046.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.393391.log.gz 2024-02-19T17:16:29.704 INFO:teuthology.orchestra.run.smithi046.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.108745.log.gz 2024-02-19T17:16:29.709 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.203373.log.gz 2024-02-19T17:16:29.717 INFO:teuthology.orchestra.run.smithi046.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.273472.log.gz 2024-02-19T17:16:29.908 INFO:teuthology.orchestra.run.smithi046.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.280396.log.gz 2024-02-19T17:16:32.579 INFO:teuthology.orchestra.run.smithi046.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.161044.log.gz 85.1% 2024-02-19T17:16:32.579 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.344594.log.gz 2024-02-19T17:16:32.580 INFO:teuthology.orchestra.run.smithi046.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.130323.log.gz 2024-02-19T17:16:32.581 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.393055.log.gz 2024-02-19T17:16:32.581 INFO:teuthology.orchestra.run.smithi046.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.216693.log.gz 2024-02-19T17:16:32.581 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.393103.log.gz 2024-02-19T17:16:32.582 INFO:teuthology.orchestra.run.smithi046.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.355563.log.gz 2024-02-19T17:16:32.583 INFO:teuthology.orchestra.run.smithi046.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.223635.log.gz 2024-02-19T17:16:32.826 INFO:teuthology.orchestra.run.smithi046.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.112645.log.gz 2024-02-19T17:16:33.429 INFO:teuthology.orchestra.run.smithi046.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.378373.log.gz 2024-02-19T17:16:33.791 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.190585.log.gz 2024-02-19T17:16:35.551 INFO:teuthology.orchestra.run.smithi046.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.110195.log.gz 2024-02-19T17:16:36.404 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.353094.log.gz 2024-02-19T17:16:38.381 INFO:teuthology.orchestra.run.smithi046.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.124889.log.gz 2024-02-19T17:16:43.050 INFO:teuthology.orchestra.run.smithi142.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-02-19T17:16:43.380 INFO:teuthology.orchestra.run.smithi046.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.380555.log.gz 2024-02-19T17:16:44.560 INFO:teuthology.orchestra.run.smithi046.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.388233.log.gz 2024-02-19T17:16:46.514 INFO:teuthology.orchestra.run.smithi046.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-02-19T17:16:48.050 INFO:teuthology.orchestra.run.smithi046.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.250996.log.gz 2024-02-19T17:16:48.886 INFO:teuthology.orchestra.run.smithi046.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.127358.log.gz 2024-02-19T17:16:49.645 INFO:teuthology.orchestra.run.smithi046.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.228508.log.gz 2024-02-19T17:16:53.217 INFO:teuthology.orchestra.run.smithi046.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.263120.log.gz 2024-02-19T17:16:53.912 INFO:teuthology.orchestra.run.smithi046.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.231321.log.gz 2024-02-19T17:16:56.757 INFO:teuthology.orchestra.run.smithi046.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.250089.log.gz 2024-02-19T17:17:00.137 INFO:teuthology.orchestra.run.smithi046.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.123946.log.gz 2024-02-19T17:17:04.280 INFO:teuthology.orchestra.run.smithi046.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.142279.log.gz 2024-02-19T17:17:04.590 INFO:teuthology.orchestra.run.smithi046.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.348021.log.gz 2024-02-19T17:17:04.705 INFO:teuthology.orchestra.run.smithi046.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.250558.log.gz 2024-02-19T17:17:04.774 INFO:teuthology.orchestra.run.smithi046.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.124418.log.gz 2024-02-19T17:17:05.086 INFO:teuthology.orchestra.run.smithi046.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.118662.log.gz 2024-02-19T17:17:06.389 INFO:teuthology.orchestra.run.smithi046.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.140041.log.gz 2024-02-19T17:17:07.412 INFO:teuthology.orchestra.run.smithi046.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.341101.log.gz 2024-02-19T17:17:07.770 INFO:teuthology.orchestra.run.smithi046.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.315628.log.gz 2024-02-19T17:17:07.831 INFO:teuthology.orchestra.run.smithi046.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.141394.log.gz 2024-02-19T17:17:08.231 INFO:teuthology.orchestra.run.smithi046.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.315196.log.gz 2024-02-19T17:17:08.874 INFO:teuthology.orchestra.run.smithi046.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.316136.log.gz 2024-02-19T17:17:10.479 INFO:teuthology.orchestra.run.smithi046.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.387094.log.gz 2024-02-19T17:17:10.480 INFO:teuthology.orchestra.run.smithi046.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.280891.log.gz 2024-02-19T17:17:10.793 INFO:teuthology.orchestra.run.smithi046.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.227448.log.gz 2024-02-19T17:17:11.119 INFO:teuthology.orchestra.run.smithi046.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.140929.log.gz 2024-02-19T17:17:12.564 INFO:teuthology.orchestra.run.smithi046.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.112199.log.gz 2024-02-19T17:17:13.620 INFO:teuthology.orchestra.run.smithi142.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-19T17:17:13.718 INFO:teuthology.orchestra.run.smithi046.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.111773.log.gz 2024-02-19T17:17:14.724 INFO:teuthology.orchestra.run.smithi046.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.113604.log.gz 2024-02-19T17:17:15.495 INFO:teuthology.orchestra.run.smithi046.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.438561.log.gz 2024-02-19T17:17:17.723 INFO:teuthology.orchestra.run.smithi046.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.459276.log.gz 2024-02-19T17:17:17.794 INFO:teuthology.orchestra.run.smithi046.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.397546.log.gz 2024-02-19T17:17:18.997 INFO:teuthology.orchestra.run.smithi046.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.146170.log.gz 2024-02-19T17:17:30.857 INFO:teuthology.orchestra.run.smithi046.stderr: 95.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-02-19T17:17:31.569 INFO:teuthology.orchestra.run.smithi046.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.247542.log.gz 2024-02-19T17:17:32.940 INFO:teuthology.orchestra.run.smithi046.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.admin.120386.log.gz 2024-02-19T17:17:40.909 INFO:teuthology.orchestra.run.smithi142.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-02-19T17:17:44.866 INFO:teuthology.orchestra.run.smithi046.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.389175.log.gz 2024-02-19T17:17:48.041 INFO:teuthology.orchestra.run.smithi046.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.481820.log.gz 2024-02-19T17:17:52.713 INFO:teuthology.orchestra.run.smithi142.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-02-19T17:18:00.999 INFO:teuthology.orchestra.run.smithi046.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.245081.log.gz 2024-02-19T17:18:03.177 INFO:teuthology.orchestra.run.smithi046.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.479656.log.gz 2024-02-19T17:18:43.534 INFO:teuthology.orchestra.run.smithi046.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.130781.log.gz 2024-02-19T17:18:43.835 INFO:teuthology.orchestra.run.smithi046.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.253743.log.gz 2024-02-19T17:18:53.479 INFO:teuthology.orchestra.run.smithi142.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-02-19T17:18:56.759 INFO:teuthology.orchestra.run.smithi142.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-02-19T17:18:56.764 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-19T17:18:56.764 INFO:teuthology.orchestra.run.smithi142.stderr:real 2m36.774s 2024-02-19T17:18:56.765 INFO:teuthology.orchestra.run.smithi142.stderr:user 3m32.394s 2024-02-19T17:18:56.765 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m24.581s 2024-02-19T17:19:07.569 INFO:teuthology.orchestra.run.smithi046.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.227948.log.gz 2024-02-19T17:19:09.105 INFO:teuthology.orchestra.run.smithi046.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.117564.log.gz 2024-02-19T17:19:18.953 INFO:teuthology.orchestra.run.smithi046.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.150230.log.gz 2024-02-19T17:19:24.561 INFO:teuthology.orchestra.run.smithi046.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.183698.log.gz 2024-02-19T17:19:37.864 INFO:teuthology.orchestra.run.smithi046.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.333145.log.gz 2024-02-19T17:21:14.661 INFO:teuthology.orchestra.run.smithi046.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.184259.log.gz 2024-02-19T17:21:57.523 INFO:teuthology.orchestra.run.smithi046.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.350715.log.gz 2024-02-19T17:22:30.101 INFO:teuthology.orchestra.run.smithi046.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.160404.log.gz 2024-02-19T17:22:53.157 INFO:teuthology.orchestra.run.smithi046.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.145275.log.gz 2024-02-19T17:24:56.098 INFO:teuthology.orchestra.run.smithi046.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.194977.log.gz 2024-02-19T17:25:30.771 INFO:teuthology.orchestra.run.smithi046.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.110698.log.gz 2024-02-19T17:25:34.476 INFO:teuthology.orchestra.run.smithi046.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.164692.log.gz 2024-02-19T17:26:46.955 INFO:teuthology.orchestra.run.smithi046.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.admin.390067.log.gz 2024-02-19T17:27:33.820 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.113099.log.gz 2024-02-19T17:32:50.752 INFO:teuthology.orchestra.run.smithi046.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.263586.log.gz 2024-02-19T17:33:31.689 INFO:teuthology.orchestra.run.smithi046.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.499816.log.gz 2024-02-19T17:36:24.157 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.111213.log.gz 2024-02-19T17:36:45.744 INFO:teuthology.orchestra.run.smithi046.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.114073.log.gz 2024-02-19T17:36:53.110 INFO:teuthology.orchestra.run.smithi046.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.242424.log.gz 2024-02-19T17:37:14.184 INFO:teuthology.orchestra.run.smithi046.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.admin.357486.log.gz 2024-02-19T17:38:01.666 INFO:teuthology.orchestra.run.smithi046.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.283865.log.gz 2024-02-19T17:40:32.977 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-19T17:40:53.862 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.496225.log.gz 2024-02-19T17:41:04.109 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.498635.log.gz 2024-02-19T17:41:43.231 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.488909.log.gz 2024-02-19T17:41:53.832 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.497391.log.gz 2024-02-19T17:41:57.098 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.487578.log.gz 2024-02-19T17:42:30.285 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.490092.log.gz 2024-02-19T17:42:42.466 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.493763.log.gz 2024-02-19T17:42:56.844 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.491405.log.gz 2024-02-19T17:42:59.328 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.492617.log.gz 2024-02-19T17:43:22.598 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.495046.log.gz 2024-02-19T17:51:47.618 INFO:teuthology.orchestra.run.smithi046.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.191089.log.gz 2024-02-19T17:51:48.204 INFO:teuthology.orchestra.run.smithi046.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.273923.log.gz 2024-02-19T17:53:11.451 INFO:teuthology.orchestra.run.smithi046.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.428356.log.gz 2024-02-19T18:06:27.144 INFO:teuthology.orchestra.run.smithi046.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-19T18:10:52.859 INFO:teuthology.orchestra.run.smithi046.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.412815.log.gz 2024-02-19T18:11:11.476 INFO:teuthology.orchestra.run.smithi046.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-19T18:11:54.366 INFO:teuthology.orchestra.run.smithi046.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-19T18:12:21.661 INFO:teuthology.orchestra.run.smithi046.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.417949.log.gz 2024-02-19T18:15:16.637 INFO:teuthology.orchestra.run.smithi046.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-19T18:16:26.160 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-02-19T18:19:18.536 INFO:teuthology.orchestra.run.smithi046.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.156424.log.gz 2024-02-19T18:30:31.545 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-02-19T18:30:31.733 DEBUG:teuthology.task.console_log:Killing console logger for smithi046 2024-02-19T18:30:31.734 DEBUG:teuthology.task.console_log:Killing console logger for smithi142 2024-02-19T18:30:31.734 DEBUG:teuthology.exit:Finished running handlers